Skip to content

feat: add per-request compression override fields #14

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
CLEMENTINATOR merged 6 commits into from
Mar 9, 2026
Merged

feat: add per-request compression override fields #14

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
a1f83e3
feat: add enable_claude_compression and enable_opencode_compression f…
CLEMENTINATOR Mar 6, 2026
c3f2a42
feat: replace per-agent booleans with compression_model
CLEMENTINATOR Mar 6, 2026
90f9c7e
Remove deprecated enable_compression and compression_technique fields
CLEMENTINATOR Mar 6, 2026
aa6983f
Replace compression_rate and compression_semantic_preservation_thresh…
CLEMENTINATOR Mar 6, 2026
78dded9
Update compression example to use compression_model and compression_c…
CLEMENTINATOR Mar 9, 2026
30747b4
update version
CLEMENTINATOR Mar 9, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 4 additions & 2 deletions example/compression.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -84,8 +84,10 @@ const response = await edgee.send({
model: "anthropic/claude-haiku-4-5",
input: {
messages: [{ role: "user", content: userMessage }],
enable_compression: true,
compression_rate: 0.5,
compression_model: "agentic",
compression_configuration: {
rate: 0.5,
},
},
});

Expand Down
2 changes: 1 addition & 1 deletion package.json
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "edgee",
"version": "0.1.5",
"version": "0.1.6",
"type": "module",
"main": "./dist/index.js",
"types": "./dist/index.d.ts",
Expand Down
15 changes: 9 additions & 6 deletions src/index.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -43,8 +43,11 @@ export interface InputObject {
tools?: Tool[];
tool_choice?: ToolChoice;
tags?: string[];
enable_compression?: boolean; // Enable token compression (gateway-internal, not sent to providers)
compression_rate?: number; // Compression rate 0.0-1.0 (gateway-internal, not sent to providers)
compression_model?: "agentic" | "claude" | "opencode" | "cursor" | "customer"; // Compression model (gateway-internal, not sent to providers)
compression_configuration?: { // Configuration for the compression model (only relevant for agentic)
rate?: number; // Compression rate 0.0-1.0
semantic_preservation_threshold?: number; // Semantic preservation threshold 0-100
};
}

export interface SendOptions {
Expand Down Expand Up @@ -202,8 +205,8 @@ export default class Edgee {
if (input.tools) body.tools = input.tools;
if (input.tool_choice) body.tool_choice = input.tool_choice;
if (input.tags) body.tags = input.tags;
if (input.enable_compression !== undefined) body.enable_compression = input.enable_compression;
if (input.compression_rate !== undefined) body.compression_rate = input.compression_rate;
if (input.compression_model) body.compression_model = input.compression_model;
if (input.compression_configuration) body.compression_configuration = input.compression_configuration;
}

const res = await fetch(`${this.baseUrl}/v1/chat/completions`, {
Expand Down Expand Up @@ -311,8 +314,8 @@ export default class Edgee {
if (input.tools) body.tools = input.tools;
if (input.tool_choice) body.tool_choice = input.tool_choice;
if (input.tags) body.tags = input.tags;
if (input.enable_compression !== undefined) body.enable_compression = input.enable_compression;
if (input.compression_rate !== undefined) body.compression_rate = input.compression_rate;
if (input.compression_model) body.compression_model = input.compression_model;
if (input.compression_configuration) body.compression_configuration = input.compression_configuration;
}

yield* this._handleStreamingResponse(
Expand Down