Skip to content

Fix Vertex OpenAI-compatible routing and countTokens - #93

Merged
LeenHawk merged 2 commits into
mainfrom
fix/vertex-openapi-counttokens-92
May 7, 2026
Merged

Fix Vertex OpenAI-compatible routing and countTokens#93
LeenHawk merged 2 commits into
mainfrom
fix/vertex-openapi-counttokens-92

Conversation

@LeenHawk

@LeenHawk LeenHawk commented May 7, 2026

Copy link
Copy Markdown
Owner

Summary

  • route Vertex OpenAI Chat Completions passthrough requests to the official endpoints/openapi/chat/completions endpoint
  • flatten Vertex countTokens generateContentRequest bodies before sending to Vertex publisher models:countTokens
  • update the gproxy-protocol submodule pointer to the latest main
  • add a root pnpm manifest so Dependabot can evaluate the root pnpm-lock.yaml

Fixes #92

Tests

  • cargo test -p gproxy-channel --test routing_alignment
  • cargo clippy --workspace --all-targets
  • pnpm install --frozen-lockfile

LeenHawk added 2 commits May 7, 2026 17:15
Route Vertex OpenAI Chat Completions passthrough requests to the official endpoints/openapi/chat/completions endpoint instead of Gemini publisher generateContent paths. Also records the latest gproxy-protocol submodule pointer.\n\nFixes #92
@LeenHawk
LeenHawk enabled auto-merge May 7, 2026 09:26
@LeenHawk
LeenHawk disabled auto-merge May 7, 2026 09:28
@LeenHawk
LeenHawk merged commit d0ebcf8 into main May 7, 2026
7 checks passed
LeenHawk added a commit that referenced this pull request Jun 21, 2026
Fix Vertex OpenAI-compatible routing and countTokens
LeenHawk added a commit that referenced this pull request Jun 21, 2026
Fix Vertex OpenAI-compatible routing and countTokens
LeenHawk added a commit that referenced this pull request Jun 21, 2026
Fix Vertex OpenAI-compatible routing and countTokens
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

vertex channel: OpenAI Chat Completions and Anthropic count_tokens both fail with 400 from Vertex

1 participant