Skip to content

docs: document fair-use rate limits on cloud models#39

Open
nchudleigh wants to merge 1 commit into
mainfrom
docs/cloud-model-rate-limits
Open

docs: document fair-use rate limits on cloud models#39
nchudleigh wants to merge 1 commit into
mainfrom
docs/cloud-model-rate-limits

Conversation

@nchudleigh

Copy link
Copy Markdown
Collaborator

What

Documents the new fair-use rate limits applied to Superwhisper's hosted cloud model proxy endpoints (LLM + voice).

  • models/language.mdx — new Fair Use & Rate Limits section (canonical home, where most cloud traffic lives). Covers:
    • Limits apply across all hosted cloud models combined, not per provider
    • Burst: 30 req/min · Sustained: 300 req/hour
    • 429 (Too Many Requests) + Retry-After behaviour, with guidance to back off
    • BYOK and local models are exempt
  • models/voice.mdx — short cross-reference, since cloud voice models share the same limit.

Notes

  • Placed on the model pages rather than the enterprise/org-data API reference. The rate limits cover the app's cloud model endpoints (Anthropic, OpenAI, Groq, Gemini, Grok, ElevenLabs voice, Superwhisper transcribe) — the same models documented on these pages where "usage is covered by your license." The enterprise/api section is a separate surface (bearer-token org data API) and isn't affected.
  • Framed as forward-looking policy. The numbers live in one editable spot and are explicitly noted as subject to change, so the docs stay correct as limits are tuned during rollout.
  • Deepgram and the Cerebrium/Modal inference-key endpoints are not rate-limited, so they're left out.
  • mintlify broken-links flags no issues on the changed pages or the new anchors.

Add a "Fair Use & Rate Limits" section to the Language Models page
covering the new abuse-prevention limits on Superwhisper's hosted
cloud model proxy endpoints (burst 30/min, sustained 300/hour,
applied across all cloud models combined), the 429 + Retry-After
behaviour, and BYOK/local as the escape hatch.

Add a short cross-reference on the Voice Models page since the
limit is shared across both surfaces.

Numbers live in one editable spot and are framed as subject to
change so the docs stay correct as limits are tuned.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@mintlify

mintlify Bot commented Jun 25, 2026

Copy link
Copy Markdown
Contributor

Preview deployment for your docs. Learn more about Mintlify Previews.

Project Status Preview Updated (UTC)
superwhisper 🟢 Ready View Preview Jun 25, 2026, 4:25 PM

💡 Tip: Enable Workflows to automatically generate PRs for you.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant