Replies: 1 comment
-
|
Dify officially supports several third-party API-based rerank providers besides Cohere, which are suitable for environments with limited disk space since they do not require downloading large model files. Supported options include Jina AI's Rerank API, Voyage AI, AWS Bedrock Rerank, Nvidia Rerank, and Azure AI Studio Rerank, among others. These integrations are implemented as plugins and can be configured by providing the relevant API credentials and endpoints—no local model installation is needed. For example, the Jina Rerank API is directly supported and works via a simple API call, making it a good fit for your VPS setup with disk constraints (Jina, Voyage, Bedrock, Nvidia, Azure). You can select and configure these rerank providers in Dify's model provider settings. This approach should let you achieve high-quality reranking for your multilingual knowledge base without exceeding your VPS disk capacity. To reply, just mention @dosu. How did I do? Good | Irrelevant | Incorrect | Verbose | Hallucination | Report 🐛 | Other |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
-
Self Checks
Content
Hello Dify Team,
I'm currently setting up a Dify instance on a VPS with very limited disk space (less than 10GB free), and I need high-quality Reranking for a large Farsi/Multilingual knowledge base.
I'm facing issues:
Cohere Rerank API is unreliable due to network/firewall issues on my specific VPS environment.
I cannot install self-hosted Cross-Encoders (like BGE Reranker via Xinference) because of the large disk footprint (Model files + Dependencies).
Question:
Does Dify officially support any other third-party Rerank API providers besides Cohere (e.g., Jina, BGE Reranker API, or any other dedicated Reranking service)?
A supported API Rerank model would be the only viable solution for me to achieve high accuracy without exceeding my disk capacity.
Thank you for your guidance.
Beta Was this translation helpful? Give feedback.
All reactions