Skip to content

add llamastack support #6154

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 7 commits into
base: main
Choose a base branch
from

Conversation

wukaixingxp
Copy link

Description

Add llamastack support to Continue. Most of the functions are just calling the openai compatible endpoints, except the completion endpoint for AutoComplete are customized as openai did not have completion anymore.

Checklist

  • [] I've read the contributing guide
  • [] The relevant docs, if any, have been updated or created
  • [] The relevant tests, if any, have been updated or created

Screenshots

Tested and passing 7 tests, the failing one is due to model problem.
Screenshot 2025-06-16 at 4 18 37 PM

@wukaixingxp wukaixingxp requested a review from a team as a code owner June 16, 2025 23:21
@wukaixingxp wukaixingxp requested review from tomasz-stefaniak and removed request for a team June 16, 2025 23:21
Copy link

netlify bot commented Jun 16, 2025

Deploy Preview for continuedev failed. Why did it fail? →

Name Link
🔨 Latest commit ad90ac4
🔍 Latest deploy log https://app.netlify.com/projects/continuedev/deploys/6853010cc9d47300087d7436

@dosubot dosubot bot added the size:M This PR changes 30-99 lines, ignoring generated files. label Jun 16, 2025
Copy link

github-actions bot commented Jun 16, 2025

All contributors have signed the CLA ✍️ ✅
Posted by the CLA Assistant Lite bot.

@@ -71,9 +71,15 @@ export const DeepseekConfigSchema = OpenAIConfigSchema.extend({
});
export type DeepseekConfig = z.infer<typeof DeepseekConfigSchema>;

export const LlamastackConfigSchema = OpenAIConfigSchema.extend({
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Type incompatibility in schema inheritance: LlamastackConfigSchema extends OpenAIConfigSchema but tries to override the provider field with 'llamastack' which is not included in the parent schema's provider union. This violates Zod's schema extension rules and will cause type errors. To fix this, either add 'llamastack' to the provider union in OpenAIConfigSchema (lines 40-66) or create a different base schema for Llamastack that doesn't extend OpenAIConfigSchema.

📚 Relevant Docs


React with 👍 to tell me that this comment was useful, or 👎 if not (and I'll stop posting more comments like this in the future)

Copy link

recurseml bot commented Jun 16, 2025

😱 Found 1 issue. Time to roll up your sleeves! 😱

@wukaixingxp
Copy link
Author

I have read the CLA Document and I hereby sign the CLA

@dosubot dosubot bot added size:L This PR changes 100-499 lines, ignoring generated files. and removed size:M This PR changes 30-99 lines, ignoring generated files. labels Jun 17, 2025
@wukaixingxp
Copy link
Author

@sestinj I tried to use my branch to build a new plugin for testing but somehow I can not get my new code installed in the VScode. Following guidance here,I installed the new built plugin successfully, but Continue extension just can not be loaded in VScode. Can you help me on this? Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
size:L This PR changes 100-499 lines, ignoring generated files.
Projects
Status: Todo
Development

Successfully merging this pull request may close these issues.

1 participant