Skip to content

Comments

Update llama_cpp_python to 0.2.29 (Adds StableLM support)#29

Open
limdingwen wants to merge 1 commit intodanielgross:mainfrom
limdingwen:main
Open

Update llama_cpp_python to 0.2.29 (Adds StableLM support)#29
limdingwen wants to merge 1 commit intodanielgross:mainfrom
limdingwen:main

Conversation

@limdingwen
Copy link

Tested with Stable Code 3B. It is functional, at least.

@limdingwen
Copy link
Author

Example config:

import os

models = {
    "GitHub": {
        "domain": "https://copilot-proxy.githubusercontent.com",
        "type": "remote",
    },
    "stable-code-3b": {
        "url": "https://huggingface.co/stabilityai/stable-code-3b/resolve/main/stable-code-3b-Q5_K_M.gguf",
        "type": "local",
        "filename": "stable-code-3b-Q5_K_M.gguf",
    },
    "default": "stable-code-3b",
}

model_folder = os.path.expanduser("~/models")

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant