Access to metadata of the underlying model #953
Unanswered
shadowfaxproject
asked this question in
Q&A
Replies: 1 comment 1 reply
-
I'd be interested to know if this is possible as well. That way, we can have a program that changes our preset prompt formats based on the type of model, since some models use whereas others use [INST]. |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Is there a way to access (print) metadata such as
general.name
ormodel type
from the python code when using llama-cpp-python. I am able to access the standard params provided by the user but not the core metadata of the model.Beta Was this translation helpful? Give feedback.
All reactions