You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
As a "basic" user of tabbyml, I'm curious about the models suggestion from the documentation (https://tabby.tabbyml.com/docs/models/) as it does not seems to change much over time. I'm also a bit confused regarding the "instruct" ones, especially since I'm using ollama as the backend, which requires me to provide a bit of extra configuration regarding template strings, which are not always obvious to a non-specialist (I basically winged it from existing models, and hoped for the best).
Is it that there was no significantly improved models published in the recent months, or am I missing something obvious?
Ultimately, I think the documentation about using different models could do with a few examples that are kept up-to-date with current recommendations for people to quick-start/maintain using tabbyml without having to dive in the wonderful world of keeping track of half a dozen of models with their specific, slightly different configurations. At least it would help people trying to embed tabbyml and ollama (and probably other backends too).
It seems that the models.json file have more recent models in it, so maybe it's just a case of an outdated documentation?
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Uh oh!
There was an error while loading. Please reload this page.
-
Hi,
As a "basic" user of tabbyml, I'm curious about the models suggestion from the documentation (https://tabby.tabbyml.com/docs/models/) as it does not seems to change much over time. I'm also a bit confused regarding the "instruct" ones, especially since I'm using ollama as the backend, which requires me to provide a bit of extra configuration regarding template strings, which are not always obvious to a non-specialist (I basically winged it from existing models, and hoped for the best).
Is it that there was no significantly improved models published in the recent months, or am I missing something obvious?
Ultimately, I think the documentation about using different models could do with a few examples that are kept up-to-date with current recommendations for people to quick-start/maintain using tabbyml without having to dive in the wonderful world of keeping track of half a dozen of models with their specific, slightly different configurations. At least it would help people trying to embed tabbyml and ollama (and probably other backends too).
It seems that the
models.json
file have more recent models in it, so maybe it's just a case of an outdated documentation?Beta Was this translation helpful? Give feedback.
All reactions