Open
Description
Hi,
I think this is the issue behind this error:
Error: Error in `parameters.max_new_tokens`: ensure this value is less than or equal to 250
I've tried something like:
const agent = new HfAgent(HF_TOKEN,
LLMFromHub(HF_TOKEN, "deepseek-ai/deepseek-coder-1.3b-instruct", {parameters: {max_new_tokens: 250}}),
);
but it didn't work, I think the last option is to set the parameters.max_new_tokens
as an optional argument of LLMFromHub
.