Skip to content

Error in parameters.max_new_tokens #440

Open
@bitsnaps

Description

@bitsnaps

Hi,

I think this is the issue behind this error:

Error: Error in `parameters.max_new_tokens`: ensure this value is less than or equal to 250

I've tried something like:

const agent = new HfAgent(HF_TOKEN,
    LLMFromHub(HF_TOKEN, "deepseek-ai/deepseek-coder-1.3b-instruct", {parameters: {max_new_tokens: 250}}),
);

but it didn't work, I think the last option is to set the parameters.max_new_tokens as an optional argument of LLMFromHub.

Metadata

Metadata

Assignees

No one assigned

    Labels

    agents@huggingface/agents related

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions