Skip to content

The gemma2 model is not unsupported #12

Description

@AZhurkin

Current transformer version is v4.52.4 but docker file has v4.39. I would like to use Gemma-2B model but YaFSDP fails with error:
The checkpoint you are trying to load has model type gemma2 but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.

Full log

Do you plan to update release versions in the container?

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions