Skip to content

LookupTable may change weight while forwarding. #1975

@qiuxin2012

Description

@qiuxin2012
Contributor

LookupTable may change weight while forwarding if maxNorm is set. This behavior will lead to different training result between one node and multi node, as update weights is separating to multi node.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

    Development

    No branches or pull requests

      Participants

      @yiheng@qiuxin2012

      Issue actions

        LookupTable may change weight while forwarding. · Issue #1975 · intel/ipex-llm