Skip to content

about the training loss curve #3

Open

Description

@Ideal-Bushgorman

Hi, thanks for your great work!
Would it be possible to share the training loss curve or logs to better understand how the model converges? It would be very helpful for reproducing the results.

Activity

  1. C0notSilly commented on Jun 24, 2025

    @C0notSilly

    Also wondering about the loss curve. In my case, when working on some AIGC tasks, the loss stays relatively high at the early stage of the training. However, with the loss continuing to decrease, the trained model collapses.

    @Devil-Ideal Did you encounter a similar issue in fine-tuning Janus-Pro 1.5B?

  2. hrz2000 commented on Jun 28, 2025

    @hrz2000
    Contributor

    Sorry for the late reply. PlanGen's training is relatively stable and simple, its text part next-token prediction loss decreases faster and more obviously, for the image part, the fluctuation is relatively large, just like the diffusion loss, this is the reference of the training curve:

    Image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions