Skip to content

Add Lion baseline #879

Description

@tfaod
  • Implementation: Google AutoML's Lion
  • Tunable hyperparameters: learning_rate, weight_decay, one_minus_beta1, beta2
  • Fixed hyperparameters: warmup_factor

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions