#

adafactor

Here is 1 public repository matching this topic...

NJUxlj / adam-optimizer-pytorch

reproduce Adam, AdamW, Adafactor optimizors with pytorch, and introduce popular optimizers in the training of the LLMs.

deep-learning adam adamw llm adafactor

Updated Mar 24, 2025
Python

Improve this page

Add a description, image, and links to the adafactor topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the adafactor topic, visit your repo's landing page and select "manage topics."