Skip to content

Releases: konstmish/prodigy

v1.1.2

16 Jan 14:57
3efb213

Choose a tag to compare

Fixing an issue with fsdp when some parameters are frozen.

v1.1.1

18 Dec 15:34

Choose a tag to compare

Higher memory efficiency when using beta1=0

v1.1

11 Dec 16:47
005dcc4

Choose a tag to compare

Major changes: add an option to make the optimizer more memory-efficient by using a higher value of the new hyperparameter slice_p (default 1).
Minor changes: optimized memory with zero initialization, and slightly changed implementation that doesn't affect the optimizer's behavior.