G a l o r e

GaLore (Gradient Low-Rank Projection) is a groundbreaking, open-source machine learning memory optimization framework hosted on GitHub that enables full-parameter training of large language models on consumer-grade hardware by projecting gradient weight matrices into low-rank spaces.