Mini Trainer implements Orthogonal Subspace Fine-Tuning (OSFT), a breakthrough continual learning technique that enables models to learn new tasks without catastrophic forgetting. OSFT uses adaptive ...
Kimi-K2-Mini is an experimental compressed version of the 1.07T parameter Kimi-K2 model, targeting ~32.5B parameters for more accessible deployment. This project explores several optimization ...
Abstract: Although the adoption of Low Code Development Platforms (LCDPs) promises significant improvements in the efficiency and effectiveness of application development, their adoption requires ...