view post Post Full fine-tuning of Microsoft's Phi2 on a single 4090 is now supported in axolotl. Thanks to @abacaj and @vikhyatk for their help with gradient checkpointing and flash attention fixes. alpaca finetune: openaccess-ai-collective/phi2-alpacawandb: https://wandb.ai/oaaic/phi2/runs/00pc4ugb?workspace=user-wing-lianmerged PR: https://github.com/OpenAccess-AI-Collective/axolotl/pull/1058 8 replies · 👍 15 15 ❤️ 8 8 + Reply