view post Post 6044 Fine-tune Florence-2 on any task ๐ฅToday we release a notebook and a walkthrough blog on fine-tuning Florence-2 on DocVQA dataset @andito @SkalskiP Blog: https://huggingface.co./blog ๐Notebook: https://colab.research.google.com/drive/1hKDrJ5AH_o7I95PtZ9__VlCTNAo1Gjpf?usp=sharing ๐Florence-2 is a great vision-language model thanks to it's massive dataset and small size!This model requires conditioning through task prefixes and it's not as generalist, requiring fine-tuning on a new task, such as DocVQA ๐We have fine-tuned the model on A100 (and one can also use a smaller GPU with smaller batch size) and saw that model picks up new tasks ๐ฅนSee below how it looks like before and after FT ๐คฉPlay with the demo here andito/Florence-2-DocVQA ๐โโ๏ธ ๐ค 27 27 ๐ฅ 7 7 + Reply
LoRA Land: 310 Fine-tuned LLMs that Rival GPT-4, A Technical Report Paper โข 2405.00732 โข Published Apr 29 โข 118