The Matrix Calculus You Need For Deep Learning
Paper
•
1802.01528
•
Published
Alignment Lab Ai
company
AI & ML interests
alignment, generative ai, language, sparsity,
Recent Activity
AlignmentLab-AI's activity
jph00
authored
2
papers
6 days ago
Alignment-Lab-AI
posted
an
update
about 2 months ago
Post
1013
remember boys and girls, always keep all your data, its never a waste of time!
Post
3887
nanoLLaVA-1.5 is here! Same size (1B), better performance 🔥🔥🔥
And it is much more powerful than v1.0
Try it out now on HF Spaces: qnguyen3/nanoLLaVA
Model: qnguyen3/nanoLLaVA-1.5
And it is much more powerful than v1.0
Try it out now on HF Spaces: qnguyen3/nanoLLaVA
Model: qnguyen3/nanoLLaVA-1.5
- 3 replies
Post
5307
🎉 Introducing nanoLLaVA, a powerful multimodal AI model that packs the capabilities of a 1B parameter vision language model into just 5GB of VRAM. 🚀 This makes it an ideal choice for edge devices, bringing cutting-edge visual understanding and generation to your devices like never before. 📱💻
Model: qnguyen3/nanoLLaVA 🔍
Spaces: qnguyen3/nanoLLaVA (thanks to @merve )
Under the hood, nanoLLaVA is based on the powerful vilm/Quyen-SE-v0.1 (my Qwen1.5-0.5B finetune) and Google's impressive google/siglip-so400m-patch14-384. 🧠 The model is trained using a data-centric approach to ensure optimal performance. 📊
In the spirit of transparency and collaboration, all code and model weights are open-sourced under the Apache 2.0 license. 🤝
Model: qnguyen3/nanoLLaVA 🔍
Spaces: qnguyen3/nanoLLaVA (thanks to @merve )
Under the hood, nanoLLaVA is based on the powerful vilm/Quyen-SE-v0.1 (my Qwen1.5-0.5B finetune) and Google's impressive google/siglip-so400m-patch14-384. 🧠 The model is trained using a data-centric approach to ensure optimal performance. 📊
In the spirit of transparency and collaboration, all code and model weights are open-sourced under the Apache 2.0 license. 🤝
- 1 reply
Alignment-Lab-AI
updated
3
models
12 months ago
Post
Full fine-tuning of Microsoft's Phi2 on a single 4090 is now supported in axolotl. Thanks to
@abacaj
and
@vikhyatk
for their help with gradient checkpointing and flash attention fixes.
alpaca finetune: openaccess-ai-collective/phi2-alpaca
wandb: https://wandb.ai/oaaic/phi2/runs/00pc4ugb?workspace=user-wing-lian
merged PR: https://github.com/OpenAccess-AI-Collective/axolotl/pull/1058
alpaca finetune: openaccess-ai-collective/phi2-alpaca
wandb: https://wandb.ai/oaaic/phi2/runs/00pc4ugb?workspace=user-wing-lian
merged PR: https://github.com/OpenAccess-AI-Collective/axolotl/pull/1058
- 8 replies
Alignment-Lab-AI
updated
a
dataset
12 months ago
Alignment-Lab-AI
updated
a
dataset
about 1 year ago
qnguyen3
authored
a
paper
about 1 year ago
Alignment-Lab-AI
updated
2
datasets
about 1 year ago
Alignment-Lab-AI
updated
a
model
about 1 year ago
Alignment-Lab-AI
updated
a
dataset
about 1 year ago
Alignment-Lab-AI
updated
a
model
about 1 year ago
Alignment-Lab-AI
updated
3
datasets
about 1 year ago