Hugging Face's logo
NIkita Balakin's picture
25 2 20

NIkita Balakin

Kotokin
digitous's profile picture 000ELYSIAN000's profile picture hppdqdq's profile picture
·

AI & ML interests

None yet

Recent Activity

reacted to csabakecskemeti's post with 👍 6 days ago
-UPDATED- 4bit inference is working! The blogpost is updated with code snippet and requirements.txt https://devquasar.com/uncategorized/all-about-amd-and-rocm/ -UPDATED- I've played around with an MI100 and ROCm and collected my experience in a blogpost: https://devquasar.com/uncategorized/all-about-amd-and-rocm/ Unfortunately I've could not make inference or training work with model loaded in 8bit or use BnB, but did everything else and documented my findings.
replied to csabakecskemeti's post 6 days ago
-UPDATED- 4bit inference is working! The blogpost is updated with code snippet and requirements.txt https://devquasar.com/uncategorized/all-about-amd-and-rocm/ -UPDATED- I've played around with an MI100 and ROCm and collected my experience in a blogpost: https://devquasar.com/uncategorized/all-about-amd-and-rocm/ Unfortunately I've could not make inference or training work with model loaded in 8bit or use BnB, but did everything else and documented my findings.
liked a model 14 days ago
featherless-ai/Qwerky-72B-Preview
View all activity

Organizations

None yet