Organizing a Privacy-preserving Hackathon
โข
8
Rรฉgis Pierrard
regisss
AI & ML interests
None yet
Recent Activity
new activity
7 days ago
AIEnergyScore/2024_Leaderboard:Tradeoff energy bost / performance
liked
a Space
7 days ago
AIEnergyScore/2024_Leaderboard
Articles
Organizations
regisss's activity
posted
an
update
7 days ago
Post
868
Nice to see day 1 support of Falcon 3 on Gaudi with Optimum Habana!
๐ https://www.intel.com/content/www/us/en/developer/articles/technical/intel-ai-solutions-support-falcon-3-fdn-models.html
๐ https://www.intel.com/content/www/us/en/developer/articles/technical/intel-ai-solutions-support-falcon-3-fdn-models.html
Tradeoff energy bost / performance
1
#2 opened 9 days ago
by
cerisara
liked
a
Space
7 days ago
Upload 2 files
#2 opened 19 days ago
by
zzhang37
Expanding AI Energy Score Research to other GPUs
1
#1 opened 21 days ago
by
PranavViswanath
Upload 2 files
2
#1 opened 23 days ago
by
zzhang37
updated
a
model
23 days ago
updated
a
dataset
2 months ago
reacted to
onekq's
post with ๐ฅ
2 months ago
Post
1848
I'm now working on finetuning of coding models. If you are GPU-hungry like me, you will find quantized models very helpful. But quantization for finetuning and inference are different and incompatible. So I made two collections here.
Inference (GGUF, via Ollama, CPU is enough)
onekq-ai/ollama-ready-coding-models-67118c3cfa1af2cf04a926d6
Finetuning (Bitsandbytes, QLora, GPU is needed)
onekq-ai/qlora-ready-coding-models-67118771ce001b8f4cf946b2
For quantization, the inference models are far more popular on HF than finetuning models. I use https://huggingface.co./QuantFactory to generate inference models (GGUF), and there are a few other choices.
But there hasn't been such a service for finetuning models. DIY isn't too hard though. I made a few myself and you can find the script in the model cards. If the original model is small enough, you can even do it on a free T4 (available via Google Colab).
If you know a (small) coding model worthy of quantization, please let me know and I'd love to add it to the collections.
Inference (GGUF, via Ollama, CPU is enough)
onekq-ai/ollama-ready-coding-models-67118c3cfa1af2cf04a926d6
Finetuning (Bitsandbytes, QLora, GPU is needed)
onekq-ai/qlora-ready-coding-models-67118771ce001b8f4cf946b2
For quantization, the inference models are far more popular on HF than finetuning models. I use https://huggingface.co./QuantFactory to generate inference models (GGUF), and there are a few other choices.
But there hasn't been such a service for finetuning models. DIY isn't too hard though. I made a few myself and you can find the script in the model cards. If the original model is small enough, you can even do it on a free T4 (available via Google Colab).
If you know a (small) coding model worthy of quantization, please let me know and I'd love to add it to the collections.
posted
an
update
2 months ago
Post
1378
Interested in performing inference with an ONNX model?โก๏ธ
The Optimum docs about model inference with ONNX Runtime is now much clearer and simpler!
You want to deploy your favorite model on the hub but you don't know how to export it to the ONNX format? You can do it in one line of code as follows:
Check out the whole guide ๐ https://huggingface.co./docs/optimum/onnxruntime/usage_guides/models
The Optimum docs about model inference with ONNX Runtime is now much clearer and simpler!
You want to deploy your favorite model on the hub but you don't know how to export it to the ONNX format? You can do it in one line of code as follows:
from optimum.onnxruntime import ORTModelForSequenceClassification
# Load the model from the hub and export it to the ONNX format
model_id = "distilbert-base-uncased-finetuned-sst-2-english"
model = ORTModelForSequenceClassification.from_pretrained(model_id, export=True)Check out the whole guide ๐ https://huggingface.co./docs/optimum/onnxruntime/usage_guides/models
upvoted
an
article
2 months ago
Article
Organizing a Privacy-preserving Hackathon
By
โข
โข
8
updated
a
Space
3 months ago
add intel CPU to leaderboard
2
#32 opened 4 months ago
by
baptistecolle
liked
5
Spaces
3 months ago
Running
65
๐ธ ๐
Image Filtering On Encrypted Data Using Fully Homomorphic Encryption
Running
80
๐ฅท๐ฌ
Sentiment Analysis On Encrypted Data Using Fully Homomorphic Encryption
Running
44
๐ฉบ๐ท
Health Prediction On Encrypted Data Using Fully Homomorphic Encryption
Running
21
๐ต๏ธโโ๏ธ ๐
Encrypted Anonymization Using Fully Homomorphic Encryption
Running
21
๐ณ โ
Encrypted Credit Card Approval Prediction Using Fully Homomorphic Encryption
updated
a
dataset
3 months ago
Delete transformers/v4.41.3.zip
4
#29 opened 3 months ago
by
joaogante