Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
mohitsha
/
Llama-2-70b-chat-hf-FP8-KV
like
0
Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Inference Endpoints
License:
llama2
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
Edit model card
README.md exists but content is empty. Use the
Edit model card
button to edit it.
Downloads last month
5
Safetensors
Model size
69B params
Tensor type
FP16
·
Inference Examples
Text Generation
Inference API (serverless) is not available, repository is disabled.
Collection including
mohitsha/Llama-2-70b-chat-hf-FP8-KV
FP8 KV Cache
Collection
Models with FP8 KV Cache Scales
•
6 items
•
Updated
Jul 4