misdelivery
/

Llama-3.1-Swallow-70B-Nemotron-Instruct-v0.1-Q4_K_S-gguf

Inference Endpoints

Model card Files Files and versions Community

Llama-3.1-Swallow-70B-Nemotron-Instruct-v0.1-Q4_K_S-gguf / README.md

misdelivery's picture

Update README.md

70067b8 verified 3 months ago

|

history blame contribute delete

276 Bytes

	---
	license: llama3.1
	---

	[misdelivery/Llama-3.1-Swallow-70B-Nemotron-Instruct-v0.1](https://huggingface.co./misdelivery/Llama-3.1-Swallow-70B-Nemotron-Instruct-v0.1)のQ4_K_S GGUF（テスト用）です。
	imatrix量子化をすると性能が向上すると思います。