fakezeta
/

openchat-3.6-8b-20240522-ov-int4

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

openchat-3.6-8b-20240522-ov-int4 / model.yaml

fakezeta's picture

Upload 13 files

e138a46 verified 3 months ago

history blame contribute delete

No virus

190 Bytes

	name: openchat-3.6
	backend: transformers
	parameters:
	model: fakezeta/openchat-3.6-8b-20240522-ov-int4
	context_size: 8192
	type: OVModelForCausalLM
	template:
	use_tokenizer_template: true