Warning: llm_load_vocab: missing pre-tokenizer type, using: 'default'
1
#4 opened 8 months ago
by
supercharge19
The f16 with 32k ctx fits nicely in 24GB VRAM
5
#3 opened 8 months ago
by
ubergarm