Wolfram Ravenwolf's picture

Wolfram Ravenwolf

wolfram

·

https://ko-fi.com/wolframravenwolf

AI & ML interests

Local LLMs

Recent Activity

updated a model about 8 hours ago

wolfram/QVQ-72B-Preview-4.65bpw-h6-exl2

liked a model 7 days ago

nisten/apollonia-7b

upvoted an article 20 days ago

They Said It Couldn’t Be Done

View all activity

Articles

🐺🐦‍⬛ LLM Comparison/Test: 25 SOTA LLMs (including QwQ) through 59 MMLU-Pro CS benchmark runs

Turning Home Assistant into an AI Powerhouse: Amy's Guide

Your AI, Everywhere

The Great LLM Showdown: Amy's Quest for the Perfect LLM

LLM Comparison/Test: Llama 3 Instruct 70B + 8B HF/GGUF/EXL2 (20 versions tested and compared!)

Organizations

wolfram's activity

New activity in turboderp/Llama-3.1-70B-Instruct-exl2 4 months ago

The tokenizer has changed just fyi

#2 opened 5 months ago by

New activity in mistralai/Mistral-7B-Instruct-v0.3 7 months ago

no system message?

#14 opened 7 months ago by

tokenizer.model and tokenizer.model.v3 are identical

#15 opened 7 months ago by

New activity in nvidia/Llama3-ChatQA-1.5-70B 8 months ago

Concerns regarding Prompt Format

#1 opened 8 months ago by

New activity in wolfram/miquliz-120b-v2.0 9 months ago

Strange observation: model becomes super horny in ST's MinP mode

#7 opened 9 months ago by deleted

New activity in wolfram/miquliz-120b-v2.0-GGUF 9 months ago

Upload folder using huggingface_hub

#3 opened 9 months ago by

New activity in wolfram/miquliz-120b-v2.0 9 months ago

VRAM Estimates

#3 opened 10 months ago by

New activity in wolfram/miquliz-120b-v2.0 10 months ago

Merge method

#4 opened 10 months ago by

New activity in wolfram/miqu-1-103b 10 months ago

Can't wait to test

#4 opened 10 months ago by

Kindly asking for quants

#2 opened 10 months ago by

New activity in LoneStriker/miqu-1-103b-3.5bpw-h6-exl2 10 months ago

Update README.md

#1 opened 10 months ago by

New activity in LoneStriker/miqu-1-103b-3.0bpw-h6-exl2 10 months ago

Update README.md

#1 opened 10 months ago by

New activity in LoneStriker/miqu-1-103b-2.4bpw-h6-exl2 10 months ago

Update README.md

#1 opened 10 months ago by

New activity in wolfram/miquliz-120b-v2.0 10 months ago

GPTQ / AWQ

#2 opened 10 months ago by

New activity in wolfram/miqu-1-120b 10 months ago

Guidance on GPU VRAM Split?

#3 opened 11 months ago by

New activity in wolfram/miqu-1-103b 10 months ago

Upload folder using huggingface_hub

#1 opened 10 months ago by

New activity in wolfram/miquliz-120b-v2.0-3.0bpw-h6-exl2 10 months ago

Very interesting that miqu will give 16k context work even only first layer and last layer

#2 opened 10 months ago by

New activity in wolfram/miquliz-120b-v2.0-GGUF 10 months ago

iMatrix, IQ2_XS & IQ2_XXS

#2 opened 11 months ago by

New activity in wolfram/miqu-1-120b 10 months ago

Performance

#2 opened 11 months ago by

KnutJaegersberg

New activity in wolfram/miquliz-120b-v2.0-3.0bpw-h6-exl2 11 months ago

VRAM requirements

#1 opened 11 months ago by

sophosympatheia