PowerInfer

community

AI & ML interests

We are committed to advancing the field of AGI by pushing the boundaries of local LLM inference efficiency.

Recent Activity

yixinsong published a model 14 days ago

PowerInfer/OPT-7B-predictor

yixinsong updated a model about 2 months ago

PowerInfer/SmallThinker-3B-Preview

yixinsong new activity about 2 months ago

PowerInfer/SmallThinker-3B-Preview:Eval script

View all activity

models 24

PowerInfer/SmallThinker-3B-Preview

Text Generation • Updated Jan 16 • 108k • • 389

PowerInfer/SparseQwen2-7B

Updated Dec 25, 2024 • 28 • 3

PowerInfer/TurboSparse-Mistral-Instruct

Feature Extraction • Updated Jun 14, 2024 • 166 • 20

PowerInfer/TurboSparse-Mixtral

Feature Extraction • Updated Jun 14, 2024 • 46 • 35

PowerInfer/TurboSparse-Mixtral-Instruct

Feature Extraction • Updated Jun 14, 2024 • 18 • 28

PowerInfer/Bamboo-base-v0_1

Feature Extraction • Updated Jun 7, 2024 • 50 • 22

PowerInfer/Bamboo-DPO-v0_1

Feature Extraction • Updated Jun 7, 2024 • 19 • 7

PowerInfer/OPT-7B-predictor

Updated Apr 10, 2024 • 2

PowerInfer/Bamboo-DPO-v0.1-predictor

Updated Mar 28, 2024

PowerInfer/Bamboo-DPO-v0.1-gguf

Updated Mar 28, 2024 • 83 • 7

datasets 2

PowerInfer/LONGCOT-Refine-500K

Viewer • Updated Jan 2 • 522k • 211 • 45

PowerInfer/QWQ-LONGCOT-500K

Viewer • Updated Dec 26, 2024 • 286k • 415 • 120