Marc Sun's picture

Marc Sun

marcsun13

·

AI & ML interests

LLM, Quantization, Training, Inference

Recent Activity

published an article 3 days ago

LLM Inference on Edge: A Fun and Easy Guide to run LLMs via React Native on your Phone!

liked a model 4 days ago

ASLP-lab/DiffRhythm-base

updated a model 24 days ago

marcsun13/Llama-3.2-1B-Instruct-SpinQuant_INT4_EO8

View all activity

Organizations

Articles 8

Article

12

LLM Inference on Edge: A Fun and Easy Guide to run LLMs via React Native on your Phone!

Article

40

Introducing SynthID Text

View all Articles

models 16

marcsun13/Llama-3.2-1B-Instruct-SpinQuant_INT4_EO8

Updated 24 days ago • 14

marcsun13/paligemma_vqav2

marcsun13/Meta-Llama-3-8B-torchao-int8_weight_only

Updated Oct 18, 2024 • 17

marcsun13/sft_openassistant-guanaco

Text Generation • Updated Jul 5, 2024 • 26

marcsun13/gemma-2-27b-it-bnb-colab

Text Generation • Updated Jul 4, 2024 • 17

marcsun13/gemma-2-9b-it-GPTQ

Text Generation • Updated Jul 3, 2024 • 290 • 3

marcsun13/test_push_checkpoint

Fill-Mask • Updated Jun 28, 2024 • 132

marcsun13/Mixtral-8x7B-v0.1-GPTQ

Text Generation • Updated Dec 11, 2023 • 18

marcsun13/Mixtral-tiny-GPTQ

Text Generation • Updated Dec 11, 2023 • 88

marcsun13/Llama-2-13B-AWQ

Text Generation • Updated Nov 6, 2023 • 89

datasets

None public yet