Nomic AI

Enterprise

company

Verified

https://nomic.ai

nomic_ai

nomic-ai

Activity Feed

AI & ML interests

embeddings, graph statistics, nlp

Recent Activity

zpn updated a model 3 days ago

nomic-ai/modernbert-embed-base

zpn new activity 4 days ago

nomic-ai/modernbert-embed-base:Amazing model. Multilingual support?

zpn new activity 9 days ago

nomic-ai/modernbert-embed-base:Improve Transformers.js code snippet

View all activity

nomic-ai's activity

zpn

updated a model 3 days ago

nomic-ai/modernbert-embed-base

zpn

in nomic-ai/modernbert-embed-base 4 days ago

Amazing model. Multilingual support?

#8 opened 4 days ago by

rjmehta

zpn

in nomic-ai/modernbert-embed-base 9 days ago

Improve Transformers.js code snippet

#6 opened 9 days ago by

Xenova

zpn

in nomic-ai/modernbert-embed-base 10 days ago

Reproducible training script somewhere?

#4 opened 11 days ago by

Jesse-marqo

Error when loading model.

#5 opened 10 days ago by

sjoshi-wm

tomaarsen

in nomic-ai/modernbert-embed-base 10 days ago

Error when loading model.

#5 opened 10 days ago by

sjoshi-wm

tomaarsen

posted an update 13 days ago

Post

2647

That didn't take long! Nomic AI has finetuned the new ModernBERT-base encoder model into a strong embedding model for search, classification, clustering and more!

Details:
🤖 Based on ModernBERT-base with 149M parameters.
📊 Outperforms both nomic-embed-text-v1 and nomic-embed-text-v1.5 on MTEB!
🏎️ Immediate FA2 and unpacking support for super efficient inference.
🪆 Trained with Matryoshka support, i.e. 2 valid output dimensionalities: 768 and 256.
➡️ Maximum sequence length of 8192 tokens!
2️⃣ Trained in 2 stages: unsupervised contrastive data -> high quality labeled datasets.
➕ Integrated in Sentence Transformers, Transformers, LangChain, LlamaIndex, Haystack, etc.
🏛️ Apache 2.0 licensed: fully commercially permissible

Try it out here: nomic-ai/modernbert-embed-base

Very nice work by Zach Nussbaum and colleagues at Nomic AI.