Tushar Tiwari

tushifire
ยท

AI & ML interests

None yet

Recent Activity

liked a model 2 days ago
hbseong/HarmAug-Guard
liked a dataset 3 days ago
proj-persona/PersonaHub
liked a model 4 days ago
sfairXC/FsfairX-LLaMA3-RM-v0.1
View all activity

Organizations

scikit-learn's profile picture

tushifire's activity

liked a Space 26 days ago
reacted to csabakecskemeti's post with ๐Ÿ‘ about 1 month ago
view post
Post
1231
Some time ago, I built a predictive LLM router that routes chat requests between small and large LLM models based on prompt classification. It dynamically selects the most suitable model depending on the complexity of the user input, ensuring optimal performance while maintaining conversation context. I also fine-tuned a RoBERTa model to use with the package, but you can plug and play any classifier of your choice.

Project's homepage:
https://devquasar.com/llm-predictive-router/
Pypi:
https://pypi.org/project/llm-predictive-router/
Model:
DevQuasar/roberta-prompt_classifier-v0.1
Training data:
DevQuasar/llm_router_dataset-synth
Git:
https://github.com/csabakecskemeti/llm_predictive_router_package

Feel free to check it out, and/or contribute.
New activity in cvachet/pdf-chatbot 3 months ago

๐Ÿšฉ Report: Not working

2
#15 opened 4 months ago by
be4zad