Simple example to use on a web page

#2
by industrialpoet - opened

Is there a simple way to load and call this from a web page I create. Then make regular LLM calls like an HTTP_Request to the API from JavaScript.

Check out this section and let me know if this is what you are looking for ๐Ÿค—
https://huggingface.co./blog/llama32#mlcai-web-llm

This looks like what I need. I will play with it in the next few days. Thankx!

sweet, we plan to release a template to make it easier to build with webllm, will lyk when it's out :).

Also be sure to check out MLCs official examples here.

cfahlgren1 changed discussion status to closed

Sign up or log in to comment