facebook/seamless-streaming · Dockerfile.. how to run

Dec 12, 2023

I see Dockerfile, but I dont see instructions..
How to run it?

AI at Meta org Dec 12, 2023

Hi @Topisun , see the README here: https://huggingface.co./spaces/facebook/seamless-streaming/blob/main/README.md for instructions on running the streaming demo.

If you'd just like to try it locally to see the quality/delay of the streaming model, an easier way (which doesn't require GPU inference) is this Colab notebook: https://fb.me/mt-neurips which you can run either in Colab or locally. See discussion here for more details https://huggingface.co./spaces/facebook/seamless-streaming/discussions/17#65789a9776b6de7978130e0f

Kakooo

Dec 17, 2023

Hi @Topisun , see the README here: https://huggingface.co./spaces/facebook/seamless-streaming/blob/main/README.md for instructions on running the streaming demo.

If you'd just like to try it locally to see the quality/delay of the streaming model, an easier way (which doesn't require GPU inference) is this Colab notebook: https://fb.me/mt-neurips which you can run either in Colab or locally. See discussion here for more details https://huggingface.co./spaces/facebook/seamless-streaming/discussions/17#65789a9776b6de7978130e0f

His question is "How to run on docker?". Are there any docker deploy instructions?

thuvuxuan

Feb 21

First, you must build docker image from Dockerfile, eg:
docker build -t seamless .
After that, make sure you have installed NVIDIA Container toolkit to enable GPU from Docker container: https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html
Finally, start Docker container by this command:
docker run --gpus all -p 7860:7860 docker.io/library/seamless