Demo Usage is too slow to use

#2
by ASleepingForest - opened

It will cost more than 1 minute to finish the translation in my computer (Intel(R) Core(TM) i5-8250U CPU @ 1.60GHz 1.80 GHz, 8GB RAM), any improvement idea?

You may want to try run it on a gpu or use fp16?

Sign up or log in to comment