Infinity usage
#9
by
michaelfeil
- opened
Adds to the readme:
Usage with infinity
Usage with Docker and infinity: https://github.com/michaelfeil/infinity
docker run -it --gpus all -v ./data:/app/.cache -p 7997:7997 michaelf34/infinity:0.0.72 \
v2 --model-id BAAI/bge-en-icl --batch-size 8
this doesn't work on my macos15 with conda:
infinity_emb v2 --port 7997 --model-id BAAI/bge-en-icl --revision "refs/heads/main" --batch-size 8