usage: https://github.com/CarperAI/trlx/blob/3396bf118869cd823b6909e082caf3810d8989e0/examples/nemo_ilql_inference.py

edit above file and below config to have num_nodes = 2 and devices = 8

python trlx/examples/nemo_ilql_inference.py trlx/configs/nemo_configs/megatron_65b.yaml "/path/to/checkpoints"
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference API
Unable to determine this model's library. Check the docs .