README.md

metadata

tags:
  - rocm
  - amd-gpus
  - amd-ai
  - rocm-ai
  - rocm-rwkv
  - 3B-rwkv

3B rocm-rwkv pth record.

• rwkv-final-chnk5.pth: 3B rocm-rwkv model trained with Slim pajama chunk1-5 and with a loss of 2.456.