Update README.md
Browse files
README.md
CHANGED
|
@@ -1,11 +1,12 @@
|
|
| 1 |
---
|
| 2 |
tags:
|
| 3 |
- fp8
|
|
|
|
| 4 |
---
|
| 5 |
|
| 6 |
# Qwen2-72B-Instruct-FP8
|
| 7 |
|
| 8 |
-
Ready to use with `vllm>=0.
|
| 9 |
|
| 10 |
Quantized with [AutoFP8](https://github.com/neuralmagic/autofp8) using the following script on 8xA100:
|
| 11 |
|
|
|
|
| 1 |
---
|
| 2 |
tags:
|
| 3 |
- fp8
|
| 4 |
+
- vllm
|
| 5 |
---
|
| 6 |
|
| 7 |
# Qwen2-72B-Instruct-FP8
|
| 8 |
|
| 9 |
+
Ready to use with `vllm>=0.5.0`.
|
| 10 |
|
| 11 |
Quantized with [AutoFP8](https://github.com/neuralmagic/autofp8) using the following script on 8xA100:
|
| 12 |
|