DevQuasar/llama3_8b_chat_brainstorm-GGUF
Text Generation
β’
Updated
β’
208
β’
2
Csaba Kecskemeti PRO
csabakecskemeti
AI & ML interests
None yet
Recent Activity
updated
a model
about 5 hours ago
DevQuasar/llama3_8b_chat_brainstorm-GGUF
updated
a model
about 5 hours ago
DevQuasar/llama3.1_8b_chat_brainstorm-v3.1-GGUF
updated
a model
about 5 hours ago
DevQuasar/llama3_8b_chat_brainstorm_plus-GGUF
Organizations
csabakecskemeti's activity
updated
3
models
about 5 hours ago
updated
a
model
about 10 hours ago
published
a
model
about 14 hours ago
updated
a
model
about 14 hours ago
published
a
model
about 14 hours ago
updated
a
model
about 14 hours ago
published
a
model
about 16 hours ago
updated
a
model
about 16 hours ago
published
a
model
about 17 hours ago
updated
a
model
about 17 hours ago
updated
2
models
about 18 hours ago
updated
a
collection
about 19 hours ago
liked
a
dataset
about 19 hours ago
published
2
models
about 19 hours ago
updated
a
model
about 20 hours ago
replied to
their
post
1 day ago
No success so far, the training data contains some larger contexts and it fails just before complete the first epoch.
(dataset: DevQuasar/brainstorm-v3.1_vicnua_1k)
If anyone has further suggestion to the bnb config (with ROCm on MI100)?
bnb_config = BitsAndBytesConfig(
load_in_4bit=True,
bnb_4bit_quant_type="nf4",
bnb_4bit_use_double_quant=True,
bnb_4bit_compute_dtype=torch.bfloat16
)
Now testing with my other dataset that is smaller seems I have a lower memory need
DevQuasar/brainstorm_vicuna_1k