Error FineTune with GPU 40GB !!!!!!!!!

#34

by developeranalyser - opened Apr 17

Apr 17

i have 40GB gpu vram and id get error CUDA out of memory.
with A100 gpu

for fine tune how much gpu vram needed ?
id use colab pro its possible ?

Isn't it ridiculous?

TnkU

Apr 22

how can reduce qpu usage ?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment