SAELens

Layer 13 saes raising "zipfile.BadZipFile: File is not a zip file"

#5
by MrGonao - opened

I tried both l0 30 and 54 and they get that error when loading the sae.

Same with layer 6 l0 36.

Google org

Hi @MrGonao , Please provide more clear context or details on this issue you are facing to understand the issue better. Thank you

Sorry, I should have been more clear. When downloading these SAEs with path_to_params = hf_hub_download( repo_id="google/gemma-scope-9b-pt-res", filename=f"layer_13/width_131k/average_l0_30"/params.npz", force_download=False, ) and then loading them using params = np.load(path_to_params) leads to the above error for SAEs of width 131k on layer 3 and 6 (at least in the specified l0s). All other layers I tried seem to be working fine.

Is this fixed now? @MrGonao

Oh, yesI

MrGonao changed discussion status to closed

Sign up or log in to comment