Adding sampling to mc4

Adjust batch size for extrating tokens

Scripts for perplexity sampling and fixes

Remove unused imports

Merge branch 'main' of https://huggingface.co./flax-community/bertin-roberta-large-spanish into main

Add script to generate dataset of embeddings and perplexities. Add script to generate t-SNE plot for embedding and perplexity visualization.

Adding correct models 10k steps

Updating run script

Adding checkpointing, wandb, and new mlm script

Epoch 1 Flax model

Changed batch size

Changed execution mode

Initial test with BETO's corpus

:sparkles: Added test_script and a folder for scripts

:see_no_evil: Added .gitignore file

Update README

README

initial commit