Richard A Aragon

TuringsSolutions

AI & ML interests

None yet

Recent Activity

View all activity

Articles

Organizations

Turing's Solutions's profile picture Cloud Mentor's profile picture ZeroGPU Explorers's profile picture Turings Solutions's profile picture Hugging Face for Legal's profile picture Data Is Better Together Contributor's profile picture

Posts 38

view post
Post
338
Maybe that post I showed the other day with my Hyperbolic Embeddings getting to perfect loss with RAdam was a one-time fluke, bad test dataset, etc.? Anotha' one! I gave it a test set a PhD student would struggle with. This model is a bit more souped up. Major callouts of the model: High Dimensional Encoding (HDC), Hyperbolic Embeddings, Entropix. Link to the Colab Notebook: https://colab.research.google.com/drive/1mS-uxhufx-h7eZXL0ZwPMAAXHqSeGZxX?usp=sharing
view post
Post
861
I created something called 'Hyperbolic Embeddings'. I literally just embed the tokens into Hyperbolic Space instead of Euclidean space. At first, this did not get me the gains I was expecting. I was a sad panda. Then I thought about it, a Hyperbolic Embedding needs a Hyperbolic Optimizer. So, instead of Adam, I used Riemannian Adam (RAdam). "Ladies and Gentlemen, We Got 'Em!"