The Aya Project: My Experience and Learnings
I don鈥檛 think anyone is born knowing the reason why they鈥檙e here. It鈥檚 just something you have to find as you go along. -Tohru Honda Well well, isn鈥檛 this something we鈥檝e always wondered about? Thinking about the impact that any decision that you are taking in the present will have have in future, is it something that we can even do? Anyways, that went too philosophical but I think that鈥檚 how this blog will be too, Why?...
Writing a Compiler in Rust #1: Lexical Analysis
Compilers are not a game of luck. If you want it to work, code hard. - Sora (No Game No Life) Another blog, another butchered quote but what matters is that they never created a season 2 for this series and I鈥檓 max pissed about it!! Anyways, as someone who has a Computer Science Degree, it鈥檚 a bit shameful for me to admit that I never formally studied compilers, well in my defense it鈥檚 because it was an elective and I chose an ML elective instead of Compiler Design....
LIMA: Less is More for Alignment
I can鈥檛 even being to explain how I felt reading this paper, the moment I finished it I shared it ASAP with everyone because it deserved it. Essentially, what LIMA wants to address is that big instruction dataset and RLHF aren鈥檛 necessary to produce high quality output. As I mentioned above, what LIMA wants to address is that big instruction dataset and RLHF aren鈥檛 necessary to produce high quality output. But aside from that it鈥檚 an investigation on how much examples are needed to align a model output?...
Transformers: Attention is all you need
Attention is Transformer鈥檚 breath, Multi-Head is Transformer鈥檚 release, RNNs thou wert and art, May thy model reach to greater accuracy. L谩tom. - Enen No Shouboutai I鈥檓 getting tired of butchering anime and video game quotes so I鈥檓 thinking I should butcher some meme quotes next time. Anyways, well I have been writing on a lot of topics but something I always wanted to write about is probably explaining a research paper....
PyTorch Lightning: DataModules, Callbacks, TPU, and Loggers
When I was a young man, I had liberty but I didn鈥檛 see it, I had time but I didn鈥檛 know it, And I had PyTorch Lightning but I didn鈥檛 use it. - Newbie PyTorch User Another Blog another great video game quote butchered by these hands. Anyways, when I was getting started with PyTorch one of the things that made me jealous was the fact that Tensorflow has so much support for monitoring the model performance....
Class Imbalance comes in Like a Lion
In a world without class imbalance we might鈥檝e been heroes. - Neural Networks Keeping aside the fact that I butchered one of the greatest Video Game quotes of all time class imbalance can be a tricky thing to handle especially if you are a beginner. When I first encountered class imbalance I treated it normally, I know right, and not just that I measured the accuracy to judge the performance....
Training SVM over Custom Kernels
One thing that always intrigued me about ML is that the more you learn about it the more you realize how little you know. One such case that happened to me a few months ago when a person asked me if I could help him in SVM and me being me I was like sure not a big deal. It was a big deal. Most of us might be familiar with training models....