Hello People 馃憢

Welcome to my Journal. You probably came here to read some of my articles. I hope you find them useful. If you have any questions, feel free to ping me on Twitter. Not an expert, but I’ll try to help you out.

Writing a Compiler in Rust #1: Lexical Analysis

Compilers are not a game of luck. If you want it to work, code hard. - Sora (No Game No Life) Another blog, another butchered quote but what matters is that they never created a season 2 for this series and I鈥檓 max pissed about it!! Anyways, as someone who has a Computer Science Degree, it鈥檚 a bit shameful for me to admit that I never formally studied compilers, well in my defense it鈥檚 because it was an elective and I chose an ML elective instead of Compiler Design....

February 26, 2024 路 21 min 路 4378 words 路 Herumb Shandilya

LIMA: Less is More for Alignment

I can鈥檛 even being to explain how I felt reading this paper, the moment I finished it I shared it ASAP with everyone because it deserved it. Essentially, what LIMA wants to address is that big instruction dataset and RLHF aren鈥檛 necessary to produce high quality output. As I mentioned above, what LIMA wants to address is that big instruction dataset and RLHF aren鈥檛 necessary to produce high quality output. But aside from that it鈥檚 an investigation on how much examples are needed to align a model output?...

May 31, 2023 路 4 min 路 778 words 路 Herumb Shandilya

Transformers: Attention is all you need

Attention is Transformer鈥檚 breath, Multi-Head is Transformer鈥檚 release, RNNs thou wert and art, May thy model reach to greater accuracy. L谩tom. - Enen No Shouboutai I鈥檓 getting tired of butchering anime and video game quotes so I鈥檓 thinking I should butcher some meme quotes next time. Anyways, well I have been writing on a lot of topics but something I always wanted to write about is probably explaining a research paper....

December 10, 2021 路 26 min 路 5520 words 路 Herumb Shandilya

PyTorch Lightning: DataModules, Callbacks, TPU, and Loggers

When I was a young man, I had liberty but I didn鈥檛 see it, I had time but I didn鈥檛 know it, And I had PyTorch Lightning but I didn鈥檛 use it. - Newbie PyTorch User Another Blog another great video game quote butchered by these hands. Anyways, when I was getting started with PyTorch one of the things that made me jealous was the fact that Tensorflow has so much support for monitoring the model performance....

June 8, 2021 路 12 min 路 2441 words 路 Herumb Shandilya

Class Imbalance comes in Like a Lion

In a world without class imbalance we might鈥檝e been heroes. - Neural Networks Keeping aside the fact that I butchered one of the greatest Video Game quotes of all time class imbalance can be a tricky thing to handle especially if you are a beginner. When I first encountered class imbalance I treated it normally, I know right, and not just that I measured the accuracy to judge the performance....

June 5, 2021 路 15 min 路 3140 words 路 Herumb Shandilya

Training SVM over Custom Kernels

One thing that always intrigued me about ML is that the more you learn about it the more you realize how little you know. One such case that happened to me a few months ago when a person asked me if I could help him in SVM and me being me I was like sure not a big deal. It was a big deal. Most of us might be familiar with training models....

April 29, 2021 路 7 min 路 1392 words 路 Herumb Shandilya