Writing

Thoughts on building, AI, design, and the founder journey.

FounderOSagentsaibuildingdata-engineeringdesignengineeringevaluationfaithfulnessfounderframeworksgpt-2linguisticsllamallmllm-opsmindsetmlmodel-atlasmozhi-ainlppaper-to-productionproductpytorchragreinforcement-learningtamiltrainingtransformers
I built a faithfulness evaluator for a real RAG problem Build 01 of paper-to-production: RAGAS + FActScore + MVVP as a working faithfulness evaluator — 102 labelled cases, LLM κ, cost/latency, and when I would not treat the score as a gate.
→
Building Llama 3.2 From Scratch (How Modern LLMs Improved on GPT-2) Week 2 of the model-atlas series: rebuild a Llama-style decoder block in PyTorch and see why RoPE, RMSNorm, GQA, and SwiGLU became the modern default.
→
Building GPT-2 From Scratch (and Loading Real Weights) Week 1 of a 24-model series: implement every layer in PyTorch, load OpenAI's checkpoint, and see why today's LLMs are still this architecture.
→
Seven Hidden Faults in Every Tamil NLP Pipeline Unicode fragmentation, mojibake, agglutination explosions, and the romanized web your model never saw - a field audit of what goes wrong before training.
→
Building a Tiny Tamil GPT From Scratch What I learned training a decoder-only Transformer on my own data
→
The Anatomy of an RL Environment — How AI Agents Actually Learn to Write Better Code Most people think training an AI agent is about feeding it data and hoping it gets smarter. It's not. Here's what a real RL environment looks like under the hood.
→
Building FounderOS - Agents SSharing the journey is part of the process — here's why I decided to document everything I build.
→
Why I'm building in public Sharing the journey is part of the process — here's why I decided to document everything I build.
→
Notes on product thinking The mental models I keep coming back to when building products people actually want.
→