Paper Dissection: Understanding the Intrinsic Dimensionality of LLMs

Building mathematical intuition for why fine-tuning methods like LoRA work so well.

May 4 • 

Jyotinder

6

Beyond ‘training’: Dynamic Context Propagation in Keras!

Understanding 'training', and call-context argument propagation in Keras 3

May 1 • 

Jyotinder

2

1

April 2025

Keras Internals: Debugging a Softmax Behavior Inconsistency

Exploring the Keras Softmax implementation details and fixing a subtle behavior inconsistency with masking.

Apr 12 • 

Jyotinder

3

September 2024

Building an Elastic Queuing Service using Kubernetes

How do you build something like SQS with lambda workers without having to learn what an I-Ay-Em policy is

Sep 24, 2024 • 

Jyotinder

9

July 2024

Implementing Go-style Channels in C++ from scratch

Learn about C++'s powerful concurrency primitives by building an intuitive inter-thread messaging channel.

Jul 29, 2024 • 

Jyotinder

17

May 2024

Build a Scalable Remote Code Execution Engine in Under 500 lines of Code

Exploring the architecture and code for a cloud-native code execution system with request-level resource limits and isolation.

May 4, 2024 • 

Jyotinder

7

April 2024

Why Meta's mission critical storage system uses a low-efficiency, high-latency replication algorithm

The algorithm from 2004 that powers replication for Meta's mission critical storage layer.

Apr 8, 2024 • 

Jyotinder

3

March 2024

Building a Write-Optimized Database Engine: Compaction and Crash Recovery (Part 5)

Handling read and write amplification in log-structured storage engines, and recovering from unexpected oopsies

Mar 11, 2024 • 

Jyotinder

2

Building a Write-Optimized Database Engine: Orchestrating Reads and Writes (Part 4)

Exploring how Memtables and SSTables fit into the low level architecture of our storage engine to support highly-concurrent reads and writes while…

Mar 5, 2024 • 

Jyotinder

3

February 2024

Building a Write-Optimized Database Engine: Sorted String Tables (Part 3)

We develop an on-disk representation of data to ensure efficient reads and writes. We also explore auxiliary structures that help us work with such…

Feb 25, 2024 • 

Jyotinder

2

Building a Write-Optimized Database Engine: The Memtable (Part 2)

A deep dive into the architecture and implementation details of Memtables.

Feb 17, 2024 • 

Jyotinder

3

Building a Write-Optimized Database Engine: High Level Architecture (Part 1)

Diving into log-structured storage, the in-memory and on-disk components, and related optimisations.

Feb 3, 2024 • 

Jyotinder

7

2

1