#distributed (128)

128 notes

2026

(33)

Mar 28

NOTE TF-IDF is one of the most widely used ways to

Distributed Systems #distributed
Mar 26

NOTE Here is an interesting use case of HyperLogLog you probably

Algorithms & Data Structures #distributed
Mar 23

NOTE Counting things seems simple, but at scale, how you count

Distributed Systems #distributed
Mar 22

NOTE There are two ways to build real-time collaboration - either

Distributed Systems #distributed
Mar 19

NOTE One way to avoid getting overwhelmed when you are designing

Distributed Systems #distributed
Mar 10

NOTE When your regular work feels mundane, you can and should

Distributed Systems #distributed
Mar 08

NOTE The "SQL doesn’t scale" argument is a lazy and absurd generalization

Distributed Systems #distributed
Mar 03

NOTE We know database replication is either sync or async, but

Distributed Systems #distributed
Feb 28

NOTE There is a very interesting hashing approach called Robin Hood Hashing

Algorithms & Data Structures #distributed
Feb 27

NOTE I wanted to read engineering blogs on my Kindle, so

Distributed Systems #distributed
Feb 24

NOTE No matter how many blogs, books, or papers you read,

Distributed Systems #distributed
Feb 23

NOTE Say you are building a news aggregator (like Google News

Distributed Systems #distributed
Feb 21

NOTE Deleting a large number of rows (say, a million) in

Distributed Systems #distributed
Feb 15

NOTE Here's something counterintuitive about B+ trees - inserting keys in

Distributed Systems #distributed
Feb 11

NOTE In 2022, I started exploring database internals out of pure

Career Growth #distributed
Feb 09

NOTE Most systems detect node or master failures using simple polling,

Distributed Systems #distributed
Feb 06

NOTE Renaming of a file is an atomic operation, and this

Distributed Systems #distributed
Feb 02

NOTE Rows in PostgreSQL are immutable and stored on the 'heap

Distributed Systems #distributed
Feb 01

NOTE Read replicas are great for scaling reads, but what if

Distributed Systems #distributed
Jan 29

NOTE GitHub stores millions of repositories the same way they exist

Distributed Systems #distributed
Jan 27

NOTE I just wrote and published an essay on Multi-Paxos and

Distributed Systems #distributed
Jan 27

NOTE Paxos has to be one of the trickiest, but also

Distributed Systems #distributed
Jan 22

NOTE Uber open-sourced their M3 metrics platform, and while skimming through

Distributed Systems #distributed
Jan 21

NOTE Here's something interesting about LIKE in SQL - it is

Distributed Systems #distributed
Jan 20

NOTE If protobuf is already a compact binary format, should we

Distributed Systems #distributed
Jan 19

NOTE Time series databases are extremely good at compression, and most

Distributed Systems #distributed
Jan 16

NOTE Wrote an essay on how MySQL binlog replication actually works

Distributed Systems #distributed
Jan 14

NOTE I was exploring MySQL internals and found something clever called

Distributed Systems #distributed
Jan 13

NOTE Looks like filesystems are the next big thing in AI

Distributed Systems #distributed
Jan 06

NOTE Most of us assume that stored procedures are cached globally,

Distributed Systems #distributed
Jan 02

NOTE Redis heavily uses Circular Buffers in its replication implementation to

Distributed Systems #distributed
Jan 01

NOTE everybody loves it when a database just works

Distributed Systems #distributed
Jan 01

NOTE Here is something interesting about memory management in Linux: most

Systems Internals #distributed

2025

(72)

Dec 29

NOTE Wrote an essay on Bloom filters, but not what you would expect

Algorithms & Data Structures #distributed
Dec 27

NOTE ORMs are an anti-pattern once you start operating at scale

Distributed Systems #distributed
Dec 24

NOTE PostgreSQL lets you clone a 6GB database in 212 milliseconds

Distributed Systems #distributed
Dec 23

NOTE Here's something as simple as a distributed build system (using

Distributed Systems #distributed
Dec 23

NOTE Wrote an essay on why time is such a hard

Distributed Systems #distributed
Dec 18

NOTE SQLite has about 155,800 lines of code, and its test

Systems Internals #distributed
Dec 17

NOTE Go 1.26 is not out yet, but the release notes

Distributed Systems #distributed
Dec 14

NOTE Wrote an essay on what Kafka does when we add

Distributed Systems #distributed
Dec 12

NOTE Imagine you are streaming changes from Postgres to Elasticsearch in Go

Distributed Systems #distributed
Dec 10

NOTE Documentation is important, but most do it for the sake

Distributed Systems #distributed
Dec 06

NOTE Cloudflare had another outage, lasting 25 mins, on 5th Dec,

Distributed Systems #distributed
Dec 02

NOTE Py 3.11 is more performant than Py 3.12+ on AWS Lambda

Distributed Systems #distributed
Nov 30

NOTE wrote an essay on terrain generation, the math behind it,

Algorithms & Data Structures #distributed
Nov 25

NOTE Google just tested the largest Kubernetes cluster with 130,000 nodes

Distributed Systems #distributed
Nov 23

NOTE Rule number 1 of multitenancy: never assume all tenants are good actors

Distributed Systems #distributed
Nov 19

NOTE Range-based partitioning is like an amoeba

Distributed Systems #distributed
Nov 16

NOTE Wrote an essay on Blocking Queues, covering the intuition, implementation,

Distributed Systems #distributed
Nov 14

NOTE Google quantum computers are now solving optimization problems that even

Distributed Systems #distributed
Nov 12

NOTE Wrote an essay on Heartbeats in Distributed Systems, capturing both

Distributed Systems #distributed
Nov 07

NOTE If you are building or using a distributed database where

Distributed Systems #distributed
Nov 06

NOTE SQLite 3.51 is out, and here are two things that

Distributed Systems #distributed
Nov 05

NOTE Cloudflare shared some data on Internet connections at scale, and

Distributed Systems #distributed
Nov 04

NOTE I am on a spree to explore PostgreSQL internals, and

Distributed Systems #distributed
Nov 03

NOTE LinkedIn leverages Apache Beam to power their Notification Platform

Distributed Systems #distributed
Oct 31

NOTE Active-active setups are fascinating

Distributed Systems #distributed
Oct 20

NOTE wrote an essay on how writes work in apache cassandra

Distributed Systems #distributed
Oct 17

NOTE Some time back, I spent some time digging deeper into

Algorithms & Data Structures #distributed
Oct 12

NOTE Here's an interesting fact about Redis - while replications on

Distributed Systems #distributed
Oct 11

NOTE PostgreSQL uses lazy pointer swizzling to speed up buffer access,

Algorithms & Data Structures #distributed
Oct 04

NOTE how does a cdn handle content replication

Distributed Systems #distributed
Oct 04

NOTE Zero-copy writes make Kafka fast, but how exactly

Systems Internals #distributed
Sep 25

NOTE Fun Fact - When you commit a transaction in PostgreSQL,

Distributed Systems #distributed
Sep 24

NOTE grpc wouldn't be possible without http/2, but why

Distributed Systems #distributed
Sep 24

NOTE The strength of a good system is not its complexity,

Distributed Systems #distributed
Sep 20

NOTE Today I learned that we can do joins in Elasticsearch

Distributed Systems #distributed
Sep 18

NOTE There is never only one way to design something, and

Distributed Systems #distributed
Sep 11

NOTE Yes, CDN improves latencies by caching things closer to the

Distributed Systems #distributed
Sep 08

NOTE Facebook Messenger moved from NoSQL to SQL for better performance

Algorithms & Data Structures #distributed
Sep 07

NOTE why the private network addresses 192.168

Distributed Systems #distributed
Sep 05

NOTE When I joined Google, I worked on building a Remote

Distributed Systems #distributed
Sep 04

NOTE For every complex problem, there is often a simpler solution

Distributed Systems #distributed
Aug 27

NOTE db nugget (3): in-mem databases do not always lose data upon restart

Distributed Systems #distributed
Aug 26

NOTE db nugget (2): if you want your database to be

Distributed Systems #distributed
Aug 25

NOTE db nugget: uuids bloat indexes

Algorithms & Data Structures #distributed
Aug 21

NOTE research is addictive; just thinking about one problem in one

Distributed Systems #distributed
Aug 16

NOTE Randomness improves algorithms

Distributed Systems #distributed
Aug 12

NOTE Your MySQL index isn’t slow; it's fragmented :) Databases like

Distributed Systems #distributed
Aug 11

NOTE Bloom Filters are more than what you learn from 5-minute

Algorithms & Data Structures #distributed
Aug 08

NOTE if you find some time, do read about robin hood hashing

Algorithms & Data Structures #distributed
Aug 07

NOTE Should two microservices share a database

Distributed Systems #distributed
Aug 04

NOTE When you need high availability, all you really need to

Distributed Systems #distributed
Jul 31

NOTE Timing Attacks are really interesting, and they can be leveraged

Distributed Systems #distributed
Jul 11

NOTE How far can you go vibecoding

Distributed Systems #distributed
Jul 08

NOTE Sometime back, I was going through PostgreSQL internals and found

Distributed Systems #distributed
Jul 03

NOTE High fork times can lead to master unavailability in Redis/Valkey,

Distributed Systems #distributed
Jun 24

NOTE While trying to understand and optimize a nuance in Redis/Valkey,

Systems Internals #distributed
Jun 18

NOTE Fun fact - Yes, most databases use B+ trees to

Distributed Systems #distributed
Jun 13

NOTE Most databases use B+ Trees to hold the data, but

Algorithms & Data Structures #distributed
May 29

NOTE Amazon just made Aurora DSQL generally available

Distributed Systems #distributed
May 29

NOTE Most people get this wrong about the master-replica setup

Distributed Systems #distributed
May 13

NOTE Optimization is a zero-sum game

Distributed Systems #distributed
May 01

NOTE was reading a paper and came across this really good insight

Distributed Systems #distributed
Apr 25

NOTE While reading a paper, I came across the term multi-socket

Distributed Systems #distributed
Apr 24

NOTE If you are into distributed systems, please spend some time

Distributed Systems #distributed
Mar 23

NOTE One of the best courses I took during my college

Distributed Systems #distributed
Mar 21

NOTE Some time back, in my live cohort, we were discussing

Distributed Systems #distributed
Mar 11

NOTE I learned a neat trick in Go

Distributed Systems #distributed
Mar 05

NOTE The "SQL doesn’t scale" argument is a lazy and an absurd generalization

Distributed Systems #distributed
Mar 04

NOTE Netflix reduced connection churn in its API gateway by 10x

Distributed Systems #distributed
Feb 19

NOTE It's surprising how many engineers I talk to today have

Distributed Systems #distributed
Feb 13

NOTE Time-series databases use a really simple algorithm to compress the

Distributed Systems #distributed
Jan 16

NOTE Sometime back, I got curious about image formats and started

Distributed Systems #distributed

2024

(16)

Dec 20

NOTE Enjoy all the Spotify Wrapped you like, but spare some

Distributed Systems #distributed
Dec 18

NOTE Implement what you read, and read how to make your implementation better

Distributed Systems #distributed
Dec 14

NOTE Most NoSQL databases should have been a jsonb column in PostgreSQL

Distributed Systems #distributed
Nov 21

NOTE Six core computer science projects that I absolutely loved doing

Distributed Systems #distributed
Nov 17

NOTE One of the good coding practices that I picked up

Distributed Systems #distributed
Nov 16

NOTE I was crunching some numbers for JSON vs protobuf and

Distributed Systems #distributed
Oct 02

NOTE Low-level design patterns are great, but beyond a point, they

Distributed Systems #distributed
Aug 27

NOTE I always wondered how we could programmatically ensure variables get

Distributed Systems #distributed
Aug 15

NOTE Build micro-services, not nano-services

Distributed Systems #distributed
Jul 21

NOTE A solution that exists for all, is a solution that

Distributed Systems #distributed
Jul 19

NOTE I saw many engineers blaming the outage on Microsoft 🤦‍♂️

Distributed Systems #distributed
Jan 20

NOTE Writing quick prototypes from scratch is easy, do it, but ⚡

Distributed Systems #distributed
Jan 18

NOTE High-observability is a prerequisite for optimization

Distributed Systems #distributed
Jan 17

NOTE In the world where you have managed databases, should you

Distributed Systems #distributed
Jan 14

NOTE Caching is not the only way to handle the load ⚡

Distributed Systems #distributed
Jan 02

NOTE Nginx is one of the most powerful tools out here,

Distributed Systems #distributed

2023

(3)

Dec 26

NOTE Writing multi-threaded programs is easy, writing correct multi-threaded programs is

Distributed Systems #distributed
Jul 25

NOTE Hardware failure in large infra is not a question of

Distributed Systems #distributed
Mar 13

NOTE I am fascinated by random numbers ⚡

Distributed Systems #distributed

2022

(4)

Oct 06

NOTE was implementing graceful shutdown for some TCP server, and it

Distributed Systems #distributed
Sep 19

NOTE Random numbers that we generate in our programming language are

Distributed Systems #distributed
Jun 04

NOTE Just spend hour and half understanding Shannon Entropy

Distributed Systems #distributed
Mar 13

NOTE There is no better resource to learn anything in-depth than

Distributed Systems #distributed

Writings and Learnings

Courses

Applied AI Masterclass

System Design Masterclass

System Design for Beginners

Legal and Contact

Terms and Conditions

Everything Else

The Smarter Chimp

Arpit's Newsletter read by 145,000 engineers

Weekly essays on real-world system design, distributed systems, or a deep dive into some super-clever algorithm.

Subscribe on LinkedIn Subscribe on Substack

The courses listed on this website are offered by

Relog Deeptech Pvt. Ltd.
203, Sagar Apartment, Camp Road, Mangilal Plot, Amravati, Maharashtra, 444602
GSTIN: 27AALCR5165R1ZF

LinkedIn (280k)

© Arpit Bhayani, 2025