Arpit Bhayani
Projects
Blogs
Notes
Videos
Papershelf
Bookshelf
Courses
Talks
Home
Topics
Databases
#databases
(101)
37 blogs
•
39 notes
•
25 videos
All
101
Distributed Systems
61
Systems Internals
10
Career Growth
9
Databases
6
AI Systems
5
Software Engineering
5
Algorithms & Data Structures
4
Leadership
1
2026
(38)
Aug 30
NOTE
Schema-Driven Data Modeling Is Essential for Deterministic Agent Memory
AI Systems
#ai-systems
#agent-memory
#ai-agents
Aug 20
NOTE
GPU Drivers Adopt Database Wound-Wait Mutex to Prevent Deadlocks
AI Systems
#ai-systems
#concurrency
#concurrency-control
Aug 14
NOTE
Fast Stores Can Mask Per-Item State Check Performance Issues
Career Growth
#distributed-systems
#access-patterns
#batching
Aug 13
NOTE
Visual Prototypes Offer Superior Product Specification Over Design Documents
Career Growth
#software-engineering
#ai-agents
#career-growth
Aug 10
NOTE
Preventing PostgreSQL database-wide recoveries using strict Linux overcommit
Systems Internals
#software-engineering
#crash-recovery
#databases
Aug 08
NOTE
Using Plain Integers in MCP Tool Parameters Cuts Agent Errors
AI Systems
#ai-systems
#agent-errors
#ai-agents
Jul 31
BLOG
Three Claude Skills I Think Every Org Should Have
AI Systems
#ai-systems
#databases
#leadership
Jul 27
NOTE
Huge Pages Optimize Postgres Shared Buffers by Improving TLB Efficiency
Systems Internals
#distributed-systems
#caching
#databases
Jul 20
NOTE
Starting From Scratch Unlocks Radical Innovation By Challenging Assumptions
Distributed Systems
#distributed-systems
#apache-spark
#building-from-scratch
Jul 15
NOTE
Fragile staging and end-to-end tests hinder system scalability
Software Engineering
#software-engineering
#contract-testing
#databases
Jul 11
NOTE
Good DevOps Practices Are Essential for Reliable AI Agentic Workflows
Software Engineering
#software-engineering
#agentic-workflows
#ai-agents
Jul 06
NOTE
Improve MySQL Master Failover Monitoring Using Replica Consensus
Distributed Systems
#distributed-systems
#consensus
#databases
Jun 30
NOTE
Optimizations Are Trades Made Within Constraints With No Free Lunch
Career Growth
#career-growth
#concurrency
#concurrency-control
Jun 27
NOTE
RocksDB's Sequence Numbers Simplify Database Snapshots and Concurrency
Distributed Systems
#distributed-systems
#compaction
#concurrency
Jun 26
NOTE
Hands-on experience with systems reveals their critical failure modes
Software Engineering
#software-engineering
#databases
#failure-modes
Jun 23
NOTE
PostgreSQL Uses Histograms and MCVs to Estimate Rows
Distributed Systems
#distributed-systems
#databases
#histograms
Jun 19
NOTE
Separating Compute From Storage Enables Serverless Database Pay-Per-Use
Distributed Systems
#distributed-systems
#compute-storage-separation
#databases
Jun 11
NOTE
Handle Consecutive 401 Errors with Circuit Breakers to Prevent Outages
Distributed Systems
#distributed-systems
#401-unauthorized
#blind-retries
Jun 04
NOTE
Successful Big Migrations Require a Plank-by-Plank Replacement Strategy
Distributed Systems
#distributed-systems
#databases
#full-cutover
Jun 04
NOTE
Asymmetry in SYN Flood Attacks Makes SYN Cookies an Effective Countermeasure
Software Engineering
#software-engineering
#asymmetry
#clock-synchronization
Jun 03
NOTE
Tool Calls Enable Internal Agent Logic Decomposition and Testability
AI Systems
#ai-systems
#agent-design
#ai-agents
Jun 02
NOTE
New Hires Should Build Trust and Gather Context Before Suggesting Changes
Distributed Systems
#career-growth
#building-trust
#communication
May 20
BLOG
Temporal Primer - Building Long-Running Systems
Distributed Systems
#distributed-systems
#ai-agents
#career-growth
May 19
NOTE
Approximating Least Recently Used Cache Eviction Using Two Random Choices
Distributed Systems
#distributed-systems
#2-random
#approximation
May 01
NOTE
Design Systems For Reversibility To Boost Confidence And Speed
Distributed Systems
#distributed-systems
#architectural-decisions
#databases
Apr 29
NOTE
Pushdown optimization in pg_clickhouse improves data querying efficiency
Distributed Systems
#distributed-systems
#clickhouse
#data-filtering
Apr 28
BLOG
Your Monolith Is Already A Distributed System
Distributed Systems
#distributed-systems
#databases
#information-retrieval
Apr 23
NOTE
Relational databases often suffice where graph databases are overengineering
Distributed Systems
#distributed-systems
#algorithms
#databases
Apr 22
NOTE
Crashing immediately on startup prevents late-run fixable issues
Career Growth
#distributed-systems
#career-growth
#configuration-validation
Apr 11
NOTE
It Depends Must Be Followed By Explanation
Career Growth
#distributed-systems
#consistency
#databases
Apr 02
NOTE
Premature Optimization Adds Complexity, Reduces Readability
Software Engineering
#software-engineering
#code-correctness
#code-maintainability
Mar 12
NOTE
The Value of Spiky Teams in the Tech Industry
Career Growth
#career-growth
#candidate-assessment
#databases
Mar 08
BLOG
Databases Were Not Designed For This
Distributed Systems
#distributed-systems
#ai-agents
#caching
Mar 04
BLOG
BM25
Algorithms & Data Structures
#algorithms-and-data-structures
#databases
#information-retrieval
Feb 24
BLOG
JOIN Algorithms
Distributed Systems
#distributed-systems
#data-structures
#databases
Jan 27
BLOG
Multi-Paxos - Consensus in Distributed Databases
Distributed Systems
#distributed-systems
#clock-synchronization
#consensus
Jan 26
NOTE
Intentionally Go Deep Based on Curiosity and Career
Career Growth
#career-growth
#abstraction-layers
#career-direction
Jan 16
BLOG
MySQL Replication Internals
Distributed Systems
#distributed-systems
#concurrency
#databases
2025
(6)
Dec 23
BLOG
Clock Synchronization Is a Nightmare
Distributed Systems
#distributed-systems
#clock-synchronization
#consistency
Oct 20
BLOG
How Writes Work in Apache Cassandra
Distributed Systems
#distributed-systems
#consistency
#databases
Sep 06
BLOG
Why Distributed Systems Need Consensus Algorithms Like Raft
Distributed Systems
#distributed-systems
#clock-synchronization
#communication
Sep 05
BLOG
Why Do Databases Deadlock and How Do They Resolve It
Distributed Systems
#distributed-systems
#concurrency
#databases
May 26
NOTE
Availability Bias Leads to Optimizing Visible Not Actual Problems
Leadership
#leadership
#availability-bias
#communication
Jan 01
BLOG
Theta sketches: set algebra over massive streams
Algorithms & Data Structures
#algorithms-and-data-structures
#databases
#hashing
2024
(13)
Dec 17
NOTE
60% of the tables I have recently designed, do not
Distributed Systems
#databases
#system-design
Dec 06
NOTE
PostgreSQL is a fascinating database and if you want to
Distributed Systems
#system-design
#databases
Oct 18
NOTE
Today, I was reading through PostgreSQL's documentation and I stumbled
Distributed Systems
#databases
#postgre-sql
Sep 03
NOTE
You must the isolation level of your database, as picking
Distributed Systems
#databases
#system-design
Aug 13
NOTE
The Unexpected Benefit of Reading Random Engineering Articles
Career Growth
#career-growth
#communication
#databases
Jun 21
VIDEO
Designing a Real-Time Gaming Leaderboard: Horizontally Scalable & Highly Available
Distributed Systems
#system-design
#real-time-analytics
#databases
Jun 20
NOTE
Do This, Once You Are Out of the Interview Cycle
Career Growth
#career-growth
#databases
#interviews
Apr 26
VIDEO
Database Join Algorithms: How Nested Loop, Sort-Merge, and Hash Joins Work Internally
Databases
#databases
#systems-internals
#query-optimization
Apr 19
VIDEO
How PostgreSQL Parses Queries and Constructs the Parse Tree
Systems Internals
#postgresql
#databases
#systems-internals
Mar 16
VIDEO
Deep Dive into CockroachDB Architecture: Distributed SQL, Distributed Execution, and Storage Internals
Distributed Systems
#cockroachdb
#distributed-sql
#databases
Feb 23
VIDEO
Understanding Database Trade-offs: The RUM Conjecture Explained
Systems Internals
#databases
#rum-conjecture
#storage-engines
Jan 30
VIDEO
Choosing the Right String Column Data Type: CHAR vs VARCHAR vs TEXT
Databases
#databases
#postgresql
#mysql
Jan 12
VIDEO
Variable-Length Integer (Varint) Encoding: How Databases Optimize Storage and Transmission
Systems Internals
#varint
#serialization
#databases
2023
(9)
Nov 10
VIDEO
Understanding the Read Uncommitted Isolation Level: Mechanics, Anomalies, and Trade-offs
Systems Internals
#databases
#acid-transactions
#isolation-levels
Aug 10
NOTE
Most databases use B+ Trees to hold the data, but
Algorithms & Data Structures
#databases
May 25
VIDEO
Designing a High-Throughput, Secure Key-Value Store: Inside PayPal's JunoDB
Distributed Systems
#junodb
#databases
#distributed-systems
May 25
VIDEO
Architecting for Six 9s: How PayPal's JunoDB Achieves High Availability
Distributed Systems
#junodb
#distributed-systems
#high-availability
May 23
VIDEO
JunoDB Overview: PayPal's Open-Source Key-Value Store and Latency Bridging
Distributed Systems
#junodb
#distributed-systems
#caching
Mar 19
VIDEO
DATETIME vs TIMESTAMP in Databases: Storage Internals, Timezones, and Trade-Offs
Databases
#databases
#mysql
#sql
Mar 19
VIDEO
Demystifying Phantom Reads: Anatomy of a Database Concurrency Bug
Databases
#databases
#acid-transactions
#isolation-levels
Mar 19
VIDEO
Why Databases Store Data in B+ Trees: From Naive Disk Storage to Indexed Pages
Systems Internals
#databases
#b-plus-tree
#storage-engines
Mar 12
NOTE
How databases are upgraded in production
Distributed Systems
#system-design
#databases
2022
(16)
Sep 26
VIDEO
Architecture of Pinterest's Time Series Database: Goku
Distributed Systems
#time-series-database
#distributed-systems
#in-memory-storage
Sep 23
VIDEO
The Architecture of Airbnb's Knowledge Graph
Distributed Systems
#knowledge-graph
#system-design
#databases
Jun 06
VIDEO
Post-Mortem: How a Single MySQL Index Broke GitHub
Databases
#mysql
#indexing
#databases
Jun 01
VIDEO
Database per Service Pattern in Microservices: Architecture, Benefits, and Trade-offs
Distributed Systems
#microservices
#databases
#distributed-systems
Apr 27
VIDEO
Sharing Databases in Microservices: Anti-Pattern or Pragmatic Architecture?
Distributed Systems
#microservices
#databases
#system-design
Apr 25
VIDEO
Database Sharding vs. Partitioning: Architecture, Mechanics, and Scaling Trade-offs
Distributed Systems
#databases
#sharding
#partitioning
Mar 25
VIDEO
What are Embedded Databases and Why Do They Exist?
Systems Internals
#databases
#systems-internals
#sqlite
Mar 23
VIDEO
What Happens When an Auto-Increment ID Hits Its Max Value: Dissecting the GitHub Outage
Databases
#mysql
#databases
#system-design
Mar 21
VIDEO
Demystifying Write-Ahead Logging: Ensuring Database Reliability and High Performance
Systems Internals
#databases
#write-ahead-logging
#durability
Mar 16
VIDEO
How Database Indexes Minimize Disk I/O to Accelerate Read Performance
Systems Internals
#databases
#indexing
#disk-io
Mar 14
VIDEO
How to Handle Database Outages: Anatomy, Incident Triage, and Architectural Fixes
Distributed Systems
#databases
#incident-response
#mysql
Feb 07
BLOG
Local vs Global Indexes in Partitioned Databases
Distributed Systems
#distributed-systems
#databases
#hashing
Jan 31
BLOG
Partitioning Data - Range, Hash, and When to Use Them
Distributed Systems
#distributed-systems
#databases
#hashing
Jan 24
BLOG
Partitioning Strategies for Distributed Databases
Distributed Systems
#distributed-systems
#databases
#hashing
Jan 16
BLOG
Leaderless Replication
Distributed Systems
#distributed-systems
#consistency
#databases
Jan 03
BLOG
Multi-Master Conflicts - How to Handle Them
Distributed Systems
#distributed-systems
#databases
#replication
2021
(11)
Nov 28
BLOG
Multi-Master Replication - Why Conflicts Happen
Distributed Systems
#distributed-systems
#databases
#replication
Nov 03
BLOG
Multi-Master Replication - Scaling Writes Across Geographies
Distributed Systems
#distributed-systems
#databases
#replication
Sep 07
BLOG
What Happens When a Master or Replica Fails
Distributed Systems
#distributed-systems
#databases
#replication
Aug 15
BLOG
Replication Formats - Statement vs Row-based
Distributed Systems
#distributed-systems
#databases
#networking
Aug 07
BLOG
Master-Replica Replication
Distributed Systems
#distributed-systems
#databases
#replication
Jul 19
BLOG
Decoding Durability - The D in ACID
Distributed Systems
#distributed-systems
#consistency
#databases
Jul 07
BLOG
Decoding Isolation - The I in ACID
Distributed Systems
#distributed-systems
#concurrency
#consistency
Jul 02
BLOG
Decoding Atomicity - The A in ACID
Distributed Systems
#distributed-systems
#consistency
#databases
Jul 02
BLOG
Decoding Consistency - The C in ACID
Distributed Systems
#distributed-systems
#consistency
#databases
Jun 22
BLOG
Architectural Patterns for Distributed Systems
Distributed Systems
#distributed-systems
#databases
#system-design
Apr 19
BLOG
Modeling Udemy's Categories in a Relational Database
Distributed Systems
#distributed-systems
#databases
#python-internals
2020
(5)
Dec 06
BLOG
Count Distinct With Minimal Memory - Flajolet Martin Algorithm
Algorithms & Data Structures
#algorithms-and-data-structures
#databases
#memory-management
Nov 29
BLOG
The 2Q Algorithm - Addressing LRU's Sub-Optimality
Distributed Systems
#distributed-systems
#caching
#databases
Jul 19
BLOG
Bitcask - A Log-Structured fast KV store
Distributed Systems
#distributed-systems
#data-structures
#databases
May 03
BLOG
Copy-On-Write - When to Use It, When to Avoid It
Distributed Systems
#distributed-systems
#databases
#memory-management
Apr 26
BLOG
How MySQL Avoids Performance Hits from Table Scans
Distributed Systems
#distributed-systems
#caching
#databases
2017
(3)
Mar 24
BLOG
Analyzing MongoDB Pagination Performance Differences
Distributed Systems
#distributed-systems
#databases
#evaluation
Mar 23
BLOG
MongoDB Pagination - Skip is Slow
Distributed Systems
#distributed-systems
#databases
Mar 22
BLOG
MongoDB Pagination - Two Approaches You Need to Know
Distributed Systems
#distributed-systems
#databases