Arpit Bhayani
Projects
Blogs
Notes
Videos
Papershelf
Bookshelf
Courses
Talks
Home
Topics
Memory Management
#memory-management
(54)
19 blogs
•
11 notes
•
24 videos
All
54
Systems Internals
27
Distributed Systems
9
Algorithms & Data Structures
9
AI Systems
5
Software Engineering
3
Career Growth
1
2026
(21)
Aug 22
NOTE
Robust Plumbing and Harness are Essential for Production-Ready AI Agents
AI Systems
#ai-systems
#ai-agents
#backoff
Aug 21
BLOG
Slop Debt
Career Growth
#career-growth
#consistency
#devops-and-testing
Aug 10
NOTE
Preventing PostgreSQL database-wide recoveries using strict Linux overcommit
Systems Internals
#software-engineering
#crash-recovery
#databases
Jul 27
NOTE
Huge Pages Optimize Postgres Shared Buffers by Improving TLB Efficiency
Systems Internals
#distributed-systems
#caching
#databases
Jul 20
NOTE
Skipping Go Compiler Bounds Checks Improves Performance with Unsafe
Software Engineering
#software-engineering
#bounds-checking
#go
Jun 21
VIDEO
How Redis Implements Strings: A Deep Dive into SDS and Encoding
Systems Internals
#redis
#sds
#string-encoding
Jun 19
NOTE
Separating Compute From Storage Enables Serverless Database Pay-Per-Use
Distributed Systems
#distributed-systems
#compute-storage-separation
#databases
Jun 13
VIDEO
How Redis Internally Implements Memory Efficient Lists: Ziplist and Quicklist
Systems Internals
#redis
#data-structures
#memory-management
Jun 11
NOTE
Learning One Language Deeply Gives Intuition AI Cannot Provide
Software Engineering
#software-engineering
#ai-code-generation
#concurrency
Jun 10
NOTE
System Design, Not Prompting, Optimizes LLM Token Budget Performance
AI Systems
#ai-systems
#leadership
#llm-context-windows
Jun 04
NOTE
Asymmetry in SYN Flood Attacks Makes SYN Cookies an Effective Countermeasure
Software Engineering
#software-engineering
#asymmetry
#clock-synchronization
Jun 01
NOTE
Agentic Systems Encounter Out of Memory Errors Due to Context Accumulation
AI Systems
#ai-systems
#agentic-systems
#ai-agents
May 31
VIDEO
How and Why Redis Overrides Malloc: Deep Dive into jemalloc and tcmalloc
Systems Internals
#redis
#memory-management
#jemalloc
May 30
VIDEO
How Redis Caps Its Memory Usage: A Deep Dive into Redis Internals
Systems Internals
#redis
#memory-management
#systems-internals
May 24
VIDEO
Implementing Redis's Approximated LRU Algorithm: A Go Deep Dive
Systems Internals
#redis
#lru
#eviction
May 23
VIDEO
Redis's Approximated LRU Algorithm: Deep Dive into Memory-Efficient Eviction
Systems Internals
#redis
#lru
#caching
May 15
BLOG
What Matters in Production RAG
AI Systems
#ai-systems
#embeddings
#llms
May 12
NOTE
Distributed System Failures Often Stem From Unintended Omissions In Design
Distributed Systems
#distributed-systems
#back-pressure
#concurrency
May 03
VIDEO
Redis Key Eviction Strategies and Approximated Implementations
Systems Internals
#redis
#eviction
#memory-management
May 02
VIDEO
Implementing DEL, EXPIRE, and Auto-Cleanup in Redis Internals
Systems Internals
#redis
#database-internals
#distributed-systems
Jan 17
VIDEO
Optimizing Database Memory Usage: When `malloc` Becomes a Bottleneck
Systems Internals
#memory-management
#malloc
#tcmalloc
2025
(5)
Dec 29
BLOG
Bloom Filters
Algorithms & Data Structures
#algorithms-and-data-structures
#bloom-filters
#hashing
Dec 07
BLOG
Product Quantization
AI Systems
#ai-systems
#embeddings
#information-retrieval
Sep 06
BLOG
Why Distributed Systems Need Consensus Algorithms Like Raft
Distributed Systems
#distributed-systems
#clock-synchronization
#communication
Sep 04
BLOG
Why and How Cache Locality Can Make Your Code Faster
Systems Internals
#systems-internals
#caching
#memory-management
Jan 01
BLOG
Theta sketches: set algebra over massive streams
Algorithms & Data Structures
#algorithms-and-data-structures
#databases
#hashing
2024
(3)
Sep 15
BLOG
Paper Notes - On-demand Container Loading in AWS Lambda
Systems Internals
#systems-internals
#caching
#cryptography
Aug 21
BLOG
Paper Notes - WTF - The Who to Follow Service at Twitter
Distributed Systems
#distributed-systems
#algorithms
#memory-management
Jan 04
VIDEO
How Pass by Value vs Pass by Pointer Works Internally: An Assembly Deep Dive
Systems Internals
#golang
#systems-internals
#assembly
2023
(2)
Oct 25
VIDEO
Disabling Python Garbage Collection at Scale: How Instagram Saved 10% Infrastructure Cost
Systems Internals
#python
#cpython
#garbage-collection
Apr 01
NOTE
I was always fascinated by virtual memory management, hence decided
Systems Internals
#memory-management
#system-design
2022
(9)
Aug 03
VIDEO
Implementing Hash Maps with Hash Tables: Internals, Memory Management, and Collision Strategies
Algorithms & Data Structures
#hash-tables
#hash-maps
#memory-management
Aug 01
VIDEO
Implementing Hash Sets with Hash Tables: Separate Chaining vs. Open Addressing
Algorithms & Data Structures
#hash-tables
#hash-sets
#data-structures
Jul 29
VIDEO
Implementing Hash Table Resizing: Separate Chaining and Open Addressing
Algorithms & Data Structures
#hash-tables
#data-structures
#open-addressing
Jul 11
VIDEO
Internal Structure of a Hash Table: The Two-Step Hashing Architecture
Algorithms & Data Structures
#hash-tables
#data-structures
#memory-management
May 20
VIDEO
Why Caching Fails to Speed Up Mark-and-Sweep Garbage Collection
Systems Internals
#garbage-collection
#caching
#systems-internals
May 06
VIDEO
Tricolor Abstraction: Foundations of Concurrent Garbage Collection
Systems Internals
#garbage-collection
#memory-management
#systems-internals
Apr 29
VIDEO
Mark and Sweep Garbage Collection: Architecture, Mechanics, and Optimizations
Systems Internals
#garbage-collection
#memory-management
#runtime-systems
Apr 22
VIDEO
How to Pick a Garbage Collector: The Seven Core Trade-Offs
Systems Internals
#garbage-collection
#memory-management
#systems-internals
Apr 11
VIDEO
Why Programming Languages Need Garbage Collection: Stack, Heap, and Memory Safety
Systems Internals
#garbage-collection
#memory-management
#stack-vs-heap
2021
(6)
Jun 09
BLOG
Fork Bomb
Systems Internals
#systems-internals
#memory-management
#operating-systems
May 24
VIDEO
Under the Hood of Python's id() Function: CPython Internals and Pointer Semantics
Systems Internals
#cpython
#python-internals
#memory-management
May 06
VIDEO
CPython Internals: How Python Optimizes and Caches Small Integers
Systems Internals
#cpython
#python-internals
#memory-management
Apr 13
VIDEO
CPython Internals: String Interning and Dictionary Optimization
Systems Internals
#python
#cpython
#string-interning
Apr 03
VIDEO
The Honest Python: Deep Diving into CPython Internals
Systems Internals
#cpython
#python-internals
#memory-management
Feb 15
BLOG
Fully Persistent Arrays
Algorithms & Data Structures
#algorithms-and-data-structures
#memory-management
2020
(8)
Dec 06
BLOG
Count Distinct With Minimal Memory - Flajolet Martin Algorithm
Algorithms & Data Structures
#algorithms-and-data-structures
#databases
#memory-management
Aug 23
BLOG
Implementing LFU in O(1)
Distributed Systems
#distributed-systems
#caching
#memory-management
Aug 02
BLOG
Space-Efficient Counting - Exploring Morris' Algorithm
Algorithms & Data Structures
#algorithms-and-data-structures
#career-growth
#memory-management
Jul 19
BLOG
Bitcask - A Log-Structured fast KV store
Distributed Systems
#distributed-systems
#data-structures
#databases
May 31
BLOG
The RUM Conjecture - Storage System Trade-offs
Distributed Systems
#distributed-systems
#consistency
#cryptography
May 17
BLOG
How Python Handles Integers Under the Hood
Systems Internals
#systems-internals
#memory-management
#python-internals
May 03
BLOG
Copy-On-Write - When to Use It, When to Avoid It
Distributed Systems
#distributed-systems
#databases
#memory-management
Apr 26
BLOG
How MySQL Avoids Performance Hits from Table Scans
Distributed Systems
#distributed-systems
#caching
#databases