#caching (31)

11 blogs • 9 notes • 11 videos

2026

(13)

Aug 26

NOTE Continuous batching achieves high GPU utilization for large language models

AI Systems #ai-systems #caching #continuous-batching
Aug 26

NOTE How S3 Enables Stateless Write-Ahead Logs Despite Latency Trade-offs

Distributed Systems #distributed-systems #caching #commit-latency
Aug 05

NOTE Cloudflare increases LLM concurrency through precision reduction without quality loss

AI Systems #ai-systems #caching #cloudflare
Jul 27

NOTE Huge Pages Optimize Postgres Shared Buffers by Improving TLB Efficiency

Systems Internals #distributed-systems #caching #databases
Jun 29

NOTE AI Makes Premature Optimization Effortless Leading to Over-Engineered Code

AI Systems #software-engineering #ai #caching
May 24

VIDEO Implementing Redis's Approximated LRU Algorithm: A Go Deep Dive

Systems Internals #redis #lru #eviction
May 23

VIDEO Redis's Approximated LRU Algorithm: Deep Dive into Memory-Efficient Eviction

Systems Internals #redis #lru #caching
May 21

NOTE Key Considerations for Building Predictably Horizontally Scalable Systems

Distributed Systems #distributed-systems #asynchronous-queues #caching
May 19

NOTE System Design Fundamentals Remain Crucial for Robust Long-Running Agentic Applications

AI Systems #ai-systems #ai-agents #caching
May 19

NOTE Approximating Least Recently Used Cache Eviction Using Two Random Choices

Distributed Systems #distributed-systems #2-random #approximation
Apr 05

NOTE Simpler Solutions Beat Complexity in System Architecture

Distributed Systems #distributed-systems #caching #complexity
Mar 08

BLOG Databases Were Not Designed For This

Distributed Systems #distributed-systems #ai-agents #caching
Jan 03

VIDEO How MySQL's Midpoint Insertion Strategy Prevents Cache Pollution

Databases #mysql #innodb #caching

2025

(3)

Sep 04

BLOG Why and How Cache Locality Can Make Your Code Faster

Systems Internals #systems-internals #caching #memory-management
Sep 02

BLOG Why does DNS use both UDP and TCP

Systems Internals #systems-internals #caching #fault-tolerance
Mar 16

VIDEO DiceDB 1.0: A Fast, Reactive, In-Memory Database for Modern Applications

Databases #dicedb #in-memory-database #reactive-systems

2024

(3)

2023

(1)

May 23

VIDEO JunoDB Overview: PayPal's Open-Source Key-Value Store and Latency Bridging

Distributed Systems #junodb #distributed-systems #caching

2021

(1)

May 02

VIDEO Scaling a Taxonomy Service and Database: Architecture and Bottlenecks

Distributed Systems #system-design #database-scaling #caching

2020

(6)