Arpit Bhayani
Projects
Blogs
Notes
Papershelf
Bookshelf
Courses
Talks
Home
Categories
AI Systems
AI Systems
(36)
Essays and notes on AI systems, LLM architectures, and agentic workflows.
11 blogs
•
25 notes
2026
(33)
Aug 30
NOTE
Design Multi-Context Processing Tools as Capabilities, Not Endpoints
AI Systems
#ai-systems
#context-management
#mcp
Aug 30
NOTE
Effective PII Masking Requires Layered Data Classification Beyond Regex
AI Systems
#ai-systems
#data-classification
#layered-approach
Aug 30
NOTE
Retrieving Correct Code for Agentic SDLCs Presents Three Major Problems
AI Systems
#ai-systems
#agentic-sdlc
#ai-agent-gullibility
Aug 30
NOTE
Schema-Driven Data Modeling Is Essential for Deterministic Agent Memory
AI Systems
#ai-systems
#agent-memory
#ai-agents
Aug 28
NOTE
Automated Verification Ensures End-to-End Correctness and Human Accountability
AI Systems
#ai-systems
#accountability
#communication
Aug 26
NOTE
Continuous batching achieves high GPU utilization for large language models
AI Systems
#ai-systems
#caching
#continuous-batching
Aug 26
NOTE
Robust System Plumbing is Key for Production-Ready AI Agents
AI Systems
#ai-systems
#ai-agents
#circuit-breaking
Aug 26
NOTE
Tailor AI Code Generation Tradeoffs Per File Based on Module Risk
AI Systems
#ai-systems
#ai-agents
#ai-code-generation
Aug 22
NOTE
Robust Plumbing and Harness are Essential for Production-Ready AI Agents
AI Systems
#ai-systems
#ai-agents
#backoff
Aug 20
NOTE
GPU Drivers Adopt Database Wound-Wait Mutex to Prevent Deadlocks
AI Systems
#ai-systems
#concurrency
#concurrency-control
Aug 19
NOTE
Self-editing agents face Ship of Theseus task drift
AI Systems
#ai-systems
#ai-agents
#career-growth
Aug 15
NOTE
Claude's Text Watermark Uses Secret Keys To Derive Randomness
AI Systems
#ai-systems
#claude
#llm-generation
Aug 08
NOTE
Using Plain Integers in MCP Tool Parameters Cuts Agent Errors
AI Systems
#ai-systems
#agent-errors
#ai-agents
Aug 06
BLOG
What AI First Engineering Orgs Look Like
AI Systems
#ai-systems
#ai-agents
#code-review
Aug 06
NOTE
Dispatch Tools Incrementally and Load Schemas Dynamically to Cut Agent Latency
AI Systems
#ai-systems
#agent-latency
#ai-agents
Aug 05
NOTE
Cloudflare increases LLM concurrency through precision reduction without quality loss
AI Systems
#ai-systems
#caching
#cloudflare
Jul 31
BLOG
Three Claude Skills I Think Every Org Should Have
AI Systems
#ai-systems
#databases
#leadership
Jul 25
NOTE
Building AI for Augmentation Creates Simpler and More Practical Systems
AI Systems
#ai-systems
#agentic-systems
#ai-agents
Jul 14
BLOG
G-Eval, Explained
AI Systems
#ai-systems
#evaluation
#llms
Jul 10
NOTE
Monitor AI Agent Apologies To Improve Their Context And Performance
AI Systems
#ai-systems
#agent-context
#ai-agent
Jul 08
NOTE
Your Specific LLM Task Requires a Custom Performance Benchmark
AI Systems
#ai-systems
#cheaper-models
#custom-benchmarks
Jun 20
NOTE
Idempotency is a must-have for reliable AI agent operations
AI Systems
#ai-systems
#ai-agents
#clock-synchronization
Jun 10
NOTE
System Design, Not Prompting, Optimizes LLM Token Budget Performance
AI Systems
#ai-systems
#leadership
#llm-context-windows
Jun 03
NOTE
Tool Calls Enable Internal Agent Logic Decomposition and Testability
AI Systems
#ai-systems
#agent-design
#ai-agents
Jun 01
BLOG
AI Workflows Need Topological Sort
AI Systems
#ai-systems
#ai-agents
#embeddings
Jun 01
NOTE
Agentic Systems Encounter Out of Memory Errors Due to Context Accumulation
AI Systems
#ai-systems
#agentic-systems
#ai-agents
May 30
NOTE
Production AI agents face classic software engineering reliability issues
AI Systems
#ai-systems
#ai-agents
#concurrency
May 28
BLOG
Embedding Models Make Or Break Your Ai App
AI Systems
#ai-systems
#embeddings
#information-retrieval
May 28
NOTE
Modern Embeddings Represent Contextual Meaning Better Than Static Word2Vec
AI Systems
#ai-systems
#bert
#contextual-embeddings
May 19
NOTE
System Design Fundamentals Remain Crucial for Robust Long-Running Agentic Applications
AI Systems
#ai-systems
#ai-agents
#caching
May 15
BLOG
What Matters in Production RAG
AI Systems
#ai-systems
#embeddings
#llms
May 13
BLOG
Structure of Every LLM Chat
AI Systems
#ai-systems
#llms
May 12
BLOG
How LLMs Really Work
AI Systems
#ai-systems
#llms
2025
(3)
Dec 07
BLOG
Product Quantization
AI Systems
#ai-systems
#embeddings
#information-retrieval
Nov 26
BLOG
The Q, K, V Matrices
AI Systems
#ai-systems
#llms
#system-design
Nov 22
BLOG
How LLM Inference Works
AI Systems
#ai-systems
#llm-inference
#llms