#ai-systems (40)

11 blogs • 29 notes

2026

(34)

Sep 08

NOTE Reorganizing KV cache memory can make models interactive in real-time

AI Systems #ai-systems #kv-cache #model-memory
Sep 07

NOTE Organizing a Model's KV Cache Unlocks New Interactive Abilities

AI Systems #ai-systems #kv-cache #model-memory
Aug 30

NOTE Design Multi-Context Processing Tools as Capabilities, Not Endpoints

AI Systems #ai-systems #context-management #mcp
Aug 30

NOTE Effective PII Masking Requires Layered Data Classification Beyond Regex

AI Systems #ai-systems #data-classification #layered-approach
Aug 30

NOTE Retrieving Correct Code for Agentic SDLCs Presents Three Major Problems

AI Systems #ai-systems #agentic-sdlc #ai-agent-gullibility
Aug 30

NOTE Schema-Driven Data Modeling Is Essential for Deterministic Agent Memory

AI Systems #ai-systems #agent-memory #ai-agents
Aug 28

NOTE Automated Verification Ensures End-to-End Correctness and Human Accountability

AI Systems #ai-systems #accountability #communication
Aug 26

NOTE Continuous batching achieves high GPU utilization for large language models

AI Systems #ai-systems #caching #continuous-batching
Aug 26

NOTE Tailor AI Code Generation Tradeoffs Per File Based on Module Risk

AI Systems #ai-systems #ai-agents #ai-code-generation
Aug 22

NOTE Robust Plumbing and Harness are Essential for Production-Ready AI Agents

AI Systems #ai-systems #ai-agents #backoff
Aug 20

NOTE GPU Drivers Adopt Database Wound-Wait Mutex to Prevent Deadlocks

AI Systems #ai-systems #concurrency #concurrency-control
Aug 19

NOTE Self-editing agents face Ship of Theseus task drift

Career Growth #ai-systems #ai-agents #career-growth
Aug 15

NOTE Claude's Text Watermark Uses Secret Keys To Derive Randomness

AI Systems #ai-systems #claude #llm-generation
Aug 08

NOTE Using Plain Integers in MCP Tool Parameters Cuts Agent Errors

AI Systems #ai-systems #agent-errors #ai-agents
Aug 06

BLOG What AI First Engineering Orgs Look Like

AI Systems #ai-systems #ai-agents #code-review
Aug 06

NOTE Dispatch Tools Incrementally and Load Schemas Dynamically to Cut Agent Latency

AI Systems #ai-systems #agent-latency #ai-agents
Aug 05

NOTE Cloudflare increases LLM concurrency through precision reduction without quality loss

AI Systems #ai-systems #caching #cloudflare
Jul 31

BLOG Three Claude Skills I Think Every Org Should Have

AI Systems #ai-systems #databases #leadership
Jul 25

NOTE Building AI for Augmentation Creates Simpler and More Practical Systems

Career Growth #ai-systems #agentic-systems #ai-agents
Jul 14

BLOG G-Eval, Explained

AI Systems #ai-systems #evaluation #llms
Jul 10

NOTE Monitor AI Agent Apologies To Improve Their Context And Performance

AI Systems #ai-systems #agent-context #ai-agent
Jul 08

NOTE Your Specific LLM Task Requires a Custom Performance Benchmark

AI Systems #ai-systems #cheaper-models #custom-benchmarks
Jun 20

NOTE Idempotency is a must-have for reliable AI agent operations

AI Systems #ai-systems #ai-agents #clock-synchronization
Jun 10

NOTE System Design, Not Prompting, Optimizes LLM Token Budget Performance

AI Systems #ai-systems #leadership #llm-context-windows
Jun 03

NOTE Tool Calls Enable Internal Agent Logic Decomposition and Testability

AI Systems #ai-systems #agent-design #ai-agents
Jun 01

BLOG AI Workflows Need Topological Sort

AI Systems #ai-systems #ai-agents #embeddings
Jun 01

NOTE Agentic Systems Encounter Out of Memory Errors Due to Context Accumulation

AI Systems #ai-systems #agentic-systems #ai-agents
May 30

NOTE Production AI agents face classic software engineering reliability issues

AI Systems #ai-systems #ai-agents #concurrency
May 28

BLOG Embedding Models Make Or Break Your Ai App

AI Systems #ai-systems #embeddings #information-retrieval
May 28

NOTE Modern Embeddings Represent Contextual Meaning Better Than Static Word2Vec

AI Systems #ai-systems #bert #contextual-embeddings
May 19

NOTE System Design Fundamentals Remain Crucial for Robust Long-Running Agentic Applications

AI Systems #ai-systems #ai-agents #caching
May 15

BLOG What Matters in Production RAG

AI Systems #ai-systems #embeddings #llms
May 13

BLOG Structure of Every LLM Chat

AI Systems #ai-systems #llms
May 12

BLOG How LLMs Really Work

AI Systems #ai-systems #llms

2025

(4)

Dec 07

BLOG Product Quantization

AI Systems #ai-systems #embeddings #information-retrieval
Nov 26

BLOG The Q, K, V Matrices

AI Systems #ai-systems #llms #system-design
Nov 22

BLOG How LLM Inference Works

AI Systems #ai-systems #llm-inference #llms
Feb 16

NOTE you don't need to watch my videos to become a better engineer.

AI Systems #ai-systems

2024

(2)