Essay : Indexing on a Partitioned Data

Arpit Bhayani

Arpit Bhayani

Feb 07, 2022 • 2 min read


Essay #72: Indexing on a Partitioned Data

Partitioning plays a vital role in scaling a database beyond a certain scale of reads and writes. This essay takes a detailed look into how we could index the partitioned data, allowing us to query the data on secondary attributes quickly.

In this quick 5 minute read, we go through the following points

 - Need of Indexing  - What are Local Secondary Indexes?  - Where do Local Secondary Indexes suffer?  - What are Global Secondary Indexes?  - Where do Global Secondary Indexes suffer?

Do give it a read: https://lnkd.in/grmqBjij.

By the way, this is exactly what happens behind the scene in DynamoDB.

This is 72nd essay and I have been regularly publishing since Jan 3rd 2020. You can find other 71 essays at arpitbhayani.me/blogs. If you are interested in Distributed Systems or CS Engineering in general do subscribe to my newsletter.

I also teach a course on System Design where you’ll learn the intuition behind building scalable systems. The course will not only help you in your technical discussions but will also make you a better engineer overall. I have compressed my ~9 years of work experience into this course, and 320+ engineers have already taken it.

You can check out the course details, curriculum, week-by-week details, and other information at arpitbhayani.me/course. If you are interested do join the waitlist for my May 2022 cohort.

You can also subscribe to my newsletter and get these essays delivered straight to your inbox: arpitbhayani.me/newsletter. 2800+ engineers have been reading my newsletter.

Arpit Bhayani

Principal Engineer II at Razorpay - building Agent Studio, Ex-staff engg at GCP Memorystore & Dataproc, Creator of DiceDB, ex-Amazon Fast Data, ex-Director of Engg. SRE and Data Engineering at Unacademy. I spark engineering curiosity through my no-fluff engineering videos on YouTube and my courses