Essay : An Introduction to Data Partitioning

Arpit Bhayani

Arpit Bhayani

Jan 25, 2022 • 2 min read


Essay #70: An Introduction to Data Partitioning

Partitioning plays a vital role in scaling a database beyond a certain scale of reads and writes. In this essay, we take a detailed look into Partitioning basics and understand how it can help us scale our Reads and Writes beyond a single machine.

In this quick 4 minute read, we go through the following points

 - What is data partitioning?  - Why do we need to partition the data?  - How Data Partitioning helps in scaling reads and writes?  - How Data Partitioning helps in improving availability?  - Skim through Horizontal and Vertical Data Partitioning

Do give it a read: https://lnkd.in/geaFQeua.

This is the 14th essay in #DistributedSystems series, you can find others at https://lnkd.in/ff2xbD2

If you are new here, I teach a course on System Design where you’ll learn how to design scalable systems intuitively. The course will not only help you in your technical discussions but will also make you a better engineer overall. I have compressed my ~9 years of work experience into this course, and 300+ engineers have already taken it.

If you also want to be part of this journey and discuss core engineering, my next batch starts on the 5th of March 2022. Course details and curriculum can be found at arpitbhayani.me/course.

You can also subscribe to my newsletter and get these essays delivered straight to your inbox: arpitbhayani.me/newsletter. 2800+ engineers have been reading my newsletter.

Arpit Bhayani

Principal Engineer II at Razorpay - building Agent Studio, Ex-staff engg at GCP Memorystore & Dataproc, Creator of DiceDB, ex-Amazon Fast Data, ex-Director of Engg. SRE and Data Engineering at Unacademy. I spark engineering curiosity through my no-fluff engineering videos on YouTube and my courses