What is the default partition size in Spark, and how can it be configured?
1Times asked
Sep 2026Last seen
Sep 2026First seen
💡 Model Answer
In Spark, the default partition size is 128 MB. This is the size of the data that will be processed in a single partition during shuffles. You can change it by setting spark.sql.shuffle.partitions or spark.default.parallelism. In Hadoop, the default block size is 128 MB, which is analogous to a partition size. The default can be configured via dfs.block.size.
This answer was generated by AI for study purposes. Use it as a starting point — personalize it with your own experience.
🎤 Get questions like this answered in real-time
Assisting AI listens to your interview, captures questions live, and gives you instant AI-powered answers on a discreet on-screen overlay.
Get Assisting AI — Starts at ₹500