You have a driver and executors. What is the role of each in Spark?
1Times asked
Oct 2026Last seen
Oct 2026First seen
💡 Model Answer
In Spark, the driver is the main process that runs the user’s application code. It builds the DAG, schedules tasks, monitors progress, and aggregates results. Executors are worker processes launched on cluster nodes; each executor runs tasks, holds data in memory or disk, and performs the actual computation. The driver sends serialized tasks to executors, which execute them and return results. The driver orchestrates the job while executors handle execution.
This answer was generated by AI for study purposes. Use it as a starting point — personalize it with your own experience.
🎤 Get questions like this answered in real-time
Assisting AI listens to your interview, captures questions live, and gives you instant AI-powered answers on a discreet on-screen overlay.
Get Assisting AI — Starts at ₹500