How will the Fair Scheduler handle more than one Job

Question

I have a Hadoop cluster running with the Fail Scheduler enabled. There are currently no jobs running on the cluster. I submit a job A, so that only job A is running on the cluster. A while later, I submit another job B. Now job A and Job B are running on the cluster al the same time. My question is how will the Fair' Scheduler handle these two Jobs?

Answer 1

In your case when job B gets submitted, it will get assigned tasks, while job A continues to run with fewer tasks.
Fair scheduling is a method of assigning resources to jobs such that all jobs get, on average, an equal share of resources over time. When there is a single job running, that job uses the entire cluster. When other jobs are submitted, tasks slots that free up are assigned to the new jobs, so that each job gets roughly the same amount of CPU time.

Hope this will help.