Submitting jobs and Validating Fair Scheduler

Let us submit few jobs and see how the resources are allocated using Fair Scheduler.

  • Submit the Long running job to the production queue.
  • Submit the other jobs to the test and production queues.
  • Submit another job to the qa queue

https://gist.github.com/dgadiraju/479059c8e3d7fd1be7d5b7672a76f447

  • Now the production queue has two apps. Since it is a fair scheduler the two jobs will be executed once the resources are available in the production queue and the job in the test queue will be executed as it is with the required resources.
  • Here is how the jobs will run with Fair Scheduler

https://gist.github.com/dgadiraju/9da9f833e6e21d6e9fad3cbbdf680dd1

Share this post