First, let us run jobs without specifying any queue and see what happens.
Submit the Long running job to production queue by using the below command. This job requires 279 containers.
https://gist.github.com/dgadiraju/f6aa41383703a8b6bb3bb902a8726581
Submit the other job which requires only 18 containers to process the data.
https://gist.github.com/dgadiraju/85c9d016bca952d4b1d5d52a828bff2f