[CSC 435] Job Dependencies are Hurting You

Andrew J. Pounds pounds_aj at mercer.edu
Thu Apr 28 18:31:28 EDT 2022


Guys -- I just checked and some of you are running with job dependencies 
set between your jobs.  I only do then when the results of one job have 
to be used by the results of another job.  If you are using the 
"afterok" clause in your job submission scripts then you are forcing the 
job queuing system to run your jobs in a synchronous manner.  The power 
of "torque" is that it can look at all of the submitted jobs and figure 
out how to run them optimally on the available nodes and processors.

You may have a reason for wanting to do this, but I can say that based 
on my experience it is not needed here and is hurting your overall job 
throughput.


-- 
*/Andrew J. Pounds, Ph.D./*
/Professor of Chemistry and Computer Science/
/Director of the Computational Science Program/
/Mercer University, Macon, GA 31207 (478) 301-5627/
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://theochem.mercer.edu/pipermail/csc435/attachments/20220428/f87f9761/attachment.html>


More information about the csc435 mailing list