[CIG-SHORT] Run on cluster using SLURM

Birendra jha bjha7333 at yahoo.com
Sun May 25 11:56:00 PDT 2014


I tried this as follows but it does not work:

1. Get the mpirun command from a cluster that uses PBS (and pylith works there) by 
pylith test.cfg --scheduler.dry

2. Create a bash script e.g. slurm.sh that has the mpirun command from PBS cluster except the following parts:
-np ${nodes} -machinefile ${PBS_NODEFILE}
--scheduler.dry --nodes=1 --macros.nodes=1 --macros.job.name= --macros.job.id=None

Here is my slurm.sh:

#!/bin/bash
#SBATCH --job-name=testjob
#SBATCH --workdir=/home2/bjha/test
#SBATCH --output=test.out
#SBATCH --error=test.err
#SBATCH --nodes=2
#SBATCH --ntasks-per-node=4

mpirun /home2/bjha/pylith/bin/mpinemesis --pyre-start
 /home2/bjha/pylith/bin:/home2/bjha/pylith/lib/python2.7/site-packages/pythia-0.8.1.16-py2.7.egg:/home2/bjha/pylith/lib/python2.7/site-packages:/home2/bjha/pylith/lib64/python2.7/site-packages:/home2/bjha/test:/usr/lib/python2.7:/usr/lib/python2.7/plat-linux2:/usr/lib/python2.7/lib-tk:/usr/lib/python2.7/lib-old:/usr/lib/python2.7/lib-dynload:/usr/local/lib/python2.7/dist-packages:/usr/lib/python2.7/dist-packages:/usr/lib/python2.7/dist-packages/PIL:/usr/lib/python2.7/dist-packages/gst-0.10:/usr/lib/python2.7/dist-packages/gtk-2.0:/usr/lib/pymodules/python2.7:/usr/lib/python2.7/dist-packages/ubuntu-sso-client:/usr/lib/python2.7/dist-packages/ubuntuone-client:/usr/lib/python2.7/dist-packages/ubuntuone-control-panel:/usr/lib/python2.7/dist-packages/ubuntuone-couch:/usr/lib/python2.7/dist-packages/ubuntuone-installer:/usr/lib/python2.7/dist-packages/ubuntuone-storage-protocol:/home2/bjha/pylith/lib64/python2.7/site-packages pythia mpi:mpistart
 pylith.apps.PyLithApp:PyLithApp test.cfg

3. Submit
sbatch slurm.sh

Question: if Pylith/Pyre does not support SLURM--like it does PBS, SGE, LSF---how can I extract the mpirun command that I can submit to a SLURM cluster?

Thanks and regards
Birendra

--------------------------------------------
On Sun, 5/25/14, Birendra jha <bjha7333 at yahoo.com> wrote:

 Subject: Run on cluster using SLURM
 To: cig-short at geodynamics.org
 Date: Sunday, May 25, 2014, 10:21 PM
 
 Hi
 
 Is it possible to submit a pylith run to a
 cluster that uses SLURM, just like in case of PBS or SGE?
 
 
 Thanks and regards
 Birendra
 


More information about the CIG-SHORT mailing list