[CIG-SHORT] Run on cluster using SLURM

Bing He bing-he at uri.edu
Fri Sep 28 13:20:57 PDT 2018


Hi Matt,

I try the example case in examples/2d/subduction/step06.cfg. It is not a big case. It usually runs about 20 minutes on my laptop.
Maybe I should try a big problem. 

Bing

> On 28 Sep 2018, at 16:12, Matthew Knepley <knepley at rice.edu> wrote:
> 
> On Fri, Sep 28, 2018 at 3:57 PM Bing He <bing-he at uri.edu <mailto:bing-he at uri.edu>> wrote:
> Dear all,
> 
> Is there anyone has successfully run Pylith using Slurm? Could you please give me some suggestions?
> I wrote the configuration file and run the code like this (attached). It can use many nodes and cpus, but the computing speed does not improve. 
> 
> How big is the problem? Only bigger problems show any speedup
> 
>   https://www.mcs.anl.gov/petsc/documentation/faq.html#slowerparallel <https://www.mcs.anl.gov/petsc/documentation/faq.html#slowerparallel>
> 
> Note also that absolutely no speedup in timestepping comes from parallelism.
> 
> Parallelism is really effective at running bigger problems. Strong speedup (running
> the same problem faster) is much harder and runs out very quickly.
> 
>   Thanks,
> 
>      Matt
>  
> [pylithapp]
> scheduler = slurm
> launcher = mpich
> [pylithapp.slurm]
> shell = /bin/bash
> [pylithapp.launcher]
> command = mpirun -np ${nodes} 
> 
> pylith step06.cfg \
>     --launcher=mpich \
>     --scheduler=slurm \
>     --job.queue=general \
>     --job.walltime=2*day \
>     --job.name <http://job.name/>=speed \
>     —-nodes=40 —-scheduler.ppn=20 \
>     --job.stdout=log \
>     --job.stderr=err
> 
> Thanks for your time and have a nice weekend!
> Bing
> _______________________________________________
> CIG-SHORT mailing list
> CIG-SHORT at geodynamics.org <mailto:CIG-SHORT at geodynamics.org>
> http://lists.geodynamics.org/cgi-bin/mailman/listinfo/cig-short <http://lists.geodynamics.org/cgi-bin/mailman/listinfo/cig-short>_______________________________________________
> CIG-SHORT mailing list
> CIG-SHORT at geodynamics.org <mailto:CIG-SHORT at geodynamics.org>
> http://lists.geodynamics.org/cgi-bin/mailman/listinfo/cig-short <http://lists.geodynamics.org/cgi-bin/mailman/listinfo/cig-short>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.geodynamics.org/pipermail/cig-short/attachments/20180928/55b19d02/attachment.html>


More information about the CIG-SHORT mailing list