[CIG-SHORT] Error message from running on cluster

Matthew Knepley knepley at mcs.anl.gov
Wed Jun 20 07:01:18 PDT 2012


On Wed, Jun 20, 2012 at 7:18 AM, Hongfeng Yang <hyang at whoi.edu> wrote:

>  Hi Matt,
>
> Last night I did not send the error message of running pylith on our
> cluster at WHOI. Sorry for that. Here it is.
>
> Could you help figure out what the problem might be?
>

So it looks like there is a problem when trying to read in the mesh,
although it is hard to tell since
we get an SEGV. My guess is that the filesystem is not exactly what you
think it is.I recommend
going through the cluster documentation to understand exactly how the
filesystem is accessed from
nodes other than the head node.

   Matt


> Thanks,
>
> Hongfeng
>
>  --
> Postdoctoral Investigator
> Department of Geology and Geophysics
> Woods Hole Oceanographic Institution
> 360 Woods Hole Rd, MS 24
> Woods Hole, MA 02543
>
>


-- 
What most experimenters take for granted before they begin their
experiments is infinitely more interesting than any results to which their
experiments lead.
-- Norbert Wiener
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://geodynamics.org/pipermail/cig-short/attachments/20120620/f740435d/attachment.htm 
-------------- next part --------------
 >> /scylla-a/home/hyang/cig/pylith171/lib/python2.7/site-packages/pylith/utils/PetscManager.py:64:initialize
 -- petsc(info)
 -- Initialized PETSc.
--------------------------------------------------------------------------
An MPI process has executed an operation involving a call to the
"fork()" system call to create a child process.  Open MPI is currently
operating in a condition that could result in memory corruption or
other system errors; your MPI job may hang, crash, or produce silent
data corruption.  The use of fork() (or system() or other calls that
create child processes) is strongly discouraged.  

The process that invoked fork was:

  Local host:          scylla070 (PID 26718)
  MPI_COMM_WORLD rank: 3

If you are *absolutely sure* that your application will successfully
and correctly survive a call to fork(), you may disable this warning
by setting the mpi_warn_on_fork MCA parameter to 0.
--------------------------------------------------------------------------
 >> /scylla-a/home/hyang/cig/pylith171/lib/python2.7/site-packages/pylith/meshio/MeshIOObj.py:55:read
 -- meshiocubit(info)
 -- Reading finite-element mesh
 >> ../../../pylith-1.7.1/libsrc/pylith/meshio/MeshIOCubit.cc:142:<unknown>
 -- meshiocubit(info)
 -- Reading 245 vertices.
 >> ../../../pylith-1.7.1/libsrc/pylith/meshio/MeshIOCubit.cc:197:<unknown>
 -- meshiocubit(info)
 -- Reading 144 cells in 2 blocks.
 >> ../../../pylith-1.7.1/libsrc/pylith/meshio/MeshIOCubit.cc:257:<unknown>
 -- meshiocubit(info)
 -- Found 8 node sets.
 >> ../../../pylith-1.7.1/libsrc/pylith/meshio/MeshIOCubit.cc:285:<unknown>
 -- meshiocubit(info)
 -- Reading node set 'fault' with id 10 containing 35 nodes.
 >> ../../../pylith-1.7.1/libsrc/pylith/meshio/MeshIOCubit.cc:285:<unknown>
 -- meshiocubit(info)
 -- Reading node set 'face_xpos' with id 11 containing 35 nodes.
 >> ../../../pylith-1.7.1/libsrc/pylith/meshio/MeshIOCubit.cc:285:<unknown>
 -- meshiocubit(info)
 -- Reading node set 'face_xneg' with id 12 containing 35 nodes.
 >> ../../../pylith-1.7.1/libsrc/pylith/meshio/MeshIOCubit.cc:285:<unknown>
 -- meshiocubit(info)
 -- Reading node set 'face_ypos' with id 13 containing 35 nodes.
 >> ../../../pylith-1.7.1/libsrc/pylith/meshio/MeshIOCubit.cc:285:<unknown>
 -- meshiocubit(info)
 -- Reading node set 'face_yneg' with id 14 containing 35 nodes.
 >> ../../../pylith-1.7.1/libsrc/pylith/meshio/MeshIOCubit.cc:285:<unknown>
 -- meshiocubit(info)
 -- Reading node set 'face_zneg' with id 15 containing 49 nodes.
 >> ../../../pylith-1.7.1/libsrc/pylith/meshio/MeshIOCubit.cc:285:<unknown>
 -- meshiocubit(info)
 -- Reading node set 'face_zneg_nofault' with id 16 containing 42 nodes.
 >> ../../../pylith-1.7.1/libsrc/pylith/meshio/MeshIOCubit.cc:285:<unknown>
 -- meshiocubit(info)
 -- Reading node set 'face_zpos' with id 17 containing 49 nodes.
 >> /scylla-a/home/hyang/cig/pylith171/lib/python2.7/site-packages/pylith/problems/TimeDependent.py:92:preinitialize
 -- timedependent(info)
 -- Pre-initializing problem.
 >> /scylla-a/home/hyang/cig/pylith171/lib/python2.7/site-packages/pylith/problems/Formulation.py:389:_setupMaterials
 -- implicit(info)
 -- Pre-initializing materials.
 >> /scylla-a/home/hyang/cig/pylith171/lib/python2.7/site-packages/pylith/feassemble/FIATLagrange.py:407:initialize
 -- fiatlagrange(info)
 -- Cell geometry: 
 -- <pylith.feassemble.CellGeometry.GeometryHex3D; proxy of <Swig Object of type 'pylith::feassemble::GeometryHex3D *' at 0x2abed9001060> >
 -- Vertices: 
 -- [[-1. -1. -1.]
 [ 1. -1. -1.]
 [ 1.  1. -1.]
 [-1.  1. -1.]
 [-1. -1.  1.]
 [ 1. -1.  1.]
 [ 1.  1.  1.]
 [-1.  1.  1.]]
 -- Quad pts:
 -- [[-0.57735027 -0.57735027 -0.57735027]
 [ 0.57735027 -0.57735027 -0.57735027]
 [-0.57735027  0.57735027 -0.57735027]
 [ 0.57735027  0.57735027 -0.57735027]
 [-0.57735027 -0.57735027  0.57735027]
 [ 0.57735027 -0.57735027  0.57735027]
 [-0.57735027  0.57735027  0.57735027]
 [ 0.57735027  0.57735027  0.57735027]]
 -- Quad wts:
 -- [ 1.  1.  1.  1.  1.  1.  1.  1.]
 -- Basis fns @ quad pts ):
 -- [[ 0.49056261  0.13144586  0.03522081  0.13144586  0.13144586  0.03522081
   0.00943739  0.03522081]
 [ 0.13144586  0.49056261  0.13144586  0.03522081  0.03522081  0.13144586
   0.03522081  0.00943739]
 [ 0.13144586  0.03522081  0.13144586  0.49056261  0.03522081  0.00943739
   0.03522081  0.13144586]
 [ 0.03522081  0.13144586  0.49056261  0.13144586  0.00943739  0.03522081
   0.13144586  0.03522081]
 [ 0.13144586  0.03522081  0.00943739  0.03522081  0.49056261  0.13144586
   0.03522081  0.13144586]
 [ 0.03522081  0.13144586  0.03522081  0.00943739  0.13144586  0.49056261
   0.13144586  0.03522081]
 [ 0.03522081  0.00943739  0.03522081  0.13144586  0.13144586  0.03522081
   0.13144586  0.49056261]
 [ 0.00943739  0.03522081  0.13144586  0.03522081  0.03522081  0.13144586
   0.49056261  0.13144586]]
 -- Basis fn derivatives @ quad pts:
 -- [[[-0.31100423 -0.31100423 -0.31100423]
  [ 0.31100423 -0.08333333 -0.08333333]
  [ 0.08333333  0.08333333 -0.0223291 ]
  [-0.08333333  0.31100423 -0.08333333]
  [-0.08333333 -0.08333333  0.31100423]
  [ 0.08333333 -0.0223291   0.08333333]
  [ 0.0223291   0.0223291   0.0223291 ]
  [-0.0223291   0.08333333  0.08333333]]

 [[-0.31100423 -0.08333333 -0.08333333]
  [ 0.31100423 -0.31100423 -0.31100423]
  [ 0.08333333  0.31100423 -0.08333333]
  [-0.08333333  0.08333333 -0.0223291 ]
  [-0.08333333 -0.0223291   0.08333333]
  [ 0.08333333 -0.08333333  0.31100423]
  [ 0.0223291   0.08333333  0.08333333]
  [-0.0223291   0.0223291   0.0223291 ]]

 [[-0.08333333 -0.31100423 -0.08333333]
  [ 0.08333333 -0.08333333 -0.0223291 ]
  [ 0.31100423  0.08333333 -0.08333333]
  [-0.31100423  0.31100423 -0.31100423]
  [-0.0223291  -0.08333333  0.08333333]
  [ 0.0223291  -0.0223291   0.0223291 ]
  [ 0.08333333  0.0223291   0.08333333]
  [-0.08333333  0.08333333  0.31100423]]

 [[-0.08333333 -0.08333333 -0.0223291 ]
  [ 0.08333333 -0.31100423 -0.08333333]
  [ 0.31100423  0.31100423 -0.31100423]
  [-0.31100423  0.08333333 -0.08333333]
  [-0.0223291  -0.0223291   0.0223291 ]
  [ 0.0223291  -0.08333333  0.08333333]
  [ 0.08333333  0.08333333  0.31100423]
  [-0.08333333  0.0223291   0.08333333]]

 [[-0.08333333 -0.08333333 -0.31100423]
  [ 0.08333333 -0.0223291  -0.08333333]
  [ 0.0223291   0.0223291  -0.0223291 ]
  [-0.0223291   0.08333333 -0.08333333]
  [-0.31100423 -0.31100423  0.31100423]
  [ 0.31100423 -0.08333333  0.08333333]
  [ 0.08333333  0.08333333  0.0223291 ]
  [-0.08333333  0.31100423  0.08333333]]

 [[-0.08333333 -0.0223291  -0.08333333]
  [ 0.08333333 -0.08333333 -0.31100423]
  [ 0.0223291   0.08333333 -0.08333333]
  [-0.0223291   0.0223291  -0.0223291 ]
  [-0.31100423 -0.08333333  0.08333333]
  [ 0.31100423 -0.31100423  0.31100423]
  [ 0.08333333  0.31100423  0.08333333]
  [-0.08333333  0.08333333  0.0223291 ]]

 [[-0.0223291  -0.08333333 -0.08333333]
  [ 0.0223291  -0.0223291  -0.0223291 ]
  [ 0.08333333  0.0223291  -0.08333333]
  [-0.08333333  0.08333333 -0.31100423]
  [-0.08333333 -0.31100423  0.08333333]
  [ 0.08333333 -0.08333333  0.0223291 ]
  [ 0.31100423  0.08333333  0.08333333]
  [-0.31100423  0.31100423  0.31100423]]

 [[-0.0223291  -0.0223291  -0.0223291 ]
  [ 0.0223291  -0.08333333 -0.08333333]
  [ 0.08333333  0.08333333 -0.31100423]
  [-0.08333333  0.0223291  -0.08333333]
  [-0.08333333 -0.08333333  0.0223291 ]
  [ 0.08333333 -0.31100423  0.08333333]
  [ 0.31100423  0.31100423  0.31100423]
  [-0.31100423  0.08333333  0.08333333]]]
 >> /scylla-a/home/hyang/cig/pylith171/lib/python2.7/site-packages/pylith/problems/Formulation.py:403:_setupMaterials
 -- implicit(info)
 -- Added elasticity integrator for material 'Lower crust material'.
 >> /scylla-a/home/hyang/cig/pylith171/lib/python2.7/site-packages/pylith/feassemble/FIATLagrange.py:407:initialize
 -- fiatlagrange(info)
 -- Cell geometry: 
 -- <pylith.feassemble.CellGeometry.GeometryHex3D; proxy of <Swig Object of type 'pylith::feassemble::GeometryHex3D *' at 0x2abed96ba150> >
 -- Vertices: 
 -- [[-1. -1. -1.]
 [ 1. -1. -1.]
 [ 1.  1. -1.]
 [-1.  1. -1.]
 [-1. -1.  1.]
 [ 1. -1.  1.]
 [ 1.  1.  1.]
 [-1.  1.  1.]]
 -- Quad pts:
 -- [[-0.57735027 -0.57735027 -0.57735027]
 [ 0.57735027 -0.57735027 -0.57735027]
 [-0.57735027  0.57735027 -0.57735027]
 [ 0.57735027  0.57735027 -0.57735027]
 [-0.57735027 -0.57735027  0.57735027]
 [ 0.57735027 -0.57735027  0.57735027]
 [-0.57735027  0.57735027  0.57735027]
 [ 0.57735027  0.57735027  0.57735027]]
 -- Quad wts:
 -- [ 1.  1.  1.  1.  1.  1.  1.  1.]
 -- Basis fns @ quad pts ):
 -- [[ 0.49056261  0.13144586  0.03522081  0.13144586  0.13144586  0.03522081
   0.00943739  0.03522081]
 [ 0.13144586  0.49056261  0.13144586  0.03522081  0.03522081  0.13144586
   0.03522081  0.00943739]
 [ 0.13144586  0.03522081  0.13144586  0.49056261  0.03522081  0.00943739
   0.03522081  0.13144586]
 [ 0.03522081  0.13144586  0.49056261  0.13144586  0.00943739  0.03522081
   0.13144586  0.03522081]
 [ 0.13144586  0.03522081  0.00943739  0.03522081  0.49056261  0.13144586
   0.03522081  0.13144586]
 [ 0.03522081  0.13144586  0.03522081  0.00943739  0.13144586  0.49056261
   0.13144586  0.03522081]
 [ 0.03522081  0.00943739  0.03522081  0.13144586  0.13144586  0.03522081
   0.13144586  0.49056261]
 [ 0.00943739  0.03522081  0.13144586  0.03522081  0.03522081  0.13144586
   0.49056261  0.13144586]]
 -- Basis fn derivatives @ quad pts:
 -- [[[-0.31100423 -0.31100423 -0.31100423]
  [ 0.31100423 -0.08333333 -0.08333333]
  [ 0.08333333  0.08333333 -0.0223291 ]
  [-0.08333333  0.31100423 -0.08333333]
  [-0.08333333 -0.08333333  0.31100423]
  [ 0.08333333 -0.0223291   0.08333333]
  [ 0.0223291   0.0223291   0.0223291 ]
  [-0.0223291   0.08333333  0.08333333]]

 [[-0.31100423 -0.08333333 -0.08333333]
  [ 0.31100423 -0.31100423 -0.31100423]
  [ 0.08333333  0.31100423 -0.08333333]
  [-0.08333333  0.08333333 -0.0223291 ]
  [-0.08333333 -0.0223291   0.08333333]
  [ 0.08333333 -0.08333333  0.31100423]
  [ 0.0223291   0.08333333  0.08333333]
  [-0.0223291   0.0223291   0.0223291 ]]

 [[-0.08333333 -0.31100423 -0.08333333]
  [ 0.08333333 -0.08333333 -0.0223291 ]
  [ 0.31100423  0.08333333 -0.08333333]
  [-0.31100423  0.31100423 -0.31100423]
  [-0.0223291  -0.08333333  0.08333333]
  [ 0.0223291  -0.0223291   0.0223291 ]
  [ 0.08333333  0.0223291   0.08333333]
  [-0.08333333  0.08333333  0.31100423]]

 [[-0.08333333 -0.08333333 -0.0223291 ]
  [ 0.08333333 -0.31100423 -0.08333333]
  [ 0.31100423  0.31100423 -0.31100423]
  [-0.31100423  0.08333333 -0.08333333]
  [-0.0223291  -0.0223291   0.0223291 ]
  [ 0.0223291  -0.08333333  0.08333333]
  [ 0.08333333  0.08333333  0.31100423]
  [-0.08333333  0.0223291   0.08333333]]

 [[-0.08333333 -0.08333333 -0.31100423]
  [ 0.08333333 -0.0223291  -0.08333333]
  [ 0.0223291   0.0223291  -0.0223291 ]
  [-0.0223291   0.08333333 -0.08333333]
  [-0.31100423 -0.31100423  0.31100423]
  [ 0.31100423 -0.08333333  0.08333333]
  [ 0.08333333  0.08333333  0.0223291 ]
  [-0.08333333  0.31100423  0.08333333]]

 [[-0.08333333 -0.0223291  -0.08333333]
  [ 0.08333333 -0.08333333 -0.31100423]
  [ 0.0223291   0.08333333 -0.08333333]
  [-0.0223291   0.0223291  -0.0223291 ]
  [-0.31100423 -0.08333333  0.08333333]
  [ 0.31100423 -0.31100423  0.31100423]
  [ 0.08333333  0.31100423  0.08333333]
  [-0.08333333  0.08333333  0.0223291 ]]

 [[-0.0223291  -0.08333333 -0.08333333]
  [ 0.0223291  -0.0223291  -0.0223291 ]
  [ 0.08333333  0.0223291  -0.08333333]
  [-0.08333333  0.08333333 -0.31100423]
  [-0.08333333 -0.31100423  0.08333333]
  [ 0.08333333 -0.08333333  0.0223291 ]
  [ 0.31100423  0.08333333  0.08333333]
  [-0.31100423  0.31100423  0.31100423]]

 [[-0.0223291  -0.0223291  -0.0223291 ]
  [ 0.0223291  -0.08333333 -0.08333333]
  [ 0.08333333  0.08333333 -0.31100423]
  [-0.08333333  0.0223291  -0.08333333]
  [-0.08333333 -0.08333333  0.0223291 ]
  [ 0.08333333 -0.31100423  0.08333333]
  [ 0.31100423  0.31100423  0.31100423]
  [-0.31100423  0.08333333  0.08333333]]]
 >> /scylla-a/home/hyang/cig/pylith171/lib/python2.7/site-packages/pylith/problems/Formulation.py:403:_setupMaterials
 -- implicit(info)
 -- Added elasticity integrator for material 'Upper crust material'.
 >> /scylla-a/home/hyang/cig/pylith171/lib/python2.7/site-packages/pylith/problems/Formulation.py:419:_setupBC
 -- implicit(info)
 -- Pre-initializing boundary conditions.
 >> /scylla-a/home/hyang/cig/pylith171/lib/python2.7/site-packages/pylith/problems/Formulation.py:438:_setupBC
 -- implicit(info)
 -- Added boundary condition 'face_zneg' as a constraint.
 >> /scylla-a/home/hyang/cig/pylith171/lib/python2.7/site-packages/pylith/problems/Formulation.py:438:_setupBC
 -- implicit(info)
 -- Added boundary condition 'face_xneg' as a constraint.
 >> /scylla-a/home/hyang/cig/pylith171/lib/python2.7/site-packages/pylith/problems/Formulation.py:438:_setupBC
 -- implicit(info)
 -- Added boundary condition 'face_xpos' as a constraint.
 >> /scylla-a/home/hyang/cig/pylith171/lib/python2.7/site-packages/pylith/problems/Formulation.py:458:_setupInterfaces
 -- implicit(info)
 -- Pre-initializing interior interfaces.
 >> /scylla-a/home/hyang/cig/pylith171/lib/python2.7/site-packages/pylith/problems/Formulation.py:187:preinitialize
 -- implicit(info)
 -- Pre-initializing output.
 >> /scylla-a/home/hyang/cig/pylith171/lib/python2.7/site-packages/pylith/problems/Problem.py:150:verifyConfiguration
 -- timedependent(info)
 -- Verifying compatibility of problem configuration.
 >> /scylla-a/home/hyang/cig/pylith171/lib/python2.7/site-packages/pylith/problems/TimeDependent.py:117:initialize
 -- timedependent(info)
 -- Initializing problem.
 >> /scylla-a/home/hyang/cig/pylith171/lib/python2.7/site-packages/pylith/problems/Formulation.py:499:_initialize
 -- implicit(info)
 -- Initializing integrators.
 >> /scylla-a/home/hyang/cig/pylith171/lib/python2.7/site-packages/pylith/problems/Formulation.py:509:_initialize
 -- implicit(info)
 -- Initializing constraints.
 >> /scylla-a/home/hyang/cig/pylith171/lib/python2.7/site-packages/pylith/problems/Formulation.py:515:_initialize
 -- implicit(info)
 -- Setting up solution output.
 >> /scylla-a/home/hyang/cig/pylith171/lib/python2.7/site-packages/pylith/problems/Formulation.py:524:_initialize
 -- implicit(info)
 -- Creating solution field.
 >> /scylla-a/home/hyang/cig/pylith171/lib/python2.7/site-packages/pylith/problems/Implicit.py:136:initialize
 -- implicit(info)
 -- Creating other fields.
 >> /scylla-a/home/hyang/cig/pylith171/lib/python2.7/site-packages/pylith/problems/Implicit.py:159:initialize
 -- implicit(info)
 -- Creating Jacobian matrix.
 >> /scylla-a/home/hyang/cig/pylith171/lib/python2.7/site-packages/pylith/problems/Implicit.py:169:initialize
 -- implicit(info)
 -- Initializing solver.
 >> /scylla-a/home/hyang/cig/pylith171/lib/python2.7/site-packages/pylith/problems/TimeDependent.py:131:run
 -- timedependent(info)
 -- Solving problem.
 >> /scylla-a/home/hyang/cig/pylith171/lib/python2.7/site-packages/pylith/problems/TimeDependent.py:137:run
 -- timedependent(info)
 -- Preparing for prestep with elastic behavior.
 >> /scylla-a/home/hyang/cig/pylith171/lib/python2.7/site-packages/pylith/problems/Implicit.py:266:prestepElastic
 -- implicit(info)
 -- Setting constraints.
 >> /scylla-a/home/hyang/cig/pylith171/lib/python2.7/site-packages/pylith/problems/Formulation.py:581:_reformJacobian
 -- implicit(info)
 -- Integrating Jacobian operator.
 >> /scylla-a/home/hyang/cig/pylith171/lib/python2.7/site-packages/pylith/problems/TimeDependent.py:152:run
 -- timedependent(info)
 -- Computing prestep with elastic behavior.
 >> /scylla-a/home/hyang/cig/pylith171/lib/python2.7/site-packages/pylith/problems/Formulation.py:606:_reformResidual
 -- implicit(info)
 -- Integrating residual term in operator.
 >> /scylla-a/home/hyang/cig/pylith171/lib/python2.7/site-packages/pylith/problems/Implicit.py:215:step
 -- implicit(info)
 -- Solving equations.
  0 KSP Residual norm 9.407412029880e-03 
  1 KSP Residual norm 2.914710512470e-03 
  2 KSP Residual norm 1.025274542494e-03 
  3 KSP Residual norm 3.476338814158e-04 
  4 KSP Residual norm 1.664113536125e-04 
  5 KSP Residual norm 6.884406193923e-05 
  6 KSP Residual norm 3.378944960723e-05 
  7 KSP Residual norm 1.351472089493e-05 
  8 KSP Residual norm 6.389725364800e-06 
  9 KSP Residual norm 2.881966429854e-06 
 10 KSP Residual norm 1.248895545186e-06 
 11 KSP Residual norm 7.428011460736e-07 
 12 KSP Residual norm 3.180891306769e-07 
 13 KSP Residual norm 1.434749247361e-07 
 14 KSP Residual norm 6.602249522350e-08 
 15 KSP Residual norm 2.478701330716e-08 
 16 KSP Residual norm 6.774344497549e-09 
 17 KSP Residual norm 2.329015910043e-09 
 18 KSP Residual norm 1.108837299769e-09 
 19 KSP Residual norm 4.099094643302e-10 
 20 KSP Residual norm 1.032051866744e-10 
 21 KSP Residual norm 3.014019292587e-11 
 22 KSP Residual norm 8.247159872306e-12 
 23 KSP Residual norm 2.232687155789e-12 
 24 KSP Residual norm 6.795912110314e-13 
Linear solve converged due to CONVERGED_RTOL iterations 24
 >> /scylla-a/home/hyang/cig/pylith171/lib/python2.7/site-packages/pylith/problems/TimeDependent.py:158:run
 -- timedependent(info)
 -- Finishing prestep with elastic behavior.
 >> /scylla-a/home/hyang/cig/pylith171/lib/python2.7/site-packages/pylith/problems/Implicit.py:250:poststep
 -- implicit(info)
 -- Writing solution fields.
 >> /scylla-a/home/hyang/cig/pylith171/lib/python2.7/site-packages/pylith/problems/Formulation.py:299:finalize
 -- implicit(info)
 -- Formulation finalize.
 >> /scylla-a/home/hyang/cig/pylith171/lib/python2.7/site-packages/pylith/utils/PetscManager.py:75:finalize
 -- petsc(info)
 -- Finalizing PETSc.
************************************************************************************************************************
***             WIDEN YOUR WINDOW TO 120 CHARACTERS.  Use 'enscript -r -fCourier9' to print this document            ***
************************************************************************************************************************

---------------------------------------------- PETSc Performance Summary: ----------------------------------------------

/scylla-a/home/hyang/cig/pylith171/bin/mpinemesis on a arch-linu named scylla070 with 12 processors, by hyang Tue Jun 19 19:12:16 2012
Using Petsc Development HG revision: 3bede28f1195e406d4257c9fbeebefe827793801  HG Date: Mon Jun 11 22:14:12 2012 -0400

                         Max       Max/Min        Avg      Total 
Time (sec):           1.431e+00      1.00790   1.423e+00
Objects:              9.700e+01      1.00000   9.700e+01
Flops:                2.286e+06      1.69762   1.685e+06  2.022e+07
Flops/sec:            1.603e+06      1.69015   1.184e+06  1.420e+07
MPI Messages:         1.424e+03      2.87867   7.736e+02  9.283e+03
MPI Message Lengths:  3.808e+05      4.01432   2.378e+02  2.207e+06
MPI Reductions:       1.840e+02      1.00000

Flop counting convention: 1 flop = 1 real number operation of type (multiply/divide/add/subtract)
                            e.g., VecAXPY() for real vectors of length N --> 2N flops
                            and VecAXPY() for complex vectors of length N --> 8N flops

Summary of Stages:   ----- Time ------  ----- Flops -----  --- Messages ---  -- Message Lengths --  -- Reductions --
                        Avg     %Total     Avg     %Total   counts   %Total     Avg         %Total   counts   %Total 
 0:      Main Stage: 1.3612e-01   9.6%  0.0000e+00   0.0%  0.000e+00   0.0%  0.000e+00        0.0%  0.000e+00   0.0% 
 1:         Meshing: 7.1151e-02   5.0%  0.0000e+00   0.0%  5.170e+02   5.6%  7.239e+00        3.0%  7.000e+00   3.8% 
 2:           Setup: 9.1157e-01  64.0%  4.0666e+05   2.0%  1.958e+03  21.1%  9.253e+00        3.9%  5.700e+01  31.0% 
 3: Reform Jacobian: 2.1845e-02   1.5%  1.2572e+07  62.2%  7.050e+02   7.6%  3.533e+01       14.9%  2.100e+01  11.4% 
 4: Reform Residual: 2.1523e-02   1.5%  5.4514e+05   2.7%  3.850e+02   4.1%  2.869e+00        1.2%  0.000e+00   0.0% 
 5:           Solve: 2.0877e-02   1.5%  5.8714e+06  29.0%  5.074e+03  54.7%  1.782e+02       74.9%  8.100e+01  44.0% 
 6:         Prestep: 3.4110e-02   2.4%  0.0000e+00   0.0%  0.000e+00   0.0%  0.000e+00        0.0%  0.000e+00   0.0% 
 7:            Step: 1.7692e-02   1.2%  0.0000e+00   0.0%  0.000e+00   0.0%  0.000e+00        0.0%  0.000e+00   0.0% 
 8:        Poststep: 1.1840e-01   8.3%  8.2138e+05   4.1%  6.440e+02   6.9%  4.935e+00        2.1%  1.700e+01   9.2% 
 9:        Finalize: 6.9916e-02   4.9%  0.0000e+00   0.0%  0.000e+00   0.0%  0.000e+00        0.0%  0.000e+00   0.0% 

------------------------------------------------------------------------------------------------------------------------
See the 'Profiling' chapter of the users' manual for details on interpreting output.
Phase summary info:
   Count: number of times phase was executed
   Time and Flops: Max - maximum over all processors
                   Ratio - ratio of maximum to minimum over all processors
   Mess: number of messages sent
   Avg. len: average message length
   Reduct: number of global reductions
   Global: entire computation
   Stage: stages of a computation. Set stages with PetscLogStagePush() and PetscLogStagePop().
      %T - percent time in this phase         %f - percent flops in this phase
      %M - percent messages in this phase     %L - percent message lengths in this phase
      %R - percent reductions in this phase
   Total Mflop/s: 10e-6 * (sum of flops over all processors)/(max time over all processors)
------------------------------------------------------------------------------------------------------------------------
Event                Count      Time (sec)     Flops                             --- Global ---  --- Stage ---   Total
                   Max Ratio  Max     Ratio   Max  Ratio  Mess   Avg len Reduct  %T %f %M %L %R  %T %f %M %L %R Mflop/s
------------------------------------------------------------------------------------------------------------------------

--- Event Stage 0: Main Stage


--- Event Stage 1: Meshing

MeIm create            1 1.0 5.5091e-02 1.0 0.00e+00 0.0 5.2e+02 1.3e+02 7.0e+00  4  0  6  3  4  77  0100100100     0
MeIm adjTopo           1 1.0 4.1008e-05 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
Dist distribute        2 2.0 2.1087e-02307.1 0.00e+00 0.0 2.6e+02 1.2e+02 5.8e-01  0  0  3  1  0   3  0 50 47  8     0
DistributeMesh         1 1.0 2.1116e-02 5.4 0.00e+00 0.0 3.0e+02 1.4e+02 6.4e+00  1  0  3  2  3  24  0 59 62 92     0
PartitionCreate        1 1.0 4.1740e-0312.5 0.00e+00 0.0 4.4e+01 1.4e+02 0.0e+00  0  0  0  0  0   4  0  9  9  0     0
PartitionClosure       1 1.0 4.2701e-04 8.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
stratify               1 1.0 2.6941e-05 9.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
Refin refine           1 1.0 5.0068e-06 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0

--- Event Stage 2: Setup

PetscBarrier           1 1.0 8.9097e-04 1.1 0.00e+00 0.0 6.6e+01 3.6e+01 7.0e+00  0  0  1  0  4   0  0  3  3 12     0
Dist distribute        1 0.0 1.0991e-04 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
stratify               1 0.0 9.0837e-05 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
TSIm preinit           1 1.0 5.7169e-01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 39  0  0  0  0  61  0  0  0  0     0
TSIm verify            1 1.0 1.1461e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
DtUn preinit           1 1.0 6.9141e-06 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
DtUn verify            1 1.0 7.1526e-06 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
DtUn init              1 1.0 4.2915e-05 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
ElIm verify            1 1.0 2.7394e-04 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
ElIm init              1 1.0 7.1621e-02 3.4 3.39e+04 0.0 6.4e+02 2.3e+01 1.3e+01  2  1  7  1  7   3 50 33 17 23     3
MaEl3D verify          1 1.0 4.3869e-05 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
OutM init              1 1.0 4.4451e-0310.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
OutM open              2 1.0 3.8021e-0332.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
OutM writeInfo         1 1.0 6.2560e-02 8.1 1.73e+03 0.0 6.4e+02 2.3e+01 1.3e+01  1  0  7  1  7   2  3 33 17 23     0
ElIm verify            1 1.0 1.3995e-04 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
ElIm init              1 1.0 5.5864e-02 1.3 3.39e+04 0.0 3.7e+02 2.7e+01 1.2e+01  4  1  4  0  7   6 50 19 12 21     4
MaEl3D verify          1 1.0 2.1935e-05 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
OutM init              1 1.0 3.8195e-04 1.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
OutM open              2 1.0 1.3018e-04 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
OutM writeInfo         1 1.0 5.4690e-02 1.3 1.73e+03 0.0 3.7e+02 2.7e+01 1.2e+01  4  0  4  0  7   6  3 19 12 21     0
DiBC verify            1 1.0 2.5988e-05 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
DiBC init              1 1.0 1.3304e-04 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
DiBC verify            1 1.0 7.8678e-06 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
DiBC init              1 1.0 2.3148e-03 4.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
DiBC verify            1 1.0 6.9141e-06 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
DiBC init              1 1.0 1.8470e-03 4.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
OutM init              1 1.0 4.8399e-04 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
OutM open              1 1.0 1.2803e-04 1.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
OutM writeInfo         1 1.0 1.9073e-05 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
OutM init              1 1.0 2.9903e-0223.1 0.00e+00 0.0 0.0e+00 0.0e+00 7.0e+00  2  0  0  0  4   3  0  0  1 12     0
OutM open              1 1.0 8.1062e-05 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
OutM writeInfo         1 1.0 8.1062e-06 2.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
MatZeroEntries         1 1.0 2.0981e-05 5.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0

--- Event Stage 3: Reform Jacobian

PetscBarrier          12 1.0 3.4881e-04 3.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   1  0  0  0  0     0
ElIJ setup             1 1.0 5.9450e-0321.9 0.00e+00 0.0 2.6e+02 2.5e+01 1.0e+00  0  0  3  0  1  18  0 37  2  5     0
ElIJ compute           1 1.0 4.9806e-04261.1 1.05e+06 0.0 0.0e+00 0.0e+00 0.0e+00  0 31  0  0  0   1 50  0  0  0 12621
ElIJ setup             1 1.0 4.0531e-06 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
ElIJ compute           1 1.0 5.8699e-04615.5 1.05e+06 0.0 0.0e+00 0.0e+00 0.0e+00  0 31  0  0  0   1 50  0  0  0 10709
VecSet                 1 1.0 6.2943e-0566.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
MatAssemblyBegin       1 1.0 5.2118e-04 2.0 0.00e+00 0.0 9.9e+01 3.1e+03 3.0e+00  0  0  1 14  2   2  0 14 93 14     0
MatAssemblyEnd         1 1.0 1.6941e-02 1.8 0.00e+00 0.0 3.4e+02 5.0e+01 1.7e+01  1  0  4  1  9  75  0 49  5 81     0
MatZeroEntries         1 1.0 1.3828e-05 4.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0

--- Event Stage 4: Reform Residual

ElIR setup             1 1.0 8.8215e-06 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
ElIR compute           1 1.0 7.5102e-05 0.0 4.53e+04 0.0 0.0e+00 0.0e+00 0.0e+00  0  1  0  0  0   0 50  0  0  0  3620
ElIR setup             1 1.0 4.0531e-06 4.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
ElIR compute           1 1.0 7.5102e-05 0.0 4.53e+04 0.0 0.0e+00 0.0e+00 0.0e+00  0  1  0  0  0   0 50  0  0  0  3620
VecScatterBegin        1 1.0 3.1948e-05 3.2 0.00e+00 0.0 3.3e+01 1.4e+02 0.0e+00  0  0  0  0  0   0  0  9 17  0     0
VecScatterEnd          1 1.0 3.6001e-05 8.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0

--- Event Stage 5: Solve

VecMDot               24 1.0 9.5868e-04 4.5 5.97e+04 6.4 0.0e+00 0.0e+00 2.4e+01  0  2  0  0 13   3  6  0  0 30   338
VecNorm               25 1.0 4.9090e-04 2.3 5.00e+03 6.2 0.0e+00 0.0e+00 2.5e+01  0  0  0  0 14   2  0  0  0 31    56
VecScale              25 1.0 1.5736e-05 2.1 2.50e+03 6.2 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0   867
VecCopy                1 1.0 2.1458e-06 2.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
VecSet               126 1.0 2.9087e-05 1.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
VecAXPY                1 1.0 1.9073e-06 0.0 2.00e+02 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0   573
VecMAXPY              25 1.0 4.5538e-05 2.7 6.48e+04 6.2 0.0e+00 0.0e+00 0.0e+00  0  2  0  0  0   0  6  0  0  0  7770
VecScatterBegin       76 1.0 3.5453e-04 2.3 0.00e+00 0.0 4.0e+03 1.2e+02 0.0e+00  0  0 43 22  0   1  0 79 30  0     0
VecScatterEnd         76 1.0 1.4641e-0213.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0  17  0  0  0  0     0
VecNormalize          25 1.0 6.1250e-04 2.4 7.50e+03 6.2 0.0e+00 0.0e+00 2.5e+01  0  0  0  0 14   2  1  0  0 31    67
MatMult               24 1.0 1.0839e-03 1.6 3.68e+0532.5 1.9e+03 1.2e+02 0.0e+00  0  7 21 10  0   4 23 38 14  0  1265
MatSolve              25 1.0 5.0378e-04 4.3 5.90e+05 5.0 0.0e+00 0.0e+00 0.0e+00  0 19  0  0  0   1 64  0  0  0  7499
MatCholFctrNum         1 1.0 2.8706e-04 6.4 2.47e+02 3.1 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   1  0  0  0  0     6
MatICCFactorSym        1 1.0 1.5020e-05 1.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
MatAssemblyBegin       2 1.0 1.1921e-06 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
MatAssemblyEnd         2 1.0 2.8849e-05 2.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
MatGetRowIJ            1 1.0 1.1921e-06 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
MatGetSubMatrice       1 1.0 9.1887e-04 2.4 0.00e+00 0.0 4.0e+02 1.1e+03 6.0e+00  0  0  4 21  3   3  0  8 28  7     0
MatGetOrdering         1 1.0 1.0967e-05 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 2.0e+00  0  0  0  0  1   0  0  0  0  2     0
MatIncreaseOvrlp       1 1.0 2.5442e-03 1.0 0.00e+00 0.0 5.3e+02 1.3e+03 1.0e+01  0  0  6 32  5  12  0 10 42 12     0
SoLi setup             1 1.0 1.4588e-02364.2 0.00e+00 0.0 0.0e+00 0.0e+00 1.0e+00  1  0  0  0  1  51  0  0  0  1     0
SoLi solve             1 1.0 7.7760e-03 1.0 1.09e+06 7.2 5.0e+03 3.3e+02 8.0e+01  1 29 54 75 43  37100 99 99 99   755
SoLi scatter           2 1.0 1.3719e-02298.1 0.00e+00 0.0 6.6e+01 1.4e+02 0.0e+00  0  0  1  0  0  12  0  1  1  0     0
KSPGMRESOrthog        24 1.0 1.0946e-03 2.2 1.20e+05 6.3 0.0e+00 0.0e+00 2.4e+01  0  3  0  0 13   4 11  0  0 30   595
KSPSetUp               2 1.0 7.7009e-05 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
KSPSolve               1 1.0 7.7560e-03 1.0 1.09e+06 7.2 5.0e+03 3.3e+02 8.0e+01  1 29 54 75 43  37100 99 99 99   757
PCSetUp                2 1.0 4.3619e-03 1.2 2.47e+02 3.1 1.1e+03 1.1e+03 3.1e+01  0  0 12 53 17  19  0 21 70 38     0
PCSetUpOnBlocks        1 1.0 3.4308e-04 3.6 2.47e+02 3.1 0.0e+00 0.0e+00 4.0e+00  0  0  0  0  2   1  0  0  0  5     5
PCApply               25 1.0 1.6618e-03 1.4 5.90e+05 5.0 2.0e+03 1.3e+02 0.0e+00  0 19 22 11  0   7 64 39 15  0  2273

--- Event Stage 6: Prestep

TSIm timestep          1 1.0 5.5075e-05 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0

--- Event Stage 7: Step


--- Event Stage 8: Poststep

TSIm poststep          1 1.0 8.8930e-05 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
TSIm write             1 1.0 8.2577e-02 1.1 6.84e+04 1.0 1.8e+02 1.6e+02 8.0e+00  5  4  2  1  4  64100 27 60 47    10
ElIm poststep          1 1.0 2.5034e-05 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
ElIm write             1 1.0 4.0238e-02 1.2 6.84e+04 0.0 8.8e+01 1.6e+02 4.0e+00  2  2  1  1  2  30 50 14 32 24    10
OutM writeData         1 1.0 4.0198e-02 1.2 6.84e+04 0.0 8.8e+01 1.6e+02 4.0e+00  2  2  1  1  2  30 50 14 32 24    10
ElIm poststep          1 1.0 6.9141e-06 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
ElIm write             1 1.0 4.2293e-02 1.0 6.84e+04 0.0 8.8e+01 1.5e+02 4.0e+00  3  2  1  1  2  34 50 14 28 24    10
OutM writeData         1 1.0 4.2250e-02 1.0 6.84e+04 0.0 8.8e+01 1.5e+02 4.0e+00  3  2  1  1  2  34 50 14 28 24    10
OutM writeData         1 1.0 3.6604e-02 7.3 0.00e+00 0.0 3.3e+02 4.8e+01 4.0e+00  1  0  4  1  2   6  0 51 34 24     0
OutM writeData         1 1.0 3.4658e-02 1.0 0.00e+00 0.0 1.4e+02 1.9e+01 5.0e+00  2  0  1  0  3  29  0 21  6 29     0

--- Event Stage 9: Finalize

TSIm finalize          1 1.0 7.3015e-02 1.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  5  0  0  0  0 100  0  0  0  0     0
OutM close             1 1.0 3.6955e-05 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
OutM close             1 1.0 1.2875e-05 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
OutM close             1 1.0 3.1948e-05 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
OutM close             1 1.0 2.5988e-05 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
------------------------------------------------------------------------------------------------------------------------

Memory usage is given in bytes:

Object Type          Creations   Destructions     Memory  Descendants' Mem.
Reports information only for process 0.

--- Event Stage 0: Main Stage

              Vector     0             55       123832     0
      Vector Scatter     0              4         4240     0
           Index Set     0              2         3480     0
              Matrix     0              5       237942     0
       Krylov Solver     0              2        46656     0
      Preconditioner     0              2         1792     0

--- Event Stage 1: Meshing


--- Event Stage 2: Setup

              Viewer     3              2         1440     0
              Vector    10              2         3744     0
      Vector Scatter     1              0            0     0
           Index Set     2              2         1504     0
              Matrix     3              0            0     0
       Krylov Solver     1              0            0     0
      Preconditioner     1              0            0     0

--- Event Stage 3: Reform Jacobian

              Vector     7              1         1504     0
      Vector Scatter     2              0            0     0
           Index Set     4              4         6536     0

--- Event Stage 4: Reform Residual


--- Event Stage 5: Solve

              Vector    38              1         2304     0
      Vector Scatter     1              0            0     0
           Index Set    11              9         8720     0
              Matrix     3              1        36356     0
       Krylov Solver     1              0            0     0
      Preconditioner     1              0            0     0

--- Event Stage 6: Prestep


--- Event Stage 7: Step


--- Event Stage 8: Poststep

              Viewer     4              4         2880     0
              Vector     4              0            0     0

--- Event Stage 9: Finalize

========================================================================================================================
Average time to get PetscTime(): 0
Average time for MPI_Barrier(): 5.76973e-06
Average time for zero size MPI_Send(): 1.33117e-06
#PETSc Option Table entries:
-ksp_atol 1.0e-20
-ksp_converged_reason
-ksp_gmres_restart 50
-ksp_max_it 100
-ksp_monitor
-ksp_rtol 1.0e-10
-linesearch_monitor
-log_summary
-pc_type asm
-snes_atol 1.0e-9
-snes_converged_reason
-snes_max_it 100
-snes_monitor
-snes_rtol 1.0e-10
-sub_pc_factor_shift_type nonzero
#End of PETSc Option Table entries
Compiled without FORTRAN kernels
Compiled with full precision matrices (default)
sizeof(short) 2 sizeof(int) 4 sizeof(long) 8 sizeof(void*) 8 sizeof(PetscScalar) 8 sizeof(PetscInt) 4
Configure run at: Tue Jun 19 18:23:39 2012
Configure options: --prefix=/scylla-a/home/hyang/cig/pylith171 --with-c2html=0 --with-x=0 --CXXFLAGS=-DMPICH_IGNORE_CXX_SEEK --with-clanguage=C++ --with-mpicompilers=1 --with-debugging=0 --with-shared-libraries=1 --with-sieve=1 --download-boost=1 --download-chaco=1 --download-ml=1 --download-f-blas-lapack=1 --with-hdf5=1 --with-hdf5-include=/scylla-a/home/hyang/cig/pylith171/include --with-hdf5-lib=/scylla-a/home/hyang/cig/pylith171/lib/libhdf5.dylib --LIBS=-lz CPPFLAGS="-I/scylla-a/home/hyang/cig/pylith171/include " LDFLAGS="-L/scylla-a/home/hyang/cig/pylith171/lib " PETSC_DIR=/scylla-a/home/hyang/cig/build/petsc-dev
-----------------------------------------
Libraries compiled on Tue Jun 19 18:23:39 2012 on scylla-b 
Machine characteristics: Linux-2.6.32-41-server-x86_64-with-debian-squeeze-sid
Using PETSc directory: /scylla-a/home/hyang/cig/build/petsc-dev
Using PETSc arch: arch-linux2-cxx-opt
-----------------------------------------

Using C compiler: mpicxx -DMPICH_IGNORE_CXX_SEEK -O   -fPIC  -I/scylla-a/home/hyang/cig/pylith171/include ${COPTFLAGS} ${CFLAGS}
Using Fortran compiler: mpif90  -fPIC -Wall -Wno-unused-variable -O  -I/scylla-a/home/hyang/cig/pylith171/include ${FOPTFLAGS} ${FFLAGS} -I/scylla-a/home/hyang/cig/pylith171/include
-----------------------------------------

Using include paths: -I/scylla-a/home/hyang/cig/build/petsc-dev/arch-linux2-cxx-opt/include -I/scylla-a/home/hyang/cig/build/petsc-dev/include -I/scylla-a/home/hyang/cig/build/petsc-dev/include -I/scylla-a/home/hyang/cig/build/petsc-dev/arch-linux2-cxx-opt/include -I/scylla-a/home/hyang/cig/build/petsc-dev/include/sieve -I/scylla-a/home/hyang/cig/pylith171/include -I/usr/local/openmpi-1.4.5_gnu-4.4.3/include
-----------------------------------------

Using C linker: mpicxx
Using Fortran linker: mpif90
Using libraries: -Wl,-rpath,/scylla-a/home/hyang/cig/build/petsc-dev/arch-linux2-cxx-opt/lib -L/scylla-a/home/hyang/cig/build/petsc-dev/arch-linux2-cxx-opt/lib -lpetsc -Wl,-rpath,/scylla-a/home/hyang/cig/build/petsc-dev/arch-linux2-cxx-opt/lib -L/scylla-a/home/hyang/cig/build/petsc-dev/arch-linux2-cxx-opt/lib -lchaco -lml -lpthread -lflapack -lfblas -Wl,-rpath,/scylla-a/home/hyang/cig/pylith171/lib -L/scylla-a/home/hyang/cig/pylith171/lib -lhdf5 -Wl,-rpath,/usr/local/openmpi-1.4.5_gnu-4.4.3/lib -L/usr/local/openmpi-1.4.5_gnu-4.4.3/lib -Wl,-rpath,/usr/lib/gcc/x86_64-linux-gnu/4.4.3 -L/usr/lib/gcc/x86_64-linux-gnu/4.4.3 -Wl,-rpath,/usr/lib/x86_64-linux-gnu -L/usr/lib/x86_64-linux-gnu -lmpi_f90 -lmpi_f77 -lgfortran -lm -lm -lm -lm -lmpi_cxx -lstdc++ -lmpi_cxx -lstdc++ -ldl -lz -lmpi -lopen-rte -lopen-pal -lnsl -lutil -lgcc_s -lpthread -ldl -lz 
-----------------------------------------

[scylla070:26714] 11 more processes have sent help message help-mpi-runtime.txt / mpi_init:warn-fork
[scylla070:26714] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages
 >> /scylla-a/home/hyang/cig/pylith171/lib/python2.7/site-packages/pylith/utils/PetscManager.py:64:initialize
 -- petsc(info)
 -- Initialized PETSc.
--------------------------------------------------------------------------
An MPI process has executed an operation involving a call to the
"fork()" system call to create a child process.  Open MPI is currently
operating in a condition that could result in memory corruption or
other system errors; your MPI job may hang, crash, or produce silent
data corruption.  The use of fork() (or system() or other calls that
create child processes) is strongly discouraged.  

The process that invoked fork was:

  Local host:          scylla064 (PID 20686)
  MPI_COMM_WORLD rank: 0

If you are *absolutely sure* that your application will successfully
and correctly survive a call to fork(), you may disable this warning
by setting the mpi_warn_on_fork MCA parameter to 0.
--------------------------------------------------------------------------
[8]PETSC ERROR: ------------------------------------------------------------------------
[8]PETSC ERROR: Caught signal number 11 SEGV: Segmentation Violation, probably memory access out of range
[8]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger
[8]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind[8]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors
[8]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run 
[8]PETSC ERROR: to get more information on the crash.
[8]PETSC ERROR: --------------------- Error Message ------------------------------------
[8]PETSC ERROR: Signal received!
[8]PETSC ERROR: ------------------------------------------------------------------------
[8]PETSC ERROR: Petsc Development HG revision: 3bede28f1195e406d4257c9fbeebefe827793801  HG Date: Mon Jun 11 22:14:12 2012 -0400
[8]PETSC ERROR: See docs/changes/index.html for recent updates.
[8]PETSC ERROR: See docs/faq.html for hints about trouble shooting.
[8]PETSC ERROR: See docs/index.html for manual pages.
[8]PETSC ERROR: ------------------------------------------------------------------------
[8]PETSC ERROR: /scylla-a/home/hyang/cig/pylith171/bin/mpinemesis on a arch-linu named scylla064 by hyang Tue Jun 19 19:14:14 2012
[8]PETSC ERROR: Libraries linked from /scylla-a/home/hyang/cig/pylith171/lib
[8]PETSC ERROR: Configure run at Tue Jun 19 18:23:39 2012
[8]PETSC ERROR: Configure options --prefix=/scylla-a/home/hyang/cig/pylith171 --with-c2html=0 --with-x=0 --CXXFLAGS=-DMPICH_IGNORE_CXX_SEEK --with-clanguage=C++ --with-mpicompilers=1 --with-debugging=0 --with-shared-libraries=1 --with-sieve=1 --download-boost=1 --download-chaco=1 --download-ml=1 --download-f-blas-lapack=1 --with-hdf5=1 --with-hdf5-include=/scylla-a/home/hyang/cig/pylith171/include --with-hdf5-lib=/scylla-a/home/hyang/cig/pylith171/lib/libhdf5.dylib --LIBS=-lz CPPFLAGS="-I/scylla-a/home/hyang/cig/pylith171/include " LDFLAGS="-L/scylla-a/home/hyang/cig/pylith171/lib " PETSC_DIR=/scylla-a/home/hyang/cig/build/petsc-dev
[8]PETSC ERROR: ------------------------------------------------------------------------
[8]PETSC ERROR: User provided function() line 0 in unknown directory unknown file
 >> /scylla-a/home/hyang/cig/pylith171/lib/python2.7/site-packages/pylith/meshio/MeshIOObj.py:55:read
 -- meshiocubit(info)
 -- Reading finite-element mesh
 >> ../../../pylith-1.7.1/libsrc/pylith/meshio/MeshIOCubit.cc:142:<unknown>
 -- meshiocubit(info)
 -- Reading 245 vertices.
 >> ../../../pylith-1.7.1/libsrc/pylith/meshio/MeshIOCubit.cc:197:<unknown>
 -- meshiocubit(info)
 -- Reading 144 cells in 2 blocks.
 >> ../../../pylith-1.7.1/libsrc/pylith/meshio/MeshIOCubit.cc:257:<unknown>
 -- meshiocubit(info)
 -- Found 8 node sets.
 >> ../../../pylith-1.7.1/libsrc/pylith/meshio/MeshIOCubit.cc:285:<unknown>
 -- meshiocubit(info)
 -- Reading node set 'fault' with id 10 containing 35 nodes.
 >> ../../../pylith-1.7.1/libsrc/pylith/meshio/MeshIOCubit.cc:285:<unknown>
 -- meshiocubit(info)
 -- Reading node set 'face_xpos' with id 11 containing 35 nodes.
 >> ../../../pylith-1.7.1/libsrc/pylith/meshio/MeshIOCubit.cc:285:<unknown>
 -- meshiocubit(info)
 -- Reading node set 'face_xneg' with id 12 containing 35 nodes.
 >> ../../../pylith-1.7.1/libsrc/pylith/meshio/MeshIOCubit.cc:285:<unknown>
 -- meshiocubit(info)
 -- Reading node set 'face_ypos' with id 13 containing 35 nodes.
 >> ../../../pylith-1.7.1/libsrc/pylith/meshio/MeshIOCubit.cc:285:<unknown>
 -- meshiocubit(info)
 -- Reading node set 'face_yneg' with id 14 containing 35 nodes.
 >> ../../../pylith-1.7.1/libsrc/pylith/meshio/MeshIOCubit.cc:285:<unknown>
 -- meshiocubit(info)
 -- Reading node set 'face_zneg' with id 15 containing 49 nodes.
 >> ../../../pylith-1.7.1/libsrc/pylith/meshio/MeshIOCubit.cc:285:<unknown>
 -- meshiocubit(info)
 -- Reading node set 'face_zneg_nofault' with id 16 containing 42 nodes.
 >> ../../../pylith-1.7.1/libsrc/pylith/meshio/MeshIOCubit.cc:285:<unknown>
 -- meshiocubit(info)
 -- Reading node set 'face_zpos' with id 17 containing 49 nodes.
[scylla064:20682] 23 more processes have sent help message help-mpi-runtime.txt / mpi_init:warn-fork
[scylla064:20682] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages
[0]PETSC ERROR: ------------------------------------------------------------------------
[0]PETSC ERROR: Caught signal number 15 Terminate: Somet process (or the batch system) has told this process to end
[0]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger
[0]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind[0]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors
[0]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run 
[0]PETSC ERROR: to get more information on the crash.
[0]PETSC ERROR: --------------------- Error Message ------------------------------------
[0]PETSC ERROR: Signal received!
[0]PETSC ERROR: ------------------------------------------------------------------------
[0]PETSC ERROR: Petsc Development HG revision: 3bede28f1195e406d4257c9fbeebefe827793801  HG Date: Mon Jun 11 22:14:12 2012 -0400
[0]PETSC ERROR: See docs/changes/index.html for recent updates.
[0]PETSC ERROR: See docs/faq.html for hints about trouble shooting.
[0]PETSC ERROR: See docs/index.html for manual pages.
[0]PETSC ERROR: ------------------------------------------------------------------------
[0]PETSC ERROR: /scylla-a/home/hyang/cig/pylith171/bin/mpinemesis on a arch-linu named scylla064 by hyang Tue Jun 19 19:14:14 2012
[0]PETSC ERROR: Libraries linked from /scylla-a/home/hyang/cig/pylith171/lib
[0]PETSC ERROR: Configure run at Tue Jun 19 18:23:39 2012
[0]PETSC ERROR: Configure options --prefix=/scylla-a/home/hyang/cig/pylith171 --with-c2html=0 --with-x=0 --CXXFLAGS=-DMPICH_IGNORE_CXX_SEEK --with-clanguage=C++ --with-mpicompilers=1 --with-debugging=0 --with-shared-libraries=1 --with-sieve=1 --download-boost=1 --download-chaco=1 --download-ml=1 --download-f-blas-lapack=1 --with-hdf5=1 --with-hdf5-include=/scylla-a/home/hyang/cig/pylith171/include --with-hdf5-lib=/scylla-a/home/hyang/cig/pylith171/lib/libhdf5.dylib --LIBS=-lz CPPFLAGS="-I/scylla-a/home/hyang/cig/pylith171/include " LDFLAGS="-L/scylla-a/home/hyang/cig/pylith171/lib " PETSC_DIR=/scylla-a/home/hyang/cig/build/petsc-dev
[0]PETSC ERROR: ------------------------------------------------------------------------
[0]PETSC ERROR: User provided function() line 0 in unknown directory unknown file
--------------------------------------------------------------------------
MPI_ABORT was invoked on rank 0 in communicator MPI_COMM_WORLD 
with errorcode 59.

NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes.
You may or may not see output from other processes, depending on
exactly when Open MPI kills them.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun has exited due to process rank 0 with PID 20686 on
node scylla064 exiting without calling "finalize". This may
have caused other processes in the application to be
terminated by signals sent by mpirun (as reported here).
--------------------------------------------------------------------------
[1]PETSC ERROR: ------------------------------------------------------------------------
[1]PETSC ERROR: Caught signal number 15 Terminate: Somet process (or the batch system) has told this process to end
[1]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger
[1]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind[1]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors
[1]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run 
[1]PETSC ERROR: to get more information on the crash.
[1]PETSC ERROR: --------------------- Error Message ------------------------------------
[1]PETSC ERROR: Signal received!
[1]PETSC ERROR: ------------------------------------------------------------------------
[1]PETSC ERROR: Petsc Development HG revision: 3bede28f1195e406d4257c9fbeebefe827793801  HG Date: Mon Jun 11 22:14:12 2012 -0400
[1]PETSC ERROR: See docs/changes/index.html for recent updates.
[1]PETSC ERROR: See docs/faq.html for hints about trouble shooting.
[1]PETSC ERROR: See docs/index.html for manual pages.
[1]PETSC ERROR: ------------------------------------------------------------------------
[1]PETSC ERROR: /scylla-a/home/hyang/cig/pylith171/bin/mpinemesis on a arch-linu named scylla064 by hyang Tue Jun 19 19:14:14 2012
[1]PETSC ERROR: Libraries linked from /scylla-a/home/hyang/cig/pylith171/lib
[1]PETSC ERROR: Configure run at Tue Jun 19 18:23:39 2012
[1]PETSC ERROR: Configure options --prefix=/scylla-a/home/hyang/cig/pylith171 --with-c2html=0 --with-x=0 --CXXFLAGS=-DMPICH_IGNORE_CXX_SEEK --with-clanguage=C++ --with-mpicompilers=1 --with-debugging=0 --with-shared-libraries=1 --with-sieve=1 --download-boost=1 --download-chaco=1 --download-ml=1 --download-f-blas-lapack=1 --with-hdf5=1 --with-hdf5-include=/scylla-a/home/hyang/cig/pylith171/include --with-hdf5-lib=/scylla-a/home/hyang/cig/pylith171/lib/libhdf5.dylib --LIBS=-lz CPPFLAGS="-I/scylla-a/home/hyang/cig/pylith171/include " LDFLAGS="-L/scylla-a/home/hyang/cig/pylith171/lib " PETSC_DIR=/scylla-a/home/hyang/cig/build/petsc-dev
[1]PETSC ERROR: ------------------------------------------------------------------------
[1]PETSC ERROR: User provided function() line 0 in unknown directory unknown file
[2]PETSC ERROR: ------------------------------------------------------------------------
[2]PETSC ERROR: Caught signal number 15 Terminate: Somet process (or the batch system) has told this process to end
[2]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger
[2]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind[2]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors
[2]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run 
[2]PETSC ERROR: to get more information on the crash.
[2]PETSC ERROR: --------------------- Error Message ------------------------------------
[2]PETSC ERROR: Signal received!
[2]PETSC ERROR: ------------------------------------------------------------------------
[2]PETSC ERROR: Petsc Development HG revision: 3bede28f1195e406d4257c9fbeebefe827793801  HG Date: Mon Jun 11 22:14:12 2012 -0400
[2]PETSC ERROR: See docs/changes/index.html for recent updates.
[2]PETSC ERROR: See docs/faq.html for hints about trouble shooting.
[2]PETSC ERROR: See docs/index.html for manual pages.
[2]PETSC ERROR: ------------------------------------------------------------------------
[2]PETSC ERROR: /scylla-a/home/hyang/cig/pylith171/bin/mpinemesis on a arch-linu named scylla064 by hyang Tue Jun 19 19:14:14 2012
[2]PETSC ERROR: Libraries linked from /scylla-a/home/hyang/cig/pylith171/lib
[2]PETSC ERROR: Configure run at Tue Jun 19 18:23:39 2012
[2]PETSC ERROR: Configure options --prefix=/scylla-a/home/hyang/cig/pylith171 --with-c2html=0 --with-x=0 --CXXFLAGS=-DMPICH_IGNORE_CXX_SEEK --with-clanguage=C++ --with-mpicompilers=1 --with-debugging=0 --with-shared-libraries=1 --with-sieve=1 --download-boost=1 --download-chaco=1 --download-ml=1 --download-f-blas-lapack=1 --with-hdf5=1 --with-hdf5-include=/scylla-a/home/hyang/cig/pylith171/include --with-hdf5-lib=/scylla-a/home/hyang/cig/pylith171/lib/libhdf5.dylib --LIBS=-lz CPPFLAGS="-I/scylla-a/home/hyang/cig/pylith171/include " LDFLAGS="-L/scylla-a/home/hyang/cig/pylith171/lib " PETSC_DIR=/scylla-a/home/hyang/cig/build/petsc-dev
[2]PETSC ERROR: ------------------------------------------------------------------------
[2]PETSC ERROR: User provided function() line 0 in unknown directory unknown file
[3]PETSC ERROR: ------------------------------------------------------------------------
[3]PETSC ERROR: Caught signal number 15 Terminate: Somet process (or the batch system) has told this process to end
[3]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger
[3]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind[3]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors
[3]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run 
[3]PETSC ERROR: to get more information on the crash.
[3]PETSC ERROR: --------------------- Error Message ------------------------------------
[3]PETSC ERROR: Signal received!
[3]PETSC ERROR: ------------------------------------------------------------------------
[3]PETSC ERROR: Petsc Development HG revision: 3bede28f1195e406d4257c9fbeebefe827793801  HG Date: Mon Jun 11 22:14:12 2012 -0400
[3]PETSC ERROR: See docs/changes/index.html for recent updates.
[3]PETSC ERROR: See docs/faq.html for hints about trouble shooting.
[3]PETSC ERROR: See docs/index.html for manual pages.
[3]PETSC ERROR: ------------------------------------------------------------------------
[3]PETSC ERROR: /scylla-a/home/hyang/cig/pylith171/bin/mpinemesis on a arch-linu named scylla064 by hyang Tue Jun 19 19:14:14 2012
[3]PETSC ERROR: Libraries linked from /scylla-a/home/hyang/cig/pylith171/lib
[3]PETSC ERROR: Configure run at Tue Jun 19 18:23:39 2012
[3]PETSC ERROR: Configure options --prefix=/scylla-a/home/hyang/cig/pylith171 --with-c2html=0 --with-x=0 --CXXFLAGS=-DMPICH_IGNORE_CXX_SEEK --with-clanguage=C++ --with-mpicompilers=1 --with-debugging=0 --with-shared-libraries=1 --with-sieve=1 --download-boost=1 --download-chaco=1 --download-ml=1 --download-f-blas-lapack=1 --with-hdf5=1 --with-hdf5-include=/scylla-a/home/hyang/cig/pylith171/include --with-hdf5-lib=/scylla-a/home/hyang/cig/pylith171/lib/libhdf5.dylib --LIBS=-lz CPPFLAGS="-I/scylla-a/home/hyang/cig/pylith171/include " LDFLAGS="-L/scylla-a/home/hyang/cig/pylith171/lib " PETSC_DIR=/scylla-a/home/hyang/cig/build/petsc-dev
[3]PETSC ERROR: ------------------------------------------------------------------------
[3]PETSC ERROR: User provided function() line 0 in unknown directory unknown file
[4]PETSC ERROR: [5]PETSC ERROR: ------------------------------------------------------------------------
[5]PETSC ERROR: Caught signal number 15 Terminate: Somet process (or the batch system) has told this process to end
[5]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger
[5]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind[5]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors
[5]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run 
[5]PETSC ERROR: to get more information on the crash.
[5]PETSC ERROR: --------------------- Error Message ------------------------------------
[5]PETSC ERROR: Signal received!
[5]PETSC ERROR: ------------------------------------------------------------------------
[5]PETSC ERROR: Petsc Development HG revision: 3bede28f1195e406d4257c9fbeebefe827793801  HG Date: Mon Jun 11 22:14:12 2012 -0400
[5]PETSC ERROR: See docs/changes/index.html for recent updates.
[5]PETSC ERROR: See docs/faq.html for hints about trouble shooting.
[5]PETSC ERROR: See docs/index.html for manual pages.
[5]PETSC ERROR: ------------------------------------------------------------------------
[5]PETSC ERROR: /scylla-a/home/hyang/cig/pylith171/bin/mpinemesis on a arch-linu named scylla064 by hyang Tue Jun 19 19:14:14 2012
[5]PETSC ERROR: Libraries linked from /scylla-a/home/hyang/cig/pylith171/lib
[5]PETSC ERROR: Configure run at Tue Jun 19 18:23:39 2012
[5]PETSC ERROR: Configure options --prefix=/scylla-a/home/hyang/cig/pylith171 --with-c2html=0 --with-x=0 --CXXFLAGS=-DMPICH_IGNORE_CXX_SEEK --with-clanguage=C++ --with-mpicompilers=1 --with-debugging=0 --with-shared-libraries=1 --with-sieve=1 --download-boost=1 --download-chaco=1 --download-ml=1 --download-f-blas-lapack=1 --with-hdf5=1 --with-hdf5-include=/scylla-a/home/hyang/cig/pylith171/include --with-hdf5-lib=/scylla-a/home/hyang/cig/pylith171/lib/libhdf5.dylib --LIBS=-lz CPPFLAGS="-I/scylla-a/home/hyang/cig/pylith171/include " LDFLAGS="-L/scylla-a/home/hyang/cig/pylith171/lib " PETSC_DIR=/scylla-a/home/hyang/cig/build/petsc-dev
[5]PETSC ERROR: ------------------------------------------------------------------------
[5]PETSC ERROR: User provided function() line 0 in unknown directory unknown file
[6]PETSC ERROR: ------------------------------------------------------------------------
[6]PETSC ERROR: Caught signal number 15 Terminate: Somet process (or the batch system) has told this process to end
[6]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger
[6]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind[6]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors
[6]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run 
[6]PETSC ERROR: to get more information on the crash.
[6]PETSC ERROR: --------------------- Error Message ------------------------------------
[6]PETSC ERROR: Signal received!
[6]PETSC ERROR: ------------------------------------------------------------------------
[6]PETSC ERROR: Petsc Development HG revision: 3bede28f1195e406d4257c9fbeebefe827793801  HG Date: Mon Jun 11 22:14:12 2012 -0400
[6]PETSC ERROR: See docs/changes/index.html for recent updates.
[6]PETSC ERROR: See docs/faq.html for hints about trouble shooting.
[6]PETSC ERROR: See docs/index.html for manual pages.
[6]PETSC ERROR: ------------------------------------------------------------------------
[6]PETSC ERROR: /scylla-a/home/hyang/cig/pylith171/bin/mpinemesis on a arch-linu named scylla064 by hyang Tue Jun 19 19:14:14 2012
[6]PETSC ERROR: Libraries linked from /scylla-a/home/hyang/cig/pylith171/lib
[6]PETSC ERROR: Configure run at Tue Jun 19 18:23:39 2012
[6]PETSC ERROR: Configure options --prefix=/scylla-a/home/hyang/cig/pylith171 --with-c2html=0 --with-x=0 --CXXFLAGS=-DMPICH_IGNORE_CXX_SEEK --with-clanguage=C++ --with-mpicompilers=1 --with-debugging=0 --with-shared-libraries=1 --with-sieve=1 --download-boost=1 --download-chaco=1 --download-ml=1 --download-f-blas-lapack=1 --with-hdf5=1 --with-hdf5-include=/scylla-a/home/hyang/cig/pylith171/include --with-hdf5-lib=/scylla-a/home/hyang/cig/pylith171/lib/libhdf5.dylib --LIBS=-lz CPPFLAGS="-I/scylla-a/home/hyang/cig/pylith171/include " LDFLAGS="-L/scylla-a/home/hyang/cig/pylith171/lib " PETSC_DIR=/scylla-a/home/hyang/cig/build/petsc-dev
[6]PETSC ERROR: ------------------------------------------------------------------------
[6]PETSC ERROR: User provided function() line 0 in unknown directory unknown file
[7]PETSC ERROR: ------------------------------------------------------------------------
[7]PETSC ERROR: Caught signal number 15 Terminate: Somet process (or the batch system) has told this process to end
[7]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger
[7]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind[7]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors
[7]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run 
[7]PETSC ERROR: to get more information on the crash.
[7]PETSC ERROR: --------------------- Error Message ------------------------------------
[7]PETSC ERROR: Signal received!
[7]PETSC ERROR: ------------------------------------------------------------------------
[7]PETSC ERROR: Petsc Development HG revision: 3bede28f1195e406d4257c9fbeebefe827793801  HG Date: Mon Jun 11 22:14:12 2012 -0400
[7]PETSC ERROR: See docs/changes/index.html for recent updates.
[7]PETSC ERROR: See docs/faq.html for hints about trouble shooting.
[7]PETSC ERROR: See docs/index.html for manual pages.
[7]PETSC ERROR: ------------------------------------------------------------------------
[7]PETSC ERROR: /scylla-a/home/hyang/cig/pylith171/bin/mpinemesis on a arch-linu named scylla064 by hyang Tue Jun 19 19:14:14 2012
[7]PETSC ERROR: Libraries linked from /scylla-a/home/hyang/cig/pylith171/lib
[7]PETSC ERROR: Configure run at Tue Jun 19 18:23:39 2012
[7]PETSC ERROR: Configure options --prefix=/scylla-a/home/hyang/cig/pylith171 --with-c2html=0 --with-x=0 --CXXFLAGS=-DMPICH_IGNORE_CXX_SEEK --with-clanguage=C++ --with-mpicompilers=1 --with-debugging=0 --with-shared-libraries=1 --with-sieve=1 --download-boost=1 --download-chaco=1 --download-ml=1 --download-f-blas-lapack=1 --with-hdf5=1 --with-hdf5-include=/scylla-a/home/hyang/cig/pylith171/include --with-hdf5-lib=/scylla-a/home/hyang/cig/pylith171/lib/libhdf5.dylib --LIBS=-lz CPPFLAGS="-I/scylla-a/home/hyang/cig/pylith171/include " LDFLAGS="-L/scylla-a/home/hyang/cig/pylith171/lib " PETSC_DIR=/scylla-a/home/hyang/cig/build/petsc-dev
[7]PETSC ERROR: ------------------------------------------------------------------------
[7]PETSC ERROR: User provided function() line 0 in unknown directory unknown file
[8]PETSC ERROR: ------------------------------------------------------------------------
[8]PETSC ERROR: Caught signal number 15 Terminate: Somet process (or the batch system) has told this process to end
[8]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger
[8]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind[8]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors
[8]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run 
[8]PETSC ERROR: to get more information on the crash.
[8]PETSC ERROR: --------------------- Error Message ------------------------------------
[8]PETSC ERROR: Signal received!
[8]PETSC ERROR: ------------------------------------------------------------------------
[8]PETSC ERROR: Petsc Development HG revision: 3bede28f1195e406d4257c9fbeebefe827793801  HG Date: Mon Jun 11 22:14:12 2012 -0400
[8]PETSC ERROR: See docs/changes/index.html for recent updates.
[8]PETSC ERROR: See docs/faq.html for hints about trouble shooting.
[8]PETSC ERROR: See docs/index.html for manual pages.
[8]PETSC ERROR: ------------------------------------------------------------------------
[8]PETSC ERROR: /scylla-a/home/hyang/cig/pylith171/bin/mpinemesis on a arch-linu named scylla064 by hyang Tue Jun 19 19:14:14 2012
[8]PETSC ERROR: Libraries linked from /scylla-a/home/hyang/cig/pylith171/lib
[8]PETSC ERROR: Configure run at Tue Jun 19 18:23:39 2012
[8]PETSC ERROR: Configure options --prefix=/scylla-a/home/hyang/cig/pylith171 --with-c2html=0 --with-x=0 --CXXFLAGS=-DMPICH_IGNORE_CXX_SEEK --with-clanguage=C++ --with-mpicompilers=1 --with-debugging=0 --with-shared-libraries=1 --with-sieve=1 --download-boost=1 --download-chaco=1 --download-ml=1 --download-f-blas-lapack=1 --with-hdf5=1 --with-hdf5-include=/scylla-a/home/hyang/cig/pylith171/include --with-hdf5-lib=/scylla-a/home/hyang/cig/pylith171/lib/libhdf5.dylib --LIBS=-lz CPPFLAGS="-I/scylla-a/home/hyang/cig/pylith171/include " LDFLAGS="-L/scylla-a/home/hyang/cig/pylith171/lib " PETSC_DIR=/scylla-a/home/hyang/cig/build/petsc-dev
[8]PETSC ERROR: ------------------------------------------------------------------------
[8]PETSC ERROR: User provided function() line 0 in unknown directory unknown file
[9]PETSC ERROR: ------------------------------------------------------------------------
[9]PETSC ERROR: Caught signal number 15 Terminate: Somet process (or the batch system) has told this process to end
[9]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger
[9]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind[9]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors
[9]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run 
[9]PETSC ERROR: to get more information on the crash.
[9]PETSC ERROR: --------------------- Error Message ------------------------------------
[9]PETSC ERROR: Signal received!
[9]PETSC ERROR: ------------------------------------------------------------------------
[9]PETSC ERROR: Petsc Development HG revision: 3bede28f1195e406d4257c9fbeebefe827793801  HG Date: Mon Jun 11 22:14:12 2012 -0400
[9]PETSC ERROR: See docs/changes/index.html for recent updates.
[9]PETSC ERROR: See docs/faq.html for hints about trouble shooting.
[9]PETSC ERROR: See docs/index.html for manual pages.
[9]PETSC ERROR: ------------------------------------------------------------------------
[9]PETSC ERROR: /scylla-a/home/hyang/cig/pylith171/bin/mpinemesis on a arch-linu named scylla064 by hyang Tue Jun 19 19:14:14 2012
[9]PETSC ERROR: Libraries linked from /scylla-a/home/hyang/cig/pylith171/lib
[9]PETSC ERROR: Configure run at Tue Jun 19 18:23:39 2012
[9]PETSC ERROR: Configure options --prefix=/scylla-a/home/hyang/cig/pylith171 --with-c2html=0 --with-x=0 --CXXFLAGS=-DMPICH_IGNORE_CXX_SEEK --with-clanguage=C++ --with-mpicompilers=1 --with-debugging=0 --with-shared-libraries=1 --with-sieve=1 --download-boost=1 --download-chaco=1 --download-ml=1 --download-f-blas-lapack=1 --with-hdf5=1 --with-hdf5-include=/scylla-a/home/hyang/cig/pylith171/include --with-hdf5-lib=/scylla-a/home/hyang/cig/pylith171/lib/libhdf5.dylib --LIBS=-lz CPPFLAGS="-I/scylla-a/home/hyang/cig/pylith171/include " LDFLAGS="-L/scylla-a/home/hyang/cig/pylith171/lib " PETSC_DIR=/scylla-a/home/hyang/cig/build/petsc-dev
[9]PETSC ERROR: ------------------------------------------------------------------------
[9]PETSC ERROR: User provided function() line 0 in unknown directory unknown file
[10]PETSC ERROR: ------------------------------------------------------------------------
[10]PETSC ERROR: Caught signal number 15 Terminate: Somet process (or the batch system) has told this process to end
[10]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger
[10]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind[10]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors
[10]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run 
[10]PETSC ERROR: to get more information on the crash.
[10]PETSC ERROR: --------------------- Error Message ------------------------------------
[10]PETSC ERROR: Signal received!
[10]PETSC ERROR: ------------------------------------------------------------------------
[10]PETSC ERROR: Petsc Development HG revision: 3bede28f1195e406d4257c9fbeebefe827793801  HG Date: Mon Jun 11 22:14:12 2012 -0400
[10]PETSC ERROR: See docs/changes/index.html for recent updates.
[10]PETSC ERROR: See docs/faq.html for hints about trouble shooting.
[10]PETSC ERROR: See docs/index.html for manual pages.
[10]PETSC ERROR: ------------------------------------------------------------------------
[10]PETSC ERROR: /scylla-a/home/hyang/cig/pylith171/bin/mpinemesis on a arch-linu named scylla064 by hyang Tue Jun 19 19:14:14 2012
[10]PETSC ERROR: Libraries linked from /scylla-a/home/hyang/cig/pylith171/lib
[10]PETSC ERROR: Configure run at Tue Jun 19 18:23:39 2012
[10]PETSC ERROR: Configure options --prefix=/scylla-a/home/hyang/cig/pylith171 --with-c2html=0 --with-x=0 --CXXFLAGS=-DMPICH_IGNORE_CXX_SEEK --with-clanguage=C++ --with-mpicompilers=1 --with-debugging=0 --with-shared-libraries=1 --with-sieve=1 --download-boost=1 --download-chaco=1 --download-ml=1 --download-f-blas-lapack=1 --with-hdf5=1 --with-hdf5-include=/scylla-a/home/hyang/cig/pylith171/include --with-hdf5-lib=/scylla-a/home/hyang/cig/pylith171/lib/libhdf5.dylib --LIBS=-lz CPPFLAGS="-I/scylla-a/home/hyang/cig/pylith171/include " LDFLAGS="-L/scylla-a/home/hyang/cig/pylith171/lib " PETSC_DIR=/scylla-a/home/hyang/cig/build/petsc-dev
[10]PETSC ERROR: ------------------------------------------------------------------------
[10]PETSC ERROR: User provided function() line 0 in unknown directory unknown file
[11]PETSC ERROR: ------------------------------------------------------------------------
[11]PETSC ERROR: Caught signal number 15 Terminate: Somet process (or the batch system) has told this process to end
[11]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger
[11]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind[11]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors
[11]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run 
[11]PETSC ERROR: to get more information on the crash.
[11]PETSC ERROR: --------------------- Error Message ------------------------------------
[11]PETSC ERROR: Signal received!
[11]PETSC ERROR: ------------------------------------------------------------------------
[11]PETSC ERROR: Petsc Development HG revision: 3bede28f1195e406d4257c9fbeebefe827793801  HG Date: Mon Jun 11 22:14:12 2012 -0400
[11]PETSC ERROR: See docs/changes/index.html for recent updates.
[11]PETSC ERROR: See docs/faq.html for hints about trouble shooting.
[11]PETSC ERROR: See docs/index.html for manual pages.
[11]PETSC ERROR: ------------------------------------------------------------------------
[11]PETSC ERROR: /scylla-a/home/hyang/cig/pylith171/bin/mpinemesis on a arch-linu named scylla064 by hyang Tue Jun 19 19:14:14 2012
[11]PETSC ERROR: Libraries linked from /scylla-a/home/hyang/cig/pylith171/lib
[11]PETSC ERROR: Configure run at Tue Jun 19 18:23:39 2012
[11]PETSC ERROR: Configure options --prefix=/scylla-a/home/hyang/cig/pylith171 --with-c2html=0 --with-x=0 --CXXFLAGS=-DMPICH_IGNORE_CXX_SEEK --with-clanguage=C++ --with-mpicompilers=1 --with-debugging=0 --with-shared-libraries=1 --with-sieve=1 --download-boost=1 --download-chaco=1 --download-ml=1 --download-f-blas-lapack=1 --with-hdf5=1 --with-hdf5-include=/scylla-a/home/hyang/cig/pylith171/include --with-hdf5-lib=/scylla-a/home/hyang/cig/pylith171/lib/libhdf5.dylib --LIBS=-lz CPPFLAGS="-I/scylla-a/home/hyang/cig/pylith171/include " LDFLAGS="-L/scylla-a/home/hyang/cig/pylith171/lib " PETSC_DIR=/scylla-a/home/hyang/cig/build/petsc-dev
[11]PETSC ERROR: ------------------------------------------------------------------------
[11]PETSC ERROR: User provided function() line 0 in unknown directory unknown file
------------------------------------------------------------------------
[4]PETSC ERROR: Caught signal number 15 Terminate: Somet process (or the batch system) has told this process to end
[4]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger
[4]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind[4]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors
[4]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run 
[4]PETSC ERROR: to get more information on the crash.
[4]PETSC ERROR: --------------------- Error Message ------------------------------------
[4]PETSC ERROR: Signal received!
[4]PETSC ERROR: ------------------------------------------------------------------------
[4]PETSC ERROR: Petsc Development HG revision: 3bede28f1195e406d4257c9fbeebefe827793801  HG Date: Mon Jun 11 22:14:12 2012 -0400
[4]PETSC ERROR: See docs/changes/index.html for recent updates.
[4]PETSC ERROR: See docs/faq.html for hints about trouble shooting.
[4]PETSC ERROR: See docs/index.html for manual pages.
[4]PETSC ERROR: ------------------------------------------------------------------------
[4]PETSC ERROR: /scylla-a/home/hyang/cig/pylith171/bin/mpinemesis on a arch-linu named scylla064 by hyang Tue Jun 19 19:14:14 2012
[4]PETSC ERROR: Libraries linked from /scylla-a/home/hyang/cig/pylith171/lib
[4]PETSC ERROR: Configure run at Tue Jun 19 18:23:39 2012
[4]PETSC ERROR: Configure options --prefix=/scylla-a/home/hyang/cig/pylith171 --with-c2html=0 --with-x=0 --CXXFLAGS=-DMPICH_IGNORE_CXX_SEEK --with-clanguage=C++ --with-mpicompilers=1 --with-debugging=0 --with-shared-libraries=1 --with-sieve=1 --download-boost=1 --download-chaco=1 --download-ml=1 --download-f-blas-lapack=1 --with-hdf5=1 --with-hdf5-include=/scylla-a/home/hyang/cig/pylith171/include --with-hdf5-lib=/scylla-a/home/hyang/cig/pylith171/lib/libhdf5.dylib --LIBS=-lz CPPFLAGS="-I/scylla-a/home/hyang/cig/pylith171/include " LDFLAGS="-L/scylla-a/home/hyang/cig/pylith171/lib " PETSC_DIR=/scylla-a/home/hyang/cig/build/petsc-dev
[4]PETSC ERROR: ------------------------------------------------------------------------
[4]PETSC ERROR: User provided function() line 0 in unknown directory unknown file
[12]PETSC ERROR: ------------------------------------------------------------------------
[12]PETSC ERROR: Caught signal number 15 Terminate: Somet process (or the batch system) has told this process to end
[12]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger
[12]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind[12]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors
[12]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run 
[12]PETSC ERROR: to get more information on the crash.
[12]PETSC ERROR: --------------------- Error Message ------------------------------------
[12]PETSC ERROR: Signal received!
[12]PETSC ERROR: ------------------------------------------------------------------------
[12]PETSC ERROR: Petsc Development HG revision: 3bede28f1195e406d4257c9fbeebefe827793801  HG Date: Mon Jun 11 22:14:12 2012 -0400
[12]PETSC ERROR: See docs/changes/index.html for recent updates.
[12]PETSC ERROR: See docs/faq.html for hints about trouble shooting.
[12]PETSC ERROR: See docs/index.html for manual pages.
[12]PETSC ERROR: ------------------------------------------------------------------------
[12]PETSC ERROR: /scylla-a/home/hyang/cig/pylith171/bin/mpinemesis on a arch-linu named scylla080 by hyang Tue Jun 19 19:14:18 2012
[12]PETSC ERROR: Libraries linked from /scylla-a/home/hyang/cig/pylith171/lib
[12]PETSC ERROR: Configure run at Tue Jun 19 18:23:39 2012
[12]PETSC ERROR: Configure options --prefix=/scylla-a/home/hyang/cig/pylith171 --with-c2html=0 --with-x=0 --CXXFLAGS=-DMPICH_IGNORE_CXX_SEEK --with-clanguage=C++ --with-mpicompilers=1 --with-debugging=0 --with-shared-libraries=1 --with-sieve=1 --download-boost=1 --download-chaco=1 --download-ml=1 --download-f-blas-lapack=1 --with-hdf5=1 --with-hdf5-include=/scylla-a/home/hyang/cig/pylith171/include --with-hdf5-lib=/scylla-a/home/hyang/cig/pylith171/lib/libhdf5.dylib --LIBS=-lz CPPFLAGS="-I/scylla-a/home/hyang/cig/pylith171/include " LDFLAGS="-L/scylla-a/home/hyang/cig/pylith171/lib " PETSC_DIR=/scylla-a/home/hyang/cig/build/petsc-dev
[12]PETSC ERROR: ------------------------------------------------------------------------
[12]PETSC ERROR: User provided function() line 0 in unknown directory unknown file
[13]PETSC ERROR: ------------------------------------------------------------------------
[13]PETSC ERROR: Caught signal number 15 Terminate: Somet process (or the batch system) has told this process to end
[13]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger
[13]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind[13]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors
[13]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run 
[13]PETSC ERROR: to get more information on the crash.
[13]PETSC ERROR: --------------------- Error Message ------------------------------------
[13]PETSC ERROR: Signal received!
[13]PETSC ERROR: ------------------------------------------------------------------------
[13]PETSC ERROR: Petsc Development HG revision: 3bede28f1195e406d4257c9fbeebefe827793801  HG Date: Mon Jun 11 22:14:12 2012 -0400
[13]PETSC ERROR: See docs/changes/index.html for recent updates.
[13]PETSC ERROR: See docs/faq.html for hints about trouble shooting.
[13]PETSC ERROR: See docs/index.html for manual pages.
[13]PETSC ERROR: ------------------------------------------------------------------------
[13]PETSC ERROR: /scylla-a/home/hyang/cig/pylith171/bin/mpinemesis on a arch-linu named scylla080 by hyang Tue Jun 19 19:14:18 2012
[13]PETSC ERROR: Libraries linked from /scylla-a/home/hyang/cig/pylith171/lib
[13]PETSC ERROR: Configure run at Tue Jun 19 18:23:39 2012
[13]PETSC ERROR: Configure options --prefix=/scylla-a/home/hyang/cig/pylith171 --with-c2html=0 --with-x=0 --CXXFLAGS=-DMPICH_IGNORE_CXX_SEEK --with-clanguage=C++ --with-mpicompilers=1 --with-debugging=0 --with-shared-libraries=1 --with-sieve=1 --download-boost=1 --download-chaco=1 --download-ml=1 --download-f-blas-lapack=1 --with-hdf5=1 --with-hdf5-include=/scylla-a/home/hyang/cig/pylith171/include --with-hdf5-lib=/scylla-a/home/hyang/cig/pylith171/lib/libhdf5.dylib --LIBS=-lz CPPFLAGS="-I/scylla-a/home/hyang/cig/pylith171/include " LDFLAGS="-L/scylla-a/home/hyang/cig/pylith171/lib " PETSC_DIR=/scylla-a/home/hyang/cig/build/petsc-dev
[13]PETSC ERROR: ------------------------------------------------------------------------
[13]PETSC ERROR: User provided function() line 0 in unknown directory unknown file
[14]PETSC ERROR: ------------------------------------------------------------------------
[14]PETSC ERROR: Caught signal number 15 Terminate: Somet process (or the batch system) has told this process to end
[14]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger
[14]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind[14]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors
[14]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run 
[14]PETSC ERROR: to get more information on the crash.
[14]PETSC ERROR: --------------------- Error Message ------------------------------------
[14]PETSC ERROR: Signal received!
[14]PETSC ERROR: ------------------------------------------------------------------------
[14]PETSC ERROR: Petsc Development HG revision: 3bede28f1195e406d4257c9fbeebefe827793801  HG Date: Mon Jun 11 22:14:12 2012 -0400
[14]PETSC ERROR: See docs/changes/index.html for recent updates.
[14]PETSC ERROR: See docs/faq.html for hints about trouble shooting.
[14]PETSC ERROR: See docs/index.html for manual pages.
[14]PETSC ERROR: ------------------------------------------------------------------------
[14]PETSC ERROR: /scylla-a/home/hyang/cig/pylith171/bin/mpinemesis on a arch-linu named scylla080 by hyang Tue Jun 19 19:14:18 2012
[14]PETSC ERROR: Libraries linked from /scylla-a/home/hyang/cig/pylith171/lib
[14]PETSC ERROR: Configure run at Tue Jun 19 18:23:39 2012
[14]PETSC ERROR: Configure options --prefix=/scylla-a/home/hyang/cig/pylith171 --with-c2html=0 --with-x=0 --CXXFLAGS=-DMPICH_IGNORE_CXX_SEEK --with-clanguage=C++ --with-mpicompilers=1 --with-debugging=0 --with-shared-libraries=1 --with-sieve=1 --download-boost=1 --download-chaco=1 --download-ml=1 --download-f-blas-lapack=1 --with-hdf5=1 --with-hdf5-include=/scylla-a/home/hyang/cig/pylith171/include --with-hdf5-lib=/scylla-a/home/hyang/cig/pylith171/lib/libhdf5.dylib --LIBS=-lz CPPFLAGS="-I/scylla-a/home/hyang/cig/pylith171/include " LDFLAGS="-L/scylla-a/home/hyang/cig/pylith171/lib " PETSC_DIR=/scylla-a/home/hyang/cig/build/petsc-dev
[14]PETSC ERROR: ------------------------------------------------------------------------
[14]PETSC ERROR: User provided function() line 0 in unknown directory unknown file
[15]PETSC ERROR: ------------------------------------------------------------------------
[15]PETSC ERROR: Caught signal number 15 Terminate: Somet process (or the batch system) has told this process to end
[15]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger
[15]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind[15]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors
[15]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run 
[15]PETSC ERROR: to get more information on the crash.
[15]PETSC ERROR: --------------------- Error Message ------------------------------------
[15]PETSC ERROR: Signal received!
[15]PETSC ERROR: ------------------------------------------------------------------------
[15]PETSC ERROR: Petsc Development HG revision: 3bede28f1195e406d4257c9fbeebefe827793801  HG Date: Mon Jun 11 22:14:12 2012 -0400
[15]PETSC ERROR: See docs/changes/index.html for recent updates.
[15]PETSC ERROR: See docs/faq.html for hints about trouble shooting.
[15]PETSC ERROR: See docs/index.html for manual pages.
[15]PETSC ERROR: ------------------------------------------------------------------------
[15]PETSC ERROR: /scylla-a/home/hyang/cig/pylith171/bin/mpinemesis on a arch-linu named scylla080 by hyang Tue Jun 19 19:14:18 2012
[15]PETSC ERROR: Libraries linked from /scylla-a/home/hyang/cig/pylith171/lib
[15]PETSC ERROR: Configure run at Tue Jun 19 18:23:39 2012
[15]PETSC ERROR: Configure options --prefix=/scylla-a/home/hyang/cig/pylith171 --with-c2html=0 --with-x=0 --CXXFLAGS=-DMPICH_IGNORE_CXX_SEEK --with-clanguage=C++ --with-mpicompilers=1 --with-debugging=0 --with-shared-libraries=1 --with-sieve=1 --download-boost=1 --download-chaco=1 --download-ml=1 --download-f-blas-lapack=1 --with-hdf5=1 --with-hdf5-include=/scylla-a/home/hyang/cig/pylith171/include --with-hdf5-lib=/scylla-a/home/hyang/cig/pylith171/lib/libhdf5.dylib --LIBS=-lz CPPFLAGS="-I/scylla-a/home/hyang/cig/pylith171/include " LDFLAGS="-L/scylla-a/home/hyang/cig/pylith171/lib " PETSC_DIR=/scylla-a/home/hyang/cig/build/petsc-dev
[15]PETSC ERROR: ------------------------------------------------------------------------
[15]PETSC ERROR: User provided function() line 0 in unknown directory unknown file
[16]PETSC ERROR: ------------------------------------------------------------------------
[16]PETSC ERROR: Caught signal number 15 Terminate: Somet process (or the batch system) has told this process to end
[16]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger
[16]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind[16]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors
[16]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run 
[16]PETSC ERROR: to get more information on the crash.
[16]PETSC ERROR: --------------------- Error Message ------------------------------------
[16]PETSC ERROR: Signal received!
[16]PETSC ERROR: ------------------------------------------------------------------------
[16]PETSC ERROR: Petsc Development HG revision: 3bede28f1195e406d4257c9fbeebefe827793801  HG Date: Mon Jun 11 22:14:12 2012 -0400
[16]PETSC ERROR: See docs/changes/index.html for recent updates.
[16]PETSC ERROR: See docs/faq.html for hints about trouble shooting.
[16]PETSC ERROR: See docs/index.html for manual pages.
[16]PETSC ERROR: ------------------------------------------------------------------------
[16]PETSC ERROR: /scylla-a/home/hyang/cig/pylith171/bin/mpinemesis on a arch-linu named scylla080 by hyang Tue Jun 19 19:14:18 2012
[16]PETSC ERROR: Libraries linked from /scylla-a/home/hyang/cig/pylith171/lib
[16]PETSC ERROR: Configure run at Tue Jun 19 18:23:39 2012
[16]PETSC ERROR: Configure options --prefix=/scylla-a/home/hyang/cig/pylith171 --with-c2html=0 --with-x=0 --CXXFLAGS=-DMPICH_IGNORE_CXX_SEEK --with-clanguage=C++ --with-mpicompilers=1 --with-debugging=0 --with-shared-libraries=1 --with-sieve=1 --download-boost=1 --download-chaco=1 --download-ml=1 --download-f-blas-lapack=1 --with-hdf5=1 --with-hdf5-include=/scylla-a/home/hyang/cig/pylith171/include --with-hdf5-lib=/scylla-a/home/hyang/cig/pylith171/lib/libhdf5.dylib --LIBS=-lz CPPFLAGS="-I/scylla-a/home/hyang/cig/pylith171/include " LDFLAGS="-L/scylla-a/home/hyang/cig/pylith171/lib " PETSC_DIR=/scylla-a/home/hyang/cig/build/petsc-dev
[16]PETSC ERROR: ------------------------------------------------------------------------
[16]PETSC ERROR: User provided function() line 0 in unknown directory unknown file
[18]PETSC ERROR: ------------------------------------------------------------------------
[18]PETSC ERROR: Caught signal number 15 Terminate: Somet process (or the batch system) has told this process to end
[18]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger
[18]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind[18]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors
[18]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run 
[18]PETSC ERROR: to get more information on the crash.
[18]PETSC ERROR: --------------------- Error Message ------------------------------------
[18]PETSC ERROR: Signal received!
[18]PETSC ERROR: ------------------------------------------------------------------------
[18]PETSC ERROR: Petsc Development HG revision: 3bede28f1195e406d4257c9fbeebefe827793801  HG Date: Mon Jun 11 22:14:12 2012 -0400
[18]PETSC ERROR: See docs/changes/index.html for recent updates.
[18]PETSC ERROR: See docs/faq.html for hints about trouble shooting.
[18]PETSC ERROR: See docs/index.html for manual pages.
[18]PETSC ERROR: ------------------------------------------------------------------------
[18]PETSC ERROR: /scylla-a/home/hyang/cig/pylith171/bin/mpinemesis on a arch-linu named scylla080 by hyang Tue Jun 19 19:14:18 2012
[18]PETSC ERROR: Libraries linked from /scylla-a/home/hyang/cig/pylith171/lib
[18]PETSC ERROR: Configure run at Tue Jun 19 18:23:39 2012
[18]PETSC ERROR: Configure options --prefix=/scylla-a/home/hyang/cig/pylith171 --with-c2html=0 --with-x=0 --CXXFLAGS=-DMPICH_IGNORE_CXX_SEEK --with-clanguage=C++ --with-mpicompilers=1 --with-debugging=0 --with-shared-libraries=1 --with-sieve=1 --download-boost=1 --download-chaco=1 --download-ml=1 --download-f-blas-lapack=1 --with-hdf5=1 --with-hdf5-include=/scylla-a/home/hyang/cig/pylith171/include --with-hdf5-lib=/scylla-a/home/hyang/cig/pylith171/lib/libhdf5.dylib --LIBS=-lz CPPFLAGS="-I/scylla-a/home/hyang/cig/pylith171/include " LDFLAGS="-L/scylla-a/home/hyang/cig/pylith171/lib " PETSC_DIR=/scylla-a/home/hyang/cig/build/petsc-dev
[18]PETSC ERROR: ------------------------------------------------------------------------
[18]PETSC ERROR: User provided function() line 0 in unknown directory unknown file
[19]PETSC ERROR: ------------------------------------------------------------------------
[19]PETSC ERROR: Caught signal number 15 Terminate: Somet process (or the batch system) has told this process to end
[19]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger
[19]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind[19]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors
[19]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run 
[19]PETSC ERROR: to get more information on the crash.
[19]PETSC ERROR: --------------------- Error Message ------------------------------------
[19]PETSC ERROR: Signal received!
[19]PETSC ERROR: ------------------------------------------------------------------------
[19]PETSC ERROR: Petsc Development HG revision: 3bede28f1195e406d4257c9fbeebefe827793801  HG Date: Mon Jun 11 22:14:12 2012 -0400
[19]PETSC ERROR: See docs/changes/index.html for recent updates.
[19]PETSC ERROR: See docs/faq.html for hints about trouble shooting.
[19]PETSC ERROR: See docs/index.html for manual pages.
[19]PETSC ERROR: ------------------------------------------------------------------------
[19]PETSC ERROR: /scylla-a/home/hyang/cig/pylith171/bin/mpinemesis on a arch-linu named scylla080 by hyang Tue Jun 19 19:14:18 2012
[19]PETSC ERROR: Libraries linked from /scylla-a/home/hyang/cig/pylith171/lib
[19]PETSC ERROR: Configure run at Tue Jun 19 18:23:39 2012
[19]PETSC ERROR: Configure options --prefix=/scylla-a/home/hyang/cig/pylith171 --with-c2html=0 --with-x=0 --CXXFLAGS=-DMPICH_IGNORE_CXX_SEEK --with-clanguage=C++ --with-mpicompilers=1 --with-debugging=0 --with-shared-libraries=1 --with-sieve=1 --download-boost=1 --download-chaco=1 --download-ml=1 --download-f-blas-lapack=1 --with-hdf5=1 --with-hdf5-include=/scylla-a/home/hyang/cig/pylith171/include --with-hdf5-lib=/scylla-a/home/hyang/cig/pylith171/lib/libhdf5.dylib --LIBS=-lz CPPFLAGS="-I/scylla-a/home/hyang/cig/pylith171/include " LDFLAGS="-L/scylla-a/home/hyang/cig/pylith171/lib " PETSC_DIR=/scylla-a/home/hyang/cig/build/petsc-dev
[19]PETSC ERROR: ------------------------------------------------------------------------
[19]PETSC ERROR: User provided function() line 0 in unknown directory unknown file
[20]PETSC ERROR: ------------------------------------------------------------------------
[20]PETSC ERROR: Caught signal number 15 Terminate: Somet process (or the batch system) has told this process to end
[20]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger
[20]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind[20]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors
[20]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run 
[20]PETSC ERROR: to get more information on the crash.
[20]PETSC ERROR: --------------------- Error Message ------------------------------------
[20]PETSC ERROR: Signal received!
[20]PETSC ERROR: ------------------------------------------------------------------------
[20]PETSC ERROR: Petsc Development HG revision: 3bede28f1195e406d4257c9fbeebefe827793801  HG Date: Mon Jun 11 22:14:12 2012 -0400
[20]PETSC ERROR: See docs/changes/index.html for recent updates.
[20]PETSC ERROR: See docs/faq.html for hints about trouble shooting.
[20]PETSC ERROR: See docs/index.html for manual pages.
[20]PETSC ERROR: ------------------------------------------------------------------------
[20]PETSC ERROR: /scylla-a/home/hyang/cig/pylith171/bin/mpinemesis on a arch-linu named scylla080 by hyang Tue Jun 19 19:14:18 2012
[20]PETSC ERROR: Libraries linked from /scylla-a/home/hyang/cig/pylith171/lib
[20]PETSC ERROR: Configure run at Tue Jun 19 18:23:39 2012
[20]PETSC ERROR: Configure options --prefix=/scylla-a/home/hyang/cig/pylith171 --with-c2html=0 --with-x=0 --CXXFLAGS=-DMPICH_IGNORE_CXX_SEEK --with-clanguage=C++ --with-mpicompilers=1 --with-debugging=0 --with-shared-libraries=1 --with-sieve=1 --download-boost=1 --download-chaco=1 --download-ml=1 --download-f-blas-lapack=1 --with-hdf5=1 --with-hdf5-include=/scylla-a/home/hyang/cig/pylith171/include --with-hdf5-lib=/scylla-a/home/hyang/cig/pylith171/lib/libhdf5.dylib --LIBS=-lz CPPFLAGS="-I/scylla-a/home/hyang/cig/pylith171/include " LDFLAGS="-L/scylla-a/home/hyang/cig/pylith171/lib " PETSC_DIR=/scylla-a/home/hyang/cig/build/petsc-dev
[20]PETSC ERROR: ------------------------------------------------------------------------
[20]PETSC ERROR: User provided function() line 0 in unknown directory unknown file
[21]PETSC ERROR: ------------------------------------------------------------------------
[21]PETSC ERROR: Caught signal number 15 Terminate: Somet process (or the batch system) has told this process to end
[21]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger
[21]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind[21]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors
[21]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run 
[21]PETSC ERROR: to get more information on the crash.
[21]PETSC ERROR: --------------------- Error Message ------------------------------------
[21]PETSC ERROR: Signal received!
[21]PETSC ERROR: ------------------------------------------------------------------------
[21]PETSC ERROR: Petsc Development HG revision: 3bede28f1195e406d4257c9fbeebefe827793801  HG Date: Mon Jun 11 22:14:12 2012 -0400
[21]PETSC ERROR: See docs/changes/index.html for recent updates.
[21]PETSC ERROR: See docs/faq.html for hints about trouble shooting.
[21]PETSC ERROR: See docs/index.html for manual pages.
[21]PETSC ERROR: ------------------------------------------------------------------------
[21]PETSC ERROR: /scylla-a/home/hyang/cig/pylith171/bin/mpinemesis on a arch-linu named scylla080 by hyang Tue Jun 19 19:14:18 2012
[21]PETSC ERROR: Libraries linked from /scylla-a/home/hyang/cig/pylith171/lib
[21]PETSC ERROR: Configure run at Tue Jun 19 18:23:39 2012
[21]PETSC ERROR: Configure options --prefix=/scylla-a/home/hyang/cig/pylith171 --with-c2html=0 --with-x=0 --CXXFLAGS=-DMPICH_IGNORE_CXX_SEEK --with-clanguage=C++ --with-mpicompilers=1 --with-debugging=0 --with-shared-libraries=1 --with-sieve=1 --download-boost=1 --download-chaco=1 --download-ml=1 --download-f-blas-lapack=1 --with-hdf5=1 --with-hdf5-include=/scylla-a/home/hyang/cig/pylith171/include --with-hdf5-lib=/scylla-a/home/hyang/cig/pylith171/lib/libhdf5.dylib --LIBS=-lz CPPFLAGS="-I/scylla-a/home/hyang/cig/pylith171/include " LDFLAGS="-L/scylla-a/home/hyang/cig/pylith171/lib " PETSC_DIR=/scylla-a/home/hyang/cig/build/petsc-dev
[21]PETSC ERROR: ------------------------------------------------------------------------
[21]PETSC ERROR: User provided function() line 0 in unknown directory unknown file
[22]PETSC ERROR: ------------------------------------------------------------------------
[22]PETSC ERROR: Caught signal number 15 Terminate: Somet process (or the batch system) has told this process to end
[22]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger
[22]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind[22]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors
[22]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run 
[22]PETSC ERROR: to get more information on the crash.
[22]PETSC ERROR: --------------------- Error Message ------------------------------------
[22]PETSC ERROR: Signal received!
[22]PETSC ERROR: ------------------------------------------------------------------------
[22]PETSC ERROR: Petsc Development HG revision: 3bede28f1195e406d4257c9fbeebefe827793801  HG Date: Mon Jun 11 22:14:12 2012 -0400
[22]PETSC ERROR: See docs/changes/index.html for recent updates.
[22]PETSC ERROR: See docs/faq.html for hints about trouble shooting.
[22]PETSC ERROR: See docs/index.html for manual pages.
[22]PETSC ERROR: ------------------------------------------------------------------------
[22]PETSC ERROR: /scylla-a/home/hyang/cig/pylith171/bin/mpinemesis on a arch-linu named scylla080 by hyang Tue Jun 19 19:14:18 2012
[22]PETSC ERROR: Libraries linked from /scylla-a/home/hyang/cig/pylith171/lib
[22]PETSC ERROR: Configure run at Tue Jun 19 18:23:39 2012
[22]PETSC ERROR: Configure options --prefix=/scylla-a/home/hyang/cig/pylith171 --with-c2html=0 --with-x=0 --CXXFLAGS=-DMPICH_IGNORE_CXX_SEEK --with-clanguage=C++ --with-mpicompilers=1 --with-debugging=0 --with-shared-libraries=1 --with-sieve=1 --download-boost=1 --download-chaco=1 --download-ml=1 --download-f-blas-lapack=1 --with-hdf5=1 --with-hdf5-include=/scylla-a/home/hyang/cig/pylith171/include --with-hdf5-lib=/scylla-a/home/hyang/cig/pylith171/lib/libhdf5.dylib --LIBS=-lz CPPFLAGS="-I/scylla-a/home/hyang/cig/pylith171/include " LDFLAGS="-L/scylla-a/home/hyang/cig/pylith171/lib " PETSC_DIR=/scylla-a/home/hyang/cig/build/petsc-dev
[22]PETSC ERROR: ------------------------------------------------------------------------
[22]PETSC ERROR: User provided function() line 0 in unknown directory unknown file
[23]PETSC ERROR: ------------------------------------------------------------------------
[23]PETSC ERROR: Caught signal number 15 Terminate: Somet process (or the batch system) has told this process to end
[23]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger
[23]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind[23]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors
[23]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run 
[23]PETSC ERROR: to get more information on the crash.
[23]PETSC ERROR: --------------------- Error Message ------------------------------------
[23]PETSC ERROR: Signal received!
[23]PETSC ERROR: ------------------------------------------------------------------------
[23]PETSC ERROR: Petsc Development HG revision: 3bede28f1195e406d4257c9fbeebefe827793801  HG Date: Mon Jun 11 22:14:12 2012 -0400
[23]PETSC ERROR: See docs/changes/index.html for recent updates.
[23]PETSC ERROR: See docs/faq.html for hints about trouble shooting.
[23]PETSC ERROR: See docs/index.html for manual pages.
[23]PETSC ERROR: ------------------------------------------------------------------------
[23]PETSC ERROR: /scylla-a/home/hyang/cig/pylith171/bin/mpinemesis on a arch-linu named scylla080 by hyang Tue Jun 19 19:14:18 2012
[23]PETSC ERROR: Libraries linked from /scylla-a/home/hyang/cig/pylith171/lib
[23]PETSC ERROR: Configure run at Tue Jun 19 18:23:39 2012
[23]PETSC ERROR: Configure options --prefix=/scylla-a/home/hyang/cig/pylith171 --with-c2html=0 --with-x=0 --CXXFLAGS=-DMPICH_IGNORE_CXX_SEEK --with-clanguage=C++ --with-mpicompilers=1 --with-debugging=0 --with-shared-libraries=1 --with-sieve=1 --download-boost=1 --download-chaco=1 --download-ml=1 --download-f-blas-lapack=1 --with-hdf5=1 --with-hdf5-include=/scylla-a/home/hyang/cig/pylith171/include --with-hdf5-lib=/scylla-a/home/hyang/cig/pylith171/lib/libhdf5.dylib --LIBS=-lz CPPFLAGS="-I/scylla-a/home/hyang/cig/pylith171/include " LDFLAGS="-L/scylla-a/home/hyang/cig/pylith171/lib " PETSC_DIR=/scylla-a/home/hyang/cig/build/petsc-dev
[23]PETSC ERROR: ------------------------------------------------------------------------
[23]PETSC ERROR: User provided function() line 0 in unknown directory unknown file
[scylla064:20682] 8 more processes have sent help message help-mpi-api.txt / mpi-abort
/scylla-a/home/hyang/cig/pylith171/bin/nemesis: mpirun: exit 59


More information about the CIG-SHORT mailing list