[aspect-devel] Aspect 2.0 tests failure question

[Ravi Kanda]

Hi,

I ran Aspect (2.0 pre) tests with "make setup_tests", and "make test" 
from the Aspect root install directory (location of the shared 
executable).  Based on the (attached) summary screen output from the 
tests, I see that 194/558 (or nearly 35%) tests failed.  I remembered 
something along these lines brought up on the [aspect-devel] mailing 
list before - found the discussion thread "aspect ctest fails?" from 
June 2017.  After going through that train of emails, I am still 
wondering about the best way to proceed.

To clarify, what I would like to do is be able to see what a 
test-failure means in practical terms - i.e., how far off is my 
model-state from that output by the reference tester?   It'd be great to 
know (say for a specific test) what the exact values from the reference 
tester are - so, I'd know whether that would invalidate a simulation I 
run using the particular code feature being tested.

I see that all successful tests generated folders called 
"output-"<TEST_NAME>.  The failed tests generated folders named 
<TEST_NAME>, typically containing "statistics" and "screen-output" 
files.  I also see that the successful test folders have a blank 
"*.diff" file. Is test-failure purely based on "diffing" the tester 
output with that from a particular aspect-installation?  If already in 
the GIT-repository, I will appreciate it if someone can point me to the 
reference tester results (I am definitely new to this repository!).

Thanks much for your time,
Ravi.
---------
Basic info regarding the system and Aspect install (command line output):
=================================================
System 76 Leopard Extreme (hex-core, Intel core-i7 at 3.4 GHz, 64 GB RAM)
=================================================
 > uname -a
Linux RKLX 3.13.0-29-generic #53-Ubuntu SMP Wed Jun 4 21:00:20 UTC 2014 
x86_64 x86_64 x86_64 GNU/Linux
 >
 > lsb_release -a
LSB Version: 
core-2.0-amd64:core-2.0-noarch:core-3.0-amd64:core-3.0-noarch:core-3.1-amd64:core-3.1-noarch:core-3.2-amd64:core-3.2-noarch:core-4.0-amd64:core-4.0-noarch:core-4.1-amd64:core-4.1-noarch:security-4.0-amd64:security-4.0-noarch:security-4.1-amd64:security-4.1-noarch
Distributor ID:    Ubuntu
Description:    Ubuntu 14.04.5 LTS
Release:    14.04
Codename:    trusty
 >
[CMAKE config log]
 > more detailed.log
###
#
#  ASPECT configuration:
#        ASPECT_VERSION:            2.0.0-pre
#        DEAL_II_DIR: 
/home/rkanda/sw/Aspect/deal.II-v8.5.1/lib/cmake/deal.II
#        DEAL_II VERSION:           8.5.1
#        ASPECT_USE_PETSC:          OFF
#        ASPECT_USE_FP_EXCEPTIONS:  OFF
#        ASPECT_RUN_ALL_TESTS:      ON
#        ASPECT_USE_SHARED_LIBS:    ON
#        ASPECT_HAVE_LINK_H:        ON
#        CMAKE_BUILD_TYPE:          Debug
#        CMAKE_INSTALL_PREFIX:      /usr/local
#        CMAKE_SOURCE_DIR:          /home/rkanda/sw/Aspect/aspect
#        CMAKE_BINARY_DIR:          /home/rkanda/sw/Aspect/aspect
#        CMAKE_CXX_COMPILER:        GNU 4.8.5 on platform Linux x86_64
#                                   /usr/bin/mpicxx
#        CMAKE_C_COMPILER:          /usr/bin/mpicc
#
#        LINKAGE:                   DYNAMIC
#
###
 >
 > aspect -v
--------------------------------------------------------------------------
SLEPc Release Version 3.7.3, Sep 29, 2016
        The SLEPc Team
     slepc-maint at upv.es
  http://slepc.upv.es
See docs/manual.html for help.
SLEPc libraries linked from /home/rkanda/sw/Aspect//slepc-3.7.3/lib
--------------------------------------------------------------------------
Petsc Release Version 3.7.6, Apr, 24, 2017
        The PETSc Team
     petsc-maint at mcs.anl.gov
  http://www.mcs.anl.gov/petsc/
See docs/changes/index.html for recent updates.
See docs/faq.html for problems.
See docs/manualpages/index.html for help.
Libraries linked from /home/rkanda/sw/Aspect/petsc-3.7.6/lib
--------------------------------------------------------------------------
-----------------------------------------------------------------------------
-- This is ASPECT, the Advanced Solver for Problems in Earth's ConvecTion.
--     . version 2.0.0-pre (master, 20cb201)
--     . using deal.II 8.5.1
--     . using Trilinos 12.10.1
--     . using p4est 2.0.0
--     . running in DEBUG mode
--     . running with 1 MPI process
-----------------------------------------------------------------------------


======================================================
-- 

---------------------------------------------------------------------
Ravi Kanda
Research Fellow
Department of Geology
Utah State University
4505 Old Main Hill
Logan UT 84322-4505
--------------------------
Web Page: https://ravi-vs-kanda.github.io

----------------------------------------------------------------------
For a human being, the unexamined life is not worth living - SOCRATES
----------------------------------------------------------------------

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.geodynamics.org/pipermail/aspect-devel/attachments/20180510/0a9b4da6/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: ASPECT_test_run1.log
Type: text/x-log
Size: 95533 bytes
Desc: not available
URL: <http://lists.geodynamics.org/pipermail/aspect-devel/attachments/20180510/0a9b4da6/attachment-0001.bin>