[aspect-devel] Aspect 2.0 tests failure question

[Bob Myhill]

Hi all,

Wolfgang, do you think it might be valuable to add a relaxed tolerance to
the tests for end users, to suppress the non critical failures? We could
always keep the pure diff when testing on Timo's server.

I could play with this at the start of the Hackathon if you wanted, in lieu
of the annual typo hunt? My OCD always plays up when I see failed tests!

Bob




On Fri, 11 May 2018, 07:50 Wolfgang Bangerth, <bangerth at colostate.edu>
wrote:

>
> Ravi,
>
> > I ran Aspect (2.0 pre) tests with "make setup_tests", and "make test"
> from the
> > Aspect root install directory (location of the shared executable).
> Based on
> > the (attached) summary screen output from the tests, I see that 194/558
> (or
> > nearly 35%) tests failed.
>
> That is a pretty normal number. It is because every compiler and processor
> produces results that differ very slightly. ASPECT stores "correct" output
> in
> the tests/<TESTNAME>/ directories (corresponding to the
> tests/<TESTNAME>.prm
> file) and after running the ASPECT executable on the .prm file, simply
> does a
> diff between your output and the stored one.
>
> If you want to see the differences, do something like
>    ctest -V -R <TESTNAME>
> and it will give you an idea how these differences look like -- generally,
> they should be in the 6th or 7th digit of all outputs.
>
> Best
>   W.
>
> --
> ------------------------------------------------------------------------
> Wolfgang Bangerth          email:                 bangerth at colostate.edu
>                             www: http://www.math.colostate.edu/~bangerth/
>
> _______________________________________________
> Aspect-devel mailing list
> Aspect-devel at geodynamics.org
> http://lists.geodynamics.org/cgi-bin/mailman/listinfo/aspect-devel
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.geodynamics.org/pipermail/aspect-devel/attachments/20180511/0f9c1206/attachment.html>