[aspect-devel] aspect ctest fails?
Rene Gassmoeller
rene.gassmoeller at mailbox.org
Wed Jun 7 13:04:42 PDT 2017
Hi Mark,
I guess the short answer to your question is: Do not worry, the
installation is most likely correct.
The slightly longer answer is that the test suite is designed to
accurately test for us if changes to the code change the results by a
small fraction, therefore it is very sensitive to different libraries,
operating systems, and so on. The fact that 3 quarters of the tests
succeed is actually very encouraging, many systems show more failures,
and the only system that succeeds in all of them is our official test
machine. As long as you do not observe crashes, but rather test failures
(caused by tiny differences in the output) there is no reason to believe
the installation is not correct.
An even more detailed answer would be a starting point for a discussion:
I have seen many times that new users got puzzled by this result,
because everyone assumes the testsuite to be a test for a correct
compilation, instead of a test for accuracy on our reference tester. We
should probably do a better job in making that clear, and maybe we can
extend our list of simple tests (the one that is executed if you set -D
ASPECT_RUN_ALL_TESTS=OFF), so that it gives everyone a better idea of
whether their installation is correct. @Timo: Is it possible to add more
tests to the simple tests and maybe also decrease their sensitivity
(i.e. increase the tolerance for numdiff)? The only problem would be the
number of solver iterations, since that can potentially change by a
significant fraction of the overall number.
Best,
Rene
On 07.06.2017 12:35, Wiederspahn, Mark wrote:
>
> I'm trying to install aspect 1.5.0 on Fedora 24, and it seems to
> produce a correct executable.
>
> I'm looking for ways to confirm it behaves as it should.
>
>
>
> When I set up the ctest runs as documented in the Testing section of
> the manual, some of it works.
>
> Does this pattern of failure suggest where I should look first for the
> culprit?
>
> There are only 4 tests with "EXPECT FAILURE" in the .prm files.
>
>
>
> thanks,
>
>
>
> ./aspect -v
>
> --------------------------------------------------------------------------
>
> SLEPc Release Version 3.6.0, Jun 12, 2015
>
> The SLEPc Team
>
> slepc-maint at upv.es
>
> http://slepc.upv.es
>
> See docs/manual.html for help.
>
> SLEPc libraries linked from
> /home/staff/markw/deal.ii-candi/slepc-3.6.0/lib
>
> --------------------------------------------------------------------------
>
> Petsc Release Version 3.6.4, Apr, 12, 2016
>
> The PETSc Team
>
> petsc-maint at mcs.anl.gov
>
> http://www.mcs.anl.gov/petsc/
>
> See docs/changes/index.html for recent updates.
>
> See docs/faq.html for problems.
>
> See docs/manualpages/index.html for help.
>
> Libraries linked from /home/staff/markw/deal.ii-candi/petsc-3.6.4/lib
>
> --------------------------------------------------------------------------
>
> -----------------------------------------------------------------------------
>
> -- This is ASPECT, the Advanced Solver for Problems in Earth's ConvecTion.
>
> -- . version 1.5.0
>
> -- . running in DEBUG mode
>
> -- . running with 1 MPI process
>
> -- . using Trilinos
>
> -----------------------------------------------------------------------------
>
>
>
> Version information of underlying libraries:
>
> . deal.II: 8.5.0
>
> . Trilinos: 12.10.1
>
> . p4est: 2.0.0
>
>
>
> Test project /home/staff/markw/Aspect/aspect-1.5.0
>
> Start 1: additional_outputs
>
> 1/414 Test #1: additional_outputs
> ............................................. Passed 9.54 sec
>
> Start 2: additional_outputs_02
>
> 2/414 Test #2: additional_outputs_02
> .......................................... Passed 8.95 sec
>
> Start 3: additional_outputs_03
>
> 3/414 Test #3: additional_outputs_03
> .......................................... Passed 9.10 sec
>
> Start 4: adiabatic_boundary
>
> 4/414 Test #4: adiabatic_boundary
> ............................................. Passed 8.81 sec
>
> Start 5: adiabatic_conditions
>
> 5/414 Test #5: adiabatic_conditions
> ...........................................***Failed 8.84 sec
>
> Start 6: adiabatic_conditions_function
>
> 6/414 Test #6: adiabatic_conditions_function
> .................................. Passed 8.96 sec
>
> Start 7: adiabatic_heating
>
> 7/414 Test #7: adiabatic_heating
> .............................................. Passed 8.97 sec
>
> Start 8: adiabatic_heating_simplified
>
> 8/414 Test #8: adiabatic_heating_simplified
> ................................... Passed 9.33 sec
>
> Start 9: adiabatic_heating_with_melt
>
> ...
>
>
>
> 72% tests passed, 117 tests failed out of 414
>
>
>
> Total Test time (real) = 6348.61 sec
>
>
>
> The following tests FAILED:
>
> 5 - adiabatic_conditions (Failed)
>
> 9 - adiabatic_heating_with_melt (Failed)
>
> 10 - adiabatic_initial_conditions (Failed)
>
> 13 - adiabatic_initial_conditions_compressible (Failed)
>
> 14 - adiabatic_initial_conditions_constant (Failed)
>
> 15 - adiabatic_initial_conditions_subadiabaticity (Failed)
>
> 16 - adiabatic_initial_conditions_without_boundary (Failed)
>
> 17 - advect_mesh_vertically (Failed)
>
> 21 - artificial_viscosity (Failed)
>
> 23 - ascii_data_adiabatic_conditions (Failed)
>
> 25 - ascii_data_boundary_composition_3d_box (Failed)
>
> 32 - ascii_data_boundary_velocity_2d_shell (Failed)
>
> 33 - ascii_data_boundary_velocity_3d_box (Failed)
>
> 35 - ascii_data_boundary_velocity_3d_shell (Failed)
>
> 36 - ascii_data_gravity (Failed)
>
> 39 - ascii_data_initial_composition_3d_shell (Failed)
>
> 42 - ascii_data_initial_temperature_3d_shell (Failed)
>
> 49 - average_none (Failed)
>
> 55 - backward_advection (Failed)
>
> 67 - burnman_test (Failed)
>
> 70 - cells_in_circumference (Failed)
>
> 71 - checkpoint_01 (Failed)
>
> 72 - checkpoint_02 (Failed)
>
> 79 - composition-active-with-melt (Failed)
>
> 86 - composition_stabilization (Failed)
>
> 87 - compositional_boundary_values (Failed)
>
> 88 - compositional_boundary_values_02 (Failed)
>
> 89 - compositional_boundary_values_03 (Failed)
>
> 101 - density_boundary (Failed)
>
> 102 - depth_average_01 (Failed)
>
> 103 - depth_average_02 (Failed)
>
> 104 - depth_average_03 (Failed)
>
> 105 - depth_average_04 (Failed)
>
> 106 - depth_average_05 (Failed)
>
> 107 - depth_average_rounding_bug (Failed)
>
> 108 - depth_average_txt_output (Failed)
>
> 109 - depth_average_underres (Failed)
>
> 110 - depth_dependent_3d_shell_list_simple (Failed)
>
> 115 - depth_postprocessor_chunk (Failed)
>
> 118 - depth_postprocessor_spherical_shell (Failed)
>
> 120 - diffusion (Failed)
>
> 121 - diffusion_dislocation (Failed)
>
> 130 - discontinuous_temperature_spherical_shell_3d (Failed)
>
> 135 - dynamic_topography3 (Failed)
>
> 139 - fail (Failed)
>
> 147 - global_melt (Failed)
>
> 149 - gplates_1_3 (Failed)
>
> 150 - gplates_1_4 (Failed)
>
> 151 - gplates_3d (Failed)
>
> 152 - gplates_rotation (Failed)
>
> 155 - graphical_output_hdf5 (Failed)
>
> 159 - heat_flux_map (Failed)
>
> 160 - heat_flux_map_vis (Failed)
>
> 161 - hexagonal_initial_temperature (Failed)
>
> 165 - initial_condition_S20RTS (Failed)
>
> 166 - initial_condition_S40RTS (Failed)
>
> 167 - initial_condition_SAVANI (Failed)
>
> 168 - inner_core (Failed)
>
> 171 - iterated_IMPES_direct_solver (Failed)
>
> 181 - material_model_dependencies_burstedde (Failed)
>
> 186 - material_model_dependencies_latent_heat (Failed)
>
> 196 - material_model_dependencies_steinberger (Failed)
>
> 198 - matrix_nonzeros_1 (Failed)
>
> 200 - matrix_nonzeros_3 (Failed)
>
> 203 - maximum_refinement_function_spherical (Failed)
>
> 205 - melt_compressible_advection (Failed)
>
> 211 - melt_postprocessor_peridotite (Failed)
>
> 213 - melt_property_visualization (Failed)
>
> 214 - melt_statistics (Failed)
>
> 217 - melt_transport_compressible (Failed)
>
> 218 - melt_transport_compressible_iterative (Failed)
>
> 221 - melting_rate (Failed)
>
> 226 - minimum_refinement_function_spherical (Failed)
>
> 237 - no_flow (Failed)
>
> 239 - nonlinear_convergence_for_small_composition (Failed)
>
> 242 - octagonal_initial_temperature (Failed)
>
> 243 - octagonal_initial_temperature_rotated (Failed)
>
> 245 - parallel_output_group_0 (Failed)
>
> 246 - parallel_output_group_1 (Failed)
>
> 247 - parallel_output_group_2 (Failed)
>
> 269 - particle_output_hdf5 (Failed)
>
> 280 - passive_comp (Failed)
>
> 291 - point_value_02 (Failed)
>
> 292 - point_value_02_mpi (Failed)
>
> 293 - point_value_03 (Failed)
>
> 302 - pressure_boundary (Failed)
>
> 306 - pressure_compatibility_4 (Failed)
>
> 312 - radioactive_decay (Failed)
>
> 314 - refine_vel (Failed)
>
> 322 - refinement_switch (Failed)
>
> 324 - remove_angular_momentum (Failed)
>
> 325 - remove_net_rotation (Failed)
>
> 327 - segregation_heating (Failed)
>
> 331 - shear_heating_with_melt (Failed)
>
> 338 - simple_compressible (Failed)
>
> 339 - simple_incompressible (Failed)
>
> 340 - simple_shear (Failed)
>
> 353 -
> sol_cx_4_normalized_pressure_large_static_pressure (Failed)
>
> 361 - sol_kz_2_q3 (Failed)
>
> 364 - solidus_initial_conditions (Failed)
>
> 365 - solitary_wave (Failed)
>
> 367 - spherical_velocity_statistics (Failed)
>
> 368 - steinberger_compressible (Failed)
>
> 369 - steinberger_lateral_fail (Failed)
>
> 370 - steinberger_viscosity (Failed)
>
> 371 - steinberger_viscosity_adiabatic (Failed)
>
> 376 -
> symbolic_boundary_names_spherical_shell_2d_180_degrees (Failed)
>
> 377 -
> symbolic_boundary_names_spherical_shell_2d_90_degrees (Failed)
>
> 378 - symbolic_boundary_names_spherical_shell_2d_full
> (Failed)
>
> 379 -
> symbolic_boundary_names_spherical_shell_3d_90_degrees (Failed)
>
> 380 - symbolic_boundary_names_spherical_shell_3d_full
> (Failed)
>
> 390 - traction_ascii_data (Failed)
>
> 395 - velocity_boundary_statistics (Failed)
>
> 396 - velocity_divergence (Failed)
>
> 409 - visualization_unique_list (Failed)
>
> 410 - visualization_vertical_heat_flux (Failed)
>
> 413 - zero_matrix (Failed)
>
> --
>
> Mark Wiederspahn
>
> Institute for Geophysics/Jackson School of Geosciences
>
> University of Texas at Austin
>
>
>
>
>
> _______________________________________________
> Aspect-devel mailing list
> Aspect-devel at geodynamics.org
> http://lists.geodynamics.org/cgi-bin/mailman/listinfo/aspect-devel
More information about the Aspect-devel
mailing list