[aspect-devel] Assemble temperature system time

[Eric Heien]

Hello all,

I’m doing some medium sized 3D box runs on TACC Stampede now (1e6 DOF, 32 cores) and I’ve noticed the Assemble temperature system timing is very large.

+---------------------------------------------+------------+------------+
| Total wallclock time elapsed since start    |  3.15e+03s |            |
|                                             |            |            |
| Section                         | no. calls |  wall time | % of total |
+---------------------------------+-----------+------------+------------+
| Assemble Stokes system          |       201 |       315s |        10% |
| Assemble temperature system     |       201 |  2.16e+03s |        69% |
| Build Stokes preconditioner     |         1 |      26.6s |      0.85% |
| Build temperature preconditioner|       201 |      21.7s |      0.69% |
| Solve Stokes system             |       201 |        90s |       2.9% |
| Solve temperature system        |       201 |      13.9s |      0.44% |
| Initialization                  |         2 |      1.51s |     0.048% |
| Postprocessing                  |       201 |       310s |       9.8% |
| Setup dof systems               |         1 |      15.7s |       0.5% |
+---------------------------------+-----------+------------+——————+

Does anyone have a suggestion for why this might be?  I know some of the developers recently worked on improving the performance of this, which is why it seems odd it would take so much time.  Before I dig into the reasons with a profiler, I was hoping someone might know what’s wrong.  This was compiled with Intel compiler version 13.0.079, and uses deal.II r31565 and Aspect r2009.

Thanks for your help,

-Eric