[CIG-SEISMO] SPECFEM3D: GPU memory usage limited

[Fehr, Moritz]

Hi Daniel,

thanks for your rapid response. Sorry, I do not have any error output file, because of breaking up the simulation by myself (The simulation remains in the process of receiver detection).  But I tried the same simulation with just one receiver and it works fine.
Please let me know if you can fix the problem.

Thanks
Mo



-----------------------------------------------------------------------------------------------------------------------------------
hi Moritz,

is there also an error output?

I’m not aware that there should be such an issue with SPECFEM3D on this newest GPU hardware. running simulations on Pascal GPUs with multiple GB memory usage works just fine. so I would expect that the run exits because of another issue, not because of the GPU memory part.

your output_solver.txt stops at the receiver detection. based on your setup which uses about 13,670 stations, i expect it to be a receiver detection issue. this routines works fine for a few hundred station, but becomes very slow for more than a few thousand on a single process. this issue has been addressed in the global version, let me see if i can implement it in a similar way in the SPECFEM3D devel version.

many thanks for pointing out,
daniel



On Jan 24, 2018, at 6:35 PM, Fehr, Moritz <Moritz.Fehr at dmt-group.com<mailto:Moritz.Fehr at dmt-group.com>> wrote:

Hallo,

I have a problem simulating a CUBIT meshed model (1.000.000 elements) on a Tesla GPU V100-SXM2 (amazon cloud CPU / GPU cluster). I am using SPECEM3D Cartesian (V3.0) and the newest CUDA 9 lib. I want to share this issue: It seems that the GPU memory usage is limited to a value of 420 MiB although the maximum GPU memory is 16000 Mib.
Do you have any idea about the origin of this limitation?

Thanks
Mo

<image001.png>



<CMTSOLUTION><output_solver.txt><gpu_device_info.txt><Par_file><output_generate_databases.txt><values_from_mesher.h>_______________________________________________
CIG-SEISMO mailing list
CIG-SEISMO at geodynamics.org<mailto:CIG-SEISMO at geodynamics.org>
http://lists.geodynamics.org/cgi-bin/mailman/listinfo/cig-seismo


________________________________
This message and its contents including attachments are intended solely for the original recipient. If you are not the intended recipient or have received this message in error, please notify me immediately and delete this message from your computer system. Any unauthorized use or distribution is prohibited. Please consider the environment before printing this email.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.geodynamics.org/pipermail/cig-seismo/attachments/20180124/7c4f0513/attachment.html>

___________________________________________________________________________________________________
Sitz der Gesellschaft/Headquarters: DMT GmbH & Co. KG * Am Technologiepark 1 * 45307 Essen * Deutschland/Germany
Registergericht/County Court: Amtsgericht Essen * HRA 9091 * USt-ID DE 253275653
Komplementär/Fully Liable Partner: DMT Verwaltungsgesellschaft mbH, Essen
Registergericht/County Court: Amtsgericht Essen * HRB 20420
Geschäftsführer/Board of Directors: Prof. Dr. Eiko Räkers (Vorsitzender/CEO), Dr. Maik Tiedemann, Ulrich Pröpper, Jens-Peter Lux
Vorsitzender des Aufsichtsrates/Chairman of the Supervisory Board: Jürgen Himmelsbach
TÜV NORD GROUP
___________________________________________________________________________________________________
Diese Nachricht enthält vertrauliche Informationen und ist nur für den Empfänger bestimmt. Wenn Sie nicht der Empfänger sind, sollten Sie die E-Mail nicht verbreiten, verteilen oder diese E-Mail kopieren. Benachrichtigen Sie bitte den Absender per E-Mail, wenn Sie diese E-Mail irrtümlich erhalten haben und löschen dann diese E-Mail von Ihrem System.

This message contains confidential information and is intended only for the recipient. If you are not the recipient you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately by e-mail if you have received this e-mail by mistake and delete this e-mail from your system.