Initializing AMReX (26.05-57-gcf037614c3b2)... MPI initialized with 4 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.05-57-gcf037614c3b2) initialized REMORA git hash: v1.5-139-g612f474 AMReX git hash: 26.05-57-gcf037614c3 Making level 0 from scratch GRIDS AT LEVEL 0 ARE (BoxArray maxbox(4) m_ref->m_hash_sig(0) ((0,0,0) (159,159,63) (0,0,0)) ((160,0,0) (319,159,63) (0,0,0)) ((0,160,0) (159,319,63) (0,0,0)) ((160,160,0) (319,319,63) (0,0,0)) ) Writing plotfile Seamount64-xy_plt00000 Coarse STEP 1 starts ... Coarse STEP 1 ends. TIME = 60 DT = 60 Coarse STEP 2 starts ... Coarse STEP 2 ends. TIME = 120 DT = 60 Coarse STEP 3 starts ... Coarse STEP 3 ends. TIME = 180 DT = 60 Coarse STEP 4 starts ... Coarse STEP 4 ends. TIME = 240 DT = 60 Coarse STEP 5 starts ... Coarse STEP 5 ends. TIME = 300 DT = 60 Coarse STEP 6 starts ... Coarse STEP 6 ends. TIME = 360 DT = 60 Coarse STEP 7 starts ... Coarse STEP 7 ends. TIME = 420 DT = 60 Coarse STEP 8 starts ... Coarse STEP 8 ends. TIME = 480 DT = 60 Coarse STEP 9 starts ... Coarse STEP 9 ends. TIME = 540 DT = 60 Coarse STEP 10 starts ... Coarse STEP 10 ends. TIME = 600 DT = 60 Writing plotfile Seamount64-xy_plt00010 TinyProfiler total time across processes [min...avg...max]: 7.52 ... 7.54 ... 7.557 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- FillBoundary_finish() 3935 1.546 1.619 1.694 22.41% FillBoundary_nowait() 3935 1.398 1.503 1.592 21.07% REMORA::advance2d() 590 1.441 1.46 1.48 19.58% REMORAPhysBCFunct::() 1896 0.2422 0.3057 0.3724 4.93% REMORA::uv3dmix() 590 0.3267 0.3312 0.3354 4.44% VisMF::Write(FabArray) 4 0.2834 0.3133 0.3256 4.31% REMORA::rhs_uv_2d() 580 0.2552 0.2734 0.2928 3.87% REMORA::vert_visc_3d() 50 0.2745 0.2795 0.2843 3.76% REMORA::advance_3d() 10 0.1884 0.1982 0.2033 2.69% REMORA::prestep() 10 0.1548 0.1577 0.161 2.13% REMORA::t3dmix2_s() 20 0.1542 0.1556 0.1568 2.08% REMORA::setup_step() 10 0.1457 0.1474 0.1485 1.97% REMORA::rhs_t_3d() 30 0.136 0.1361 0.1362 1.80% REMORA::rhs_uv_3d() 10 0.1275 0.1288 0.1304 1.73% REMORA::prestep_t_advection() 30 0.11 0.1177 0.1254 1.66% FabArray::setVal() 171 0.08013 0.0817 0.08426 1.11% REMORA::estTimeStep() 11 0.04 0.04996 0.06885 0.91% REMORA::InitData() 2 0.04652 0.05233 0.06262 0.83% REMORA::Evolve() 1 0.03605 0.04147 0.05142 0.68% amrex::Copy() 52 0.03532 0.03672 0.03757 0.50% REMORA::stretch_transform() 11 0.0317 0.03323 0.03403 0.45% REMORA::update_massflux_3d() 20 0.0175 0.02274 0.02608 0.35% REMORA::prsgrd() 10 0.00837 0.01367 0.01862 0.25% MultiFab::contains_nan() 10 0.01326 0.01395 0.01497 0.20% MultiFab::contains_inf() 10 0.01027 0.01027 0.01027 0.14% REMORA::set_analytic_vmix() 11 0.008554 0.008769 0.00893 0.12% REMORA::advance_3d_ml() 10 0.006726 0.007287 0.007847 0.10% WriteMultiLevelPlotfileWithBathymetry() 2 0.001098 0.002275 0.00501 0.07% REMORA::init_only() 1 0.002994 0.003708 0.004006 0.05% REMORA::FillPatch() 1866 0.003544 0.003631 0.003821 0.05% REMORA::set_zeta_to_Ztavg() 10 0.003635 0.003654 0.003664 0.05% FillPatchSingleLevel 1998 0.002003 0.002127 0.00226 0.03% FabArray::FillBoundary() 3313 0.00184 0.002039 0.002192 0.03% FabArray::EnforcePeriodicity 619 0.0003485 0.0003648 0.0003759 0.00% REMORA::Advance() 10 0.0003003 0.0003178 0.0003368 0.00% REMORA::FillPatchNoBC() 132 0.0001223 0.0001355 0.0001514 0.00% main() 1 0.0001344 0.0001383 0.0001459 0.00% MultiFab::Copy() 39 1.611e-05 1.673e-05 1.845e-05 0.00% Other 4794 0.0182 0.02303 0.0275 0.36% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 7.52 7.54 7.557 100.00% REMORA::Evolve() 1 7.184 7.202 7.212 95.44% REMORA::Advance() 10 6.93 6.935 6.943 91.87% REMORA::advance2d() 590 4.766 4.767 4.768 63.09% FabArray::FillBoundary() 3313 2.65 2.702 2.745 36.32% REMORA::FillPatch() 1866 2.111 2.149 2.183 28.89% FillBoundary_finish() 3935 1.546 1.619 1.694 22.41% FillPatchSingleLevel 1998 1.576 1.624 1.662 21.99% FillBoundary_nowait() 3935 1.4 1.505 1.594 21.10% REMORA::setup_step() 10 1.148 1.153 1.161 15.36% REMORA::advance_3d_ml() 10 1.013 1.014 1.015 13.43% REMORA::advance_3d() 10 0.8835 0.8853 0.8875 11.74% FabArray::EnforcePeriodicity 619 0.3798 0.4231 0.4676 6.19% REMORAPhysBCFunct::() 1896 0.2538 0.3178 0.3809 5.04% REMORA::InitData() 2 0.3333 0.3373 0.3448 4.56% REMORA::uv3dmix() 590 0.3267 0.3312 0.3354 4.44% WriteMultiLevelPlotfileWithBathymetry() 2 0.289 0.3173 0.3296 4.36% VisMF::Write(FabArray) 4 0.2834 0.3133 0.3256 4.31% REMORA::prestep() 10 0.2956 0.2999 0.3045 4.03% REMORA::rhs_uv_2d() 580 0.2552 0.2734 0.2928 3.87% REMORA::vert_visc_3d() 50 0.2745 0.2795 0.2843 3.76% REMORA::FillPatchNoBC() 132 0.195 0.2002 0.2064 2.73% REMORA::t3dmix2_s() 20 0.1542 0.1556 0.1568 2.08% REMORA::rhs_t_3d() 30 0.1371 0.1371 0.1371 1.81% REMORA::rhs_uv_3d() 10 0.1275 0.1288 0.1304 1.73% REMORA::prestep_t_advection() 30 0.11 0.1177 0.1254 1.66% REMORA::stretch_transform() 11 0.09648 0.09708 0.0974 1.29% FabArray::setVal() 171 0.08013 0.0817 0.08426 1.11% REMORA::set_analytic_vmix() 11 0.0775 0.07751 0.07751 1.03% REMORA::estTimeStep() 11 0.04 0.04996 0.06885 0.91% REMORA::init_only() 1 0.05782 0.05782 0.05782 0.77% amrex::Copy() 52 0.03532 0.03672 0.03757 0.50% MultiFab::Copy() 39 0.02848 0.02905 0.02975 0.39% REMORA::update_massflux_3d() 20 0.0175 0.02274 0.02608 0.35% REMORA::prsgrd() 10 0.00837 0.01367 0.01862 0.25% MultiFab::contains_nan() 10 0.01326 0.01395 0.01497 0.20% REMORA::set_zeta_to_Ztavg() 10 0.009397 0.009854 0.0103 0.14% MultiFab::contains_inf() 10 0.01027 0.01027 0.01027 0.14% Other 4794 0.05384 0.06214 0.07122 0.94% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] Device Memory Usage: ---------------------------------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max CurrentMem max ---------------------------------------------------------------------------------------------------------------------------------------------- The_Arena::Initialize() 4 4 81 B 94 B 113 B 1024 MiB 1024 MiB 1024 MiB 0 B REMORA::InitData() 352 320 624 MiB 626 MiB 626 MiB 786 MiB 786 MiB 786 MiB 174 MiB REMORA::Evolve() 12 12 3094 KiB 3434 KiB 3623 KiB 141 MiB 141 MiB 141 MiB 0 B REMORA::advance_3d() 760 760 8593 KiB 8703 KiB 8791 KiB 107 MiB 107 MiB 107 MiB 0 B REMORA::prestep_t_advection() 120 120 2436 KiB 2514 KiB 2596 KiB 105 MiB 105 MiB 105 MiB 0 B REMORA::prestep() 160 160 2942 KiB 2986 KiB 3034 KiB 79 MiB 79 MiB 79 MiB 0 B REMORA::prsgrd() 40 40 1026 KiB 1096 KiB 1163 KiB 78 MiB 78 MiB 78 MiB 0 B REMORA::setup_step() 240 240 7749 KiB 7765 KiB 7781 KiB 67 MiB 67 MiB 67 MiB 0 B REMORA::rhs_t_3d() 480 480 868 KiB 1063 KiB 1188 KiB 65 MiB 65 MiB 65 MiB 0 B REMORA::t3dmix2_s() 160 160 768 KiB 788 KiB 806 KiB 62 MiB 62 MiB 62 MiB 0 B WriteMultiLevelPlotfileWithBathymetry() 8 8 2353 KiB 2598 KiB 2699 KiB 62 MiB 62 MiB 62 MiB 0 B REMORA::uv3dmix() 2360 2360 793 KiB 820 KiB 844 KiB 52 MiB 52 MiB 52 MiB 0 B REMORA::rhs_uv_3d() 160 160 761 KiB 782 KiB 799 KiB 50 MiB 50 MiB 50 MiB 0 B REMORA::estTimeStep() 132 132 196 KiB 245 KiB 339 KiB 37 MiB 37 MiB 37 MiB 0 B ResizeRandomSeed 4 4 9206 KiB 9206 KiB 9206 KiB 9216 KiB 9216 KiB 9216 KiB 0 B REMORA::advance2d() 9440 9440 1705 KiB 1706 KiB 1707 KiB 3222 KiB 3222 KiB 3222 KiB 0 B REMORA::rhs_uv_2d() 2320 2320 61 KiB 62 KiB 64 KiB 840 KiB 840 KiB 840 KiB 0 B REMORA::update_massflux_3d() 80 80 1439 B 1695 B 1857 B 420 KiB 420 KiB 420 KiB 0 B VisMF::Write(FabArray) 64 64 23 B 87 B 165 B 96 KiB 96 KiB 96 KiB 0 B FillBoundary_nowait() 4936 4892 47 KiB 47 KiB 48 KiB 51 KiB 52 KiB 52 KiB 13 KiB FillBoundary_finish() 4936 4892 47 KiB 47 KiB 48 KiB 51 KiB 52 KiB 52 KiB 13 KiB MultiFab::contains_nan() 52 48 262 B 262 B 264 B 6656 B 6656 B 6656 B 256 B MultiFab::contains_inf() 40 40 6 B 6 B 7 B 6144 B 6144 B 6144 B 0 B impose_cons_bcs() 88 88 0 B 0 B 0 B 256 B 256 B 256 B 0 B impose_xvel_bcs() 44 44 0 B 0 B 0 B 256 B 256 B 256 B 0 B impose_yvel_bcs() 44 44 0 B 0 B 0 B 256 B 256 B 256 B 0 B ---------------------------------------------------------------------------------------------------------------------------------------------- Async Memory Usage: ------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ------------------------------------------------------------------------------------------------------------- REMORA::prsgrd() 40 86 KiB 141 KiB 192 KiB 78 MiB 78 MiB 78 MiB REMORA::advance_3d() 600 2970 KiB 3007 KiB 3054 KiB 53 MiB 53 MiB 53 MiB REMORA::prestep_t_advection() 120 759 KiB 812 KiB 865 KiB 52 MiB 52 MiB 52 MiB REMORA::rhs_t_3d() 480 417 KiB 441 KiB 479 KiB 52 MiB 52 MiB 52 MiB REMORA::uv3dmix() 2360 130 KiB 152 KiB 173 KiB 52 MiB 52 MiB 52 MiB REMORA::rhs_uv_3d() 160 667 KiB 670 KiB 673 KiB 50 MiB 50 MiB 50 MiB REMORA::t3dmix2_s() 160 490 KiB 518 KiB 542 KiB 50 MiB 50 MiB 50 MiB REMORA::setup_step() 80 568 KiB 579 KiB 588 KiB 13 MiB 13 MiB 13 MiB REMORA::prestep() 40 203 KiB 216 KiB 229 KiB 13 MiB 13 MiB 13 MiB REMORA::rhs_uv_2d() 2320 27 KiB 29 KiB 31 KiB 840 KiB 840 KiB 840 KiB REMORA::advance2d() 2360 6080 B 6138 B 6188 B 215 KiB 215 KiB 215 KiB REMORA::update_massflux_3d() 80 482 B 626 B 719 B 210 KiB 210 KiB 210 KiB ------------------------------------------------------------------------------------------------------------- Managed Memory Usage: --------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------- The_Managed_Arena::Initialize() 4 0 B 0 B 0 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------- Pinned Memory Usage: ------------------------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max CurrentMem max ------------------------------------------------------------------------------------------------------------------------------------- VisMF::Write(FabArray) 80 80 1612 KiB 1702 KiB 1749 KiB 62 MiB 62 MiB 62 MiB 0 B The_Pinned_Arena::Initialize() 4 4 0 B 0 B 1 B 8192 KiB 8192 KiB 8192 KiB 0 B FillBoundary_nowait() 36400 36356 277 KiB 287 KiB 306 KiB 5917 KiB 5917 KiB 5918 KiB 13 KiB FillBoundary_finish() 4936 4892 47 KiB 47 KiB 48 KiB 51 KiB 52 KiB 52 KiB 13 KiB MultiFab::contains_nan() 52 48 253 B 254 B 255 B 768 B 768 B 768 B 256 B REMORA::estTimeStep() 88 88 1 B 1 B 2 B 512 B 512 B 512 B 0 B MultiFab::contains_inf() 40 40 0 B 0 B 0 B 256 B 256 B 256 B 0 B ------------------------------------------------------------------------------------------------------------------------------------- Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [3315 ... 3315] [The Arena] max space (MB) allocated spread across MPI: [1024 ... 1024] [The Arena] max space (MB) used spread across MPI: [891 ... 891] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [133 ... 133] [The Pinned Arena] max space (MB) used spread across MPI: [62 ... 62] AMReX (26.05-57-gcf037614c3b2) finalized