Initializing AMReX (26.06-11-g9ed35ab0e584)... MPI initialized with 4 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.06-11-g9ed35ab0e584) initialized REMORA git hash: v1.5-149-g3b71c66 AMReX git hash: 26.06-11-g9ed35ab0e5 Making level 0 from scratch GRIDS AT LEVEL 0 ARE (BoxArray maxbox(4) m_ref->m_hash_sig(0) ((0,0,0) (159,159,63) (0,0,0)) ((160,0,0) (319,159,63) (0,0,0)) ((0,160,0) (159,319,63) (0,0,0)) ((160,160,0) (319,319,63) (0,0,0)) ) Writing plotfile Seamount64-xy_plt00000 Coarse STEP 1 starts ... Coarse STEP 1 ends. TIME = 60 DT = 60 Coarse STEP 2 starts ... Coarse STEP 2 ends. TIME = 120 DT = 60 Coarse STEP 3 starts ... Coarse STEP 3 ends. TIME = 180 DT = 60 Coarse STEP 4 starts ... Coarse STEP 4 ends. TIME = 240 DT = 60 Coarse STEP 5 starts ... Coarse STEP 5 ends. TIME = 300 DT = 60 Coarse STEP 6 starts ... Coarse STEP 6 ends. TIME = 360 DT = 60 Coarse STEP 7 starts ... Coarse STEP 7 ends. TIME = 420 DT = 60 Coarse STEP 8 starts ... Coarse STEP 8 ends. TIME = 480 DT = 60 Coarse STEP 9 starts ... Coarse STEP 9 ends. TIME = 540 DT = 60 Coarse STEP 10 starts ... Coarse STEP 10 ends. TIME = 600 DT = 60 Writing plotfile Seamount64-xy_plt00010 TinyProfiler total time across processes [min...avg...max]: 7.988 ... 8.007 ... 8.019 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- FillBoundary_finish() 3935 1.577 1.625 1.681 20.96% FillBoundary_nowait() 3935 1.432 1.508 1.557 19.42% REMORA::advance2d() 590 1.454 1.463 1.479 18.44% VisMF::Write(FabArray) 4 0.721 0.7371 0.7541 9.40% REMORAPhysBCFunct::() 1896 0.2383 0.3071 0.3727 4.65% REMORA::uv3dmix() 590 0.3295 0.3357 0.3412 4.25% REMORA::rhs_uv_2d() 580 0.2644 0.2733 0.2888 3.60% REMORA::vert_visc_3d() 50 0.2758 0.2797 0.2829 3.53% REMORA::advance_3d() 10 0.1967 0.1987 0.2041 2.55% REMORA::prestep() 10 0.1517 0.1579 0.163 2.03% REMORA::t3dmix2_s() 20 0.1482 0.1517 0.1589 1.98% REMORA::setup_step() 10 0.1292 0.1409 0.1525 1.90% REMORA::rhs_t_3d() 30 0.1364 0.1364 0.1364 1.70% REMORA::prestep_t_advection() 30 0.1054 0.1177 0.1329 1.66% REMORA::rhs_uv_3d() 10 0.1261 0.1285 0.1318 1.64% FabArray::setVal() 171 0.07904 0.08206 0.085 1.06% REMORA::estTimeStep() 11 0.03938 0.05856 0.08465 1.06% REMORA::InitData() 2 0.04529 0.05921 0.07146 0.89% REMORA::Evolve() 1 0.03476 0.03999 0.04517 0.56% amrex::Copy() 52 0.03616 0.0372 0.03776 0.47% main() 1 0.0002065 0.009115 0.03561 0.44% REMORA::stretch_transform() 11 0.03245 0.03353 0.03439 0.43% REMORA::update_massflux_3d() 20 0.02082 0.02273 0.02561 0.32% REMORA::prsgrd() 10 0.009452 0.01709 0.02379 0.30% MultiFab::contains_nan() 10 0.01343 0.01411 0.01474 0.18% DistributionMapping::LeastUsedCPUs() 1 1.102e-05 0.005205 0.01247 0.16% REMORA::advance_3d_ml() 10 0.005228 0.007197 0.00972 0.12% REMORA::set_analytic_vmix() 11 0.008434 0.008779 0.009068 0.11% REMORA::init_only() 1 0.003183 0.00389 0.004486 0.06% WriteMultiLevelPlotfileWithBathymetry() 2 0.001359 0.002282 0.004251 0.05% REMORA::FillPatch() 1866 0.003678 0.003764 0.003943 0.05% REMORA::set_zeta_to_Ztavg() 10 0.003641 0.003661 0.003677 0.05% FillPatchSingleLevel 1998 0.002094 0.00216 0.002319 0.03% FabArray::FillBoundary() 3313 0.001887 0.002011 0.002213 0.03% FabArray::EnforcePeriodicity 619 0.0003442 0.0003708 0.0003868 0.00% REMORA::Advance() 10 0.0003199 0.0003392 0.0003571 0.00% REMORA::FillPatchNoBC() 132 0.0001271 0.0001335 0.0001462 0.00% MultiFab::Copy() 39 1.419e-05 1.509e-05 1.63e-05 0.00% AmrMesh::MakeDistributionMap() 1 1.126e-06 3.691e-06 7.637e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 1.956e-06 2.486e-06 3.719e-06 0.00% Other 4801 0.02977 0.03306 0.03711 0.46% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 7.988 8.007 8.019 100.00% REMORA::Evolve() 1 7.489 7.512 7.525 93.83% REMORA::Advance() 10 6.938 6.948 6.954 86.72% REMORA::advance2d() 590 4.777 4.778 4.779 59.59% FabArray::FillBoundary() 3313 2.702 2.711 2.722 33.95% REMORA::FillPatch() 1866 2.128 2.16 2.189 27.30% FillBoundary_finish() 3935 1.577 1.625 1.681 20.96% FillPatchSingleLevel 1998 1.622 1.631 1.642 20.48% FillBoundary_nowait() 3935 1.434 1.51 1.559 19.44% REMORA::setup_step() 10 1.146 1.154 1.161 14.48% REMORA::advance_3d_ml() 10 1.013 1.015 1.018 12.69% REMORA::advance_3d() 10 0.8827 0.8861 0.8891 11.09% WriteMultiLevelPlotfileWithBathymetry() 2 0.725 0.7414 0.7584 9.46% VisMF::Write(FabArray) 4 0.721 0.7371 0.7541 9.40% REMORA::InitData() 2 0.4781 0.4858 0.4945 6.17% FabArray::EnforcePeriodicity 619 0.4105 0.4249 0.4572 5.70% REMORAPhysBCFunct::() 1896 0.2513 0.3193 0.3841 4.79% REMORA::uv3dmix() 590 0.3295 0.3357 0.3412 4.25% REMORA::prestep() 10 0.2931 0.3001 0.3089 3.85% REMORA::rhs_uv_2d() 580 0.2644 0.2733 0.2888 3.60% REMORA::vert_visc_3d() 50 0.2758 0.2797 0.2829 3.53% REMORA::FillPatchNoBC() 132 0.191 0.2002 0.2123 2.65% REMORA::t3dmix2_s() 20 0.1482 0.1517 0.1589 1.98% REMORA::rhs_t_3d() 30 0.1372 0.1372 0.1372 1.71% REMORA::prestep_t_advection() 30 0.1054 0.1177 0.1329 1.66% REMORA::rhs_uv_3d() 10 0.1261 0.1285 0.1318 1.64% REMORA::stretch_transform() 11 0.09646 0.0971 0.09775 1.22% FabArray::setVal() 171 0.07904 0.08206 0.085 1.06% REMORA::estTimeStep() 11 0.03938 0.05856 0.08465 1.06% REMORA::set_analytic_vmix() 11 0.07777 0.07777 0.07778 0.97% REMORA::init_only() 1 0.05911 0.05922 0.05954 0.74% amrex::Copy() 52 0.03616 0.0372 0.03776 0.47% MultiFab::Copy() 39 0.02851 0.02919 0.03012 0.38% REMORA::update_massflux_3d() 20 0.02082 0.02273 0.02561 0.32% REMORA::prsgrd() 10 0.009452 0.01709 0.02379 0.30% MultiFab::contains_nan() 10 0.01343 0.01411 0.01474 0.18% AmrMesh::MakeDistributionMap() 1 1.471e-05 0.005212 0.01249 0.16% DistributionMapping::SFCProcessorMapDoIt() 1 1.358e-05 0.005209 0.01248 0.16% DistributionMapping::LeastUsedCPUs() 1 1.102e-05 0.005205 0.01247 0.16% REMORA::set_zeta_to_Ztavg() 10 0.009138 0.009866 0.01078 0.13% Other 4801 0.06644 0.072 0.07953 0.99% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] Device Memory Usage: ---------------------------------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max CurrentMem max ---------------------------------------------------------------------------------------------------------------------------------------------- The_Arena::Initialize() 4 4 82 B 90 B 108 B 1024 MiB 1024 MiB 1024 MiB 0 B REMORA::InitData() 352 320 627 MiB 629 MiB 629 MiB 786 MiB 786 MiB 786 MiB 174 MiB REMORA::Evolve() 12 12 8031 KiB 8429 KiB 8653 KiB 141 MiB 141 MiB 141 MiB 0 B REMORA::advance_3d() 760 760 8164 KiB 8221 KiB 8261 KiB 107 MiB 107 MiB 107 MiB 0 B REMORA::prestep_t_advection() 120 120 2253 KiB 2373 KiB 2524 KiB 105 MiB 105 MiB 105 MiB 0 B REMORA::prestep() 160 160 2751 KiB 2819 KiB 2905 KiB 79 MiB 79 MiB 79 MiB 0 B REMORA::prsgrd() 40 40 790 KiB 996 KiB 1087 KiB 78 MiB 78 MiB 78 MiB 0 B REMORA::setup_step() 240 240 7287 KiB 7328 KiB 7353 KiB 67 MiB 67 MiB 67 MiB 0 B REMORA::rhs_t_3d() 480 480 936 KiB 1004 KiB 1105 KiB 65 MiB 65 MiB 65 MiB 0 B REMORA::t3dmix2_s() 160 160 720 KiB 742 KiB 769 KiB 62 MiB 62 MiB 62 MiB 0 B WriteMultiLevelPlotfileWithBathymetry() 8 8 5612 KiB 5737 KiB 5872 KiB 62 MiB 62 MiB 62 MiB 0 B REMORA::uv3dmix() 2360 2360 676 KiB 759 KiB 797 KiB 52 MiB 52 MiB 52 MiB 0 B REMORA::rhs_uv_3d() 160 160 730 KiB 764 KiB 790 KiB 50 MiB 50 MiB 50 MiB 0 B REMORA::estTimeStep() 132 132 182 KiB 272 KiB 393 KiB 37 MiB 37 MiB 37 MiB 0 B ResizeRandomSeed 4 4 9206 KiB 9206 KiB 9207 KiB 9216 KiB 9216 KiB 9216 KiB 0 B REMORA::advance2d() 9440 9440 1613 KiB 1613 KiB 1613 KiB 3222 KiB 3222 KiB 3222 KiB 0 B REMORA::rhs_uv_2d() 2320 2320 58 KiB 59 KiB 60 KiB 840 KiB 840 KiB 840 KiB 0 B REMORA::update_massflux_3d() 80 80 1514 B 1603 B 1736 B 420 KiB 420 KiB 420 KiB 0 B VisMF::Write(FabArray) 64 64 17 B 77 B 135 B 96 KiB 96 KiB 96 KiB 0 B FillBoundary_nowait() 4936 4892 47 KiB 47 KiB 48 KiB 51 KiB 52 KiB 52 KiB 13 KiB FillBoundary_finish() 4936 4892 47 KiB 47 KiB 48 KiB 51 KiB 52 KiB 52 KiB 13 KiB MultiFab::contains_nan() 52 48 274 B 275 B 276 B 6656 B 6656 B 6656 B 256 B MultiFab::contains_inf() 40 40 6 B 6 B 7 B 6144 B 6144 B 6144 B 0 B impose_cons_bcs() 88 88 0 B 0 B 0 B 256 B 256 B 256 B 0 B impose_xvel_bcs() 44 44 0 B 0 B 0 B 256 B 256 B 256 B 0 B impose_yvel_bcs() 44 44 0 B 0 B 0 B 256 B 256 B 256 B 0 B ---------------------------------------------------------------------------------------------------------------------------------------------- Async Memory Usage: ------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ------------------------------------------------------------------------------------------------------------- REMORA::prsgrd() 40 92 KiB 166 KiB 232 KiB 78 MiB 78 MiB 78 MiB REMORA::advance_3d() 600 2806 KiB 2835 KiB 2866 KiB 53 MiB 53 MiB 53 MiB REMORA::prestep_t_advection() 120 686 KiB 766 KiB 865 KiB 52 MiB 52 MiB 52 MiB REMORA::rhs_t_3d() 480 396 KiB 415 KiB 429 KiB 52 MiB 52 MiB 52 MiB REMORA::uv3dmix() 2360 128 KiB 173 KiB 200 KiB 52 MiB 52 MiB 52 MiB REMORA::rhs_uv_3d() 160 621 KiB 630 KiB 639 KiB 50 MiB 50 MiB 50 MiB REMORA::t3dmix2_s() 160 473 KiB 494 KiB 541 KiB 50 MiB 50 MiB 50 MiB REMORA::setup_step() 80 536 KiB 552 KiB 565 KiB 13 MiB 13 MiB 13 MiB REMORA::prestep() 40 184 KiB 204 KiB 229 KiB 13 MiB 13 MiB 13 MiB REMORA::rhs_uv_2d() 2320 26 KiB 27 KiB 29 KiB 840 KiB 840 KiB 840 KiB REMORA::advance2d() 2360 5761 B 5798 B 5819 B 215 KiB 215 KiB 215 KiB REMORA::update_massflux_3d() 80 541 B 591 B 666 B 210 KiB 210 KiB 210 KiB ------------------------------------------------------------------------------------------------------------- Managed Memory Usage: --------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------- The_Managed_Arena::Initialize() 4 0 B 1 B 5 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------- Pinned Memory Usage: ------------------------------------------------------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max CurrentMem max ------------------------------------------------------------------------------------------------------------------------------------- VisMF::Write(FabArray) 80 80 1695 KiB 1734 KiB 1814 KiB 62 MiB 62 MiB 62 MiB 0 B The_Pinned_Arena::Initialize() 4 4 0 B 1 B 5 B 8192 KiB 8192 KiB 8192 KiB 0 B FillBoundary_nowait() 36400 36356 261 KiB 275 KiB 298 KiB 5917 KiB 5917 KiB 5918 KiB 13 KiB FillBoundary_finish() 4936 4892 47 KiB 47 KiB 48 KiB 51 KiB 52 KiB 52 KiB 13 KiB MultiFab::contains_nan() 52 48 267 B 267 B 268 B 768 B 768 B 768 B 256 B REMORA::estTimeStep() 88 88 1 B 1 B 2 B 512 B 512 B 512 B 0 B MultiFab::contains_inf() 40 40 0 B 0 B 0 B 256 B 256 B 256 B 0 B ------------------------------------------------------------------------------------------------------------------------------------- Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [3315 ... 3315] [The Arena] max space (MB) allocated spread across MPI: [1024 ... 1024] [The Arena] max space (MB) used spread across MPI: [891 ... 891] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [133 ... 133] [The Pinned Arena] max space (MB) used spread across MPI: [62 ... 62] AMReX (26.06-11-g9ed35ab0e584) finalized