Initializing AMReX (26.09-166-g29e408043123)... MPI initialized with 4 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.09-166-g29e408043123) initialized Successfully read inputs file ... Successfully read inputs file ... Starting to call amrex_probinit ... Successfully run amrex_probinit Now regridding at level lbase = 0 grid_places() time: 0.019356107 new finest: 1 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 INITIAL GRIDS Level 0 16 grids 4194304 cells 100 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 PLOTFILE: file = CNS-RT_plt00000 grid_places() time: 0.022290407 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is 0 Total y-momentum is 0 Total z-momentum is 0 Total energy is 7176192.0007176176 Write plotfile time = 0.203979781 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.0002870776155 [Level 0 step 1] Advanced 4194304 cells [Level 1 step 1] ADVANCE at time 0 with dt = 0.0001435388078 [Level 1 step 1] Advanced 4194304 cells [Level 1 step 2] ADVANCE at time 0.0001435388078 with dt = 0.0001435388078 [Level 1 step 2] Advanced 4194304 cells STEP = 1 TIME = 0.0002870776155 DT = 0.0002870776155 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -3.5092716654764083e-23 Total y-momentum is -4.7581467629282477e-22 Total z-momentum is 1.0569463681968465 Total energy is 7176192.0005832035 [STEP 1] Coarse TimeStep time: 0.746655403 [STEP 1] FAB kilobyte spread across MPI nodes: [596970 ... 596970] [Level 0 step 2] ADVANCE at time 0.0002870776155 with dt = 0.0002870672688 [Level 0 step 2] Advanced 4194304 cells [Level 1 step 3] ADVANCE at time 0.0002870776155 with dt = 0.0001435336344 [Level 1 step 3] Advanced 4194304 cells [Level 1 step 4] ADVANCE at time 0.0004306112499 with dt = 0.0001435336344 [Level 1 step 4] Advanced 4194304 cells STEP = 2 TIME = 0.0005741448843 DT = 0.0002870672688 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -8.7689508216908893e-21 Total y-momentum is -5.5967446161605243e-21 Total z-momentum is 2.3209418694909125 Total energy is 7176192.0001132824 [STEP 2] Coarse TimeStep time: 0.716741688 [STEP 2] FAB kilobyte spread across MPI nodes: [644102 ... 644102] Now regridding at level lbase = 0 STEP = 2 TIME = 0.0005741448843 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 3] ADVANCE at time 0.0005741448843 with dt = 0.0002870608582 [Level 0 step 3] Advanced 4194304 cells [Level 1 step 5] ADVANCE at time 0.0005741448843 with dt = 0.0001435304291 [Level 1 step 5] Advanced 4194304 cells [Level 1 step 6] ADVANCE at time 0.0007176753134 with dt = 0.0001435304291 [Level 1 step 6] Advanced 4194304 cells STEP = 3 TIME = 0.0008612057425 DT = 0.0002870608582 grid_places() time: 0.016205169 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -1.5519205277449085e-20 Total y-momentum is -1.1509814932737082e-19 Total z-momentum is 3.7623957612122778 Total energy is 7176191.9992529377 [STEP 3] Coarse TimeStep time: 0.753562647 [STEP 3] FAB kilobyte spread across MPI nodes: [644102 ... 644102] [Level 0 step 4] ADVANCE at time 0.0008612057425 with dt = 0.00028705672 [Level 0 step 4] Advanced 4194304 cells [Level 1 step 7] ADVANCE at time 0.0008612057425 with dt = 0.00014352836 [Level 1 step 7] Advanced 4194304 cells [Level 1 step 8] ADVANCE at time 0.001004734103 with dt = 0.00014352836 [Level 1 step 8] Advanced 4194304 cells STEP = 4 TIME = 0.001148262463 DT = 0.00028705672 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -4.1479205999343841e-20 Total y-momentum is -3.6936901787582409e-19 Total z-momentum is 5.3553134404616589 Total energy is 7176191.9979552217 [STEP 4] Coarse TimeStep time: 0.713903923 [STEP 4] FAB kilobyte spread across MPI nodes: [644102 ... 644102] Now regridding at level lbase = 0 STEP = 4 TIME = 0.001148262463 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 5] ADVANCE at time 0.001148262463 with dt = 0.0002870541933 [Level 0 step 5] Advanced 4194304 cells [Level 1 step 9] ADVANCE at time 0.001148262463 with dt = 0.0001435270967 [Level 1 step 9] Advanced 4194304 cells [Level 1 step 10] ADVANCE at time 0.001291789559 with dt = 0.0001435270967 [Level 1 step 10] Advanced 4194304 cells STEP = 5 TIME = 0.001435316656 DT = 0.0002870541933 grid_places() time: 0.016309855 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -1.1396633721934696e-19 Total y-momentum is -3.0462678646188091e-19 Total z-momentum is 7.0771445174316794 Total energy is 7176191.9961801395 [STEP 5] Coarse TimeStep time: 0.749454917 [STEP 5] FAB kilobyte spread across MPI nodes: [644102 ... 644102] [Level 0 step 6] ADVANCE at time 0.001435316656 with dt = 0.0002870527674 [Level 0 step 6] Advanced 4194304 cells [Level 1 step 11] ADVANCE at time 0.001435316656 with dt = 0.0001435263837 [Level 1 step 11] Advanced 4194304 cells [Level 1 step 12] ADVANCE at time 0.00157884304 with dt = 0.0001435263837 [Level 1 step 12] Advanced 4194304 cells STEP = 6 TIME = 0.001722369423 DT = 0.0002870527674 [CNS] Total mass is 1302338.0233411891 Total x-momentum is 1.7090321664713806e-19 Total y-momentum is 1.146401821544799e-18 Total z-momentum is 8.9084964335707451 Total energy is 7176191.9938936941 [STEP 6] Coarse TimeStep time: 0.711336056 [STEP 6] FAB kilobyte spread across MPI nodes: [644102 ... 644102] Now regridding at level lbase = 0 STEP = 6 TIME = 0.001722369423 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 7] ADVANCE at time 0.001722369423 with dt = 0.0002870520599 [Level 0 step 7] Advanced 4194304 cells [Level 1 step 13] ADVANCE at time 0.001722369423 with dt = 0.00014352603 [Level 1 step 13] Advanced 4194304 cells [Level 1 step 14] ADVANCE at time 0.001865895453 with dt = 0.00014352603 [Level 1 step 14] Advanced 4194304 cells STEP = 7 TIME = 0.002009421483 DT = 0.0002870520599 grid_places() time: 0.016385478 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is 6.6878559368472745e-20 Total y-momentum is -1.6894380193141711e-18 Total z-momentum is 10.832804311097526 Total energy is 7176191.9910670239 [STEP 7] Coarse TimeStep time: 0.746880698 [STEP 7] FAB kilobyte spread across MPI nodes: [644102 ... 644102] [Level 0 step 8] ADVANCE at time 0.002009421483 with dt = 0.0002870517947 [Level 0 step 8] Advanced 4194304 cells [Level 1 step 15] ADVANCE at time 0.002009421483 with dt = 0.0001435258973 [Level 1 step 15] Advanced 4194304 cells [Level 1 step 16] ADVANCE at time 0.002152947381 with dt = 0.0001435258973 [Level 1 step 16] Advanced 4194304 cells STEP = 8 TIME = 0.002296473278 DT = 0.0002870517947 [CNS] Total mass is 1302338.0233411889 Total x-momentum is 5.3927956212891139e-19 Total y-momentum is 2.0251664316853536e-18 Total z-momentum is 12.835981478053228 Total energy is 7176191.9876756454 [STEP 8] Coarse TimeStep time: 0.715073051 [STEP 8] FAB kilobyte spread across MPI nodes: [644102 ... 644102] Now regridding at level lbase = 0 STEP = 8 TIME = 0.002296473278 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 9] ADVANCE at time 0.002296473278 with dt = 0.00028705178 [Level 0 step 9] Advanced 4194304 cells [Level 1 step 17] ADVANCE at time 0.002296473278 with dt = 0.00014352589 [Level 1 step 17] Advanced 4194304 cells [Level 1 step 18] ADVANCE at time 0.002439999168 with dt = 0.00014352589 [Level 1 step 18] Advanced 4194304 cells STEP = 9 TIME = 0.002583525058 DT = 0.00028705178 grid_places() time: 0.016495513 new finest: 1 [CNS] Total mass is 1302338.0233411889 Total x-momentum is -1.5595441074624861e-18 Total y-momentum is -6.5262894030504217e-19 Total z-momentum is 14.906076194007591 Total energy is 7176191.9836987816 [STEP 9] Coarse TimeStep time: 0.751236418 [STEP 9] FAB kilobyte spread across MPI nodes: [644102 ... 644102] [Level 0 step 10] ADVANCE at time 0.002583525058 with dt = 0.0002870518889 [Level 0 step 10] Advanced 4194304 cells [Level 1 step 19] ADVANCE at time 0.002583525058 with dt = 0.0001435259444 [Level 1 step 19] Advanced 4194304 cells [Level 1 step 20] ADVANCE at time 0.002727051002 with dt = 0.0001435259444 [Level 1 step 20] Advanced 4194304 cells STEP = 10 TIME = 0.002870576947 DT = 0.0002870518889 [CNS] Total mass is 1302338.0233411891 Total x-momentum is 2.3105562861671332e-18 Total y-momentum is -4.9690956240102015e-18 Total z-momentum is 17.032951759614726 Total energy is 7176191.979118811 [STEP 10] Coarse TimeStep time: 0.713339082 [STEP 10] FAB kilobyte spread across MPI nodes: [644102 ... 644102] Now regridding at level lbase = 0 STEP = 10 TIME = 0.002870576947 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 11] ADVANCE at time 0.002870576947 with dt = 0.0002870520422 [Level 0 step 11] Advanced 4194304 cells [Level 1 step 21] ADVANCE at time 0.002870576947 with dt = 0.0001435260211 [Level 1 step 21] Advanced 4194304 cells [Level 1 step 22] ADVANCE at time 0.003014102968 with dt = 0.0001435260211 [Level 1 step 22] Advanced 4194304 cells STEP = 11 TIME = 0.003157628989 DT = 0.0002870520422 grid_places() time: 0.016408874 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -1.3842651682936686e-18 Total y-momentum is 5.6171843056422593e-18 Total z-momentum is 19.208000131229255 Total energy is 7176191.9739207756 [STEP 11] Coarse TimeStep time: 0.75044466 [STEP 11] FAB kilobyte spread across MPI nodes: [644102 ... 644102] [Level 0 step 12] ADVANCE at time 0.003157628989 with dt = 0.0002870521946 [Level 0 step 12] Advanced 4194304 cells [Level 1 step 23] ADVANCE at time 0.003157628989 with dt = 0.0001435260973 [Level 1 step 23] Advanced 4194304 cells [Level 1 step 24] ADVANCE at time 0.003301155086 with dt = 0.0001435260973 [Level 1 step 24] Advanced 4194304 cells STEP = 12 TIME = 0.003444681184 DT = 0.0002870521946 [CNS] Total mass is 1302338.0233411889 Total x-momentum is 3.0293679392959181e-18 Total y-momentum is -2.1651749930855106e-18 Total z-momentum is 21.42389356856874 Total energy is 7176191.9680919927 [STEP 12] Coarse TimeStep time: 0.712927123 [STEP 12] FAB kilobyte spread across MPI nodes: [644102 ... 644102] Now regridding at level lbase = 0 STEP = 12 TIME = 0.003444681184 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 13] ADVANCE at time 0.003444681184 with dt = 0.0002870523239 [Level 0 step 13] Advanced 4194304 cells [Level 1 step 25] ADVANCE at time 0.003444681184 with dt = 0.0001435261619 [Level 1 step 25] Advanced 4194304 cells [Level 1 step 26] ADVANCE at time 0.003588207345 with dt = 0.0001435261619 [Level 1 step 26] Advanced 4194304 cells STEP = 13 TIME = 0.003731733507 DT = 0.0002870523239 grid_places() time: 0.016504186 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -3.7108914826106779e-18 Total y-momentum is -4.6691001700992167e-18 Total z-momentum is 23.674374717272052 Total energy is 7176191.9616217129 [STEP 13] Coarse TimeStep time: 0.749761608 [STEP 13] FAB kilobyte spread across MPI nodes: [644102 ... 644102] [Level 0 step 14] ADVANCE at time 0.003731733507 with dt = 0.000287052422 [Level 0 step 14] Advanced 4194304 cells [Level 1 step 27] ADVANCE at time 0.003731733507 with dt = 0.000143526211 [Level 1 step 27] Advanced 4194304 cells [Level 1 step 28] ADVANCE at time 0.003875259718 with dt = 0.000143526211 [Level 1 step 28] Advanced 4194304 cells STEP = 14 TIME = 0.004018785929 DT = 0.000287052422 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -1.9339331742030253e-18 Total y-momentum is -1.0218823386068499e-17 Total z-momentum is 25.954082739011707 Total energy is 7176191.9545008428 [STEP 14] Coarse TimeStep time: 0.712040023 [STEP 14] FAB kilobyte spread across MPI nodes: [644102 ... 644102] Now regridding at level lbase = 0 STEP = 14 TIME = 0.004018785929 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 15] ADVANCE at time 0.004018785929 with dt = 0.0002870524893 [Level 0 step 15] Advanced 4194304 cells [Level 1 step 29] ADVANCE at time 0.004018785929 with dt = 0.0001435262446 [Level 1 step 29] Advanced 4194304 cells [Level 1 step 30] ADVANCE at time 0.004162312174 with dt = 0.0001435262446 [Level 1 step 30] Advanced 4194304 cells STEP = 15 TIME = 0.004305838419 DT = 0.0002870524893 grid_places() time: 0.016415624 new finest: 1 [CNS] Total mass is 1302338.0233411889 Total x-momentum is -4.0042499541114582e-18 Total y-momentum is 7.0420759999267868e-19 Total z-momentum is 28.2584114435783 Total energy is 7176191.9467217075 [STEP 15] Coarse TimeStep time: 0.748931222 [STEP 15] FAB kilobyte spread across MPI nodes: [644102 ... 644102] [Level 0 step 16] ADVANCE at time 0.004305838419 with dt = 0.0002870525306 [Level 0 step 16] Advanced 4194304 cells [Level 1 step 31] ADVANCE at time 0.004305838419 with dt = 0.0001435262653 [Level 1 step 31] Advanced 4194304 cells [Level 1 step 32] ADVANCE at time 0.004449364684 with dt = 0.0001435262653 [Level 1 step 32] Advanced 4194304 cells STEP = 16 TIME = 0.004592890949 DT = 0.0002870525306 [CNS] Total mass is 1302338.0233411889 Total x-momentum is -5.0148171426294211e-18 Total y-momentum is 1.127948322283892e-17 Total z-momentum is 30.58339461141512 Total energy is 7176191.9382778564 [STEP 16] Coarse TimeStep time: 0.711884045 [STEP 16] FAB kilobyte spread across MPI nodes: [644102 ... 644102] Now regridding at level lbase = 0 STEP = 16 TIME = 0.004592890949 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 17] ADVANCE at time 0.004592890949 with dt = 0.000287052552 [Level 0 step 17] Advanced 4194304 cells [Level 1 step 33] ADVANCE at time 0.004592890949 with dt = 0.000143526276 [Level 1 step 33] Advanced 4194304 cells [Level 1 step 34] ADVANCE at time 0.004736417225 with dt = 0.000143526276 [Level 1 step 34] Advanced 4194304 cells STEP = 17 TIME = 0.004879943501 DT = 0.000287052552 grid_places() time: 0.016497897 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -4.1491161035438706e-18 Total y-momentum is -5.9631131894411932e-18 Total z-momentum is 32.925613582717467 Total energy is 7176191.9291638918 [STEP 17] Coarse TimeStep time: 0.747981236 [STEP 17] FAB kilobyte spread across MPI nodes: [644102 ... 644102] [Level 0 step 18] ADVANCE at time 0.004879943501 with dt = 0.0002870525597 [Level 0 step 18] Advanced 4194304 cells [Level 1 step 35] ADVANCE at time 0.004879943501 with dt = 0.0001435262798 [Level 1 step 35] Advanced 4194304 cells [Level 1 step 36] ADVANCE at time 0.005023469781 with dt = 0.0001435262798 [Level 1 step 36] Advanced 4194304 cells STEP = 18 TIME = 0.005166996061 DT = 0.0002870525597 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -7.7919414836719597e-18 Total y-momentum is -5.1829230531260779e-18 Total z-momentum is 35.28212251382287 Total energy is 7176191.9193753228 [STEP 18] Coarse TimeStep time: 0.710848213 [STEP 18] FAB kilobyte spread across MPI nodes: [644102 ... 644102] Now regridding at level lbase = 0 STEP = 18 TIME = 0.005166996061 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 19] ADVANCE at time 0.005166996061 with dt = 0.0002870525588 [Level 0 step 19] Advanced 4194304 cells [Level 1 step 37] ADVANCE at time 0.005166996061 with dt = 0.0001435262794 [Level 1 step 37] Advanced 4194304 cells [Level 1 step 38] ADVANCE at time 0.00531052234 with dt = 0.0001435262794 [Level 1 step 38] Advanced 4194304 cells STEP = 19 TIME = 0.00545404862 DT = 0.0002870525588 grid_places() time: 0.016496411 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -5.0148412415562031e-18 Total y-momentum is -1.8209513886482642e-17 Total z-momentum is 37.650387281643575 Total energy is 7176191.9089084426 [STEP 19] Coarse TimeStep time: 0.74712976 [STEP 19] FAB kilobyte spread across MPI nodes: [644102 ... 644102] [Level 0 step 20] ADVANCE at time 0.00545404862 with dt = 0.0002870525536 [Level 0 step 20] Advanced 4194304 cells [Level 1 step 39] ADVANCE at time 0.00545404862 with dt = 0.0001435262768 [Level 1 step 39] Advanced 4194304 cells [Level 1 step 40] ADVANCE at time 0.005597574896 with dt = 0.0001435262768 [Level 1 step 40] Advanced 4194304 cells STEP = 20 TIME = 0.005741101173 DT = 0.0002870525536 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -5.2651302026207714e-18 Total y-momentum is 4.3880382600241113e-18 Total z-momentum is 40.028234710671754 Total energy is 7176191.8977602143 [STEP 20] Coarse TimeStep time: 0.709480529 [STEP 20] FAB kilobyte spread across MPI nodes: [644102 ... 644102] PLOTFILE: file = CNS-RT_plt00020 Write plotfile time = 0.136814368 seconds Run Time total = 15.09458562 Run Time init = 0.340651431 Run Time advance = 14.61694173 TinyProfiler total time across processes [min...avg...max]: 15.07 ... 15.08 ... 15.09 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- CNS::compute_dSdt() 120 8.088 8.268 8.46 56.05% FabArray::ParallelCopy_finish() 692 0.7536 1.298 1.822 12.07% StateDataPhysBCFunct::() 220 0.0009617 0.8585 1.717 11.38% FabArray::ParallelCopy_nowait() 692 0.782 1.026 1.313 8.70% FluxRegister::Reflux() 120 0.6174 0.6504 0.6865 4.55% VisMF::Write(FabArray) 4 0.3114 0.3175 0.324 2.15% CNS::advance() 60 0.3113 0.3134 0.3174 2.10% FillPatchIterator::Initialize 140 0.2918 0.2978 0.3067 2.03% amrex::Copy() 168 0.2762 0.288 0.3033 2.01% FabArray::setVal() 282 0.2204 0.2525 0.2795 1.85% FabArray::LinComb() 120 0.1586 0.2049 0.2403 1.59% CNS::computeTemp() 141 0.1483 0.1791 0.2106 1.40% CellConservativeLinear::interp() 120 0.05255 0.1237 0.1984 1.31% FillPatchSingleLevel 220 0.1068 0.1328 0.1591 1.05% FillPatchTwoLevels 89 0.06584 0.1114 0.1546 1.02% FabArray::Saxpy() 60 0.1196 0.1227 0.1249 0.83% FillPatchInterp(Fab) 80 0.01722 0.056 0.1238 0.82% Amr::regrid() 10 0.1086 0.1091 0.1096 0.73% amrex::average_down 21 0.08199 0.09642 0.1087 0.72% CNS::estTimeStep() 41 0.05903 0.0759 0.0937 0.62% FabArray::sum() 105 0.05546 0.07297 0.08975 0.59% TagBoxArray::collate() 11 0.002506 0.03847 0.07494 0.50% FabArray::setDomainBndry() 220 0.0006514 0.02381 0.04934 0.33% post_timestep 60 0.02913 0.03391 0.03734 0.25% DistributionMapping::LeastUsedCPUs() 3 0.0001501 0.01852 0.0272 0.18% CNS::errorEst() 11 0.02127 0.02231 0.02337 0.15% Amr::bldFineLevels() 1 0.01261 0.01267 0.01272 0.08% Amr::writePlotFile() 2 0.001755 0.00694 0.01133 0.08% AmrMesh::MakeNewGrids() 11 0.006969 0.008169 0.00938 0.06% AmrLevel::writePlotFile() 4 0.004224 0.005647 0.008212 0.05% Amr::coarseTimeStep() 20 0.0002929 0.001384 0.002665 0.02% AmrLevel::FillPatch() 140 0.001666 0.001723 0.001844 0.01% Amr::timeStep() 60 0.0006216 0.0008675 0.00138 0.01% FabArray::ParallelCopy() 692 0.0006836 0.0007087 0.0007728 0.01% main() 1 0.0002122 0.0002355 0.0002512 0.00% FillPatchIterator::FillFromTwoLevels() 89 0.0001337 0.0001453 0.0001661 0.00% FillPatchIterator::FillFromLevel0() 51 6.395e-05 6.806e-05 7.111e-05 0.00% postCoarseTimeStep() 20 4.022e-05 5.08e-05 6.488e-05 0.00% Amr::grid_places() 11 5.49e-05 5.993e-05 6.297e-05 0.00% Amr::FinalizeInit() 1 5.49e-06 1.677e-05 4.315e-05 0.00% CNS::avgDown() 21 3.066e-05 3.657e-05 4.148e-05 0.00% Amr::defBaseLevel() 1 1.813e-05 2.095e-05 2.506e-05 0.00% amrex::average_down_w_geom 21 1.605e-05 1.814e-05 2.053e-05 0.00% Amr::InitializeInit() 1 2.377e-06 4.455e-06 8.161e-06 0.00% CNS::writePlotFile() 4 6.808e-06 7.495e-06 7.951e-06 0.00% Amr::init() 1 1.125e-06 1.474e-06 1.7e-06 0.00% Amr::initialInit() 1 9.45e-07 1.131e-06 1.553e-06 0.00% Other 1369 0.03982 0.05284 0.06756 0.45% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 15.07 15.08 15.09 100.00% Amr::coarseTimeStep() 20 14.62 14.62 14.62 96.84% Amr::timeStep() 60 14.44 14.47 14.51 96.12% CNS::advance() 60 12.93 12.94 12.95 85.78% CNS::compute_dSdt() 120 8.323 9.16 10.01 66.33% AmrLevel::FillPatch() 140 2.225 3.115 3.986 26.41% FillPatchIterator::Initialize 140 1.946 2.835 3.711 24.59% FabArray::ParallelCopy() 692 1.55 2.33 3.141 20.81% FillPatchSingleLevel 220 0.9874 1.868 2.78 18.41% FillPatchIterator::FillFromLevel0() 51 0.2394 1.096 1.956 12.96% FabArray::ParallelCopy_finish() 692 0.7536 1.298 1.822 12.07% StateDataPhysBCFunct::() 220 0.0009617 0.8632 1.726 11.44% FillPatchIterator::FillFromTwoLevels() 89 1.393 1.418 1.461 9.68% FillPatchTwoLevels 89 1.393 1.418 1.461 9.68% FabArray::ParallelCopy_nowait() 692 0.7861 1.031 1.319 8.74% post_timestep 60 1.189 1.225 1.265 8.38% FluxRegister::Reflux() 120 0.9237 0.9554 0.9878 6.54% Amr::regrid() 10 0.342 0.3462 0.3531 2.34% Amr::writePlotFile() 2 0.3405 0.3407 0.3409 2.26% CNS::writePlotFile() 4 0.3292 0.3338 0.3391 2.25% AmrLevel::writePlotFile() 4 0.3292 0.3338 0.3391 2.25% Amr::init() 1 0.3098 0.3284 0.3381 2.24% VisMF::Write(FabArray) 4 0.3114 0.3175 0.324 2.15% amrex::Copy() 168 0.2762 0.288 0.3033 2.01% FabArray::setVal() 282 0.2204 0.2525 0.2795 1.85% CNS::avgDown() 21 0.2191 0.2378 0.262 1.74% amrex::average_down_w_geom 21 0.2018 0.2227 0.2463 1.63% amrex::average_down 21 0.2018 0.2226 0.2463 1.63% FabArray::LinComb() 120 0.1586 0.2049 0.2403 1.59% FillPatchInterp(Fab) 80 0.118 0.1797 0.2159 1.43% CNS::computeTemp() 141 0.1483 0.1791 0.2106 1.40% CellConservativeLinear::interp() 120 0.05255 0.1237 0.1984 1.31% Amr::grid_places() 11 0.1864 0.1879 0.1894 1.25% AmrMesh::MakeNewGrids() 11 0.1864 0.1878 0.1893 1.25% CNS::errorEst() 11 0.0698 0.1135 0.1572 1.04% Amr::initialInit() 1 0.1059 0.1246 0.134 0.89% FabArray::Saxpy() 60 0.1196 0.1227 0.1249 0.83% Amr::FinalizeInit() 1 0.09929 0.1008 0.1024 0.68% CNS::estTimeStep() 41 0.05903 0.0759 0.0937 0.62% FabArray::sum() 105 0.05546 0.07297 0.08975 0.59% postCoarseTimeStep() 20 0.05315 0.06938 0.08562 0.57% Amr::bldFineLevels() 1 0.07375 0.07521 0.07669 0.51% TagBoxArray::collate() 11 0.002506 0.03847 0.07494 0.50% FabArray::setDomainBndry() 220 0.0006514 0.02381 0.04934 0.33% Amr::InitializeInit() 1 0.006604 0.02371 0.03386 0.22% Amr::defBaseLevel() 1 0.006581 0.02312 0.03193 0.21% DistributionMapping::LeastUsedCPUs() 3 0.0001501 0.01852 0.0272 0.18% Other 1369 0.07333 0.1124 0.1434 0.95% ------------------------------------------------------------------------------------------- Device Memory Usage: ---------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ---------------------------------------------------------------------------------------------------------------- CNS::compute_dSdt() 19200 119 MiB 132 MiB 145 MiB 261 MiB 261 MiB 261 MiB CNS::advance() 2096 220 MiB 220 MiB 220 MiB 257 MiB 257 MiB 257 MiB StateData::define() 192 132 MiB 132 MiB 133 MiB 201 MiB 201 MiB 201 MiB FluxRegister::Reflux() 1920 3331 KiB 3464 KiB 3632 KiB 56 MiB 67 MiB 71 MiB FillPatchIterator::Initialize 2240 9281 KiB 12 MiB 16 MiB 67 MiB 67 MiB 67 MiB AmrLevel::writePlotFile() 64 1227 KiB 1243 KiB 1260 KiB 56 MiB 56 MiB 56 MiB FillPatchSingleLevel 640 673 KiB 736 KiB 856 KiB 56 MiB 56 MiB 56 MiB FillPatchTwoLevels 960 225 KiB 336 KiB 457 KiB 5073 KiB 7663 KiB 10 MiB ResizeRandomSeed 4 9209 KiB 9210 KiB 9211 KiB 9216 KiB 9216 KiB 9216 KiB CNS::errorEst() 176 37 KiB 62 KiB 88 KiB 8985 KiB 8985 KiB 8985 KiB post_timestep 320 536 KiB 544 KiB 552 KiB 8192 KiB 8192 KiB 8192 KiB amrex::average_down 428 82 KiB 90 KiB 103 KiB 7169 KiB 7169 KiB 7169 KiB CellConservativeLinear::interp() 960 14 KiB 21 KiB 33 KiB 1355 KiB 2064 KiB 2773 KiB Amr::regrid() 960 1326 KiB 1326 KiB 1326 KiB 2688 KiB 2688 KiB 2688 KiB StateDataPhysBCFunct::() 816 0 B 44 KiB 89 KiB 0 B 736 KiB 1473 KiB Amr::bldFineLevels() 96 4027 B 4046 B 4066 B 1344 KiB 1344 KiB 1344 KiB AmrMesh::MakeNewGrids() 352 12 KiB 12 KiB 12 KiB 1025 KiB 1025 KiB 1025 KiB FabArray::ParallelCopy_nowait() 3002 19 KiB 58 KiB 97 KiB 31 KiB 103 KiB 176 KiB VisMF::Write(FabArray) 448 86 B 114 B 159 B 96 KiB 96 KiB 96 KiB CNS::estTimeStep() 172 1122 B 1138 B 1154 B 49 KiB 49 KiB 49 KiB FabArray::sum() 420 177 B 233 B 288 B 48 KiB 48 KiB 48 KiB FabArray::ParallelCopy_finish() 2168 692 B 2006 B 3322 B 4096 B 7872 B 11 KiB amrex::Copy() 912 2803 B 2819 B 2835 B 3584 B 3584 B 3584 B FabArray::setVal() 1144 2077 B 2104 B 2132 B 3072 B 3072 B 3072 B TagBoxArray::mapPRD 352 1 B 2 B 3 B 2048 B 2048 B 2048 B FabArray::LinComb() 284 1078 B 1078 B 1078 B 1536 B 1536 B 1536 B TagBoxArray::collate() 88 0 B 0 B 0 B 256 B 896 B 1536 B OwnerMask() 176 0 B 0 B 0 B 1024 B 1024 B 1024 B StateData::FillBoundary(geom) 1224 0 B 10 B 20 B 0 B 256 B 512 B Amr::InitAmr() 8 504 B 504 B 505 B 512 B 512 B 512 B ---------------------------------------------------------------------------------------------------------------- Async Memory Usage: ------------------------------------------------------------------------------------------------------ Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ------------------------------------------------------------------------------------------------------ CNS::compute_dSdt() 3840 4425 KiB 7906 KiB 11 MiB 65 MiB 65 MiB 65 MiB FluxRegister::Reflux() 1920 2449 KiB 2941 KiB 3291 KiB 56 MiB 56 MiB 56 MiB post_timestep 320 513 KiB 530 KiB 547 KiB 8192 KiB 8192 KiB 8192 KiB amrex::average_down 336 82 KiB 89 KiB 102 KiB 7168 KiB 7168 KiB 7168 KiB ------------------------------------------------------------------------------------------------------ Managed Memory Usage: --------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------- The_Managed_Arena::Initialize() 4 0 B 0 B 0 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------- Pinned Memory Usage: ---------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ---------------------------------------------------------------------------------------------------------------- FabArray::ParallelCopy_nowait() 7136 504 KiB 710 KiB 926 KiB 7531 KiB 11 MiB 14 MiB VisMF::Write(FabArray) 512 186 KiB 206 KiB 217 KiB 14 MiB 14 MiB 14 MiB The_Pinned_Arena::Initialize() 4 0 B 0 B 0 B 8192 KiB 8192 KiB 8192 KiB FabArray::ParallelCopy_finish() 2168 692 B 2006 B 3322 B 4096 B 7872 B 11 KiB amrex::Copy() 912 2803 B 2819 B 2835 B 3584 B 3584 B 3584 B CNS::compute_dSdt() 1920 118 B 167 B 219 B 3072 B 3072 B 3072 B FabArray::setVal() 1144 2077 B 2104 B 2132 B 3072 B 3072 B 3072 B TagBoxArray::collate() 154 0 B 2 B 4 B 512 B 1344 B 1792 B FabArray::LinComb() 284 1078 B 1078 B 1078 B 1536 B 1536 B 1536 B amrex::average_down 92 563 B 563 B 565 B 1536 B 1536 B 1536 B CNS::estTimeStep() 172 1009 B 1009 B 1009 B 1280 B 1280 B 1280 B CellConservativeLinear::interp() 480 1 B 1 B 2 B 256 B 384 B 512 B StateData::FillBoundary(geom) 1224 0 B 10 B 20 B 0 B 256 B 512 B FabArray::sum() 420 0 B 0 B 1 B 256 B 256 B 256 B ---------------------------------------------------------------------------------------------------------------- Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [3963 ... 3963] [The Arena] max space (MB) allocated spread across MPI: [797 ... 871] [The Arena] max space (MB) used spread across MPI: [663 ... 663] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [32 ... 36] [The Pinned Arena] max space (MB) used spread across MPI: [14 ... 14] AMReX (26.09-166-g29e408043123) finalized