Initializing AMReX (26.09-120-g66028f892b7d)... MPI initialized with 4 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.09-120-g66028f892b7d) initialized Successfully read inputs file ... Successfully read inputs file ... Starting to call amrex_probinit ... Successfully run amrex_probinit Now regridding at level lbase = 0 grid_places() time: 0.019202716 new finest: 1 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 INITIAL GRIDS Level 0 16 grids 4194304 cells 100 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 PLOTFILE: file = CNS-RT_plt00000 grid_places() time: 0.021848921 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is 0 Total y-momentum is 0 Total z-momentum is 0 Total energy is 7176192.0007176176 Write plotfile time = 0.159148608 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.0002870776155 [Level 0 step 1] Advanced 4194304 cells [Level 1 step 1] ADVANCE at time 0 with dt = 0.0001435388078 [Level 1 step 1] Advanced 4194304 cells [Level 1 step 2] ADVANCE at time 0.0001435388078 with dt = 0.0001435388078 [Level 1 step 2] Advanced 4194304 cells STEP = 1 TIME = 0.0002870776155 DT = 0.0002870776155 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -3.5092716654764083e-23 Total y-momentum is -4.7581467629282477e-22 Total z-momentum is 1.0569463681968465 Total energy is 7176192.0005832035 [STEP 1] Coarse TimeStep time: 0.74877866 [STEP 1] FAB kilobyte spread across MPI nodes: [596970 ... 596970] [Level 0 step 2] ADVANCE at time 0.0002870776155 with dt = 0.0002870672688 [Level 0 step 2] Advanced 4194304 cells [Level 1 step 3] ADVANCE at time 0.0002870776155 with dt = 0.0001435336344 [Level 1 step 3] Advanced 4194304 cells [Level 1 step 4] ADVANCE at time 0.0004306112499 with dt = 0.0001435336344 [Level 1 step 4] Advanced 4194304 cells STEP = 2 TIME = 0.0005741448843 DT = 0.0002870672688 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -8.7689508216908893e-21 Total y-momentum is -5.5967446161605243e-21 Total z-momentum is 2.3209418694909125 Total energy is 7176192.0001132824 [STEP 2] Coarse TimeStep time: 0.716440039 [STEP 2] FAB kilobyte spread across MPI nodes: [644102 ... 644102] Now regridding at level lbase = 0 STEP = 2 TIME = 0.0005741448843 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 3] ADVANCE at time 0.0005741448843 with dt = 0.0002870608582 [Level 0 step 3] Advanced 4194304 cells [Level 1 step 5] ADVANCE at time 0.0005741448843 with dt = 0.0001435304291 [Level 1 step 5] Advanced 4194304 cells [Level 1 step 6] ADVANCE at time 0.0007176753134 with dt = 0.0001435304291 [Level 1 step 6] Advanced 4194304 cells STEP = 3 TIME = 0.0008612057425 DT = 0.0002870608582 grid_places() time: 0.01627215 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -1.5519205277449085e-20 Total y-momentum is -1.1509814932737082e-19 Total z-momentum is 3.7623957612122778 Total energy is 7176191.9992529377 [STEP 3] Coarse TimeStep time: 0.750216234 [STEP 3] FAB kilobyte spread across MPI nodes: [644102 ... 644102] [Level 0 step 4] ADVANCE at time 0.0008612057425 with dt = 0.00028705672 [Level 0 step 4] Advanced 4194304 cells [Level 1 step 7] ADVANCE at time 0.0008612057425 with dt = 0.00014352836 [Level 1 step 7] Advanced 4194304 cells [Level 1 step 8] ADVANCE at time 0.001004734103 with dt = 0.00014352836 [Level 1 step 8] Advanced 4194304 cells STEP = 4 TIME = 0.001148262463 DT = 0.00028705672 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -4.1479205999343841e-20 Total y-momentum is -3.6936901787582409e-19 Total z-momentum is 5.3553134404616589 Total energy is 7176191.9979552217 [STEP 4] Coarse TimeStep time: 0.712974947 [STEP 4] FAB kilobyte spread across MPI nodes: [644102 ... 644102] Now regridding at level lbase = 0 STEP = 4 TIME = 0.001148262463 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 5] ADVANCE at time 0.001148262463 with dt = 0.0002870541933 [Level 0 step 5] Advanced 4194304 cells [Level 1 step 9] ADVANCE at time 0.001148262463 with dt = 0.0001435270967 [Level 1 step 9] Advanced 4194304 cells [Level 1 step 10] ADVANCE at time 0.001291789559 with dt = 0.0001435270967 [Level 1 step 10] Advanced 4194304 cells STEP = 5 TIME = 0.001435316656 DT = 0.0002870541933 grid_places() time: 0.015913663 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -1.1396633721934696e-19 Total y-momentum is -3.0462678646188091e-19 Total z-momentum is 7.0771445174316794 Total energy is 7176191.9961801395 [STEP 5] Coarse TimeStep time: 0.74740161 [STEP 5] FAB kilobyte spread across MPI nodes: [644102 ... 644102] [Level 0 step 6] ADVANCE at time 0.001435316656 with dt = 0.0002870527674 [Level 0 step 6] Advanced 4194304 cells [Level 1 step 11] ADVANCE at time 0.001435316656 with dt = 0.0001435263837 [Level 1 step 11] Advanced 4194304 cells [Level 1 step 12] ADVANCE at time 0.00157884304 with dt = 0.0001435263837 [Level 1 step 12] Advanced 4194304 cells STEP = 6 TIME = 0.001722369423 DT = 0.0002870527674 [CNS] Total mass is 1302338.0233411891 Total x-momentum is 1.7090321664713806e-19 Total y-momentum is 1.146401821544799e-18 Total z-momentum is 8.9084964335707451 Total energy is 7176191.9938936941 [STEP 6] Coarse TimeStep time: 0.711322204 [STEP 6] FAB kilobyte spread across MPI nodes: [644102 ... 644102] Now regridding at level lbase = 0 STEP = 6 TIME = 0.001722369423 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 7] ADVANCE at time 0.001722369423 with dt = 0.0002870520599 [Level 0 step 7] Advanced 4194304 cells [Level 1 step 13] ADVANCE at time 0.001722369423 with dt = 0.00014352603 [Level 1 step 13] Advanced 4194304 cells [Level 1 step 14] ADVANCE at time 0.001865895453 with dt = 0.00014352603 [Level 1 step 14] Advanced 4194304 cells STEP = 7 TIME = 0.002009421483 DT = 0.0002870520599 grid_places() time: 0.016240396 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is 6.6878559368472745e-20 Total y-momentum is -1.6894380193141711e-18 Total z-momentum is 10.832804311097526 Total energy is 7176191.9910670239 [STEP 7] Coarse TimeStep time: 0.74605686 [STEP 7] FAB kilobyte spread across MPI nodes: [644102 ... 644102] [Level 0 step 8] ADVANCE at time 0.002009421483 with dt = 0.0002870517947 [Level 0 step 8] Advanced 4194304 cells [Level 1 step 15] ADVANCE at time 0.002009421483 with dt = 0.0001435258973 [Level 1 step 15] Advanced 4194304 cells [Level 1 step 16] ADVANCE at time 0.002152947381 with dt = 0.0001435258973 [Level 1 step 16] Advanced 4194304 cells STEP = 8 TIME = 0.002296473278 DT = 0.0002870517947 [CNS] Total mass is 1302338.0233411889 Total x-momentum is 5.3927956212891139e-19 Total y-momentum is 2.0251664316853536e-18 Total z-momentum is 12.835981478053228 Total energy is 7176191.9876756454 [STEP 8] Coarse TimeStep time: 0.709949216 [STEP 8] FAB kilobyte spread across MPI nodes: [644102 ... 644102] Now regridding at level lbase = 0 STEP = 8 TIME = 0.002296473278 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 9] ADVANCE at time 0.002296473278 with dt = 0.00028705178 [Level 0 step 9] Advanced 4194304 cells [Level 1 step 17] ADVANCE at time 0.002296473278 with dt = 0.00014352589 [Level 1 step 17] Advanced 4194304 cells [Level 1 step 18] ADVANCE at time 0.002439999168 with dt = 0.00014352589 [Level 1 step 18] Advanced 4194304 cells STEP = 9 TIME = 0.002583525058 DT = 0.00028705178 grid_places() time: 0.016201143 new finest: 1 [CNS] Total mass is 1302338.0233411889 Total x-momentum is -1.5595441074624861e-18 Total y-momentum is -6.5262894030504217e-19 Total z-momentum is 14.906076194007591 Total energy is 7176191.9836987816 [STEP 9] Coarse TimeStep time: 0.744890246 [STEP 9] FAB kilobyte spread across MPI nodes: [644102 ... 644102] [Level 0 step 10] ADVANCE at time 0.002583525058 with dt = 0.0002870518889 [Level 0 step 10] Advanced 4194304 cells [Level 1 step 19] ADVANCE at time 0.002583525058 with dt = 0.0001435259444 [Level 1 step 19] Advanced 4194304 cells [Level 1 step 20] ADVANCE at time 0.002727051002 with dt = 0.0001435259444 [Level 1 step 20] Advanced 4194304 cells STEP = 10 TIME = 0.002870576947 DT = 0.0002870518889 [CNS] Total mass is 1302338.0233411891 Total x-momentum is 2.3105562861671332e-18 Total y-momentum is -4.9690956240102015e-18 Total z-momentum is 17.032951759614726 Total energy is 7176191.979118811 [STEP 10] Coarse TimeStep time: 0.709253756 [STEP 10] FAB kilobyte spread across MPI nodes: [644102 ... 644102] Now regridding at level lbase = 0 STEP = 10 TIME = 0.002870576947 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 11] ADVANCE at time 0.002870576947 with dt = 0.0002870520422 [Level 0 step 11] Advanced 4194304 cells [Level 1 step 21] ADVANCE at time 0.002870576947 with dt = 0.0001435260211 [Level 1 step 21] Advanced 4194304 cells [Level 1 step 22] ADVANCE at time 0.003014102968 with dt = 0.0001435260211 [Level 1 step 22] Advanced 4194304 cells STEP = 11 TIME = 0.003157628989 DT = 0.0002870520422 grid_places() time: 0.016215523 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -1.3842651682936686e-18 Total y-momentum is 5.6171843056422593e-18 Total z-momentum is 19.208000131229255 Total energy is 7176191.9739207756 [STEP 11] Coarse TimeStep time: 0.745715697 [STEP 11] FAB kilobyte spread across MPI nodes: [644102 ... 644102] [Level 0 step 12] ADVANCE at time 0.003157628989 with dt = 0.0002870521946 [Level 0 step 12] Advanced 4194304 cells [Level 1 step 23] ADVANCE at time 0.003157628989 with dt = 0.0001435260973 [Level 1 step 23] Advanced 4194304 cells [Level 1 step 24] ADVANCE at time 0.003301155086 with dt = 0.0001435260973 [Level 1 step 24] Advanced 4194304 cells STEP = 12 TIME = 0.003444681184 DT = 0.0002870521946 [CNS] Total mass is 1302338.0233411889 Total x-momentum is 3.0293679392959181e-18 Total y-momentum is -2.1651749930855106e-18 Total z-momentum is 21.42389356856874 Total energy is 7176191.9680919927 [STEP 12] Coarse TimeStep time: 0.70672677 [STEP 12] FAB kilobyte spread across MPI nodes: [644102 ... 644102] Now regridding at level lbase = 0 STEP = 12 TIME = 0.003444681184 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 13] ADVANCE at time 0.003444681184 with dt = 0.0002870523239 [Level 0 step 13] Advanced 4194304 cells [Level 1 step 25] ADVANCE at time 0.003444681184 with dt = 0.0001435261619 [Level 1 step 25] Advanced 4194304 cells [Level 1 step 26] ADVANCE at time 0.003588207345 with dt = 0.0001435261619 [Level 1 step 26] Advanced 4194304 cells STEP = 13 TIME = 0.003731733507 DT = 0.0002870523239 grid_places() time: 0.016126357 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -3.7108914826106779e-18 Total y-momentum is -4.6691001700992167e-18 Total z-momentum is 23.674374717272052 Total energy is 7176191.9616217129 [STEP 13] Coarse TimeStep time: 0.743728686 [STEP 13] FAB kilobyte spread across MPI nodes: [644102 ... 644102] [Level 0 step 14] ADVANCE at time 0.003731733507 with dt = 0.000287052422 [Level 0 step 14] Advanced 4194304 cells [Level 1 step 27] ADVANCE at time 0.003731733507 with dt = 0.000143526211 [Level 1 step 27] Advanced 4194304 cells [Level 1 step 28] ADVANCE at time 0.003875259718 with dt = 0.000143526211 [Level 1 step 28] Advanced 4194304 cells STEP = 14 TIME = 0.004018785929 DT = 0.000287052422 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -1.9339331742030253e-18 Total y-momentum is -1.0218823386068499e-17 Total z-momentum is 25.954082739011707 Total energy is 7176191.9545008428 [STEP 14] Coarse TimeStep time: 0.706198036 [STEP 14] FAB kilobyte spread across MPI nodes: [644102 ... 644102] Now regridding at level lbase = 0 STEP = 14 TIME = 0.004018785929 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 15] ADVANCE at time 0.004018785929 with dt = 0.0002870524893 [Level 0 step 15] Advanced 4194304 cells [Level 1 step 29] ADVANCE at time 0.004018785929 with dt = 0.0001435262446 [Level 1 step 29] Advanced 4194304 cells [Level 1 step 30] ADVANCE at time 0.004162312174 with dt = 0.0001435262446 [Level 1 step 30] Advanced 4194304 cells STEP = 15 TIME = 0.004305838419 DT = 0.0002870524893 grid_places() time: 0.016309377 new finest: 1 [CNS] Total mass is 1302338.0233411889 Total x-momentum is -4.0042499541114582e-18 Total y-momentum is 7.0420759999267868e-19 Total z-momentum is 28.2584114435783 Total energy is 7176191.9467217075 [STEP 15] Coarse TimeStep time: 0.744229939 [STEP 15] FAB kilobyte spread across MPI nodes: [644102 ... 644102] [Level 0 step 16] ADVANCE at time 0.004305838419 with dt = 0.0002870525306 [Level 0 step 16] Advanced 4194304 cells [Level 1 step 31] ADVANCE at time 0.004305838419 with dt = 0.0001435262653 [Level 1 step 31] Advanced 4194304 cells [Level 1 step 32] ADVANCE at time 0.004449364684 with dt = 0.0001435262653 [Level 1 step 32] Advanced 4194304 cells STEP = 16 TIME = 0.004592890949 DT = 0.0002870525306 [CNS] Total mass is 1302338.0233411889 Total x-momentum is -5.0148171426294211e-18 Total y-momentum is 1.127948322283892e-17 Total z-momentum is 30.58339461141512 Total energy is 7176191.9382778564 [STEP 16] Coarse TimeStep time: 0.706034992 [STEP 16] FAB kilobyte spread across MPI nodes: [644102 ... 644102] Now regridding at level lbase = 0 STEP = 16 TIME = 0.004592890949 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 17] ADVANCE at time 0.004592890949 with dt = 0.000287052552 [Level 0 step 17] Advanced 4194304 cells [Level 1 step 33] ADVANCE at time 0.004592890949 with dt = 0.000143526276 [Level 1 step 33] Advanced 4194304 cells [Level 1 step 34] ADVANCE at time 0.004736417225 with dt = 0.000143526276 [Level 1 step 34] Advanced 4194304 cells STEP = 17 TIME = 0.004879943501 DT = 0.000287052552 grid_places() time: 0.016228916 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -4.1491161035438706e-18 Total y-momentum is -5.9631131894411932e-18 Total z-momentum is 32.925613582717467 Total energy is 7176191.9291638918 [STEP 17] Coarse TimeStep time: 0.743032482 [STEP 17] FAB kilobyte spread across MPI nodes: [644102 ... 644102] [Level 0 step 18] ADVANCE at time 0.004879943501 with dt = 0.0002870525597 [Level 0 step 18] Advanced 4194304 cells [Level 1 step 35] ADVANCE at time 0.004879943501 with dt = 0.0001435262798 [Level 1 step 35] Advanced 4194304 cells [Level 1 step 36] ADVANCE at time 0.005023469781 with dt = 0.0001435262798 [Level 1 step 36] Advanced 4194304 cells STEP = 18 TIME = 0.005166996061 DT = 0.0002870525597 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -7.7919414836719597e-18 Total y-momentum is -5.1829230531260779e-18 Total z-momentum is 35.28212251382287 Total energy is 7176191.9193753228 [STEP 18] Coarse TimeStep time: 0.706465951 [STEP 18] FAB kilobyte spread across MPI nodes: [644102 ... 644102] Now regridding at level lbase = 0 STEP = 18 TIME = 0.005166996061 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 19] ADVANCE at time 0.005166996061 with dt = 0.0002870525588 [Level 0 step 19] Advanced 4194304 cells [Level 1 step 37] ADVANCE at time 0.005166996061 with dt = 0.0001435262794 [Level 1 step 37] Advanced 4194304 cells [Level 1 step 38] ADVANCE at time 0.00531052234 with dt = 0.0001435262794 [Level 1 step 38] Advanced 4194304 cells STEP = 19 TIME = 0.00545404862 DT = 0.0002870525588 grid_places() time: 0.016283022 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -5.0148412415562031e-18 Total y-momentum is -1.8209513886482642e-17 Total z-momentum is 37.650387281643575 Total energy is 7176191.9089084426 [STEP 19] Coarse TimeStep time: 0.747189598 [STEP 19] FAB kilobyte spread across MPI nodes: [644102 ... 644102] [Level 0 step 20] ADVANCE at time 0.00545404862 with dt = 0.0002870525536 [Level 0 step 20] Advanced 4194304 cells [Level 1 step 39] ADVANCE at time 0.00545404862 with dt = 0.0001435262768 [Level 1 step 39] Advanced 4194304 cells [Level 1 step 40] ADVANCE at time 0.005597574896 with dt = 0.0001435262768 [Level 1 step 40] Advanced 4194304 cells STEP = 20 TIME = 0.005741101173 DT = 0.0002870525536 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -5.2651302026207714e-18 Total y-momentum is 4.3880382600241113e-18 Total z-momentum is 40.028234710671754 Total energy is 7176191.8977602143 [STEP 20] Coarse TimeStep time: 0.708622166 [STEP 20] FAB kilobyte spread across MPI nodes: [644102 ... 644102] PLOTFILE: file = CNS-RT_plt00020 Write plotfile time = 0.131298257 seconds Run Time total = 14.95828435 Run Time init = 0.280194009 Run Time advance = 14.54657372 TinyProfiler total time across processes [min...avg...max]: 14.94 ... 14.95 ... 14.96 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- CNS::compute_dSdt() 120 8.061 8.234 8.446 56.46% FabArray::ParallelCopy_finish() 692 0.7884 1.346 1.829 12.23% StateDataPhysBCFunct::() 220 0.0009628 0.8532 1.706 11.40% FabArray::ParallelCopy_nowait() 692 0.7113 0.958 1.283 8.58% FluxRegister::Reflux() 120 0.5932 0.6482 0.6844 4.58% CNS::advance() 60 0.3113 0.3169 0.3231 2.16% FillPatchIterator::Initialize 140 0.2964 0.3059 0.318 2.13% amrex::Copy() 168 0.2816 0.294 0.302 2.02% FabArray::setVal() 282 0.2228 0.2533 0.2821 1.89% VisMF::Write(FabArray) 4 0.2608 0.2645 0.2682 1.79% FabArray::LinComb() 120 0.1514 0.2069 0.2398 1.60% CNS::computeTemp() 141 0.1413 0.1699 0.2019 1.35% CellConservativeLinear::interp() 120 0.05435 0.1113 0.1766 1.18% FillPatchTwoLevels 89 0.06546 0.1196 0.1757 1.17% FillPatchSingleLevel 220 0.1072 0.1342 0.1578 1.06% CNS::estTimeStep() 41 0.05022 0.08642 0.1519 1.02% FillPatchInterp(Fab) 80 0.01744 0.05728 0.1277 0.85% FabArray::Saxpy() 60 0.0992 0.1122 0.1203 0.80% amrex::average_down 21 0.07859 0.09781 0.1115 0.75% Amr::regrid() 10 0.1083 0.1088 0.1094 0.73% TagBoxArray::collate() 11 0.001408 0.03725 0.07323 0.49% FabArray::sum() 105 0.01652 0.04949 0.06893 0.46% FabArray::setDomainBndry() 220 0.000642 0.02541 0.05324 0.36% post_timestep 60 0.02898 0.03549 0.04624 0.31% CNS::errorEst() 11 0.02057 0.02223 0.02357 0.16% Amr::bldFineLevels() 1 0.01258 0.01264 0.0127 0.08% Amr::writePlotFile() 2 0.001563 0.004769 0.01057 0.07% AmrLevel::writePlotFile() 4 0.005381 0.006674 0.01025 0.07% AmrMesh::MakeNewGrids() 11 0.005847 0.007636 0.009485 0.06% TagBoxArray::mapPRD 11 0.00382 0.006635 0.009467 0.06% Amr::coarseTimeStep() 20 0.0002845 0.002684 0.008769 0.06% AmrLevel::FillPatch() 140 0.001736 0.001834 0.001952 0.01% Amr::timeStep() 60 0.0006338 0.0008841 0.001391 0.01% FabArray::ParallelCopy() 692 0.0007082 0.0007333 0.0007762 0.01% main() 1 0.0001914 0.0002257 0.0002492 0.00% FillPatchIterator::FillFromTwoLevels() 89 0.0001524 0.0001611 0.0001698 0.00% FillPatchIterator::FillFromLevel0() 51 6.713e-05 6.961e-05 7.122e-05 0.00% postCoarseTimeStep() 20 3.935e-05 4.866e-05 6.843e-05 0.00% Amr::grid_places() 11 5.029e-05 5.973e-05 6.524e-05 0.00% Amr::FinalizeInit() 1 4.954e-06 1.828e-05 4.911e-05 0.00% CNS::avgDown() 21 3.306e-05 3.893e-05 4.569e-05 0.00% AmrLevel::AmrLevel(dm) 12 2.789e-05 2.978e-05 3.19e-05 0.00% amrex::average_down_w_geom 21 1.622e-05 1.815e-05 2.042e-05 0.00% CNS::writePlotFile() 4 6.785e-06 7.144e-06 7.373e-06 0.00% Amr::init() 1 1.259e-06 1.374e-06 1.458e-06 0.00% Amr::initialInit() 1 7.85e-07 9.645e-07 1.299e-06 0.00% Other 1351 0.03574 0.05488 0.07484 0.50% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 14.94 14.95 14.96 100.00% Amr::coarseTimeStep() 20 14.55 14.55 14.55 97.25% Amr::timeStep() 60 14.38 14.42 14.45 96.62% CNS::advance() 60 12.88 12.9 12.9 86.26% CNS::compute_dSdt() 120 8.296 9.131 9.985 66.75% AmrLevel::FillPatch() 140 2.221 3.112 3.976 26.58% FillPatchIterator::Initialize 140 1.941 2.831 3.692 24.68% FabArray::ParallelCopy() 692 1.516 2.31 3.119 20.85% FillPatchSingleLevel 220 0.9228 1.834 2.769 18.51% FillPatchIterator::FillFromLevel0() 51 0.2338 1.085 1.931 12.91% FabArray::ParallelCopy_finish() 692 0.7884 1.346 1.829 12.23% StateDataPhysBCFunct::() 220 0.0009628 0.8577 1.715 11.46% FillPatchIterator::FillFromTwoLevels() 89 1.388 1.415 1.462 9.77% FillPatchTwoLevels 89 1.388 1.415 1.462 9.77% FabArray::ParallelCopy_nowait() 692 0.7154 0.9634 1.289 8.61% post_timestep 60 1.175 1.214 1.239 8.29% FluxRegister::Reflux() 120 0.9198 0.9521 0.9843 6.58% Amr::regrid() 10 0.3387 0.3433 0.351 2.35% amrex::Copy() 168 0.2816 0.294 0.302 2.02% Amr::writePlotFile() 2 0.2899 0.2903 0.2908 1.94% CNS::writePlotFile() 4 0.2795 0.2855 0.2885 1.93% AmrLevel::writePlotFile() 4 0.2795 0.2854 0.2885 1.93% FabArray::setVal() 282 0.2228 0.2533 0.2821 1.89% Amr::init() 1 0.2595 0.2675 0.2749 1.84% VisMF::Write(FabArray) 4 0.2608 0.2645 0.2682 1.79% FabArray::LinComb() 120 0.1514 0.2069 0.2398 1.60% CNS::avgDown() 21 0.218 0.2236 0.2327 1.56% amrex::average_down_w_geom 21 0.2028 0.2073 0.2125 1.42% amrex::average_down 21 0.2028 0.2072 0.2125 1.42% CNS::computeTemp() 141 0.1413 0.1699 0.2019 1.35% FillPatchInterp(Fab) 80 0.12 0.1685 0.1949 1.30% Amr::grid_places() 11 0.1839 0.1854 0.1868 1.25% AmrMesh::MakeNewGrids() 11 0.1839 0.1853 0.1868 1.25% CellConservativeLinear::interp() 120 0.05435 0.1113 0.1766 1.18% CNS::errorEst() 11 0.06893 0.1124 0.157 1.05% CNS::estTimeStep() 41 0.05022 0.08642 0.1519 1.02% FabArray::Saxpy() 60 0.0992 0.1122 0.1203 0.80% Amr::initialInit() 1 0.1009 0.1086 0.1162 0.78% Amr::FinalizeInit() 1 0.09346 0.09549 0.09702 0.65% Amr::bldFineLevels() 1 0.07314 0.0746 0.07606 0.51% TagBoxArray::collate() 11 0.001408 0.03725 0.07323 0.49% FabArray::sum() 105 0.01652 0.04949 0.06893 0.46% postCoarseTimeStep() 20 0.01169 0.04582 0.06504 0.43% FabArray::setDomainBndry() 220 0.000642 0.02541 0.05324 0.36% TagBoxArray::mapPRD 11 0.01183 0.0193 0.02613 0.17% AmrLevel::AmrLevel(dm) 12 0.02136 0.02309 0.02482 0.17% Other 1351 0.05012 0.09297 0.1337 0.89% ------------------------------------------------------------------------------------------- Device Memory Usage: ---------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ---------------------------------------------------------------------------------------------------------------- CNS::compute_dSdt() 19200 120 MiB 133 MiB 146 MiB 261 MiB 268 MiB 291 MiB CNS::advance() 2096 221 MiB 221 MiB 221 MiB 257 MiB 257 MiB 257 MiB StateData::define() 192 133 MiB 133 MiB 133 MiB 201 MiB 201 MiB 201 MiB FluxRegister::Reflux() 1920 3317 KiB 3488 KiB 3662 KiB 56 MiB 67 MiB 71 MiB FillPatchIterator::Initialize 2240 9320 KiB 12 MiB 16 MiB 67 MiB 67 MiB 67 MiB AmrLevel::writePlotFile() 64 1053 KiB 1073 KiB 1081 KiB 56 MiB 56 MiB 56 MiB FillPatchSingleLevel 640 672 KiB 745 KiB 859 KiB 56 MiB 56 MiB 56 MiB FillPatchTwoLevels 960 218 KiB 348 KiB 465 KiB 5073 KiB 7663 KiB 10 MiB ResizeRandomSeed 4 9209 KiB 9210 KiB 9211 KiB 9216 KiB 9216 KiB 9216 KiB CNS::errorEst() 176 37 KiB 62 KiB 89 KiB 8985 KiB 8985 KiB 8985 KiB post_timestep 320 542 KiB 547 KiB 555 KiB 8192 KiB 8192 KiB 8192 KiB amrex::average_down 428 76 KiB 84 KiB 94 KiB 7169 KiB 7169 KiB 7169 KiB CellConservativeLinear::interp() 960 12 KiB 20 KiB 33 KiB 1355 KiB 2064 KiB 2773 KiB Amr::regrid() 960 1329 KiB 1329 KiB 1330 KiB 2688 KiB 2688 KiB 2688 KiB StateDataPhysBCFunct::() 816 0 B 44 KiB 89 KiB 0 B 736 KiB 1473 KiB Amr::bldFineLevels() 96 4042 B 4051 B 4081 B 1344 KiB 1344 KiB 1344 KiB AmrMesh::MakeNewGrids() 352 12 KiB 12 KiB 12 KiB 1025 KiB 1025 KiB 1025 KiB FabArray::ParallelCopy_nowait() 3002 19 KiB 58 KiB 97 KiB 31 KiB 103 KiB 176 KiB VisMF::Write(FabArray) 448 27 B 55 B 78 B 96 KiB 96 KiB 96 KiB CNS::estTimeStep() 172 1115 B 1145 B 1208 B 49 KiB 49 KiB 49 KiB FabArray::sum() 420 53 B 160 B 223 B 48 KiB 48 KiB 48 KiB FabArray::ParallelCopy_finish() 2168 714 B 2021 B 3362 B 4096 B 7872 B 11 KiB amrex::Copy() 912 2817 B 2832 B 2847 B 3584 B 3584 B 3584 B FabArray::setVal() 1144 2089 B 2115 B 2142 B 3072 B 3072 B 3072 B TagBoxArray::mapPRD 352 1 B 2 B 3 B 2048 B 2048 B 2048 B FabArray::LinComb() 284 1084 B 1084 B 1084 B 1536 B 1536 B 1536 B TagBoxArray::collate() 88 0 B 0 B 0 B 256 B 896 B 1536 B OwnerMask() 176 0 B 0 B 0 B 1024 B 1024 B 1024 B StateData::FillBoundary(geom) 1224 0 B 9 B 20 B 0 B 256 B 512 B Amr::InitAmr() 8 505 B 505 B 506 B 512 B 512 B 512 B ---------------------------------------------------------------------------------------------------------------- Async Memory Usage: ------------------------------------------------------------------------------------------------------ Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ------------------------------------------------------------------------------------------------------ CNS::compute_dSdt() 3840 4509 KiB 7995 KiB 11 MiB 65 MiB 65 MiB 65 MiB FluxRegister::Reflux() 1920 2471 KiB 2962 KiB 3291 KiB 56 MiB 56 MiB 56 MiB post_timestep 320 517 KiB 535 KiB 552 KiB 8192 KiB 8192 KiB 8192 KiB amrex::average_down 336 75 KiB 83 KiB 94 KiB 7168 KiB 7168 KiB 7168 KiB ------------------------------------------------------------------------------------------------------ Managed Memory Usage: --------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------- The_Managed_Arena::Initialize() 4 0 B 0 B 0 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------- Pinned Memory Usage: ---------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ---------------------------------------------------------------------------------------------------------------- FabArray::ParallelCopy_nowait() 7136 491 KiB 706 KiB 893 KiB 7531 KiB 11 MiB 14 MiB VisMF::Write(FabArray) 512 194 KiB 212 KiB 221 KiB 14 MiB 14 MiB 14 MiB The_Pinned_Arena::Initialize() 4 0 B 0 B 1 B 8192 KiB 8192 KiB 8192 KiB FabArray::ParallelCopy_finish() 2168 714 B 2021 B 3362 B 4096 B 7872 B 11 KiB amrex::Copy() 912 2817 B 2832 B 2847 B 3584 B 3584 B 3584 B CNS::compute_dSdt() 1920 122 B 170 B 220 B 3072 B 3072 B 3072 B FabArray::setVal() 1144 2089 B 2115 B 2142 B 3072 B 3072 B 3072 B TagBoxArray::collate() 154 0 B 2 B 4 B 512 B 1344 B 1792 B FabArray::LinComb() 284 1084 B 1084 B 1084 B 1536 B 1536 B 1536 B amrex::average_down 92 563 B 563 B 565 B 1536 B 1536 B 1536 B CNS::estTimeStep() 172 1011 B 1011 B 1012 B 1280 B 1280 B 1280 B CellConservativeLinear::interp() 480 1 B 1 B 2 B 256 B 384 B 512 B StateData::FillBoundary(geom) 1224 0 B 9 B 20 B 0 B 256 B 512 B FabArray::sum() 420 0 B 0 B 1 B 256 B 256 B 256 B ---------------------------------------------------------------------------------------------------------------- Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [3987 ... 3987] [The Arena] max space (MB) allocated spread across MPI: [805 ... 841] [The Arena] max space (MB) used spread across MPI: [663 ... 693] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [32 ... 36] [The Pinned Arena] max space (MB) used spread across MPI: [14 ... 14] AMReX (26.09-120-g66028f892b7d) finalized