Initializing AMReX (26.09-125-g523e7305089a)... MPI initialized with 4 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.09-125-g523e7305089a) initialized Successfully read inputs file ... Successfully read inputs file ... Starting to call amrex_probinit ... Successfully run amrex_probinit Now regridding at level lbase = 0 grid_places() time: 0.035735496 new finest: 1 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 INITIAL GRIDS Level 0 16 grids 4194304 cells 100 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 PLOTFILE: file = CNS-RT_plt00000 grid_places() time: 0.040289019 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is 0 Total y-momentum is 0 Total z-momentum is 0 Total energy is 7176192.0007176176 Write plotfile time = 0.31570157 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.0002870776155 [Level 0 step 1] Advanced 4194304 cells [Level 1 step 1] ADVANCE at time 0 with dt = 0.0001435388078 [Level 1 step 1] Advanced 4194304 cells [Level 1 step 2] ADVANCE at time 0.0001435388078 with dt = 0.0001435388078 [Level 1 step 2] Advanced 4194304 cells STEP = 1 TIME = 0.0002870776155 DT = 0.0002870776155 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -3.5092716654764083e-23 Total y-momentum is -4.7581467629282477e-22 Total z-momentum is 1.0569463681968465 Total energy is 7176192.0005832035 [STEP 1] Coarse TimeStep time: 1.014297074 [STEP 1] FAB kilobyte spread across MPI nodes: [596970 ... 596970] [Level 0 step 2] ADVANCE at time 0.0002870776155 with dt = 0.0002870672688 [Level 0 step 2] Advanced 4194304 cells [Level 1 step 3] ADVANCE at time 0.0002870776155 with dt = 0.0001435336344 [Level 1 step 3] Advanced 4194304 cells [Level 1 step 4] ADVANCE at time 0.0004306112499 with dt = 0.0001435336344 [Level 1 step 4] Advanced 4194304 cells STEP = 2 TIME = 0.0005741448843 DT = 0.0002870672688 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -8.7689508216908893e-21 Total y-momentum is -5.5967446161605243e-21 Total z-momentum is 2.3209418694909125 Total energy is 7176192.0001132824 [STEP 2] Coarse TimeStep time: 0.959907125 [STEP 2] FAB kilobyte spread across MPI nodes: [644102 ... 644102] Now regridding at level lbase = 0 STEP = 2 TIME = 0.0005741448843 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 3] ADVANCE at time 0.0005741448843 with dt = 0.0002870608582 [Level 0 step 3] Advanced 4194304 cells [Level 1 step 5] ADVANCE at time 0.0005741448843 with dt = 0.0001435304291 [Level 1 step 5] Advanced 4194304 cells [Level 1 step 6] ADVANCE at time 0.0007176753134 with dt = 0.0001435304291 [Level 1 step 6] Advanced 4194304 cells STEP = 3 TIME = 0.0008612057425 DT = 0.0002870608582 grid_places() time: 0.026088639 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -1.5519205277449085e-20 Total y-momentum is -1.1509814932737082e-19 Total z-momentum is 3.7623957612122778 Total energy is 7176191.9992529377 [STEP 3] Coarse TimeStep time: 1.015800224 [STEP 3] FAB kilobyte spread across MPI nodes: [644102 ... 644102] [Level 0 step 4] ADVANCE at time 0.0008612057425 with dt = 0.00028705672 [Level 0 step 4] Advanced 4194304 cells [Level 1 step 7] ADVANCE at time 0.0008612057425 with dt = 0.00014352836 [Level 1 step 7] Advanced 4194304 cells [Level 1 step 8] ADVANCE at time 0.001004734103 with dt = 0.00014352836 [Level 1 step 8] Advanced 4194304 cells STEP = 4 TIME = 0.001148262463 DT = 0.00028705672 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -4.1479205999343841e-20 Total y-momentum is -3.6936901787582409e-19 Total z-momentum is 5.3553134404616589 Total energy is 7176191.9979552217 [STEP 4] Coarse TimeStep time: 0.978753174 [STEP 4] FAB kilobyte spread across MPI nodes: [644102 ... 644102] Now regridding at level lbase = 0 STEP = 4 TIME = 0.001148262463 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 5] ADVANCE at time 0.001148262463 with dt = 0.0002870541933 [Level 0 step 5] Advanced 4194304 cells [Level 1 step 9] ADVANCE at time 0.001148262463 with dt = 0.0001435270967 [Level 1 step 9] Advanced 4194304 cells [Level 1 step 10] ADVANCE at time 0.001291789559 with dt = 0.0001435270967 [Level 1 step 10] Advanced 4194304 cells STEP = 5 TIME = 0.001435316656 DT = 0.0002870541933 grid_places() time: 0.037464403 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -1.1396633721934696e-19 Total y-momentum is -3.0462678646188091e-19 Total z-momentum is 7.0771445174316794 Total energy is 7176191.9961801395 [STEP 5] Coarse TimeStep time: 1.043121824 [STEP 5] FAB kilobyte spread across MPI nodes: [644102 ... 644102] [Level 0 step 6] ADVANCE at time 0.001435316656 with dt = 0.0002870527674 [Level 0 step 6] Advanced 4194304 cells [Level 1 step 11] ADVANCE at time 0.001435316656 with dt = 0.0001435263837 [Level 1 step 11] Advanced 4194304 cells [Level 1 step 12] ADVANCE at time 0.00157884304 with dt = 0.0001435263837 [Level 1 step 12] Advanced 4194304 cells STEP = 6 TIME = 0.001722369423 DT = 0.0002870527674 [CNS] Total mass is 1302338.0233411891 Total x-momentum is 1.7090321664713806e-19 Total y-momentum is 1.146401821544799e-18 Total z-momentum is 8.9084964335707451 Total energy is 7176191.9938936941 [STEP 6] Coarse TimeStep time: 0.962574064 [STEP 6] FAB kilobyte spread across MPI nodes: [644102 ... 644102] Now regridding at level lbase = 0 STEP = 6 TIME = 0.001722369423 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 7] ADVANCE at time 0.001722369423 with dt = 0.0002870520599 [Level 0 step 7] Advanced 4194304 cells [Level 1 step 13] ADVANCE at time 0.001722369423 with dt = 0.00014352603 [Level 1 step 13] Advanced 4194304 cells [Level 1 step 14] ADVANCE at time 0.001865895453 with dt = 0.00014352603 [Level 1 step 14] Advanced 4194304 cells STEP = 7 TIME = 0.002009421483 DT = 0.0002870520599 grid_places() time: 0.037629009 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is 6.6878559368472745e-20 Total y-momentum is -1.6894380193141711e-18 Total z-momentum is 10.832804311097526 Total energy is 7176191.9910670239 [STEP 7] Coarse TimeStep time: 1.049171915 [STEP 7] FAB kilobyte spread across MPI nodes: [644102 ... 644102] [Level 0 step 8] ADVANCE at time 0.002009421483 with dt = 0.0002870517947 [Level 0 step 8] Advanced 4194304 cells [Level 1 step 15] ADVANCE at time 0.002009421483 with dt = 0.0001435258973 [Level 1 step 15] Advanced 4194304 cells [Level 1 step 16] ADVANCE at time 0.002152947381 with dt = 0.0001435258973 [Level 1 step 16] Advanced 4194304 cells STEP = 8 TIME = 0.002296473278 DT = 0.0002870517947 [CNS] Total mass is 1302338.0233411889 Total x-momentum is 5.3927956212891139e-19 Total y-momentum is 2.0251664316853536e-18 Total z-momentum is 12.835981478053228 Total energy is 7176191.9876756454 [STEP 8] Coarse TimeStep time: 0.960615683 [STEP 8] FAB kilobyte spread across MPI nodes: [644102 ... 644102] Now regridding at level lbase = 0 STEP = 8 TIME = 0.002296473278 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 9] ADVANCE at time 0.002296473278 with dt = 0.00028705178 [Level 0 step 9] Advanced 4194304 cells [Level 1 step 17] ADVANCE at time 0.002296473278 with dt = 0.00014352589 [Level 1 step 17] Advanced 4194304 cells [Level 1 step 18] ADVANCE at time 0.002439999168 with dt = 0.00014352589 [Level 1 step 18] Advanced 4194304 cells STEP = 9 TIME = 0.002583525058 DT = 0.00028705178 grid_places() time: 0.037044458 new finest: 1 [CNS] Total mass is 1302338.0233411889 Total x-momentum is -1.5595441074624861e-18 Total y-momentum is -6.5262894030504217e-19 Total z-momentum is 14.906076194007591 Total energy is 7176191.9836987816 [STEP 9] Coarse TimeStep time: 1.053642459 [STEP 9] FAB kilobyte spread across MPI nodes: [644102 ... 644102] [Level 0 step 10] ADVANCE at time 0.002583525058 with dt = 0.0002870518889 [Level 0 step 10] Advanced 4194304 cells [Level 1 step 19] ADVANCE at time 0.002583525058 with dt = 0.0001435259444 [Level 1 step 19] Advanced 4194304 cells [Level 1 step 20] ADVANCE at time 0.002727051002 with dt = 0.0001435259444 [Level 1 step 20] Advanced 4194304 cells STEP = 10 TIME = 0.002870576947 DT = 0.0002870518889 [CNS] Total mass is 1302338.0233411891 Total x-momentum is 2.3105562861671332e-18 Total y-momentum is -4.9690956240102015e-18 Total z-momentum is 17.032951759614726 Total energy is 7176191.979118811 [STEP 10] Coarse TimeStep time: 0.961640706 [STEP 10] FAB kilobyte spread across MPI nodes: [644102 ... 644102] Now regridding at level lbase = 0 STEP = 10 TIME = 0.002870576947 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 11] ADVANCE at time 0.002870576947 with dt = 0.0002870520422 [Level 0 step 11] Advanced 4194304 cells [Level 1 step 21] ADVANCE at time 0.002870576947 with dt = 0.0001435260211 [Level 1 step 21] Advanced 4194304 cells [Level 1 step 22] ADVANCE at time 0.003014102968 with dt = 0.0001435260211 [Level 1 step 22] Advanced 4194304 cells STEP = 11 TIME = 0.003157628989 DT = 0.0002870520422 grid_places() time: 0.041197841 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -1.3842651682936686e-18 Total y-momentum is 5.6171843056422593e-18 Total z-momentum is 19.208000131229255 Total energy is 7176191.9739207756 [STEP 11] Coarse TimeStep time: 1.044138016 [STEP 11] FAB kilobyte spread across MPI nodes: [644102 ... 644102] [Level 0 step 12] ADVANCE at time 0.003157628989 with dt = 0.0002870521946 [Level 0 step 12] Advanced 4194304 cells [Level 1 step 23] ADVANCE at time 0.003157628989 with dt = 0.0001435260973 [Level 1 step 23] Advanced 4194304 cells [Level 1 step 24] ADVANCE at time 0.003301155086 with dt = 0.0001435260973 [Level 1 step 24] Advanced 4194304 cells STEP = 12 TIME = 0.003444681184 DT = 0.0002870521946 [CNS] Total mass is 1302338.0233411889 Total x-momentum is 3.0293679392959181e-18 Total y-momentum is -2.1651749930855106e-18 Total z-momentum is 21.42389356856874 Total energy is 7176191.9680919927 [STEP 12] Coarse TimeStep time: 0.959376358 [STEP 12] FAB kilobyte spread across MPI nodes: [644102 ... 644102] Now regridding at level lbase = 0 STEP = 12 TIME = 0.003444681184 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 13] ADVANCE at time 0.003444681184 with dt = 0.0002870523239 [Level 0 step 13] Advanced 4194304 cells [Level 1 step 25] ADVANCE at time 0.003444681184 with dt = 0.0001435261619 [Level 1 step 25] Advanced 4194304 cells [Level 1 step 26] ADVANCE at time 0.003588207345 with dt = 0.0001435261619 [Level 1 step 26] Advanced 4194304 cells STEP = 13 TIME = 0.003731733507 DT = 0.0002870523239 grid_places() time: 0.036949577 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -3.7108914826106779e-18 Total y-momentum is -4.6691001700992167e-18 Total z-momentum is 23.674374717272052 Total energy is 7176191.9616217129 [STEP 13] Coarse TimeStep time: 1.046689489 [STEP 13] FAB kilobyte spread across MPI nodes: [644102 ... 644102] [Level 0 step 14] ADVANCE at time 0.003731733507 with dt = 0.000287052422 [Level 0 step 14] Advanced 4194304 cells [Level 1 step 27] ADVANCE at time 0.003731733507 with dt = 0.000143526211 [Level 1 step 27] Advanced 4194304 cells [Level 1 step 28] ADVANCE at time 0.003875259718 with dt = 0.000143526211 [Level 1 step 28] Advanced 4194304 cells STEP = 14 TIME = 0.004018785929 DT = 0.000287052422 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -1.9339331742030253e-18 Total y-momentum is -1.0218823386068499e-17 Total z-momentum is 25.954082739011707 Total energy is 7176191.9545008428 [STEP 14] Coarse TimeStep time: 0.964725425 [STEP 14] FAB kilobyte spread across MPI nodes: [644102 ... 644102] Now regridding at level lbase = 0 STEP = 14 TIME = 0.004018785929 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 15] ADVANCE at time 0.004018785929 with dt = 0.0002870524893 [Level 0 step 15] Advanced 4194304 cells [Level 1 step 29] ADVANCE at time 0.004018785929 with dt = 0.0001435262446 [Level 1 step 29] Advanced 4194304 cells [Level 1 step 30] ADVANCE at time 0.004162312174 with dt = 0.0001435262446 [Level 1 step 30] Advanced 4194304 cells STEP = 15 TIME = 0.004305838419 DT = 0.0002870524893 grid_places() time: 0.036344851 new finest: 1 [CNS] Total mass is 1302338.0233411889 Total x-momentum is -4.0042499541114582e-18 Total y-momentum is 7.0420759999267868e-19 Total z-momentum is 28.2584114435783 Total energy is 7176191.9467217075 [STEP 15] Coarse TimeStep time: 1.045421196 [STEP 15] FAB kilobyte spread across MPI nodes: [644102 ... 644102] [Level 0 step 16] ADVANCE at time 0.004305838419 with dt = 0.0002870525306 [Level 0 step 16] Advanced 4194304 cells [Level 1 step 31] ADVANCE at time 0.004305838419 with dt = 0.0001435262653 [Level 1 step 31] Advanced 4194304 cells [Level 1 step 32] ADVANCE at time 0.004449364684 with dt = 0.0001435262653 [Level 1 step 32] Advanced 4194304 cells STEP = 16 TIME = 0.004592890949 DT = 0.0002870525306 [CNS] Total mass is 1302338.0233411889 Total x-momentum is -5.0148171426294211e-18 Total y-momentum is 1.127948322283892e-17 Total z-momentum is 30.58339461141512 Total energy is 7176191.9382778564 [STEP 16] Coarse TimeStep time: 0.964349032 [STEP 16] FAB kilobyte spread across MPI nodes: [644102 ... 644102] Now regridding at level lbase = 0 STEP = 16 TIME = 0.004592890949 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 17] ADVANCE at time 0.004592890949 with dt = 0.000287052552 [Level 0 step 17] Advanced 4194304 cells [Level 1 step 33] ADVANCE at time 0.004592890949 with dt = 0.000143526276 [Level 1 step 33] Advanced 4194304 cells [Level 1 step 34] ADVANCE at time 0.004736417225 with dt = 0.000143526276 [Level 1 step 34] Advanced 4194304 cells STEP = 17 TIME = 0.004879943501 DT = 0.000287052552 grid_places() time: 0.036070847 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -4.1491161035438706e-18 Total y-momentum is -5.9631131894411932e-18 Total z-momentum is 32.925613582717467 Total energy is 7176191.9291638918 [STEP 17] Coarse TimeStep time: 1.040304451 [STEP 17] FAB kilobyte spread across MPI nodes: [644102 ... 644102] [Level 0 step 18] ADVANCE at time 0.004879943501 with dt = 0.0002870525597 [Level 0 step 18] Advanced 4194304 cells [Level 1 step 35] ADVANCE at time 0.004879943501 with dt = 0.0001435262798 [Level 1 step 35] Advanced 4194304 cells [Level 1 step 36] ADVANCE at time 0.005023469781 with dt = 0.0001435262798 [Level 1 step 36] Advanced 4194304 cells STEP = 18 TIME = 0.005166996061 DT = 0.0002870525597 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -7.7919414836719597e-18 Total y-momentum is -5.1829230531260779e-18 Total z-momentum is 35.28212251382287 Total energy is 7176191.9193753228 [STEP 18] Coarse TimeStep time: 0.963770808 [STEP 18] FAB kilobyte spread across MPI nodes: [644102 ... 644102] Now regridding at level lbase = 0 STEP = 18 TIME = 0.005166996061 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 19] ADVANCE at time 0.005166996061 with dt = 0.0002870525588 [Level 0 step 19] Advanced 4194304 cells [Level 1 step 37] ADVANCE at time 0.005166996061 with dt = 0.0001435262794 [Level 1 step 37] Advanced 4194304 cells [Level 1 step 38] ADVANCE at time 0.00531052234 with dt = 0.0001435262794 [Level 1 step 38] Advanced 4194304 cells STEP = 19 TIME = 0.00545404862 DT = 0.0002870525588 grid_places() time: 0.03743007 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -5.0148412415562031e-18 Total y-momentum is -1.8209513886482642e-17 Total z-momentum is 37.650387281643575 Total energy is 7176191.9089084426 [STEP 19] Coarse TimeStep time: 1.035184831 [STEP 19] FAB kilobyte spread across MPI nodes: [644102 ... 644102] [Level 0 step 20] ADVANCE at time 0.00545404862 with dt = 0.0002870525536 [Level 0 step 20] Advanced 4194304 cells [Level 1 step 39] ADVANCE at time 0.00545404862 with dt = 0.0001435262768 [Level 1 step 39] Advanced 4194304 cells [Level 1 step 40] ADVANCE at time 0.005597574896 with dt = 0.0001435262768 [Level 1 step 40] Advanced 4194304 cells STEP = 20 TIME = 0.005741101173 DT = 0.0002870525536 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -5.2651302026207714e-18 Total y-momentum is 4.3880382600241113e-18 Total z-momentum is 40.028234710671754 Total energy is 7176191.8977602143 [STEP 20] Coarse TimeStep time: 0.973824948 [STEP 20] FAB kilobyte spread across MPI nodes: [644102 ... 644102] PLOTFILE: file = CNS-RT_plt00020 Write plotfile time = 0.223314215 seconds Run Time total = 20.77468368 Run Time init = 0.5179818 Run Time advance = 20.0331 TinyProfiler total time across processes [min...avg...max]: 20.74 ... 20.76 ... 20.77 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- CNS::compute_dSdt() 120 10.43 10.6 10.76 51.80% FabArray::ParallelCopy_finish() 692 1.39 2.028 2.718 13.08% StateDataPhysBCFunct::() 220 0.001487 1.132 2.287 11.01% FabArray::ParallelCopy_nowait() 692 0.8417 1.334 1.798 8.65% FluxRegister::Reflux() 120 0.8707 0.8876 0.9041 4.35% CNS::advance() 60 0.5571 0.5726 0.5858 2.82% FillPatchIterator::Initialize 140 0.5069 0.525 0.5436 2.62% FabArray::setVal() 282 0.4582 0.4796 0.5061 2.44% amrex::Copy() 168 0.3939 0.4304 0.4634 2.23% VisMF::Write(FabArray) 4 0.4018 0.4274 0.4547 2.19% FabArray::LinComb() 120 0.2182 0.2805 0.3419 1.65% CellConservativeLinear::interp() 120 0.06449 0.1721 0.307 1.48% FillPatchTwoLevels 89 0.1288 0.2087 0.2883 1.39% CNS::computeTemp() 141 0.1813 0.2221 0.2714 1.31% FillPatchSingleLevel 220 0.1865 0.2087 0.2296 1.11% Amr::regrid() 10 0.2156 0.2165 0.218 1.05% TagBoxArray::collate() 11 0.007364 0.1012 0.1934 0.93% amrex::average_down 21 0.1274 0.1397 0.1604 0.77% FabArray::Saxpy() 60 0.1312 0.1364 0.1462 0.70% FabArray::sum() 105 0.1011 0.1203 0.1375 0.66% FillPatchInterp(Fab) 80 0.02045 0.06764 0.1279 0.62% CNS::estTimeStep() 41 0.07508 0.09608 0.1209 0.58% Amr::writePlotFile() 2 0.002194 0.05375 0.09518 0.46% FabArray::setDomainBndry() 220 0.001176 0.03671 0.08151 0.39% post_timestep 60 0.06255 0.06801 0.07379 0.36% CNS::errorEst() 11 0.0404 0.04169 0.0431 0.21% StateData::define() 12 0.03809 0.04039 0.04271 0.21% Amr::bldFineLevels() 1 0.02193 0.02255 0.02423 0.12% TagBoxArray::mapPRD 11 0.01121 0.01396 0.01742 0.08% AmrLevel::writePlotFile() 4 0.01214 0.01411 0.01637 0.08% AmrMesh::MakeNewGrids() 11 0.0116 0.01278 0.014 0.07% Amr::timeStep() 60 0.0007201 0.002592 0.007842 0.04% Amr::coarseTimeStep() 20 0.0005918 0.002478 0.004761 0.02% Amr::FinalizeInit() 1 6.482e-06 0.0007087 0.002801 0.01% AmrLevel::FillPatch() 140 0.002484 0.002563 0.002618 0.01% FabArray::ParallelCopy() 692 0.0008671 0.0009431 0.001003 0.00% main() 1 0.0002415 0.0003353 0.0003946 0.00% FillPatchIterator::FillFromTwoLevels() 89 0.0001775 0.0001993 0.0002168 0.00% FillPatchIterator::FillFromLevel0() 51 7.176e-05 8.354e-05 9.271e-05 0.00% postCoarseTimeStep() 20 5.333e-05 6.736e-05 9.063e-05 0.00% Amr::grid_places() 11 6.425e-05 7.21e-05 7.734e-05 0.00% CNS::avgDown() 21 4.591e-05 5.299e-05 6.648e-05 0.00% AmrLevel::AmrLevel(dm) 12 3.86e-05 4.167e-05 5.019e-05 0.00% Amr::InitializeInit() 1 2.826e-06 1.237e-05 3.988e-05 0.00% amrex::average_down_w_geom 21 2.297e-05 2.536e-05 2.819e-05 0.00% CNS::writePlotFile() 4 6.958e-06 7.863e-06 8.37e-06 0.00% Amr::init() 1 1.47e-06 1.881e-06 2.262e-06 0.00% Amr::initialInit() 1 1.295e-06 1.344e-06 1.386e-06 0.00% Other 1338 0.01711 0.05532 0.1095 0.53% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 20.74 20.76 20.77 100.00% Amr::coarseTimeStep() 20 20.03 20.03 20.03 96.43% Amr::timeStep() 60 19.78 19.82 19.86 95.61% CNS::advance() 60 17.38 17.39 17.41 83.80% CNS::compute_dSdt() 120 11.02 12.08 13.13 63.23% AmrLevel::FillPatch() 140 3.241 4.386 5.536 26.65% FillPatchIterator::Initialize 140 2.827 3.989 5.145 24.77% FabArray::ParallelCopy() 692 2.24 3.37 4.523 21.77% FillPatchSingleLevel 220 1.244 2.488 3.66 17.62% FabArray::ParallelCopy_finish() 692 1.39 2.028 2.718 13.08% FillPatchIterator::FillFromLevel0() 51 0.3168 1.439 2.58 12.42% StateDataPhysBCFunct::() 220 0.001487 1.142 2.307 11.11% FillPatchIterator::FillFromTwoLevels() 89 1.969 1.989 2.004 9.65% FillPatchTwoLevels 89 1.969 1.989 2.004 9.65% post_timestep 60 1.772 1.806 1.847 8.89% FabArray::ParallelCopy_nowait() 692 0.849 1.341 1.805 8.69% FluxRegister::Reflux() 120 1.374 1.407 1.433 6.90% Amr::regrid() 10 0.6861 0.6919 0.7 3.37% Amr::writePlotFile() 2 0.5298 0.537 0.5398 2.60% Amr::init() 1 0.4835 0.4979 0.5162 2.48% FabArray::setVal() 282 0.4582 0.4796 0.5061 2.44% CNS::writePlotFile() 4 0.4437 0.4773 0.5036 2.42% AmrLevel::writePlotFile() 4 0.4437 0.4773 0.5036 2.42% amrex::Copy() 168 0.3939 0.4304 0.4634 2.23% VisMF::Write(FabArray) 4 0.4018 0.4274 0.4547 2.19% Amr::grid_places() 11 0.3989 0.4006 0.4022 1.94% AmrMesh::MakeNewGrids() 11 0.3989 0.4006 0.4022 1.94% FabArray::LinComb() 120 0.2182 0.2805 0.3419 1.65% CNS::avgDown() 21 0.3017 0.3178 0.3349 1.61% CNS::errorEst() 11 0.1295 0.2286 0.3287 1.58% FillPatchInterp(Fab) 80 0.1669 0.2398 0.3274 1.58% CellConservativeLinear::interp() 120 0.06449 0.1721 0.307 1.48% amrex::average_down_w_geom 21 0.2834 0.2951 0.3048 1.47% amrex::average_down 21 0.2834 0.2951 0.3048 1.47% CNS::computeTemp() 141 0.1813 0.2221 0.2714 1.31% Amr::initialInit() 1 0.1738 0.1844 0.2 0.96% TagBoxArray::collate() 11 0.007364 0.1012 0.1934 0.93% Amr::FinalizeInit() 1 0.1609 0.1631 0.1691 0.81% FabArray::Saxpy() 60 0.1312 0.1364 0.1462 0.70% FabArray::sum() 105 0.1011 0.1203 0.1375 0.66% Amr::bldFineLevels() 1 0.1307 0.132 0.1333 0.64% postCoarseTimeStep() 20 0.09752 0.115 0.1303 0.63% CNS::estTimeStep() 41 0.07508 0.09608 0.1209 0.58% FabArray::setDomainBndry() 220 0.001176 0.03671 0.08151 0.39% TagBoxArray::mapPRD 11 0.03513 0.042 0.04955 0.24% AmrLevel::AmrLevel(dm) 12 0.03813 0.04044 0.04276 0.21% StateData::define() 12 0.03809 0.04039 0.04271 0.21% Amr::InitializeInit() 1 0.008028 0.02124 0.03908 0.19% Other 1338 0.02912 0.09882 0.1934 0.93% ------------------------------------------------------------------------------------------- Device Memory Usage: ---------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ---------------------------------------------------------------------------------------------------------------- CNS::compute_dSdt() 19200 111 MiB 123 MiB 135 MiB 261 MiB 280 MiB 291 MiB CNS::advance() 2096 216 MiB 216 MiB 216 MiB 257 MiB 257 MiB 257 MiB StateData::define() 192 133 MiB 133 MiB 133 MiB 201 MiB 201 MiB 201 MiB FluxRegister::Reflux() 1920 3453 KiB 3653 KiB 3853 KiB 56 MiB 67 MiB 71 MiB FillPatchIterator::Initialize 2240 9653 KiB 12 MiB 16 MiB 67 MiB 67 MiB 67 MiB AmrLevel::writePlotFile() 64 1200 KiB 1289 KiB 1360 KiB 56 MiB 56 MiB 56 MiB FillPatchSingleLevel 640 756 KiB 825 KiB 878 KiB 56 MiB 56 MiB 56 MiB FillPatchTwoLevels 960 220 KiB 356 KiB 483 KiB 5073 KiB 7663 KiB 10 MiB ResizeRandomSeed 4 9204 KiB 9206 KiB 9208 KiB 9216 KiB 9216 KiB 9216 KiB CNS::errorEst() 176 50 KiB 92 KiB 135 KiB 8985 KiB 8985 KiB 8985 KiB post_timestep 320 586 KiB 593 KiB 598 KiB 8192 KiB 8192 KiB 8192 KiB amrex::average_down 428 79 KiB 85 KiB 93 KiB 7169 KiB 7169 KiB 7169 KiB CellConservativeLinear::interp() 960 13 KiB 19 KiB 25 KiB 1355 KiB 2064 KiB 2773 KiB Amr::regrid() 960 1330 KiB 1330 KiB 1330 KiB 2688 KiB 2688 KiB 2688 KiB StateDataPhysBCFunct::() 816 0 B 41 KiB 85 KiB 0 B 736 KiB 1473 KiB Amr::bldFineLevels() 96 5189 B 5219 B 5230 B 1344 KiB 1344 KiB 1344 KiB AmrMesh::MakeNewGrids() 352 19 KiB 19 KiB 19 KiB 1025 KiB 1025 KiB 1025 KiB FabArray::ParallelCopy_nowait() 3002 19 KiB 58 KiB 97 KiB 31 KiB 103 KiB 176 KiB VisMF::Write(FabArray) 448 355 B 397 B 463 B 96 KiB 96 KiB 96 KiB CNS::estTimeStep() 172 1088 B 1133 B 1176 B 49 KiB 49 KiB 49 KiB FabArray::sum() 420 236 B 280 B 321 B 48 KiB 48 KiB 48 KiB FabArray::ParallelCopy_finish() 2168 685 B 1998 B 3325 B 4096 B 7872 B 11 KiB amrex::Copy() 912 2795 B 2808 B 2824 B 3584 B 3584 B 3584 B FabArray::setVal() 1144 2104 B 2127 B 2152 B 3072 B 3072 B 3072 B TagBoxArray::mapPRD 352 3 B 3 B 4 B 2048 B 2048 B 2048 B FabArray::LinComb() 284 1064 B 1064 B 1064 B 1536 B 1536 B 1536 B TagBoxArray::collate() 88 0 B 0 B 1 B 256 B 896 B 1536 B OwnerMask() 176 0 B 0 B 0 B 1024 B 1024 B 1024 B StateData::FillBoundary(geom) 1224 0 B 9 B 20 B 0 B 256 B 512 B Amr::InitAmr() 8 505 B 505 B 506 B 512 B 512 B 512 B ---------------------------------------------------------------------------------------------------------------- Async Memory Usage: ------------------------------------------------------------------------------------------------------ Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ------------------------------------------------------------------------------------------------------ CNS::compute_dSdt() 3840 6764 KiB 9 MiB 12 MiB 65 MiB 65 MiB 65 MiB FluxRegister::Reflux() 1920 2971 KiB 3196 KiB 3421 KiB 56 MiB 56 MiB 56 MiB post_timestep 320 565 KiB 577 KiB 587 KiB 8192 KiB 8192 KiB 8192 KiB amrex::average_down 336 78 KiB 85 KiB 92 KiB 7168 KiB 7168 KiB 7168 KiB ------------------------------------------------------------------------------------------------------ Managed Memory Usage: --------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------- The_Managed_Arena::Initialize() 4 0 B 0 B 0 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------- Pinned Memory Usage: ---------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ---------------------------------------------------------------------------------------------------------------- FabArray::ParallelCopy_nowait() 7136 444 KiB 669 KiB 854 KiB 7531 KiB 11 MiB 14 MiB VisMF::Write(FabArray) 512 148 KiB 165 KiB 180 KiB 14 MiB 14 MiB 14 MiB The_Pinned_Arena::Initialize() 4 0 B 0 B 1 B 8192 KiB 8192 KiB 8192 KiB FabArray::ParallelCopy_finish() 2168 685 B 1998 B 3325 B 4096 B 7872 B 11 KiB amrex::Copy() 912 2795 B 2808 B 2824 B 3584 B 3584 B 3584 B CNS::compute_dSdt() 1920 175 B 221 B 268 B 3072 B 3072 B 3072 B FabArray::setVal() 1144 2104 B 2127 B 2152 B 3072 B 3072 B 3072 B TagBoxArray::collate() 154 0 B 4 B 8 B 512 B 1344 B 1792 B FabArray::LinComb() 284 1064 B 1064 B 1064 B 1536 B 1536 B 1536 B amrex::average_down 92 564 B 564 B 565 B 1536 B 1536 B 1536 B CNS::estTimeStep() 172 1011 B 1011 B 1011 B 1280 B 1280 B 1280 B CellConservativeLinear::interp() 480 1 B 1 B 2 B 256 B 384 B 512 B StateData::FillBoundary(geom) 1224 0 B 9 B 20 B 0 B 256 B 512 B FabArray::sum() 420 1 B 1 B 1 B 256 B 256 B 256 B ---------------------------------------------------------------------------------------------------------------- Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [2799 ... 2799] [The Arena] max space (MB) allocated spread across MPI: [816 ... 850] [The Arena] max space (MB) used spread across MPI: [663 ... 693] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [32 ... 36] [The Pinned Arena] max space (MB) used spread across MPI: [14 ... 14] AMReX (26.09-125-g523e7305089a) finalized