Initializing AMReX (26.04-114-g95e461b1a293)... MPI initialized with 4 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.04-114-g95e461b1a293) initialized Successfully read inputs file ... Successfully read inputs file ... Starting to call amrex_probinit ... Successfully run amrex_probinit Now regridding at level lbase = 0 grid_places() time: 0.019099468 new finest: 1 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 INITIAL GRIDS Level 0 16 grids 4194304 cells 100 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 PLOTFILE: file = CNS-RT_plt00000 grid_places() time: 0.019689647 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is 0 Total y-momentum is 0 Total z-momentum is 0 Total energy is 7176192.0007176176 Write plotfile time = 0.151573996 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.0002870776155 [Level 0 step 1] Advanced 4194304 cells [Level 1 step 1] ADVANCE at time 0 with dt = 0.0001435388078 [Level 1 step 1] Advanced 4194304 cells [Level 1 step 2] ADVANCE at time 0.0001435388078 with dt = 0.0001435388078 [Level 1 step 2] Advanced 4194304 cells STEP = 1 TIME = 0.0002870776155 DT = 0.0002870776155 [CNS] Total mass is 1302338.0233411891 Total x-momentum is 3.4600423210458683e-21 Total y-momentum is 2.0479171591388077e-21 Total z-momentum is 1.0569463681968465 Total energy is 7176192.0005832035 [STEP 1] Coarse TimeStep time: 0.695620692 [STEP 1] FAB kilobyte spread across MPI nodes: [536184 ... 544157] [Level 0 step 2] ADVANCE at time 0.0002870776155 with dt = 0.0002870783094 [Level 0 step 2] Advanced 4194304 cells [Level 1 step 3] ADVANCE at time 0.0002870776155 with dt = 0.0001435391547 [Level 1 step 3] Advanced 4194304 cells [Level 1 step 4] ADVANCE at time 0.0004306167702 with dt = 0.0001435391547 [Level 1 step 4] Advanced 4194304 cells STEP = 2 TIME = 0.0005741559249 DT = 0.0002870783094 [CNS] Total mass is 1302338.0233411891 Total x-momentum is 3.9958311725556041e-20 Total y-momentum is 1.3460343874667005e-20 Total z-momentum is 2.3209944805054441 Total energy is 7176192.0001132581 [STEP 2] Coarse TimeStep time: 0.667772798 [STEP 2] FAB kilobyte spread across MPI nodes: [575320 ... 575320] Now regridding at level lbase = 0 STEP = 2 TIME = 0.0005741559249 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 3] ADVANCE at time 0.0005741559249 with dt = 0.0002870780246 [Level 0 step 3] Advanced 4194304 cells [Level 1 step 5] ADVANCE at time 0.0005741559249 with dt = 0.0001435390123 [Level 1 step 5] Advanced 4194304 cells [Level 1 step 6] ADVANCE at time 0.0007176949372 with dt = 0.0001435390123 [Level 1 step 6] Advanced 4194304 cells STEP = 3 TIME = 0.0008612339496 DT = 0.0002870780246 grid_places() time: 0.016096611 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -1.5772450013167652e-20 Total y-momentum is -3.3612896367759814e-20 Total z-momentum is 3.7625461629590609 Total energy is 7176191.9992528344 [STEP 3] Coarse TimeStep time: 0.709711602 [STEP 3] FAB kilobyte spread across MPI nodes: [575320 ... 575320] [Level 0 step 4] ADVANCE at time 0.0008612339496 with dt = 0.0002870774356 [Level 0 step 4] Advanced 4194304 cells [Level 1 step 7] ADVANCE at time 0.0008612339496 with dt = 0.0001435387178 [Level 1 step 7] Advanced 4194304 cells [Level 1 step 8] ADVANCE at time 0.001004772667 with dt = 0.0001435387178 [Level 1 step 8] Advanced 4194304 cells STEP = 4 TIME = 0.001148311385 DT = 0.0002870774356 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -1.6642168363118369e-19 Total y-momentum is -5.342067168146162e-19 Total z-momentum is 5.355597903262626 Total energy is 7176191.9979549646 [STEP 4] Coarse TimeStep time: 0.670039431 [STEP 4] FAB kilobyte spread across MPI nodes: [575320 ... 575320] Now regridding at level lbase = 0 STEP = 4 TIME = 0.001148311385 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 5] ADVANCE at time 0.001148311385 with dt = 0.0002870767217 [Level 0 step 5] Advanced 4194304 cells [Level 1 step 9] ADVANCE at time 0.001148311385 with dt = 0.0001435383608 [Level 1 step 9] Advanced 4194304 cells [Level 1 step 10] ADVANCE at time 0.001291849746 with dt = 0.0001435383608 [Level 1 step 10] Advanced 4194304 cells STEP = 5 TIME = 0.001435388107 DT = 0.0002870767217 grid_places() time: 0.016240154 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -1.358812720720659e-19 Total y-momentum is -2.0160459479448667e-21 Total z-momentum is 7.0775892529197408 Total energy is 7176191.9961796384 [STEP 5] Coarse TimeStep time: 0.705098961 [STEP 5] FAB kilobyte spread across MPI nodes: [575320 ... 575320] [Level 0 step 6] ADVANCE at time 0.001435388107 with dt = 0.0002870760002 [Level 0 step 6] Advanced 4194304 cells [Level 1 step 11] ADVANCE at time 0.001435388107 with dt = 0.0001435380001 [Level 1 step 11] Advanced 4194304 cells [Level 1 step 12] ADVANCE at time 0.001578926107 with dt = 0.0001435380001 [Level 1 step 12] Advanced 4194304 cells STEP = 6 TIME = 0.001722464107 DT = 0.0002870760002 [CNS] Total mass is 1302338.0233411891 Total x-momentum is 7.2906006961982036e-19 Total y-momentum is -1.2884571541290133e-18 Total z-momentum is 8.9091186975067487 Total energy is 7176191.9938928559 [STEP 6] Coarse TimeStep time: 0.668568362 [STEP 6] FAB kilobyte spread across MPI nodes: [575320 ... 575320] Now regridding at level lbase = 0 STEP = 6 TIME = 0.001722464107 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 7] ADVANCE at time 0.001722464107 with dt = 0.0002870753412 [Level 0 step 7] Advanced 4194304 cells [Level 1 step 13] ADVANCE at time 0.001722464107 with dt = 0.0001435376706 [Level 1 step 13] Advanced 4194304 cells [Level 1 step 14] ADVANCE at time 0.001866001778 with dt = 0.0001435376706 [Level 1 step 14] Advanced 4194304 cells STEP = 7 TIME = 0.002009539448 DT = 0.0002870753412 grid_places() time: 0.016084095 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -8.5144132686239444e-19 Total y-momentum is -1.3986777590613538e-20 Total z-momentum is 10.83361436279802 Total energy is 7176191.9910657536 [STEP 7] Coarse TimeStep time: 0.703011584 [STEP 7] FAB kilobyte spread across MPI nodes: [575320 ... 575320] [Level 0 step 8] ADVANCE at time 0.002009539448 with dt = 0.00028707478 [Level 0 step 8] Advanced 4194304 cells [Level 1 step 15] ADVANCE at time 0.002009539448 with dt = 0.00014353739 [Level 1 step 15] Advanced 4194304 cells [Level 1 step 16] ADVANCE at time 0.002153076838 with dt = 0.00014353739 [Level 1 step 16] Advanced 4194304 cells STEP = 8 TIME = 0.002296614228 DT = 0.00028707478 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -7.2204597721556348e-19 Total y-momentum is -2.4427946815143561e-18 Total z-momentum is 12.836984615501322 Total energy is 7176191.9876738414 [STEP 8] Coarse TimeStep time: 0.665562257 [STEP 8] FAB kilobyte spread across MPI nodes: [575320 ... 575320] Now regridding at level lbase = 0 STEP = 8 TIME = 0.002296614228 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 9] ADVANCE at time 0.002296614228 with dt = 0.0002870743281 [Level 0 step 9] Advanced 4194304 cells [Level 1 step 17] ADVANCE at time 0.002296614228 with dt = 0.000143537164 [Level 1 step 17] Advanced 4194304 cells [Level 1 step 18] ADVANCE at time 0.002440151392 with dt = 0.000143537164 [Level 1 step 18] Advanced 4194304 cells STEP = 9 TIME = 0.002583688556 DT = 0.0002870743281 grid_places() time: 0.016317546 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is 1.2783712819635498e-18 Total y-momentum is 1.0977113243582025e-19 Total z-momentum is 14.907274492170664 Total energy is 7176191.9836963499 [STEP 9] Coarse TimeStep time: 0.702189476 [STEP 9] FAB kilobyte spread across MPI nodes: [575320 ... 575320] [Level 0 step 10] ADVANCE at time 0.002583688556 with dt = 0.0002870739818 [Level 0 step 10] Advanced 4194304 cells [Level 1 step 19] ADVANCE at time 0.002583688556 with dt = 0.0001435369909 [Level 1 step 19] Advanced 4194304 cells [Level 1 step 20] ADVANCE at time 0.002727225547 with dt = 0.0001435369909 [Level 1 step 20] Advanced 4194304 cells STEP = 10 TIME = 0.002870762538 DT = 0.0002870739818 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -2.0429037700670925e-18 Total y-momentum is 6.4881480403821162e-19 Total z-momentum is 17.034345387467006 Total energy is 7176191.9791156547 [STEP 10] Coarse TimeStep time: 0.665101524 [STEP 10] FAB kilobyte spread across MPI nodes: [575320 ... 575320] Now regridding at level lbase = 0 STEP = 10 TIME = 0.002870762538 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 11] ADVANCE at time 0.002870762538 with dt = 0.0002870737289 [Level 0 step 11] Advanced 4194304 cells [Level 1 step 21] ADVANCE at time 0.002870762538 with dt = 0.0001435368644 [Level 1 step 21] Advanced 4194304 cells [Level 1 step 22] ADVANCE at time 0.003014299402 with dt = 0.0001435368644 [Level 1 step 22] Advanced 4194304 cells STEP = 11 TIME = 0.003157836267 DT = 0.0002870737289 grid_places() time: 0.016306793 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -2.3110753741976848e-18 Total y-momentum is 8.5020291015675668e-19 Total z-momentum is 19.209588257631538 Total energy is 7176191.9739167988 [STEP 11] Coarse TimeStep time: 0.702047711 [STEP 11] FAB kilobyte spread across MPI nodes: [575320 ... 575320] [Level 0 step 12] ADVANCE at time 0.003157836267 with dt = 0.0002870735531 [Level 0 step 12] Advanced 4194304 cells [Level 1 step 23] ADVANCE at time 0.003157836267 with dt = 0.0001435367766 [Level 1 step 23] Advanced 4194304 cells [Level 1 step 24] ADVANCE at time 0.003301373043 with dt = 0.0001435367766 [Level 1 step 24] Advanced 4194304 cells STEP = 12 TIME = 0.00344490982 DT = 0.0002870735531 [CNS] Total mass is 1302338.0233411889 Total x-momentum is 1.1878774904533169e-18 Total y-momentum is 6.1642905454492962e-18 Total z-momentum is 21.425674928290547 Total energy is 7176191.9680870995 [STEP 12] Coarse TimeStep time: 0.663765259 [STEP 12] FAB kilobyte spread across MPI nodes: [575320 ... 575320] Now regridding at level lbase = 0 STEP = 12 TIME = 0.00344490982 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 13] ADVANCE at time 0.00344490982 with dt = 0.0002870734377 [Level 0 step 13] Advanced 4194304 cells [Level 1 step 25] ADVANCE at time 0.00344490982 with dt = 0.0001435367188 [Level 1 step 25] Advanced 4194304 cells [Level 1 step 26] ADVANCE at time 0.003588446539 with dt = 0.0001435367188 [Level 1 step 26] Advanced 4194304 cells STEP = 13 TIME = 0.003731983258 DT = 0.0002870734377 grid_places() time: 0.016246834 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is 1.9370850150886611e-18 Total y-momentum is -3.7199697674035681e-18 Total z-momentum is 23.676347925915085 Total energy is 7176191.9616158046 [STEP 13] Coarse TimeStep time: 0.70342894 [STEP 13] FAB kilobyte spread across MPI nodes: [575320 ... 575320] [Level 0 step 14] ADVANCE at time 0.003731983258 with dt = 0.000287073367 [Level 0 step 14] Advanced 4194304 cells [Level 1 step 27] ADVANCE at time 0.003731983258 with dt = 0.0001435366835 [Level 1 step 27] Advanced 4194304 cells [Level 1 step 28] ADVANCE at time 0.003875519941 with dt = 0.0001435366835 [Level 1 step 28] Advanced 4194304 cells STEP = 14 TIME = 0.004019056625 DT = 0.000287073367 [CNS] Total mass is 1302338.0233411891 Total x-momentum is 1.9618247652419002e-18 Total y-momentum is 2.1637474215199119e-18 Total z-momentum is 25.956246439946725 Total energy is 7176191.9544938197 [STEP 14] Coarse TimeStep time: 0.662939009 [STEP 14] FAB kilobyte spread across MPI nodes: [575320 ... 575320] Now regridding at level lbase = 0 STEP = 14 TIME = 0.004019056625 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 15] ADVANCE at time 0.004019056625 with dt = 0.0002870733276 [Level 0 step 15] Advanced 4194304 cells [Level 1 step 29] ADVANCE at time 0.004019056625 with dt = 0.0001435366638 [Level 1 step 29] Advanced 4194304 cells [Level 1 step 30] ADVANCE at time 0.004162593288 with dt = 0.0001435366638 [Level 1 step 30] Advanced 4194304 cells STEP = 15 TIME = 0.004306129952 DT = 0.0002870733276 grid_places() time: 0.016070431 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is 2.5164719770389941e-18 Total y-momentum is -1.9526228567543407e-18 Total z-momentum is 28.260764354252117 Total energy is 7176191.9467134727 [STEP 15] Coarse TimeStep time: 0.699224448 [STEP 15] FAB kilobyte spread across MPI nodes: [575320 ... 575320] [Level 0 step 16] ADVANCE at time 0.004306129952 with dt = 0.000287073309 [Level 0 step 16] Advanced 4194304 cells [Level 1 step 31] ADVANCE at time 0.004306129952 with dt = 0.0001435366545 [Level 1 step 31] Advanced 4194304 cells [Level 1 step 32] ADVANCE at time 0.004449666607 with dt = 0.0001435366545 [Level 1 step 32] Advanced 4194304 cells STEP = 16 TIME = 0.004593203261 DT = 0.000287073309 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -7.0597052721974554e-18 Total y-momentum is 1.599185848405719e-18 Total z-momentum is 30.58593551816789 Total energy is 7176191.9382683076 [STEP 16] Coarse TimeStep time: 0.663029541 [STEP 16] FAB kilobyte spread across MPI nodes: [575320 ... 575320] Now regridding at level lbase = 0 STEP = 16 TIME = 0.004593203261 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 17] ADVANCE at time 0.004593203261 with dt = 0.0002870733031 [Level 0 step 17] Advanced 4194304 cells [Level 1 step 33] ADVANCE at time 0.004593203261 with dt = 0.0001435366516 [Level 1 step 33] Advanced 4194304 cells [Level 1 step 34] ADVANCE at time 0.004736739913 with dt = 0.0001435366516 [Level 1 step 34] Advanced 4194304 cells STEP = 17 TIME = 0.004880276564 DT = 0.0002870733031 grid_places() time: 0.016060617 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -1.9438899178277888e-18 Total y-momentum is -6.0749455267165249e-18 Total z-momentum is 32.928341316525405 Total energy is 7176191.9291529283 [STEP 17] Coarse TimeStep time: 0.698277296 [STEP 17] FAB kilobyte spread across MPI nodes: [575320 ... 575320] [Level 0 step 18] ADVANCE at time 0.004880276564 with dt = 0.0002870733041 [Level 0 step 18] Advanced 4194304 cells [Level 1 step 35] ADVANCE at time 0.004880276564 with dt = 0.0001435366521 [Level 1 step 35] Advanced 4194304 cells [Level 1 step 36] ADVANCE at time 0.005023813216 with dt = 0.0001435366521 [Level 1 step 36] Advanced 4194304 cells STEP = 18 TIME = 0.005167349868 DT = 0.0002870733041 [CNS] Total mass is 1302338.0233411889 Total x-momentum is 5.6810548860320156e-18 Total y-momentum is -1.5707062577299444e-17 Total z-momentum is 35.285035925910549 Total energy is 7176191.9193628421 [STEP 18] Coarse TimeStep time: 0.66184533 [STEP 18] FAB kilobyte spread across MPI nodes: [575320 ... 575320] Now regridding at level lbase = 0 STEP = 18 TIME = 0.005167349868 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 19] ADVANCE at time 0.005167349868 with dt = 0.0002870733082 [Level 0 step 19] Advanced 4194304 cells [Level 1 step 37] ADVANCE at time 0.005167349868 with dt = 0.0001435366541 [Level 1 step 37] Advanced 4194304 cells [Level 1 step 38] ADVANCE at time 0.005310886523 with dt = 0.0001435366541 [Level 1 step 38] Advanced 4194304 cells STEP = 19 TIME = 0.005454423177 DT = 0.0002870733082 grid_places() time: 0.016230268 new finest: 1 [CNS] Total mass is 1302338.0233411889 Total x-momentum is 8.3932117135403259e-18 Total y-momentum is -2.0684121055476387e-17 Total z-momentum is 37.653485228064916 Total energy is 7176191.9088943424 [STEP 19] Coarse TimeStep time: 0.699889961 [STEP 19] FAB kilobyte spread across MPI nodes: [575320 ... 575320] [Level 0 step 20] ADVANCE at time 0.005454423177 with dt = 0.0002870733131 [Level 0 step 20] Advanced 4194304 cells [Level 1 step 39] ADVANCE at time 0.005454423177 with dt = 0.0001435366565 [Level 1 step 39] Advanced 4194304 cells [Level 1 step 40] ADVANCE at time 0.005597959833 with dt = 0.0001435366565 [Level 1 step 40] Advanced 4194304 cells STEP = 20 TIME = 0.00574149649 DT = 0.0002870733131 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -6.3501140143874955e-18 Total y-momentum is -1.7382606036736604e-18 Total z-momentum is 40.031516048437133 Total energy is 7176191.8977443911 [STEP 20] Coarse TimeStep time: 0.661225725 [STEP 20] FAB kilobyte spread across MPI nodes: [575320 ... 575320] PLOTFILE: file = CNS-RT_plt00020 Write plotfile time = 0.139262869 seconds Run Time total = 14.06391399 Run Time init = 0.266829747 Run Time advance = 13.65763476 TinyProfiler total time across processes [min...avg...max]: 14.05 ... 14.06 ... 14.06 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- CNS::compute_dSdt() 120 8.112 8.255 8.456 60.13% StateDataPhysBCFunct::() 220 0.001072 0.8517 1.716 12.20% FabArray::ParallelCopy_finish() 572 0.4986 1.08 1.653 11.75% FabArray::ParallelCopy_nowait() 572 0.4615 0.6887 0.9489 6.75% FluxRegister::Reflux() 120 0.5973 0.6523 0.6831 4.86% RungeKutta2 60 0.2989 0.341 0.3794 2.70% FillBoundary_finish() 80 0.1379 0.2076 0.2791 1.98% FabArray::setVal() 282 0.2194 0.2521 0.2781 1.98% VisMF::Write(FabArray) 4 0.2683 0.2713 0.2737 1.95% CNS::computeTemp() 144 0.1331 0.1764 0.2288 1.63% CellConservativeLinear::interp() 120 0.03451 0.09929 0.1795 1.28% FillBoundary_nowait() 80 0.1155 0.1494 0.1675 1.19% FillPatcher::fillCFB 80 0.1008 0.1269 0.147 1.04% FillPatchIterator::Initialize 60 0.1185 0.1245 0.1343 0.95% amrex::Copy() 88 0.09145 0.1052 0.1177 0.84% FillPatchInterp(Fab) 80 0.01745 0.05432 0.1171 0.83% CNS::estTimeStep() 41 0.05494 0.07643 0.114 0.81% Amr::regrid() 10 0.1082 0.1088 0.1095 0.78% amrex::average_down 21 0.07938 0.09644 0.1068 0.76% CNS::advance() 60 0.06725 0.07259 0.07644 0.54% FabArray::sum() 105 0.05199 0.06087 0.07254 0.52% TagBoxArray::collate() 11 0.0009889 0.03703 0.07229 0.51% FabArray::setDomainBndry() 60 0.0002043 0.02364 0.04868 0.35% post_timestep 60 0.0296 0.03655 0.04864 0.35% CNS::errorEst() 11 0.02042 0.02221 0.02356 0.17% Amr::bldFineLevels() 1 0.01258 0.01263 0.01269 0.09% AmrLevel::writePlotFile() 4 0.004152 0.005965 0.0107 0.08% TagBoxArray::mapPRD 11 0.003169 0.006376 0.009767 0.07% AmrMesh::MakeNewGrids() 11 0.005653 0.00745 0.009565 0.07% Amr::coarseTimeStep() 20 0.0002888 0.001556 0.004176 0.03% Amr::writePlotFile() 2 0.00222 0.002928 0.003686 0.03% Amr::timeStep() 60 0.0006454 0.0008847 0.00142 0.01% AmrLevel::FillPatch() 60 0.0006453 0.0006829 0.0007418 0.01% FabArray::ParallelCopy() 572 0.0005461 0.0005774 0.0006121 0.00% FillPatchSingleLevel 140 0.0002389 0.0002741 0.0003382 0.00% AmrLevel::FillPatcherFill() 120 0.0002436 0.0002686 0.000287 0.00% main() 1 0.0001888 0.0002369 0.0002722 0.00% FillPatcher::fill() 80 0.0001409 0.0001583 0.0001947 0.00% FabArray::FillBoundary() 80 0.0001218 0.0001421 0.0001561 0.00% postCoarseTimeStep() 20 3.493e-05 4.614e-05 7.539e-05 0.00% FillPatchIterator::FillFromLevel0() 51 6.302e-05 6.753e-05 7.326e-05 0.00% AmrLevel::RK() 60 4.169e-05 5.062e-05 6.103e-05 0.00% Amr::grid_places() 11 5.496e-05 5.601e-05 5.772e-05 0.00% Amr::FinalizeInit() 1 5.483e-06 1.852e-05 5.004e-05 0.00% CNS::avgDown() 21 3.204e-05 3.789e-05 4.084e-05 0.00% AmrLevel::AmrLevel(dm) 12 2.718e-05 2.962e-05 3.187e-05 0.00% amrex::average_down_w_geom 21 1.861e-05 1.914e-05 1.986e-05 0.00% CNS::writePlotFile() 4 5.951e-06 6.717e-06 7.408e-06 0.00% Amr::init() 1 1.45e-06 1.589e-06 1.733e-06 0.00% Amr::initialInit() 1 7.99e-07 9.165e-07 1.189e-06 0.00% Other 1209 0.03151 0.04616 0.06459 0.46% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 14.05 14.06 14.06 100.00% Amr::coarseTimeStep() 20 13.66 13.66 13.66 97.11% Amr::timeStep() 60 13.49 13.53 13.56 96.38% CNS::advance() 60 11.99 12 12.01 85.40% AmrLevel::RK() 60 11.92 11.93 11.94 84.93% RungeKutta2 60 11.92 11.93 11.94 84.93% CNS::compute_dSdt() 120 8.345 9.153 9.99 71.04% AmrLevel::FillPatcherFill() 120 1.444 2.288 3.086 21.94% FabArray::ParallelCopy() 572 0.9928 1.771 2.522 17.93% FillPatchSingleLevel 140 0.5777 1.452 2.321 16.50% AmrLevel::FillPatch() 60 0.4674 1.338 2.193 15.59% FillPatchIterator::Initialize 60 0.3599 1.242 2.111 15.01% FillPatchIterator::FillFromLevel0() 51 0.23 1.084 1.932 13.73% StateDataPhysBCFunct::() 220 0.001072 0.8563 1.725 12.27% FabArray::ParallelCopy_finish() 572 0.4986 1.08 1.653 11.75% post_timestep 60 1.17 1.214 1.233 8.77% FillPatcher::fill() 80 1.069 1.088 1.126 8.00% FluxRegister::Reflux() 120 0.9218 0.951 0.9834 6.99% FabArray::ParallelCopy_nowait() 572 0.4632 0.6907 0.9511 6.76% FillPatcher::fillCFB 80 0.689 0.7295 0.8191 5.82% FabArray::FillBoundary() 80 0.3057 0.3572 0.3948 2.81% Amr::regrid() 10 0.3399 0.3446 0.3494 2.48% Amr::writePlotFile() 2 0.29 0.2905 0.291 2.07% CNS::writePlotFile() 4 0.2872 0.2876 0.2886 2.05% AmrLevel::writePlotFile() 4 0.2872 0.2875 0.2886 2.05% FillBoundary_finish() 80 0.1379 0.2076 0.2791 1.98% FabArray::setVal() 282 0.2194 0.2521 0.2781 1.98% VisMF::Write(FabArray) 4 0.2683 0.2713 0.2737 1.95% CNS::avgDown() 21 0.1956 0.223 0.2673 1.90% Amr::init() 1 0.2546 0.2571 0.2641 1.88% CNS::computeTemp() 144 0.1331 0.1764 0.2288 1.63% amrex::average_down_w_geom 21 0.19 0.2031 0.2172 1.54% amrex::average_down 21 0.19 0.203 0.2172 1.54% FillPatchInterp(Fab) 80 0.09859 0.1536 0.1981 1.41% Amr::grid_places() 11 0.1837 0.1841 0.1844 1.31% AmrMesh::MakeNewGrids() 11 0.1836 0.184 0.1843 1.31% CellConservativeLinear::interp() 120 0.03451 0.09929 0.1795 1.28% FillBoundary_nowait() 80 0.1156 0.1495 0.1676 1.19% CNS::errorEst() 11 0.06914 0.1127 0.1581 1.12% amrex::Copy() 88 0.09145 0.1052 0.1177 0.84% CNS::estTimeStep() 41 0.05494 0.07643 0.114 0.81% Amr::initialInit() 1 0.1033 0.1059 0.1124 0.80% Amr::FinalizeInit() 1 0.09593 0.09617 0.09639 0.69% Amr::bldFineLevels() 1 0.07727 0.07766 0.07804 0.55% FabArray::sum() 105 0.05199 0.06087 0.07254 0.52% TagBoxArray::collate() 11 0.0009889 0.03703 0.07229 0.51% postCoarseTimeStep() 20 0.04971 0.05736 0.07014 0.50% FabArray::setDomainBndry() 60 0.0002043 0.02364 0.04868 0.35% TagBoxArray::mapPRD 11 0.01154 0.01914 0.02643 0.19% AmrLevel::AmrLevel(dm) 12 0.02137 0.02342 0.02548 0.18% Other 1209 0.06843 0.09361 0.1298 0.92% ------------------------------------------------------------------------------------------- Device Memory Usage: ---------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ---------------------------------------------------------------------------------------------------------------- CNS::compute_dSdt() 19200 127 MiB 141 MiB 155 MiB 261 MiB 261 MiB 261 MiB StateData::define() 192 133 MiB 133 MiB 133 MiB 201 MiB 201 MiB 201 MiB CNS::advance() 176 117 MiB 117 MiB 117 MiB 134 MiB 134 MiB 134 MiB FluxRegister::Reflux() 1920 3508 KiB 3711 KiB 3911 KiB 56 MiB 67 MiB 71 MiB RungeKutta2 1244 46 MiB 46 MiB 46 MiB 70 MiB 70 MiB 70 MiB FillPatchIterator::Initialize 960 1832 KiB 5845 KiB 9818 KiB 67 MiB 67 MiB 67 MiB AmrLevel::writePlotFile() 64 1145 KiB 1149 KiB 1151 KiB 56 MiB 56 MiB 56 MiB FillPatcher::fillCFB 760 4274 KiB 6451 KiB 8614 KiB 7998 KiB 11 MiB 15 MiB ResizeRandomSeed 4 9210 KiB 9210 KiB 9211 KiB 9216 KiB 9216 KiB 9216 KiB CNS::errorEst() 176 39 KiB 67 KiB 95 KiB 8985 KiB 8985 KiB 8985 KiB post_timestep 320 574 KiB 580 KiB 590 KiB 8192 KiB 8192 KiB 8192 KiB amrex::average_down 428 77 KiB 87 KiB 96 KiB 7169 KiB 7169 KiB 7169 KiB CellConservativeLinear::interp() 960 12 KiB 19 KiB 31 KiB 1355 KiB 2064 KiB 2773 KiB Amr::regrid() 960 1328 KiB 1329 KiB 1329 KiB 2688 KiB 2688 KiB 2688 KiB StateDataPhysBCFunct::() 816 0 B 47 KiB 96 KiB 0 B 736 KiB 1473 KiB Amr::bldFineLevels() 96 4396 B 4416 B 4437 B 1344 KiB 1344 KiB 1344 KiB AmrMesh::MakeNewGrids() 352 13 KiB 13 KiB 13 KiB 1025 KiB 1025 KiB 1025 KiB FabArray::ParallelCopy_nowait() 2202 16 KiB 55 KiB 95 KiB 26 KiB 99 KiB 173 KiB VisMF::Write(FabArray) 448 67 B 86 B 117 B 96 KiB 96 KiB 96 KiB CNS::estTimeStep() 172 1114 B 1147 B 1173 B 49 KiB 49 KiB 49 KiB FabArray::sum() 420 179 B 209 B 250 B 48 KiB 48 KiB 48 KiB FabArray::ParallelCopy_finish() 1568 5180 B 6476 B 8302 B 9216 B 13 KiB 17 KiB FillBoundary_nowait() 160 7562 B 7571 B 7578 B 10 KiB 10 KiB 10 KiB FillBoundary_finish() 80 3776 B 3777 B 3779 B 5120 B 5120 B 5120 B FabArray::setVal() 1144 2078 B 2115 B 2150 B 3072 B 3072 B 3072 B amrex::Copy() 348 1956 B 1958 B 1960 B 3072 B 3072 B 3072 B TagBoxArray::mapPRD 352 1 B 2 B 3 B 2048 B 2048 B 2048 B TagBoxArray::collate() 88 0 B 0 B 0 B 256 B 896 B 1536 B OwnerMask() 176 0 B 0 B 0 B 1024 B 1024 B 1024 B StateData::FillBoundary(geom) 1224 0 B 11 B 23 B 0 B 256 B 512 B Amr::InitAmr() 8 505 B 505 B 505 B 512 B 512 B 512 B ---------------------------------------------------------------------------------------------------------------- Async Memory Usage: ------------------------------------------------------------------------------------------------------ Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ------------------------------------------------------------------------------------------------------ CNS::compute_dSdt() 3840 4797 KiB 8499 KiB 11 MiB 65 MiB 65 MiB 65 MiB FluxRegister::Reflux() 1920 2618 KiB 3138 KiB 3507 KiB 56 MiB 56 MiB 56 MiB RungeKutta2 960 46 MiB 46 MiB 46 MiB 56 MiB 56 MiB 56 MiB post_timestep 320 550 KiB 567 KiB 586 KiB 8192 KiB 8192 KiB 8192 KiB ------------------------------------------------------------------------------------------------------ Managed Memory Usage: --------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------- The_Managed_Arena::Initialize() 4 0 B 0 B 0 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------- Pinned Memory Usage: ---------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ---------------------------------------------------------------------------------------------------------------- FabArray::ParallelCopy_nowait() 5496 273 KiB 495 KiB 684 KiB 7189 KiB 11 MiB 14 MiB VisMF::Write(FabArray) 512 200 KiB 221 KiB 241 KiB 14 MiB 14 MiB 14 MiB The_Pinned_Arena::Initialize() 4 0 B 0 B 1 B 8192 KiB 8192 KiB 8192 KiB FillBoundary_nowait() 800 166 KiB 194 KiB 215 KiB 7514 KiB 7514 KiB 7514 KiB FabArray::ParallelCopy_finish() 1568 5180 B 6476 B 8302 B 9216 B 13 KiB 17 KiB FillBoundary_finish() 80 3776 B 3777 B 3779 B 5120 B 5120 B 5120 B CNS::compute_dSdt() 1920 121 B 175 B 230 B 3072 B 3072 B 3072 B amrex::Copy() 348 1956 B 1958 B 1960 B 3072 B 3072 B 3072 B FabArray::setVal() 1144 2078 B 2115 B 2150 B 3072 B 3072 B 3072 B TagBoxArray::collate() 154 0 B 2 B 4 B 512 B 1344 B 1792 B amrex::average_down 92 562 B 563 B 564 B 1536 B 1536 B 1536 B RungeKutta2 284 1075 B 1075 B 1076 B 1536 B 1536 B 1536 B CNS::estTimeStep() 172 1011 B 1011 B 1011 B 1280 B 1280 B 1280 B FillPatcher::fillCFB 280 396 B 466 B 540 B 768 B 896 B 1024 B StateData::FillBoundary(geom) 1224 0 B 11 B 23 B 0 B 256 B 512 B CellConservativeLinear::interp() 480 1 B 1 B 2 B 256 B 384 B 512 B FabArray::sum() 420 0 B 0 B 1 B 256 B 256 B 256 B ---------------------------------------------------------------------------------------------------------------- Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [4227 ... 4227] [The Arena] max space (MB) allocated spread across MPI: [741 ... 766] [The Arena] max space (MB) used spread across MPI: [603 ... 611] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [32 ... 36] [The Pinned Arena] max space (MB) used spread across MPI: [14 ... 14] AMReX (26.04-114-g95e461b1a293) finalized