Initializing AMReX (26.11-18-g21e455c381db)... MPI initialized with 4 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.11-18-g21e455c381db) initialized Successfully read inputs file ... Successfully read inputs file ... Starting to call amrex_probinit ... Successfully run amrex_probinit grid_places() time: 0.007887638 new finest: 1 Now regridding at level lbase = 0 grid_places() time: 0.008507739 new finest: 1 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 4 grids 1024 cells 12.5 % of domain smallest grid: 16 x 16 biggest grid: 16 x 16 INITIAL GRIDS Level 0 4 grids 2048 cells 100 % of domain smallest grid: 32 x 16 biggest grid: 32 x 16 Level 1 4 grids 1024 cells 12.5 % of domain smallest grid: 16 x 16 biggest grid: 16 x 16 PLOTFILE: file = CNS_RT_2D_plt00000 Write plotfile time = 0.038201158 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.001148647095 [Level 0 step 1] Advanced 2048 cells [Level 1 step 1] ADVANCE at time 0 with dt = 0.0005743235474 [Level 1 step 1] Advanced 1024 cells [Level 1 step 2] ADVANCE at time 0.0005743235474 with dt = 0.0005743235474 [Level 1 step 2] Advanced 1024 cells [STEP 1] Coarse TimeStep time: 0.070252757 [STEP 1] FAB kilobyte spread across MPI nodes: [305 ... 305] STEP = 1 TIME = 0.001148647095 DT = 0.001148647095 [Level 0 step 2] ADVANCE at time 0.001148647095 with dt = 0.001148481408 [Level 0 step 2] Advanced 2048 cells [Level 1 step 3] ADVANCE at time 0.001148647095 with dt = 0.0005742407041 [Level 1 step 3] Advanced 1024 cells [Level 1 step 4] ADVANCE at time 0.001722887799 with dt = 0.0005742407041 [Level 1 step 4] Advanced 1024 cells [STEP 2] Coarse TimeStep time: 0.069178419 [STEP 2] FAB kilobyte spread across MPI nodes: [327 ... 327] STEP = 2 TIME = 0.002297128503 DT = 0.001148481408 Now regridding at level lbase = 0 grid_places() time: 0.008308239 new finest: 1 STEP = 2 TIME = 0.002297128503 : REGRID with lbase = 0 Level 1 4 grids 2048 cells 25 % of domain smallest grid: 32 x 16 biggest grid: 32 x 16 [Level 0 step 3] ADVANCE at time 0.002297128503 with dt = 0.00114837877 [Level 0 step 3] Advanced 2048 cells [Level 1 step 5] ADVANCE at time 0.002297128503 with dt = 0.000574189385 [Level 1 step 5] Advanced 2048 cells [Level 1 step 6] ADVANCE at time 0.002871317888 with dt = 0.000574189385 [Level 1 step 6] Advanced 2048 cells [STEP 3] Coarse TimeStep time: 0.086362798 [STEP 3] FAB kilobyte spread across MPI nodes: [375 ... 388] STEP = 3 TIME = 0.003445507273 DT = 0.00114837877 [Level 0 step 4] ADVANCE at time 0.003445507273 with dt = 0.001148312512 [Level 0 step 4] Advanced 2048 cells [Level 1 step 7] ADVANCE at time 0.003445507273 with dt = 0.0005741562561 [Level 1 step 7] Advanced 2048 cells [Level 1 step 8] ADVANCE at time 0.004019663529 with dt = 0.0005741562561 [Level 1 step 8] Advanced 2048 cells [STEP 4] Coarse TimeStep time: 0.070516844 [STEP 4] FAB kilobyte spread across MPI nodes: [375 ... 388] STEP = 4 TIME = 0.004593819785 DT = 0.001148312512 Now regridding at level lbase = 0 grid_places() time: 0.008298762 new finest: 1 STEP = 4 TIME = 0.004593819785 : REGRID with lbase = 0 Level 1 4 grids 2048 cells 25 % of domain smallest grid: 32 x 16 biggest grid: 32 x 16 [Level 0 step 5] ADVANCE at time 0.004593819785 with dt = 0.001148272048 [Level 0 step 5] Advanced 2048 cells [Level 1 step 9] ADVANCE at time 0.004593819785 with dt = 0.0005741360238 [Level 1 step 9] Advanced 2048 cells [Level 1 step 10] ADVANCE at time 0.005167955809 with dt = 0.0005741360238 [Level 1 step 10] Advanced 2048 cells [STEP 5] Coarse TimeStep time: 0.083571266 [STEP 5] FAB kilobyte spread across MPI nodes: [375 ... 388] STEP = 5 TIME = 0.005742091833 DT = 0.001148272048 [Level 0 step 6] ADVANCE at time 0.005742091833 with dt = 0.001148249198 [Level 0 step 6] Advanced 2048 cells [Level 1 step 11] ADVANCE at time 0.005742091833 with dt = 0.0005741245991 [Level 1 step 11] Advanced 2048 cells [Level 1 step 12] ADVANCE at time 0.006316216432 with dt = 0.0005741245991 [Level 1 step 12] Advanced 2048 cells [STEP 6] Coarse TimeStep time: 0.070650939 [STEP 6] FAB kilobyte spread across MPI nodes: [375 ... 388] STEP = 6 TIME = 0.006890341031 DT = 0.001148249198 Now regridding at level lbase = 0 grid_places() time: 0.008298006 new finest: 1 STEP = 6 TIME = 0.006890341031 : REGRID with lbase = 0 Level 1 4 grids 2048 cells 25 % of domain smallest grid: 32 x 16 biggest grid: 32 x 16 [Level 0 step 7] ADVANCE at time 0.006890341031 with dt = 0.001148237846 [Level 0 step 7] Advanced 2048 cells [Level 1 step 13] ADVANCE at time 0.006890341031 with dt = 0.0005741189232 [Level 1 step 13] Advanced 2048 cells [Level 1 step 14] ADVANCE at time 0.007464459954 with dt = 0.0005741189232 [Level 1 step 14] Advanced 2048 cells [STEP 7] Coarse TimeStep time: 0.083732214 [STEP 7] FAB kilobyte spread across MPI nodes: [375 ... 388] STEP = 7 TIME = 0.008038578877 DT = 0.001148237846 [Level 0 step 8] ADVANCE at time 0.008038578877 with dt = 0.001148233574 [Level 0 step 8] Advanced 2048 cells [Level 1 step 15] ADVANCE at time 0.008038578877 with dt = 0.0005741167868 [Level 1 step 15] Advanced 2048 cells [Level 1 step 16] ADVANCE at time 0.008612695664 with dt = 0.0005741167868 [Level 1 step 16] Advanced 2048 cells [STEP 8] Coarse TimeStep time: 0.070675173 [STEP 8] FAB kilobyte spread across MPI nodes: [375 ... 388] STEP = 8 TIME = 0.009186812451 DT = 0.001148233574 Now regridding at level lbase = 0 grid_places() time: 0.008300865 new finest: 1 STEP = 8 TIME = 0.009186812451 : REGRID with lbase = 0 Level 1 4 grids 2048 cells 25 % of domain smallest grid: 32 x 16 biggest grid: 32 x 16 [Level 0 step 9] ADVANCE at time 0.009186812451 with dt = 0.001148233312 [Level 0 step 9] Advanced 2048 cells [Level 1 step 17] ADVANCE at time 0.009186812451 with dt = 0.0005741166562 [Level 1 step 17] Advanced 2048 cells [Level 1 step 18] ADVANCE at time 0.009760929107 with dt = 0.0005741166562 [Level 1 step 18] Advanced 2048 cells [STEP 9] Coarse TimeStep time: 0.083727946 [STEP 9] FAB kilobyte spread across MPI nodes: [375 ... 388] STEP = 9 TIME = 0.01033504576 DT = 0.001148233312 [Level 0 step 10] ADVANCE at time 0.01033504576 with dt = 0.001148235031 [Level 0 step 10] Advanced 2048 cells [Level 1 step 19] ADVANCE at time 0.01033504576 with dt = 0.0005741175154 [Level 1 step 19] Advanced 2048 cells [Level 1 step 20] ADVANCE at time 0.01090916328 with dt = 0.0005741175154 [Level 1 step 20] Advanced 2048 cells [STEP 10] Coarse TimeStep time: 0.070382265 [STEP 10] FAB kilobyte spread across MPI nodes: [375 ... 388] STEP = 10 TIME = 0.01148328079 DT = 0.001148235031 PLOTFILE: file = CNS_RT_2D_plt00010 Write plotfile time = 0.015026641 seconds Now regridding at level lbase = 0 grid_places() time: 0.008304576 new finest: 1 STEP = 10 TIME = 0.01148328079 : REGRID with lbase = 0 Level 1 4 grids 2048 cells 25 % of domain smallest grid: 32 x 16 biggest grid: 32 x 16 [Level 0 step 11] ADVANCE at time 0.01148328079 with dt = 0.001148237462 [Level 0 step 11] Advanced 2048 cells [Level 1 step 21] ADVANCE at time 0.01148328079 with dt = 0.000574118731 [Level 1 step 21] Advanced 2048 cells [Level 1 step 22] ADVANCE at time 0.01205739953 with dt = 0.000574118731 [Level 1 step 22] Advanced 2048 cells [STEP 11] Coarse TimeStep time: 0.083863543 [STEP 11] FAB kilobyte spread across MPI nodes: [375 ... 388] STEP = 11 TIME = 0.01263151826 DT = 0.001148237462 [Level 0 step 12] ADVANCE at time 0.01263151826 with dt = 0.001148239882 [Level 0 step 12] Advanced 2048 cells [Level 1 step 23] ADVANCE at time 0.01263151826 with dt = 0.0005741199408 [Level 1 step 23] Advanced 2048 cells [Level 1 step 24] ADVANCE at time 0.0132056382 with dt = 0.0005741199408 [Level 1 step 24] Advanced 2048 cells [STEP 12] Coarse TimeStep time: 0.070470598 [STEP 12] FAB kilobyte spread across MPI nodes: [375 ... 388] STEP = 12 TIME = 0.01377975814 DT = 0.001148239882 Now regridding at level lbase = 0 grid_places() time: 0.008297545 new finest: 1 STEP = 12 TIME = 0.01377975814 : REGRID with lbase = 0 Level 1 4 grids 2048 cells 25 % of domain smallest grid: 32 x 16 biggest grid: 32 x 16 [Level 0 step 13] ADVANCE at time 0.01377975814 with dt = 0.00114824193 [Level 0 step 13] Advanced 2048 cells [Level 1 step 25] ADVANCE at time 0.01377975814 with dt = 0.000574120965 [Level 1 step 25] Advanced 2048 cells [Level 1 step 26] ADVANCE at time 0.0143538791 with dt = 0.000574120965 [Level 1 step 26] Advanced 2048 cells [STEP 13] Coarse TimeStep time: 0.083829489 [STEP 13] FAB kilobyte spread across MPI nodes: [375 ... 388] STEP = 13 TIME = 0.01492800007 DT = 0.00114824193 [Level 0 step 14] ADVANCE at time 0.01492800007 with dt = 0.001148243479 [Level 0 step 14] Advanced 2048 cells [Level 1 step 27] ADVANCE at time 0.01492800007 with dt = 0.0005741217395 [Level 1 step 27] Advanced 2048 cells [Level 1 step 28] ADVANCE at time 0.01550212181 with dt = 0.0005741217395 [Level 1 step 28] Advanced 2048 cells [STEP 14] Coarse TimeStep time: 0.070463116 [STEP 14] FAB kilobyte spread across MPI nodes: [375 ... 388] STEP = 14 TIME = 0.01607624355 DT = 0.001148243479 Now regridding at level lbase = 0 grid_places() time: 0.008211492 new finest: 1 STEP = 14 TIME = 0.01607624355 : REGRID with lbase = 0 Level 1 4 grids 2048 cells 25 % of domain smallest grid: 32 x 16 biggest grid: 32 x 16 [Level 0 step 15] ADVANCE at time 0.01607624355 with dt = 0.001148244536 [Level 0 step 15] Advanced 2048 cells [Level 1 step 29] ADVANCE at time 0.01607624355 with dt = 0.0005741222679 [Level 1 step 29] Advanced 2048 cells [Level 1 step 30] ADVANCE at time 0.01665036581 with dt = 0.0005741222679 [Level 1 step 30] Advanced 2048 cells [STEP 15] Coarse TimeStep time: 0.083639155 [STEP 15] FAB kilobyte spread across MPI nodes: [375 ... 388] STEP = 15 TIME = 0.01722448808 DT = 0.001148244536 [Level 0 step 16] ADVANCE at time 0.01722448808 with dt = 0.001148245175 [Level 0 step 16] Advanced 2048 cells [Level 1 step 31] ADVANCE at time 0.01722448808 with dt = 0.0005741225874 [Level 1 step 31] Advanced 2048 cells [Level 1 step 32] ADVANCE at time 0.01779861067 with dt = 0.0005741225874 [Level 1 step 32] Advanced 2048 cells [STEP 16] Coarse TimeStep time: 0.070650984 [STEP 16] FAB kilobyte spread across MPI nodes: [375 ... 388] STEP = 16 TIME = 0.01837273326 DT = 0.001148245175 Now regridding at level lbase = 0 grid_places() time: 0.008295492 new finest: 1 STEP = 16 TIME = 0.01837273326 : REGRID with lbase = 0 Level 1 4 grids 2048 cells 25 % of domain smallest grid: 32 x 16 biggest grid: 32 x 16 [Level 0 step 17] ADVANCE at time 0.01837273326 with dt = 0.001148245495 [Level 0 step 17] Advanced 2048 cells [Level 1 step 33] ADVANCE at time 0.01837273326 with dt = 0.0005741227476 [Level 1 step 33] Advanced 2048 cells [Level 1 step 34] ADVANCE at time 0.018946856 with dt = 0.0005741227476 [Level 1 step 34] Advanced 2048 cells [STEP 17] Coarse TimeStep time: 0.083672985 [STEP 17] FAB kilobyte spread across MPI nodes: [375 ... 388] STEP = 17 TIME = 0.01952097875 DT = 0.001148245495 [Level 0 step 18] ADVANCE at time 0.01952097875 with dt = 0.001148245596 [Level 0 step 18] Advanced 2048 cells [Level 1 step 35] ADVANCE at time 0.01952097875 with dt = 0.0005741227978 [Level 1 step 35] Advanced 2048 cells [Level 1 step 36] ADVANCE at time 0.02009510155 with dt = 0.0005741227978 [Level 1 step 36] Advanced 2048 cells [STEP 18] Coarse TimeStep time: 0.070363428 [STEP 18] FAB kilobyte spread across MPI nodes: [375 ... 388] STEP = 18 TIME = 0.02066922435 DT = 0.001148245596 Now regridding at level lbase = 0 grid_places() time: 0.008309197 new finest: 1 STEP = 18 TIME = 0.02066922435 : REGRID with lbase = 0 Level 1 4 grids 2048 cells 25 % of domain smallest grid: 32 x 16 biggest grid: 32 x 16 [Level 0 step 19] ADVANCE at time 0.02066922435 with dt = 0.001148245559 [Level 0 step 19] Advanced 2048 cells [Level 1 step 37] ADVANCE at time 0.02066922435 with dt = 0.0005741227796 [Level 1 step 37] Advanced 2048 cells [Level 1 step 38] ADVANCE at time 0.02124334713 with dt = 0.0005741227796 [Level 1 step 38] Advanced 2048 cells [STEP 19] Coarse TimeStep time: 0.08376261 [STEP 19] FAB kilobyte spread across MPI nodes: [375 ... 388] STEP = 19 TIME = 0.02181746991 DT = 0.001148245559 [Level 0 step 20] ADVANCE at time 0.02181746991 with dt = 0.001148245451 [Level 0 step 20] Advanced 2048 cells [Level 1 step 39] ADVANCE at time 0.02181746991 with dt = 0.0005741227256 [Level 1 step 39] Advanced 2048 cells [Level 1 step 40] ADVANCE at time 0.02239159263 with dt = 0.0005741227256 [Level 1 step 40] Advanced 2048 cells [STEP 20] Coarse TimeStep time: 0.070372535 [STEP 20] FAB kilobyte spread across MPI nodes: [375 ... 388] STEP = 20 TIME = 0.02296571536 DT = 0.001148245451 PLOTFILE: file = CNS_RT_2D_plt00020 Write plotfile time = 0.016142844 seconds Relative change in total mass: 0 Run time = 1.643271703 Total GPU global memory (MB) spread across MPI: [7784 ... 7784] Free GPU global memory (MB) spread across MPI: [7150 ... 7150] [The Arena] max space (MB) allocated spread across MPI: [17 ... 17] [The Arena] max space (MB) used spread across MPI: [9 ... 9] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Pinned Arena] max space (MB) used spread across MPI: [0 ... 0] AMReX (26.11-18-g21e455c381db) finalized