Initializing AMReX (26.04-109-g60df5ae33414)... MPI initialized with 4 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.04-109-g60df5ae33414) initialized Successfully read inputs file ... Successfully read inputs file ... Starting to call amrex_probinit ... Successfully run amrex_probinit Now regridding at level lbase = 0 grid_places() time: 0.019047144 new finest: 1 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 INITIAL GRIDS Level 0 16 grids 4194304 cells 100 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 PLOTFILE: file = CNS-RT_plt00000 grid_places() time: 0.021938493 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is 0 Total y-momentum is 0 Total z-momentum is 0 Total energy is 7176192.0007176176 Write plotfile time = 0.151298526 seconds [Level 0 step 1] ADVANCE at time 0 with dt = 0.0002870776155 [Level 0 step 1] Advanced 4194304 cells [Level 1 step 1] ADVANCE at time 0 with dt = 0.0001435388078 [Level 1 step 1] Advanced 4194304 cells [Level 1 step 2] ADVANCE at time 0.0001435388078 with dt = 0.0001435388078 [Level 1 step 2] Advanced 4194304 cells STEP = 1 TIME = 0.0002870776155 DT = 0.0002870776155 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -3.5092716654764083e-23 Total y-momentum is -4.7581467629282477e-22 Total z-momentum is 1.0569463681968465 Total energy is 7176192.0005832035 [STEP 1] Coarse TimeStep time: 0.748344268 [STEP 1] FAB kilobyte spread across MPI nodes: [596970 ... 596970] [Level 0 step 2] ADVANCE at time 0.0002870776155 with dt = 0.0002870783094 [Level 0 step 2] Advanced 4194304 cells [Level 1 step 3] ADVANCE at time 0.0002870776155 with dt = 0.0001435391547 [Level 1 step 3] Advanced 4194304 cells [Level 1 step 4] ADVANCE at time 0.0004306167702 with dt = 0.0001435391547 [Level 1 step 4] Advanced 4194304 cells STEP = 2 TIME = 0.0005741559249 DT = 0.0002870783094 [CNS] Total mass is 1302338.0233411891 Total x-momentum is 1.6462432660686566e-20 Total y-momentum is -2.2251200079045142e-20 Total z-momentum is 2.3209944805054445 Total energy is 7176192.0001132581 [STEP 2] Coarse TimeStep time: 0.716461137 [STEP 2] FAB kilobyte spread across MPI nodes: [644102 ... 644102] Now regridding at level lbase = 0 STEP = 2 TIME = 0.0005741559249 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 3] ADVANCE at time 0.0005741559249 with dt = 0.0002870780246 [Level 0 step 3] Advanced 4194304 cells [Level 1 step 5] ADVANCE at time 0.0005741559249 with dt = 0.0001435390123 [Level 1 step 5] Advanced 4194304 cells [Level 1 step 6] ADVANCE at time 0.0007176949372 with dt = 0.0001435390123 [Level 1 step 6] Advanced 4194304 cells STEP = 3 TIME = 0.0008612339496 DT = 0.0002870780246 grid_places() time: 0.016259691 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is 2.6461317954783192e-20 Total y-momentum is -1.5030781305644894e-20 Total z-momentum is 3.7625461629590609 Total energy is 7176191.9992528344 [STEP 3] Coarse TimeStep time: 0.751429215 [STEP 3] FAB kilobyte spread across MPI nodes: [644102 ... 644102] [Level 0 step 4] ADVANCE at time 0.0008612339496 with dt = 0.0002870774356 [Level 0 step 4] Advanced 4194304 cells [Level 1 step 7] ADVANCE at time 0.0008612339496 with dt = 0.0001435387178 [Level 1 step 7] Advanced 4194304 cells [Level 1 step 8] ADVANCE at time 0.001004772667 with dt = 0.0001435387178 [Level 1 step 8] Advanced 4194304 cells STEP = 4 TIME = 0.001148311385 DT = 0.0002870774356 [CNS] Total mass is 1302338.0233411891 Total x-momentum is 1.0550936035599116e-19 Total y-momentum is -2.5581895887527256e-19 Total z-momentum is 5.3555979032626295 Total energy is 7176191.9979549646 [STEP 4] Coarse TimeStep time: 0.712630335 [STEP 4] FAB kilobyte spread across MPI nodes: [644102 ... 644102] Now regridding at level lbase = 0 STEP = 4 TIME = 0.001148311385 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 5] ADVANCE at time 0.001148311385 with dt = 0.0002870767217 [Level 0 step 5] Advanced 4194304 cells [Level 1 step 9] ADVANCE at time 0.001148311385 with dt = 0.0001435383608 [Level 1 step 9] Advanced 4194304 cells [Level 1 step 10] ADVANCE at time 0.001291849746 with dt = 0.0001435383608 [Level 1 step 10] Advanced 4194304 cells STEP = 5 TIME = 0.001435388107 DT = 0.0002870767217 grid_places() time: 0.016130484 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -6.2056542418165885e-20 Total y-momentum is -2.9858181032206734e-19 Total z-momentum is 7.0775892529197391 Total energy is 7176191.9961796384 [STEP 5] Coarse TimeStep time: 0.748506324 [STEP 5] FAB kilobyte spread across MPI nodes: [644102 ... 644102] [Level 0 step 6] ADVANCE at time 0.001435388107 with dt = 0.0002870760002 [Level 0 step 6] Advanced 4194304 cells [Level 1 step 11] ADVANCE at time 0.001435388107 with dt = 0.0001435380001 [Level 1 step 11] Advanced 4194304 cells [Level 1 step 12] ADVANCE at time 0.001578926107 with dt = 0.0001435380001 [Level 1 step 12] Advanced 4194304 cells STEP = 6 TIME = 0.001722464107 DT = 0.0002870760002 [CNS] Total mass is 1302338.0233411889 Total x-momentum is -5.9192933809719626e-19 Total y-momentum is 5.5947435903261632e-19 Total z-momentum is 8.9091186975067522 Total energy is 7176191.9938928559 [STEP 6] Coarse TimeStep time: 0.710936702 [STEP 6] FAB kilobyte spread across MPI nodes: [644102 ... 644102] Now regridding at level lbase = 0 STEP = 6 TIME = 0.001722464107 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 7] ADVANCE at time 0.001722464107 with dt = 0.0002870753412 [Level 0 step 7] Advanced 4194304 cells [Level 1 step 13] ADVANCE at time 0.001722464107 with dt = 0.0001435376706 [Level 1 step 13] Advanced 4194304 cells [Level 1 step 14] ADVANCE at time 0.001866001778 with dt = 0.0001435376706 [Level 1 step 14] Advanced 4194304 cells STEP = 7 TIME = 0.002009539448 DT = 0.0002870753412 grid_places() time: 0.016384872 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -9.6315471318175511e-20 Total y-momentum is 1.1251136984017646e-18 Total z-momentum is 10.83361436279802 Total energy is 7176191.9910657536 [STEP 7] Coarse TimeStep time: 0.74724229 [STEP 7] FAB kilobyte spread across MPI nodes: [644102 ... 644102] [Level 0 step 8] ADVANCE at time 0.002009539448 with dt = 0.00028707478 [Level 0 step 8] Advanced 4194304 cells [Level 1 step 15] ADVANCE at time 0.002009539448 with dt = 0.00014353739 [Level 1 step 15] Advanced 4194304 cells [Level 1 step 16] ADVANCE at time 0.002153076838 with dt = 0.00014353739 [Level 1 step 16] Advanced 4194304 cells STEP = 8 TIME = 0.002296614228 DT = 0.00028707478 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -9.1339336332606351e-19 Total y-momentum is -2.3887278819312057e-18 Total z-momentum is 12.836984615501322 Total energy is 7176191.9876738414 [STEP 8] Coarse TimeStep time: 0.71135504 [STEP 8] FAB kilobyte spread across MPI nodes: [644102 ... 644102] Now regridding at level lbase = 0 STEP = 8 TIME = 0.002296614228 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 9] ADVANCE at time 0.002296614228 with dt = 0.0002870743281 [Level 0 step 9] Advanced 4194304 cells [Level 1 step 17] ADVANCE at time 0.002296614228 with dt = 0.000143537164 [Level 1 step 17] Advanced 4194304 cells [Level 1 step 18] ADVANCE at time 0.002440151392 with dt = 0.000143537164 [Level 1 step 18] Advanced 4194304 cells STEP = 9 TIME = 0.002583688556 DT = 0.0002870743281 grid_places() time: 0.016489826 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -2.7289998793969525e-19 Total y-momentum is -5.2197431498621948e-19 Total z-momentum is 14.90727449217067 Total energy is 7176191.9836963499 [STEP 9] Coarse TimeStep time: 0.751552594 [STEP 9] FAB kilobyte spread across MPI nodes: [644102 ... 644102] [Level 0 step 10] ADVANCE at time 0.002583688556 with dt = 0.0002870739818 [Level 0 step 10] Advanced 4194304 cells [Level 1 step 19] ADVANCE at time 0.002583688556 with dt = 0.0001435369909 [Level 1 step 19] Advanced 4194304 cells [Level 1 step 20] ADVANCE at time 0.002727225547 with dt = 0.0001435369909 [Level 1 step 20] Advanced 4194304 cells STEP = 10 TIME = 0.002870762538 DT = 0.0002870739818 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -2.4587675402868006e-19 Total y-momentum is 2.7516659384943997e-18 Total z-momentum is 17.034345387467017 Total energy is 7176191.9791156547 [STEP 10] Coarse TimeStep time: 0.712136314 [STEP 10] FAB kilobyte spread across MPI nodes: [644102 ... 644102] Now regridding at level lbase = 0 STEP = 10 TIME = 0.002870762538 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 11] ADVANCE at time 0.002870762538 with dt = 0.0002870737289 [Level 0 step 11] Advanced 4194304 cells [Level 1 step 21] ADVANCE at time 0.002870762538 with dt = 0.0001435368644 [Level 1 step 21] Advanced 4194304 cells [Level 1 step 22] ADVANCE at time 0.003014299402 with dt = 0.0001435368644 [Level 1 step 22] Advanced 4194304 cells STEP = 11 TIME = 0.003157836267 DT = 0.0002870737289 grid_places() time: 0.016174086 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -1.1277198633499611e-18 Total y-momentum is 2.1169783711922223e-18 Total z-momentum is 19.209588257631552 Total energy is 7176191.9739167988 [STEP 11] Coarse TimeStep time: 0.750437487 [STEP 11] FAB kilobyte spread across MPI nodes: [644102 ... 644102] [Level 0 step 12] ADVANCE at time 0.003157836267 with dt = 0.0002870735531 [Level 0 step 12] Advanced 4194304 cells [Level 1 step 23] ADVANCE at time 0.003157836267 with dt = 0.0001435367766 [Level 1 step 23] Advanced 4194304 cells [Level 1 step 24] ADVANCE at time 0.003301373043 with dt = 0.0001435367766 [Level 1 step 24] Advanced 4194304 cells STEP = 12 TIME = 0.00344490982 DT = 0.0002870735531 [CNS] Total mass is 1302338.0233411891 Total x-momentum is 5.3971292128629264e-19 Total y-momentum is 1.6965544156826782e-18 Total z-momentum is 21.425674928290562 Total energy is 7176191.9680870995 [STEP 12] Coarse TimeStep time: 0.712491557 [STEP 12] FAB kilobyte spread across MPI nodes: [644102 ... 644102] Now regridding at level lbase = 0 STEP = 12 TIME = 0.00344490982 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 13] ADVANCE at time 0.00344490982 with dt = 0.0002870734377 [Level 0 step 13] Advanced 4194304 cells [Level 1 step 25] ADVANCE at time 0.00344490982 with dt = 0.0001435367188 [Level 1 step 25] Advanced 4194304 cells [Level 1 step 26] ADVANCE at time 0.003588446539 with dt = 0.0001435367188 [Level 1 step 26] Advanced 4194304 cells STEP = 13 TIME = 0.003731983258 DT = 0.0002870734377 grid_places() time: 0.016346873 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is 6.0392428511544642e-19 Total y-momentum is 3.0528083817222659e-18 Total z-momentum is 23.676347925915096 Total energy is 7176191.9616158046 [STEP 13] Coarse TimeStep time: 0.749239519 [STEP 13] FAB kilobyte spread across MPI nodes: [644102 ... 644102] [Level 0 step 14] ADVANCE at time 0.003731983258 with dt = 0.000287073367 [Level 0 step 14] Advanced 4194304 cells [Level 1 step 27] ADVANCE at time 0.003731983258 with dt = 0.0001435366835 [Level 1 step 27] Advanced 4194304 cells [Level 1 step 28] ADVANCE at time 0.003875519941 with dt = 0.0001435366835 [Level 1 step 28] Advanced 4194304 cells STEP = 14 TIME = 0.004019056625 DT = 0.000287073367 [CNS] Total mass is 1302338.0233411891 Total x-momentum is 4.3439361791132241e-18 Total y-momentum is -4.1132185650440607e-18 Total z-momentum is 25.956246439946739 Total energy is 7176191.9544938207 [STEP 14] Coarse TimeStep time: 0.711660519 [STEP 14] FAB kilobyte spread across MPI nodes: [644102 ... 644102] Now regridding at level lbase = 0 STEP = 14 TIME = 0.004019056625 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 15] ADVANCE at time 0.004019056625 with dt = 0.0002870733276 [Level 0 step 15] Advanced 4194304 cells [Level 1 step 29] ADVANCE at time 0.004019056625 with dt = 0.0001435366638 [Level 1 step 29] Advanced 4194304 cells [Level 1 step 30] ADVANCE at time 0.004162593288 with dt = 0.0001435366638 [Level 1 step 30] Advanced 4194304 cells STEP = 15 TIME = 0.004306129952 DT = 0.0002870733276 grid_places() time: 0.01633892 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is 9.3800620437616596e-19 Total y-momentum is 2.9685361514935525e-19 Total z-momentum is 28.260764354252135 Total energy is 7176191.9467134727 [STEP 15] Coarse TimeStep time: 0.748865089 [STEP 15] FAB kilobyte spread across MPI nodes: [644102 ... 644102] [Level 0 step 16] ADVANCE at time 0.004306129952 with dt = 0.000287073309 [Level 0 step 16] Advanced 4194304 cells [Level 1 step 31] ADVANCE at time 0.004306129952 with dt = 0.0001435366545 [Level 1 step 31] Advanced 4194304 cells [Level 1 step 32] ADVANCE at time 0.004449666607 with dt = 0.0001435366545 [Level 1 step 32] Advanced 4194304 cells STEP = 16 TIME = 0.004593203261 DT = 0.000287073309 [CNS] Total mass is 1302338.0233411891 Total x-momentum is -5.5036097928987013e-19 Total y-momentum is -8.9895746795815146e-18 Total z-momentum is 30.585935518167897 Total energy is 7176191.9382683076 [STEP 16] Coarse TimeStep time: 0.71125823 [STEP 16] FAB kilobyte spread across MPI nodes: [644102 ... 644102] Now regridding at level lbase = 0 STEP = 16 TIME = 0.004593203261 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 17] ADVANCE at time 0.004593203261 with dt = 0.0002870733031 [Level 0 step 17] Advanced 4194304 cells [Level 1 step 33] ADVANCE at time 0.004593203261 with dt = 0.0001435366516 [Level 1 step 33] Advanced 4194304 cells [Level 1 step 34] ADVANCE at time 0.004736739913 with dt = 0.0001435366516 [Level 1 step 34] Advanced 4194304 cells STEP = 17 TIME = 0.004880276564 DT = 0.0002870733031 grid_places() time: 0.015383095 new finest: 1 [CNS] Total mass is 1302338.0233411891 Total x-momentum is 1.6046463397861939e-18 Total y-momentum is -1.0849327435723901e-17 Total z-momentum is 32.928341316525412 Total energy is 7176191.9291529283 [STEP 17] Coarse TimeStep time: 0.747334444 [STEP 17] FAB kilobyte spread across MPI nodes: [644102 ... 644102] [Level 0 step 18] ADVANCE at time 0.004880276564 with dt = 0.0002870733041 [Level 0 step 18] Advanced 4194304 cells [Level 1 step 35] ADVANCE at time 0.004880276564 with dt = 0.0001435366521 [Level 1 step 35] Advanced 4194304 cells [Level 1 step 36] ADVANCE at time 0.005023813216 with dt = 0.0001435366521 [Level 1 step 36] Advanced 4194304 cells STEP = 18 TIME = 0.005167349868 DT = 0.0002870733041 [CNS] Total mass is 1302338.0233411889 Total x-momentum is 2.6679435570583068e-18 Total y-momentum is 1.6491833639846878e-17 Total z-momentum is 35.285035925910563 Total energy is 7176191.9193628421 [STEP 18] Coarse TimeStep time: 0.710290817 [STEP 18] FAB kilobyte spread across MPI nodes: [644102 ... 644102] Now regridding at level lbase = 0 STEP = 18 TIME = 0.005167349868 : REGRID with lbase = 0 Level 1 16 grids 4194304 cells 12.5 % of domain smallest grid: 64 x 64 x 64 biggest grid: 64 x 64 x 64 [Level 0 step 19] ADVANCE at time 0.005167349868 with dt = 0.0002870733082 [Level 0 step 19] Advanced 4194304 cells [Level 1 step 37] ADVANCE at time 0.005167349868 with dt = 0.0001435366541 [Level 1 step 37] Advanced 4194304 cells [Level 1 step 38] ADVANCE at time 0.005310886523 with dt = 0.0001435366541 [Level 1 step 38] Advanced 4194304 cells STEP = 19 TIME = 0.005454423177 DT = 0.0002870733082 grid_places() time: 0.016201013 new finest: 1 [CNS] Total mass is 1302338.0233411889 Total x-momentum is 3.4040115490333886e-18 Total y-momentum is 1.5422522372748553e-17 Total z-momentum is 37.653485228064923 Total energy is 7176191.9088943424 [STEP 19] Coarse TimeStep time: 0.746549279 [STEP 19] FAB kilobyte spread across MPI nodes: [644102 ... 644102] [Level 0 step 20] ADVANCE at time 0.005454423177 with dt = 0.0002870733131 [Level 0 step 20] Advanced 4194304 cells [Level 1 step 39] ADVANCE at time 0.005454423177 with dt = 0.0001435366565 [Level 1 step 39] Advanced 4194304 cells [Level 1 step 40] ADVANCE at time 0.005597959833 with dt = 0.0001435366565 [Level 1 step 40] Advanced 4194304 cells STEP = 20 TIME = 0.00574149649 DT = 0.0002870733131 [CNS] Total mass is 1302338.0233411891 Total x-momentum is 4.5026000404309944e-18 Total y-momentum is 2.5918280709719765e-18 Total z-momentum is 40.031516048437148 Total energy is 7176191.8977443911 [STEP 20] Coarse TimeStep time: 0.709575271 [STEP 20] FAB kilobyte spread across MPI nodes: [644102 ... 644102] PLOTFILE: file = CNS-RT_plt00020 Write plotfile time = 0.144637449 seconds Run Time total = 15.00911715 Run Time init = 0.258918605 Run Time advance = 14.60537397 TinyProfiler total time across processes [min...avg...max]: 15 ... 15.01 ... 15.01 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- CNS::compute_dSdt() 120 8.08 8.29 8.511 56.71% StateDataPhysBCFunct::() 220 0.001027 0.8571 1.715 11.42% FabArray::ParallelCopy_finish() 692 0.752 1.255 1.708 11.38% FabArray::ParallelCopy_nowait() 692 0.7852 1.026 1.321 8.80% FluxRegister::Reflux() 120 0.6189 0.6544 0.688 4.58% CNS::advance() 60 0.3114 0.3135 0.3161 2.11% FillPatchIterator::Initialize 140 0.2931 0.2969 0.3045 2.03% amrex::Copy() 168 0.2772 0.2924 0.2994 1.99% VisMF::Write(FabArray) 4 0.2741 0.2771 0.2792 1.86% FabArray::setVal() 282 0.222 0.253 0.2785 1.86% FabArray::LinComb() 120 0.1523 0.2046 0.237 1.58% CNS::computeTemp() 141 0.1502 0.1789 0.2272 1.51% CellConservativeLinear::interp() 120 0.05223 0.1171 0.1999 1.33% FillPatchSingleLevel 220 0.1089 0.1341 0.1585 1.06% FillPatchTwoLevels 89 0.06482 0.1119 0.1549 1.03% FillPatchInterp(Fab) 80 0.01762 0.05925 0.1352 0.90% FabArray::Saxpy() 60 0.121 0.1237 0.1255 0.84% amrex::average_down 21 0.08071 0.09604 0.1111 0.74% Amr::regrid() 10 0.1088 0.1092 0.1098 0.73% FabArray::sum() 105 0.05509 0.07383 0.09104 0.61% CNS::estTimeStep() 41 0.05924 0.07363 0.09013 0.60% TagBoxArray::collate() 11 0.002168 0.03714 0.0718 0.48% FabArray::setDomainBndry() 220 0.0006999 0.02524 0.05412 0.36% post_timestep 60 0.02912 0.0336 0.03778 0.25% CNS::errorEst() 11 0.02109 0.02223 0.02354 0.16% Amr::bldFineLevels() 1 0.01258 0.01264 0.01269 0.08% AmrMesh::MakeNewGrids() 11 0.005804 0.007591 0.009324 0.06% AmrLevel::writePlotFile() 4 0.003991 0.005496 0.007457 0.05% Amr::writePlotFile() 2 0.001652 0.002881 0.003902 0.03% Amr::coarseTimeStep() 20 0.0003057 0.001397 0.002441 0.02% AmrLevel::FillPatch() 140 0.001705 0.001771 0.001826 0.01% Amr::timeStep() 60 0.0006357 0.0008743 0.001389 0.01% FabArray::ParallelCopy() 692 0.0007126 0.0007624 0.0008126 0.01% main() 1 0.0001618 0.0002093 0.0002451 0.00% FillPatchIterator::FillFromTwoLevels() 89 0.0001441 0.000154 0.0001684 0.00% FillPatchIterator::FillFromLevel0() 51 6.28e-05 7.225e-05 7.774e-05 0.00% postCoarseTimeStep() 20 4.254e-05 5.692e-05 7.407e-05 0.00% Amr::grid_places() 11 5.321e-05 5.728e-05 5.924e-05 0.00% CNS::avgDown() 21 3.508e-05 4.351e-05 5.055e-05 0.00% Amr::FinalizeInit() 1 5.34e-06 1.768e-05 3.839e-05 0.00% amrex::average_down_w_geom 21 1.632e-05 1.901e-05 2.359e-05 0.00% CNS::writePlotFile() 4 6.743e-06 6.915e-06 7.078e-06 0.00% Amr::init() 1 1.127e-06 1.491e-06 1.872e-06 0.00% Amr::initialInit() 1 9.54e-07 1.033e-06 1.232e-06 0.00% Other 1374 0.03805 0.05607 0.0722 0.48% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 15 15.01 15.01 100.00% Amr::coarseTimeStep() 20 14.61 14.61 14.61 97.31% Amr::timeStep() 60 14.43 14.46 14.5 96.60% CNS::advance() 60 12.93 12.94 12.95 86.26% CNS::compute_dSdt() 120 8.313 9.155 10 66.66% AmrLevel::FillPatch() 140 2.228 3.116 3.995 26.62% FillPatchIterator::Initialize 140 1.941 2.832 3.707 24.70% FabArray::ParallelCopy() 692 1.55 2.287 3.036 20.23% FillPatchSingleLevel 220 0.9878 1.868 2.783 18.54% FillPatchIterator::FillFromLevel0() 51 0.2389 1.092 1.949 12.98% StateDataPhysBCFunct::() 220 0.001027 0.8616 1.724 11.48% FabArray::ParallelCopy_finish() 692 0.752 1.255 1.708 11.38% FillPatchIterator::FillFromTwoLevels() 89 1.386 1.418 1.461 9.74% FillPatchTwoLevels 89 1.386 1.417 1.461 9.73% FabArray::ParallelCopy_nowait() 692 0.7893 1.031 1.327 8.84% post_timestep 60 1.186 1.218 1.254 8.36% FluxRegister::Reflux() 120 0.9227 0.9558 0.9883 6.58% Amr::regrid() 10 0.3399 0.3441 0.3476 2.32% amrex::Copy() 168 0.2772 0.2924 0.2994 1.99% Amr::writePlotFile() 2 0.2953 0.2957 0.2963 1.97% CNS::writePlotFile() 4 0.2924 0.2928 0.2939 1.96% AmrLevel::writePlotFile() 4 0.2924 0.2928 0.2939 1.96% VisMF::Write(FabArray) 4 0.2741 0.2771 0.2792 1.86% FabArray::setVal() 282 0.222 0.253 0.2785 1.86% Amr::init() 1 0.2513 0.2534 0.2557 1.70% CNS::avgDown() 21 0.2093 0.2266 0.2466 1.64% FabArray::LinComb() 120 0.1523 0.2046 0.237 1.58% CNS::computeTemp() 141 0.1502 0.1789 0.2272 1.51% amrex::average_down_w_geom 21 0.2013 0.2115 0.2196 1.46% amrex::average_down 21 0.2012 0.2115 0.2195 1.46% FillPatchInterp(Fab) 80 0.1183 0.1764 0.218 1.45% CellConservativeLinear::interp() 120 0.05223 0.1171 0.1999 1.33% Amr::grid_places() 11 0.1838 0.1852 0.1867 1.24% AmrMesh::MakeNewGrids() 11 0.1837 0.1852 0.1866 1.24% CNS::errorEst() 11 0.06958 0.1127 0.1568 1.04% FabArray::Saxpy() 60 0.121 0.1237 0.1255 0.84% Amr::initialInit() 1 0.1007 0.1024 0.1047 0.70% Amr::FinalizeInit() 1 0.09389 0.09537 0.09723 0.65% FabArray::sum() 105 0.05509 0.07383 0.09104 0.61% CNS::estTimeStep() 41 0.05924 0.07363 0.09013 0.60% postCoarseTimeStep() 20 0.05266 0.07032 0.08617 0.57% Amr::bldFineLevels() 1 0.07309 0.07456 0.07602 0.51% TagBoxArray::collate() 11 0.002168 0.03714 0.0718 0.48% FabArray::setDomainBndry() 220 0.0006999 0.02524 0.05412 0.36% Other 1374 0.07818 0.1117 0.1425 0.95% ------------------------------------------------------------------------------------------- Device Memory Usage: ---------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ---------------------------------------------------------------------------------------------------------------- CNS::compute_dSdt() 19200 120 MiB 133 MiB 146 MiB 261 MiB 268 MiB 291 MiB CNS::advance() 2096 221 MiB 221 MiB 221 MiB 257 MiB 257 MiB 257 MiB StateData::define() 192 133 MiB 133 MiB 133 MiB 201 MiB 201 MiB 201 MiB FluxRegister::Reflux() 1920 3352 KiB 3497 KiB 3672 KiB 56 MiB 67 MiB 71 MiB FillPatchIterator::Initialize 2240 9358 KiB 12 MiB 16 MiB 67 MiB 67 MiB 67 MiB AmrLevel::writePlotFile() 64 1090 KiB 1096 KiB 1099 KiB 56 MiB 56 MiB 56 MiB FillPatchSingleLevel 640 680 KiB 743 KiB 862 KiB 56 MiB 56 MiB 56 MiB FillPatchTwoLevels 960 219 KiB 339 KiB 452 KiB 5073 KiB 7663 KiB 10 MiB ResizeRandomSeed 4 9209 KiB 9210 KiB 9211 KiB 9216 KiB 9216 KiB 9216 KiB CNS::errorEst() 176 37 KiB 62 KiB 88 KiB 8985 KiB 8985 KiB 8985 KiB post_timestep 320 541 KiB 548 KiB 556 KiB 8192 KiB 8192 KiB 8192 KiB amrex::average_down 428 78 KiB 85 KiB 93 KiB 7169 KiB 7169 KiB 7169 KiB CellConservativeLinear::interp() 960 12 KiB 21 KiB 35 KiB 1355 KiB 2064 KiB 2773 KiB Amr::regrid() 960 1329 KiB 1329 KiB 1330 KiB 2688 KiB 2688 KiB 2688 KiB StateDataPhysBCFunct::() 816 0 B 44 KiB 88 KiB 0 B 736 KiB 1473 KiB Amr::bldFineLevels() 96 4045 B 4045 B 4045 B 1344 KiB 1344 KiB 1344 KiB AmrMesh::MakeNewGrids() 352 12 KiB 12 KiB 12 KiB 1025 KiB 1025 KiB 1025 KiB FabArray::ParallelCopy_nowait() 3002 19 KiB 58 KiB 97 KiB 31 KiB 103 KiB 176 KiB VisMF::Write(FabArray) 448 46 B 86 B 118 B 96 KiB 96 KiB 96 KiB CNS::estTimeStep() 172 1123 B 1139 B 1152 B 49 KiB 49 KiB 49 KiB FabArray::sum() 420 177 B 238 B 294 B 48 KiB 48 KiB 48 KiB FabArray::ParallelCopy_finish() 2168 711 B 2018 B 3339 B 4096 B 7872 B 11 KiB amrex::Copy() 912 2816 B 2831 B 2847 B 3584 B 3584 B 3584 B FabArray::setVal() 1144 2075 B 2110 B 2143 B 3072 B 3072 B 3072 B TagBoxArray::mapPRD 352 1 B 2 B 3 B 2048 B 2048 B 2048 B FabArray::LinComb() 284 1083 B 1083 B 1084 B 1536 B 1536 B 1536 B TagBoxArray::collate() 88 0 B 0 B 0 B 256 B 896 B 1536 B OwnerMask() 176 0 B 0 B 0 B 1024 B 1024 B 1024 B StateData::FillBoundary(geom) 1224 0 B 10 B 20 B 0 B 256 B 512 B Amr::InitAmr() 8 505 B 505 B 506 B 512 B 512 B 512 B ---------------------------------------------------------------------------------------------------------------- Async Memory Usage: ------------------------------------------------------------------------------------------------------ Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ------------------------------------------------------------------------------------------------------ CNS::compute_dSdt() 3840 4449 KiB 7950 KiB 11 MiB 65 MiB 65 MiB 65 MiB FluxRegister::Reflux() 1920 2462 KiB 2960 KiB 3307 KiB 56 MiB 56 MiB 56 MiB post_timestep 320 516 KiB 534 KiB 551 KiB 8192 KiB 8192 KiB 8192 KiB ------------------------------------------------------------------------------------------------------ Managed Memory Usage: --------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------- The_Managed_Arena::Initialize() 4 0 B 0 B 0 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------- Pinned Memory Usage: ---------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ---------------------------------------------------------------------------------------------------------------- FabArray::ParallelCopy_nowait() 7136 501 KiB 710 KiB 912 KiB 7531 KiB 11 MiB 14 MiB VisMF::Write(FabArray) 512 197 KiB 213 KiB 228 KiB 14 MiB 14 MiB 14 MiB The_Pinned_Arena::Initialize() 4 0 B 0 B 0 B 8192 KiB 8192 KiB 8192 KiB FabArray::ParallelCopy_finish() 2168 711 B 2018 B 3339 B 4096 B 7872 B 11 KiB amrex::Copy() 912 2816 B 2831 B 2847 B 3584 B 3584 B 3584 B CNS::compute_dSdt() 1920 112 B 163 B 215 B 3072 B 3072 B 3072 B FabArray::setVal() 1144 2075 B 2110 B 2143 B 3072 B 3072 B 3072 B TagBoxArray::collate() 154 0 B 2 B 4 B 512 B 1344 B 1792 B FabArray::LinComb() 284 1083 B 1083 B 1084 B 1536 B 1536 B 1536 B amrex::average_down 92 563 B 563 B 564 B 1536 B 1536 B 1536 B CNS::estTimeStep() 172 1011 B 1011 B 1011 B 1280 B 1280 B 1280 B CellConservativeLinear::interp() 480 1 B 1 B 2 B 256 B 384 B 512 B StateData::FillBoundary(geom) 1224 0 B 10 B 20 B 0 B 256 B 512 B FabArray::sum() 420 0 B 0 B 1 B 256 B 256 B 256 B ---------------------------------------------------------------------------------------------------------------- Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [3979 ... 3979] [The Arena] max space (MB) allocated spread across MPI: [805 ... 850] [The Arena] max space (MB) used spread across MPI: [663 ... 693] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [32 ... 36] [The Pinned Arena] max space (MB) used spread across MPI: [14 ... 14] AMReX (26.04-109-g60df5ae33414) finalized