Initializing AMReX (26.11-56-g9b56dbc0c2e4)... MPI initialized with 1 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.11-56-g9b56dbc0c2e4) initialized incflo git hash: 24.11-66-ga788f2e4 Scalar diffusion coefficients Tracer diffusion coeff: 0:0 Newtonian fluid with mu = 0.001 incflo.geometry_filename: Building cylinder geometry. Internal Flow: 1 Radius: 0.49 Direction: 0 Rotation angle(rad): 0 Rotation axe: 0 Center: 0.5, 1.5, 1.5 Done making the EB geometry index space. ylo set to no-slip wall. yhi set to no-slip wall. zlo set to no-slip wall. zhi set to no-slip wall. Making new level 0 from scratch Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 4.62842735 MLMG: Initial rhs = 4.62842735 MLMG: Initial residual (resid0) = 4.62842735 MLMG: Final Iter. 3 resid, resid/bnorm = 3.455014053e-13, 7.464768898e-14 MLMG: Timers: Solve = 0.006373471 Iter = 0.004842551 Bottom = 0.004467655 >> After projection: * On lev 0 max(abs(rhs)) = 0.4897860472 Doing initial pressure iterations with dt = 0.006075017499 In initial_iterations: iter = 0 MAC Projection: MLMG: Initial rhs = 1.281174304 MLMG: Initial residual (resid0) = 1.281174304 MLMG: Final Iter. 3 resid, resid/bnorm = 8.466005674e-13, 6.608004587e-13 MLMG: Timers: Solve = 0.00792425 Iter = 0.007185896 Bottom = 0.006824713 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.07799679507 MLMG: Initial rhs = 0.07799679507 MLMG: Initial residual (resid0) = 0.07799679507 MLMG: Final Iter. 3 resid, resid/bnorm = 5.215463478e-13, 6.68676639e-12 MLMG: Timers: Solve = 0.004403901 Iter = 0.003949193 Bottom = 0.003657278 >> After projection: * On lev 0 max(abs(rhs)) = 0.03443623279 In initial_iterations: iter = 1 MAC Projection: MLMG: Initial rhs = 1.288200724 MLMG: Initial residual (resid0) = 1.288200724 MLMG: Final Iter. 3 resid, resid/bnorm = 2.682298827e-13, 2.082205651e-13 MLMG: Timers: Solve = 0.007457694 Iter = 0.00719558 Bottom = 0.006838098 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.03555691119 MLMG: Initial rhs = 0.03555691119 MLMG: Initial residual (resid0) = 0.03555691119 MLMG: Final Iter. 3 resid, resid/bnorm = 7.159897675e-14, 2.013644447e-12 MLMG: Timers: Solve = 0.004431414 Iter = 0.00397373 Bottom = 0.003681027 >> After projection: * On lev 0 max(abs(rhs)) = 0.0158965414 Writing checkpoint tracer_advection_chk00000 Writing plotfile tracer_advection_plt00000 at time 0 Level 0 1 grids 1125 cells 100 % of domain ============ NEW TIME STEP ============ Step 1: from old_time 0 to new time 0.002976688659 with dt = 0.002976688659. MAC Projection: MLMG: Initial rhs = 1.293159099 MLMG: Initial residual (resid0) = 1.293159099 MLMG: Final Iter. 3 resid, resid/bnorm = 7.075451336e-13, 5.471446896e-13 MLMG: Timers: Solve = 0.007086285 Iter = 0.006845538 Bottom = 0.006486918 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.5003739384 MLMG: Initial rhs = 0.5003739384 MLMG: Initial residual (resid0) = 0.5003739384 MLMG: Final Iter. 3 resid, resid/bnorm = 1.504629754e-13, 3.007010635e-13 MLMG: Timers: Solve = 0.004498618 Iter = 0.004038078 Bottom = 0.003746244 >> After projection: * On lev 0 max(abs(rhs)) = 0.1307440403 Sum tracer volume wgt = 0.002976688659 1.256978381 Time per step 0.024486169 ============ NEW TIME STEP ============ Step 2: from old_time 0.002976688659 to new time 0.006251046185 with dt = 0.003274357525. MAC Projection: MLMG: Initial rhs = 1.90012723 MLMG: Initial residual (resid0) = 1.90012723 MLMG: Final Iter. 3 resid, resid/bnorm = 5.477840404e-13, 2.88288085e-13 MLMG: Timers: Solve = 0.007367265 Iter = 0.007128309 Bottom = 0.006772537 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1634967245 MLMG: Initial rhs = 0.1634967245 MLMG: Initial residual (resid0) = 0.1634967245 MLMG: Final Iter. 3 resid, resid/bnorm = 2.563574353e-13, 1.567966796e-12 MLMG: Timers: Solve = 0.004358606 Iter = 0.003915241 Bottom = 0.003622389 >> After projection: * On lev 0 max(abs(rhs)) = 0.06653742934 Sum tracer volume wgt = 0.006251046185 1.256978381 Time per step 0.024181489 ============ NEW TIME STEP ============ Step 3: from old_time 0.006251046185 to new time 0.009852839463 with dt = 0.003601793278. MAC Projection: MLMG: Initial rhs = 1.782506951 MLMG: Initial residual (resid0) = 1.782506951 MLMG: Final Iter. 3 resid, resid/bnorm = 6.872315217e-13, 3.855421272e-13 MLMG: Timers: Solve = 0.007497829 Iter = 0.007262908 Bottom = 0.006905772 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1484410134 MLMG: Initial rhs = 0.1484410134 MLMG: Initial residual (resid0) = 0.1484410134 MLMG: Final Iter. 3 resid, resid/bnorm = 6.573908085e-14, 4.428633254e-13 MLMG: Timers: Solve = 0.004297952 Iter = 0.0038534 Bottom = 0.003558748 >> After projection: * On lev 0 max(abs(rhs)) = 0.06773384638 Sum tracer volume wgt = 0.009852839463 1.256978381 Time per step 0.02423951 ============ NEW TIME STEP ============ Step 4: from old_time 0.009852839463 to new time 0.01381481207 with dt = 0.003961972606. MAC Projection: MLMG: Initial rhs = 1.588422369 MLMG: Initial residual (resid0) = 1.588422369 MLMG: Final Iter. 3 resid, resid/bnorm = 1.169342401e-13, 7.361659114e-14 MLMG: Timers: Solve = 0.00759484 Iter = 0.007363539 Bottom = 0.006993441 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1407745223 MLMG: Initial rhs = 0.1407745223 MLMG: Initial residual (resid0) = 0.1407745223 MLMG: Final Iter. 3 resid, resid/bnorm = 5.737632591e-13, 4.075760654e-12 MLMG: Timers: Solve = 0.004072059 Iter = 0.003627072 Bottom = 0.003331293 >> After projection: * On lev 0 max(abs(rhs)) = 0.06923815584 Sum tracer volume wgt = 0.01381481207 1.256978381 Time per step 0.024143426 ============ NEW TIME STEP ============ Step 5: from old_time 0.01381481207 to new time 0.01817298193 with dt = 0.004358169866. MAC Projection: MLMG: Initial rhs = 1.369871006 MLMG: Initial residual (resid0) = 1.369871006 MLMG: Final Iter. 3 resid, resid/bnorm = 3.822497874e-13, 2.790407167e-13 MLMG: Timers: Solve = 0.007904187 Iter = 0.0076694 Bottom = 0.007314324 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1347633448 MLMG: Initial rhs = 0.1347633448 MLMG: Initial residual (resid0) = 0.1347633448 MLMG: Final Iter. 3 resid, resid/bnorm = 2.565794799e-13, 1.903926326e-12 MLMG: Timers: Solve = 0.004361973 Iter = 0.003907438 Bottom = 0.00361412 >> After projection: * On lev 0 max(abs(rhs)) = 0.06769763019 Sum tracer volume wgt = 0.01817298193 1.256978381 Time per step 0.024671743 ============ NEW TIME STEP ============ Step 6: from old_time 0.01817298193 to new time 0.02296696879 with dt = 0.004793986853. MAC Projection: MLMG: Initial rhs = 1.155243571 MLMG: Initial residual (resid0) = 1.155243571 MLMG: Final Iter. 3 resid, resid/bnorm = 3.480965516e-13, 3.013187525e-13 MLMG: Timers: Solve = 0.007597249 Iter = 0.007362379 Bottom = 0.007007029 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1302280548 MLMG: Initial rhs = 0.1302280548 MLMG: Initial residual (resid0) = 0.1302280548 MLMG: Final Iter. 3 resid, resid/bnorm = 1.002843641e-12, 7.700672818e-12 MLMG: Timers: Solve = 0.004024489 Iter = 0.003605628 Bottom = 0.003317242 >> After projection: * On lev 0 max(abs(rhs)) = 0.06886871528 Sum tracer volume wgt = 0.02296696879 1.256978381 Time per step 0.023275657 ============ NEW TIME STEP ============ Step 7: from old_time 0.02296696879 to new time 0.02824035433 with dt = 0.005273385538. MAC Projection: MLMG: Initial rhs = 1.079165035 MLMG: Initial residual (resid0) = 1.079165035 MLMG: Final Iter. 3 resid, resid/bnorm = 1.398881011e-13, 1.296262356e-13 MLMG: Timers: Solve = 0.006830785 Iter = 0.006600187 Bottom = 0.00625615 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1254569799 MLMG: Initial rhs = 0.1254569799 MLMG: Initial residual (resid0) = 0.1254569799 MLMG: Final Iter. 3 resid, resid/bnorm = 2.173157487e-13, 1.73219337e-12 MLMG: Timers: Solve = 0.00409358 Iter = 0.003673963 Bottom = 0.003402555 >> After projection: * On lev 0 max(abs(rhs)) = 0.06943609635 Sum tracer volume wgt = 0.02824035433 1.256978381 Time per step 0.022106764 ============ NEW TIME STEP ============ Step 8: from old_time 0.02824035433 to new time 0.03404107842 with dt = 0.005800724092. MAC Projection: MLMG: Initial rhs = 1.10813588 MLMG: Initial residual (resid0) = 1.10813588 MLMG: Final Iter. 3 resid, resid/bnorm = 3.752553823e-13, 3.38636614e-13 MLMG: Timers: Solve = 0.007396299 Iter = 0.007178924 Bottom = 0.006853197 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1185834123 MLMG: Initial rhs = 0.1185834123 MLMG: Initial residual (resid0) = 0.1185834123 MLMG: Final Iter. 3 resid, resid/bnorm = 4.235084505e-13, 3.571397064e-12 MLMG: Timers: Solve = 0.004383358 Iter = 0.003936439 Bottom = 0.003659494 >> After projection: * On lev 0 max(abs(rhs)) = 0.06900048026 Sum tracer volume wgt = 0.03404107842 1.256978381 Time per step 0.02287346 ============ NEW TIME STEP ============ Step 9: from old_time 0.03404107842 to new time 0.04042187492 with dt = 0.006380796501. MAC Projection: MLMG: Initial rhs = 1.141078222 MLMG: Initial residual (resid0) = 1.141078222 MLMG: Final Iter. 3 resid, resid/bnorm = 4.260480857e-15, 3.733732514e-15 MLMG: Timers: Solve = 0.007295996 Iter = 0.007079079 Bottom = 0.006751273 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1110860561 MLMG: Initial rhs = 0.1110860561 MLMG: Initial residual (resid0) = 0.1110860561 MLMG: Final Iter. 4 resid, resid/bnorm = 5.551115123e-17, 4.997130441e-16 MLMG: Timers: Solve = 0.005378317 Iter = 0.004953206 Bottom = 0.004596916 >> After projection: * On lev 0 max(abs(rhs)) = 0.06818242353 Sum tracer volume wgt = 0.04042187492 1.256978381 Time per step 0.024182023 ============ NEW TIME STEP ============ Step 10: from old_time 0.04042187492 to new time 0.04744075107 with dt = 0.007018876151. MAC Projection: MLMG: Initial rhs = 1.170182965 MLMG: Initial residual (resid0) = 1.170182965 MLMG: Final Iter. 3 resid, resid/bnorm = 2.2759572e-13, 1.944958411e-13 MLMG: Timers: Solve = 0.007121783 Iter = 0.006904732 Bottom = 0.006575392 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1140859542 MLMG: Initial rhs = 0.1140859542 MLMG: Initial residual (resid0) = 0.1140859542 MLMG: Final Iter. 3 resid, resid/bnorm = 2.111505415e-13, 1.850802257e-12 MLMG: Timers: Solve = 0.00406087 Iter = 0.003634735 Bottom = 0.003360756 >> After projection: * On lev 0 max(abs(rhs)) = 0.06871379533 Sum tracer volume wgt = 0.04744075107 1.256978381 Time per step 0.02266423 Writing plotfile tracer_advection_plt00010 at time 0.04744075107 Writing checkpoint tracer_advection_chk00010 Time spent in InitData(): 0.094964901 Time spent in Evolve(): 0.249110214 Unused ParmParse Variables: [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] Total GPU global memory (MB) spread across MPI: [7784 ... 7784] Free GPU global memory (MB) spread across MPI: [6506 ... 6506] [The Arena] max space (MB) allocated spread across MPI: [25 ... 25] [The Arena] max space (MB) used spread across MPI: [21 ... 21] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Pinned Arena] max space (MB) used spread across MPI: [0 ... 0] AMReX (26.11-56-g9b56dbc0c2e4) finalized