Initializing AMReX (26.11-20-g24aedb0e61d7)... MPI initialized with 1 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.11-20-g24aedb0e61d7) initialized incflo git hash: 24.11-66-ga788f2e4 Scalar diffusion coefficients Tracer diffusion coeff: 0:0 Newtonian fluid with mu = 0.001 incflo.geometry_filename: Building cylinder geometry. Internal Flow: 1 Radius: 0.49 Direction: 0 Rotation angle(rad): 0 Rotation axe: 0 Center: 0.5, 1.5, 1.5 Done making the EB geometry index space. ylo set to no-slip wall. yhi set to no-slip wall. zlo set to no-slip wall. zhi set to no-slip wall. Making new level 0 from scratch Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 4.62842735 MLMG: Initial rhs = 4.62842735 MLMG: Initial residual (resid0) = 4.62842735 MLMG: Final Iter. 3 resid, resid/bnorm = 3.455014053e-13, 7.464768898e-14 MLMG: Timers: Solve = 0.006419195 Iter = 0.004943861 Bottom = 0.00455766 >> After projection: * On lev 0 max(abs(rhs)) = 0.4897860472 Doing initial pressure iterations with dt = 0.006075017499 In initial_iterations: iter = 0 MAC Projection: MLMG: Initial rhs = 1.281174304 MLMG: Initial residual (resid0) = 1.281174304 MLMG: Final Iter. 3 resid, resid/bnorm = 8.466005674e-13, 6.608004587e-13 MLMG: Timers: Solve = 0.008057611 Iter = 0.007332471 Bottom = 0.006965063 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.07799679507 MLMG: Initial rhs = 0.07799679507 MLMG: Initial residual (resid0) = 0.07799679507 MLMG: Final Iter. 3 resid, resid/bnorm = 5.215463478e-13, 6.68676639e-12 MLMG: Timers: Solve = 0.004518522 Iter = 0.004052814 Bottom = 0.003744555 >> After projection: * On lev 0 max(abs(rhs)) = 0.03443623279 In initial_iterations: iter = 1 MAC Projection: MLMG: Initial rhs = 1.288200724 MLMG: Initial residual (resid0) = 1.288200724 MLMG: Final Iter. 3 resid, resid/bnorm = 2.682298827e-13, 2.082205651e-13 MLMG: Timers: Solve = 0.007628602 Iter = 0.00736035 Bottom = 0.006985656 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.03555691119 MLMG: Initial rhs = 0.03555691119 MLMG: Initial residual (resid0) = 0.03555691119 MLMG: Final Iter. 3 resid, resid/bnorm = 7.159897675e-14, 2.013644447e-12 MLMG: Timers: Solve = 0.004565647 Iter = 0.004079897 Bottom = 0.003759528 >> After projection: * On lev 0 max(abs(rhs)) = 0.0158965414 Writing checkpoint tracer_advection_chk00000 Writing plotfile tracer_advection_plt00000 at time 0 Level 0 1 grids 1125 cells 100 % of domain ============ NEW TIME STEP ============ Step 1: from old_time 0 to new time 0.002976688659 with dt = 0.002976688659. MAC Projection: MLMG: Initial rhs = 1.293159099 MLMG: Initial residual (resid0) = 1.293159099 MLMG: Final Iter. 3 resid, resid/bnorm = 7.075451336e-13, 5.471446896e-13 MLMG: Timers: Solve = 0.007242421 Iter = 0.006998995 Bottom = 0.00663138 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.5003739384 MLMG: Initial rhs = 0.5003739384 MLMG: Initial residual (resid0) = 0.5003739384 MLMG: Final Iter. 3 resid, resid/bnorm = 1.504629754e-13, 3.007010635e-13 MLMG: Timers: Solve = 0.004668792 Iter = 0.004186184 Bottom = 0.0038768 >> After projection: * On lev 0 max(abs(rhs)) = 0.1307440403 Sum tracer volume wgt = 0.002976688659 1.256978381 Time per step 0.025078735 ============ NEW TIME STEP ============ Step 2: from old_time 0.002976688659 to new time 0.006251046185 with dt = 0.003274357525. MAC Projection: MLMG: Initial rhs = 1.90012723 MLMG: Initial residual (resid0) = 1.90012723 MLMG: Final Iter. 3 resid, resid/bnorm = 5.477840404e-13, 2.88288085e-13 MLMG: Timers: Solve = 0.00752011 Iter = 0.007281628 Bottom = 0.006919125 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1634967245 MLMG: Initial rhs = 0.1634967245 MLMG: Initial residual (resid0) = 0.1634967245 MLMG: Final Iter. 3 resid, resid/bnorm = 2.563574353e-13, 1.567966796e-12 MLMG: Timers: Solve = 0.004442119 Iter = 0.003983063 Bottom = 0.003674976 >> After projection: * On lev 0 max(abs(rhs)) = 0.06653742934 Sum tracer volume wgt = 0.006251046185 1.256978381 Time per step 0.024717304 ============ NEW TIME STEP ============ Step 3: from old_time 0.006251046185 to new time 0.009852839463 with dt = 0.003601793278. MAC Projection: MLMG: Initial rhs = 1.782506951 MLMG: Initial residual (resid0) = 1.782506951 MLMG: Final Iter. 3 resid, resid/bnorm = 6.872315217e-13, 3.855421272e-13 MLMG: Timers: Solve = 0.007768793 Iter = 0.007507274 Bottom = 0.007144279 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1484410134 MLMG: Initial rhs = 0.1484410134 MLMG: Initial residual (resid0) = 0.1484410134 MLMG: Final Iter. 3 resid, resid/bnorm = 6.573908085e-14, 4.428633254e-13 MLMG: Timers: Solve = 0.004405867 Iter = 0.003953925 Bottom = 0.003646982 >> After projection: * On lev 0 max(abs(rhs)) = 0.06773384638 Sum tracer volume wgt = 0.009852839463 1.256978381 Time per step 0.024920449 ============ NEW TIME STEP ============ Step 4: from old_time 0.009852839463 to new time 0.01381481207 with dt = 0.003961972606. MAC Projection: MLMG: Initial rhs = 1.588422369 MLMG: Initial residual (resid0) = 1.588422369 MLMG: Final Iter. 3 resid, resid/bnorm = 1.169342401e-13, 7.361659114e-14 MLMG: Timers: Solve = 0.007592046 Iter = 0.007348269 Bottom = 0.006974615 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1407745223 MLMG: Initial rhs = 0.1407745223 MLMG: Initial residual (resid0) = 0.1407745223 MLMG: Final Iter. 3 resid, resid/bnorm = 5.737632591e-13, 4.075760654e-12 MLMG: Timers: Solve = 0.004151302 Iter = 0.003709491 Bottom = 0.003402464 >> After projection: * On lev 0 max(abs(rhs)) = 0.06923815584 Sum tracer volume wgt = 0.01381481207 1.256978381 Time per step 0.024628337 ============ NEW TIME STEP ============ Step 5: from old_time 0.01381481207 to new time 0.01817298193 with dt = 0.004358169866. MAC Projection: MLMG: Initial rhs = 1.369871006 MLMG: Initial residual (resid0) = 1.369871006 MLMG: Final Iter. 3 resid, resid/bnorm = 3.822497874e-13, 2.790407167e-13 MLMG: Timers: Solve = 0.008113426 Iter = 0.007874856 Bottom = 0.00751096 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1347633448 MLMG: Initial rhs = 0.1347633448 MLMG: Initial residual (resid0) = 0.1347633448 MLMG: Final Iter. 3 resid, resid/bnorm = 2.565794799e-13, 1.903926326e-12 MLMG: Timers: Solve = 0.004520724 Iter = 0.004040829 Bottom = 0.003733215 >> After projection: * On lev 0 max(abs(rhs)) = 0.06769763019 Sum tracer volume wgt = 0.01817298193 1.256978381 Time per step 0.025326619 ============ NEW TIME STEP ============ Step 6: from old_time 0.01817298193 to new time 0.02296696879 with dt = 0.004793986853. MAC Projection: MLMG: Initial rhs = 1.155243571 MLMG: Initial residual (resid0) = 1.155243571 MLMG: Final Iter. 3 resid, resid/bnorm = 3.480965516e-13, 3.013187525e-13 MLMG: Timers: Solve = 0.007766602 Iter = 0.007525673 Bottom = 0.007158352 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1302280548 MLMG: Initial rhs = 0.1302280548 MLMG: Initial residual (resid0) = 0.1302280548 MLMG: Final Iter. 3 resid, resid/bnorm = 1.002843641e-12, 7.700672818e-12 MLMG: Timers: Solve = 0.004342148 Iter = 0.003886739 Bottom = 0.003578967 >> After projection: * On lev 0 max(abs(rhs)) = 0.06886871528 Sum tracer volume wgt = 0.02296696879 1.256978381 Time per step 0.024808698 ============ NEW TIME STEP ============ Step 7: from old_time 0.02296696879 to new time 0.02824035433 with dt = 0.005273385538. MAC Projection: MLMG: Initial rhs = 1.079165035 MLMG: Initial residual (resid0) = 1.079165035 MLMG: Final Iter. 3 resid, resid/bnorm = 1.398881011e-13, 1.296262356e-13 MLMG: Timers: Solve = 0.007432392 Iter = 0.007196294 Bottom = 0.006831599 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1254569799 MLMG: Initial rhs = 0.1254569799 MLMG: Initial residual (resid0) = 0.1254569799 MLMG: Final Iter. 3 resid, resid/bnorm = 2.173157487e-13, 1.73219337e-12 MLMG: Timers: Solve = 0.00447345 Iter = 0.00402322 Bottom = 0.003714054 >> After projection: * On lev 0 max(abs(rhs)) = 0.06943609635 Sum tracer volume wgt = 0.02824035433 1.256978381 Time per step 0.024638897 ============ NEW TIME STEP ============ Step 8: from old_time 0.02824035433 to new time 0.03404107842 with dt = 0.005800724092. MAC Projection: MLMG: Initial rhs = 1.10813588 MLMG: Initial residual (resid0) = 1.10813588 MLMG: Final Iter. 3 resid, resid/bnorm = 3.752553823e-13, 3.38636614e-13 MLMG: Timers: Solve = 0.008154991 Iter = 0.007916831 Bottom = 0.007554992 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1185834123 MLMG: Initial rhs = 0.1185834123 MLMG: Initial residual (resid0) = 0.1185834123 MLMG: Final Iter. 3 resid, resid/bnorm = 4.235084505e-13, 3.571397064e-12 MLMG: Timers: Solve = 0.004690964 Iter = 0.004241396 Bottom = 0.003934461 >> After projection: * On lev 0 max(abs(rhs)) = 0.06900048026 Sum tracer volume wgt = 0.03404107842 1.256978381 Time per step 0.025641075 ============ NEW TIME STEP ============ Step 9: from old_time 0.03404107842 to new time 0.04042187492 with dt = 0.006380796501. MAC Projection: MLMG: Initial rhs = 1.141078222 MLMG: Initial residual (resid0) = 1.141078222 MLMG: Final Iter. 3 resid, resid/bnorm = 4.260480857e-15, 3.733732514e-15 MLMG: Timers: Solve = 0.008194019 Iter = 0.007954717 Bottom = 0.007596576 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1110860561 MLMG: Initial rhs = 0.1110860561 MLMG: Initial residual (resid0) = 0.1110860561 MLMG: Final Iter. 4 resid, resid/bnorm = 5.551115123e-17, 4.997130441e-16 MLMG: Timers: Solve = 0.005883417 Iter = 0.005428117 Bottom = 0.005020295 >> After projection: * On lev 0 max(abs(rhs)) = 0.06818242353 Sum tracer volume wgt = 0.04042187492 1.256978381 Time per step 0.027259923 ============ NEW TIME STEP ============ Step 10: from old_time 0.04042187492 to new time 0.04744075107 with dt = 0.007018876151. MAC Projection: MLMG: Initial rhs = 1.170182965 MLMG: Initial residual (resid0) = 1.170182965 MLMG: Final Iter. 3 resid, resid/bnorm = 2.2759572e-13, 1.944958411e-13 MLMG: Timers: Solve = 0.007893819 Iter = 0.007655648 Bottom = 0.007291788 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1140859542 MLMG: Initial rhs = 0.1140859542 MLMG: Initial residual (resid0) = 0.1140859542 MLMG: Final Iter. 3 resid, resid/bnorm = 2.111505415e-13, 1.850802257e-12 MLMG: Timers: Solve = 0.004136909 Iter = 0.003710409 Bottom = 0.003425973 >> After projection: * On lev 0 max(abs(rhs)) = 0.06871379533 Sum tracer volume wgt = 0.04744075107 1.256978381 Time per step 0.024759426 Writing plotfile tracer_advection_plt00010 at time 0.04744075107 Writing checkpoint tracer_advection_chk00010 Time spent in InitData(): 0.096408117 Time spent in Evolve(): 0.264205272 Unused ParmParse Variables: [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] Total GPU global memory (MB) spread across MPI: [7784 ... 7784] Free GPU global memory (MB) spread across MPI: [6506 ... 6506] [The Arena] max space (MB) allocated spread across MPI: [25 ... 25] [The Arena] max space (MB) used spread across MPI: [21 ... 21] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Pinned Arena] max space (MB) used spread across MPI: [0 ... 0] AMReX (26.11-20-g24aedb0e61d7) finalized