Initializing AMReX (26.09-175-gf2e8bf0a946a)... MPI initialized with 1 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.09-175-gf2e8bf0a946a) initialized incflo git hash: 24.11-55-g878827de Scalar diffusion coefficients Tracer diffusion coeff: 0:0 Newtonian fluid with mu = 0.001 incflo.geometry_filename: Building cylinder geometry. Internal Flow: 1 Radius: 0.49 Direction: 0 Rotation angle(rad): 0 Rotation axe: 0 Center: 0.5, 1.5, 1.5 Done making the EB geometry index space. ylo set to no-slip wall. yhi set to no-slip wall. zlo set to no-slip wall. zhi set to no-slip wall. Making new level 0 from scratch Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 4.62842735 MLMG: Initial rhs = 4.62842735 MLMG: Initial residual (resid0) = 4.62842735 MLMG: Final Iter. 3 resid, resid/bnorm = 3.459454945e-13, 7.474363716e-14 MLMG: Timers: Solve = 0.006936908 Iter = 0.004974172 Bottom = 0.004583543 >> After projection: * On lev 0 max(abs(rhs)) = 0.4897860472 Doing initial pressure iterations with dt = 0.006075017499 In initial_iterations: iter = 0 MAC Projection: MLMG: Initial rhs = 1.281174304 MLMG: Initial residual (resid0) = 1.281174304 MLMG: Final Iter. 3 resid, resid/bnorm = 8.465450563e-13, 6.607571303e-13 MLMG: Timers: Solve = 0.008048461 Iter = 0.007367598 Bottom = 0.007001985 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.07799679507 MLMG: Initial rhs = 0.07799679507 MLMG: Initial residual (resid0) = 0.07799679507 MLMG: Final Iter. 3 resid, resid/bnorm = 5.215307353e-13, 6.686566221e-12 MLMG: Timers: Solve = 0.004576501 Iter = 0.004112643 Bottom = 0.003807131 >> After projection: * On lev 0 max(abs(rhs)) = 0.03443623279 In initial_iterations: iter = 1 MAC Projection: MLMG: Initial rhs = 1.288200724 MLMG: Initial residual (resid0) = 1.288200724 MLMG: Final Iter. 3 resid, resid/bnorm = 2.682298827e-13, 2.082205651e-13 MLMG: Timers: Solve = 0.007659235 Iter = 0.007412697 Bottom = 0.007052253 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.03555691119 MLMG: Initial rhs = 0.03555691119 MLMG: Initial residual (resid0) = 0.03555691119 MLMG: Final Iter. 3 resid, resid/bnorm = 7.160591564e-14, 2.013839596e-12 MLMG: Timers: Solve = 0.004996661 Iter = 0.004440879 Bottom = 0.004134901 >> After projection: * On lev 0 max(abs(rhs)) = 0.0158965414 Writing checkpoint tracer_advection_chk00000 Writing plotfile tracer_advection_plt00000 at time 0 Level 0 1 grids 1125 cells 100 % of domain ============ NEW TIME STEP ============ Step 1: from old_time 0 to new time 0.002976688659 with dt = 0.002976688659. MAC Projection: MLMG: Initial rhs = 1.293159099 MLMG: Initial residual (resid0) = 1.293159099 MLMG: Final Iter. 3 resid, resid/bnorm = 7.074341113e-13, 5.470588361e-13 MLMG: Timers: Solve = 0.007303525 Iter = 0.007063794 Bottom = 0.006715286 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.5003739384 MLMG: Initial rhs = 0.5003739384 MLMG: Initial residual (resid0) = 0.5003739384 MLMG: Final Iter. 3 resid, resid/bnorm = 1.504490976e-13, 3.006733287e-13 MLMG: Timers: Solve = 0.004850649 Iter = 0.004344692 Bottom = 0.004051849 >> After projection: * On lev 0 max(abs(rhs)) = 0.1307440403 Sum tracer volume wgt = 0.002976688659 1.256978381 Time per step 0.028011967 ============ NEW TIME STEP ============ Step 2: from old_time 0.002976688659 to new time 0.006251046185 with dt = 0.003274357525. MAC Projection: MLMG: Initial rhs = 1.90012723 MLMG: Initial residual (resid0) = 1.90012723 MLMG: Final Iter. 3 resid, resid/bnorm = 5.478950627e-13, 2.883465139e-13 MLMG: Timers: Solve = 0.007654976 Iter = 0.007419033 Bottom = 0.007068771 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1634967245 MLMG: Initial rhs = 0.1634967245 MLMG: Initial residual (resid0) = 0.1634967245 MLMG: Final Iter. 3 resid, resid/bnorm = 2.563435575e-13, 1.567881915e-12 MLMG: Timers: Solve = 0.004498674 Iter = 0.004020439 Bottom = 0.00372874 >> After projection: * On lev 0 max(abs(rhs)) = 0.06653742934 Sum tracer volume wgt = 0.006251046185 1.256978381 Time per step 0.027986041 ============ NEW TIME STEP ============ Step 3: from old_time 0.006251046185 to new time 0.009852839463 with dt = 0.003601793278. MAC Projection: MLMG: Initial rhs = 1.782506951 MLMG: Initial residual (resid0) = 1.782506951 MLMG: Final Iter. 3 resid, resid/bnorm = 6.869435576e-13, 3.853805771e-13 MLMG: Timers: Solve = 0.007744974 Iter = 0.007511433 Bottom = 0.00716229 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1484410134 MLMG: Initial rhs = 0.1484410134 MLMG: Initial residual (resid0) = 0.1484410134 MLMG: Final Iter. 3 resid, resid/bnorm = 6.578071421e-14, 4.431437962e-13 MLMG: Timers: Solve = 0.004193113 Iter = 0.003738062 Bottom = 0.003453382 >> After projection: * On lev 0 max(abs(rhs)) = 0.06773384638 Sum tracer volume wgt = 0.009852839463 1.256978381 Time per step 0.026804387 ============ NEW TIME STEP ============ Step 4: from old_time 0.009852839463 to new time 0.01381481207 with dt = 0.003961972606. MAC Projection: MLMG: Initial rhs = 1.588422369 MLMG: Initial residual (resid0) = 1.588422369 MLMG: Final Iter. 3 resid, resid/bnorm = 1.169619956e-13, 7.363406481e-14 MLMG: Timers: Solve = 0.007087613 Iter = 0.006864446 Bottom = 0.006541926 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1407745223 MLMG: Initial rhs = 0.1407745223 MLMG: Initial residual (resid0) = 0.1407745223 MLMG: Final Iter. 3 resid, resid/bnorm = 5.73770198e-13, 4.075809945e-12 MLMG: Timers: Solve = 0.003987629 Iter = 0.003541015 Bottom = 0.003257485 >> After projection: * On lev 0 max(abs(rhs)) = 0.06923815584 Sum tracer volume wgt = 0.01381481207 1.256978381 Time per step 0.025275675 ============ NEW TIME STEP ============ Step 5: from old_time 0.01381481207 to new time 0.01817298193 with dt = 0.004358169866. MAC Projection: MLMG: Initial rhs = 1.369871006 MLMG: Initial residual (resid0) = 1.369871006 MLMG: Final Iter. 3 resid, resid/bnorm = 3.820832539e-13, 2.78919148e-13 MLMG: Timers: Solve = 0.007561103 Iter = 0.007340153 Bottom = 0.00701616 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1347633448 MLMG: Initial rhs = 0.1347633448 MLMG: Initial residual (resid0) = 0.1347633448 MLMG: Final Iter. 3 resid, resid/bnorm = 2.566072355e-13, 1.904132284e-12 MLMG: Timers: Solve = 0.004209118 Iter = 0.003774112 Bottom = 0.003506162 >> After projection: * On lev 0 max(abs(rhs)) = 0.06769763019 Sum tracer volume wgt = 0.01817298193 1.256978381 Time per step 0.026113207 ============ NEW TIME STEP ============ Step 6: from old_time 0.01817298193 to new time 0.02296696879 with dt = 0.004793986853. MAC Projection: MLMG: Initial rhs = 1.155243571 MLMG: Initial residual (resid0) = 1.155243571 MLMG: Final Iter. 3 resid, resid/bnorm = 3.480826738e-13, 3.013067396e-13 MLMG: Timers: Solve = 0.007358689 Iter = 0.007139746 Bottom = 0.006814341 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1302280548 MLMG: Initial rhs = 0.1302280548 MLMG: Initial residual (resid0) = 0.1302280548 MLMG: Final Iter. 3 resid, resid/bnorm = 1.002840172e-12, 7.700646176e-12 MLMG: Timers: Solve = 0.004140187 Iter = 0.003699156 Bottom = 0.003415725 >> After projection: * On lev 0 max(abs(rhs)) = 0.06886871528 Sum tracer volume wgt = 0.02296696879 1.256978381 Time per step 0.025855603 ============ NEW TIME STEP ============ Step 7: from old_time 0.02296696879 to new time 0.02824035433 with dt = 0.005273385538. MAC Projection: MLMG: Initial rhs = 1.079165035 MLMG: Initial residual (resid0) = 1.079165035 MLMG: Final Iter. 3 resid, resid/bnorm = 1.397770788e-13, 1.295233577e-13 MLMG: Timers: Solve = 0.006961919 Iter = 0.00673062 Bottom = 0.006393429 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1254569799 MLMG: Initial rhs = 0.1254569799 MLMG: Initial residual (resid0) = 0.1254569799 MLMG: Final Iter. 3 resid, resid/bnorm = 2.173088098e-13, 1.732138061e-12 MLMG: Timers: Solve = 0.004216232 Iter = 0.003782955 Bottom = 0.003511472 >> After projection: * On lev 0 max(abs(rhs)) = 0.06943609635 Sum tracer volume wgt = 0.02824035433 1.256978381 Time per step 0.025606807 ============ NEW TIME STEP ============ Step 8: from old_time 0.02824035433 to new time 0.03404107842 with dt = 0.005800724092. MAC Projection: MLMG: Initial rhs = 1.10813588 MLMG: Initial residual (resid0) = 1.10813588 MLMG: Final Iter. 3 resid, resid/bnorm = 3.752553823e-13, 3.38636614e-13 MLMG: Timers: Solve = 0.007667689 Iter = 0.007446826 Bottom = 0.007117629 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1185834123 MLMG: Initial rhs = 0.1185834123 MLMG: Initial residual (resid0) = 0.1185834123 MLMG: Final Iter. 3 resid, resid/bnorm = 4.235153894e-13, 3.571455578e-12 MLMG: Timers: Solve = 0.004488638 Iter = 0.004043481 Bottom = 0.003760452 >> After projection: * On lev 0 max(abs(rhs)) = 0.06900048026 Sum tracer volume wgt = 0.03404107842 1.256978381 Time per step 0.026417545 ============ NEW TIME STEP ============ Step 9: from old_time 0.03404107842 to new time 0.04042187492 with dt = 0.006380796501. MAC Projection: MLMG: Initial rhs = 1.141078222 MLMG: Initial residual (resid0) = 1.141078222 MLMG: Final Iter. 3 resid, resid/bnorm = 4.218847494e-15, 3.697246528e-15 MLMG: Timers: Solve = 0.007666497 Iter = 0.007434983 Bottom = 0.007100544 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1110860561 MLMG: Initial rhs = 0.1110860561 MLMG: Initial residual (resid0) = 0.1110860561 MLMG: Final Iter. 4 resid, resid/bnorm = 6.938893904e-17, 6.246413051e-16 MLMG: Timers: Solve = 0.005606461 Iter = 0.005170799 Bottom = 0.004814029 >> After projection: * On lev 0 max(abs(rhs)) = 0.06818242353 Sum tracer volume wgt = 0.04042187492 1.256978381 Time per step 0.027950603 ============ NEW TIME STEP ============ Step 10: from old_time 0.04042187492 to new time 0.04744075107 with dt = 0.007018876151. MAC Projection: MLMG: Initial rhs = 1.170182965 MLMG: Initial residual (resid0) = 1.170182965 MLMG: Final Iter. 3 resid, resid/bnorm = 2.2759572e-13, 1.944958411e-13 MLMG: Timers: Solve = 0.007411818 Iter = 0.007192187 Bottom = 0.006869722 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1140859542 MLMG: Initial rhs = 0.1140859542 MLMG: Initial residual (resid0) = 0.1140859542 MLMG: Final Iter. 3 resid, resid/bnorm = 2.111713582e-13, 1.850984721e-12 MLMG: Timers: Solve = 0.004216907 Iter = 0.003782443 Bottom = 0.0035117 >> After projection: * On lev 0 max(abs(rhs)) = 0.06871379533 Sum tracer volume wgt = 0.04744075107 1.256978381 Time per step 0.026307282 Writing plotfile tracer_advection_plt00010 at time 0.04744075107 Writing checkpoint tracer_advection_chk00010 Time spent in InitData(): 0.103296301 Time spent in Evolve(): 0.278617521 Unused ParmParse Variables: [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [6689 ... 6689] [The Arena] max space (MB) allocated spread across MPI: [25 ... 25] [The Arena] max space (MB) used spread across MPI: [21 ... 21] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Pinned Arena] max space (MB) used spread across MPI: [0 ... 0] AMReX (26.09-175-gf2e8bf0a946a) finalized