Initializing AMReX (26.10-57-g6c637e9855a0)... MPI initialized with 1 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.10-57-g6c637e9855a0) initialized incflo git hash: 24.11-57-gdf047690 Scalar diffusion coefficients Tracer diffusion coeff: 0:0 Newtonian fluid with mu = 0.001 incflo.geometry_filename: Building cylinder geometry. Internal Flow: 1 Radius: 0.49 Direction: 0 Rotation angle(rad): 0 Rotation axe: 0 Center: 0.5, 1.5, 1.5 Done making the EB geometry index space. ylo set to no-slip wall. yhi set to no-slip wall. zlo set to no-slip wall. zhi set to no-slip wall. Making new level 0 from scratch Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 4.62842735 MLMG: Initial rhs = 4.62842735 MLMG: Initial residual (resid0) = 4.62842735 MLMG: Final Iter. 3 resid, resid/bnorm = 3.459454945e-13, 7.474363716e-14 MLMG: Timers: Solve = 0.006931766 Iter = 0.004963742 Bottom = 0.004581153 >> After projection: * On lev 0 max(abs(rhs)) = 0.4897860472 Doing initial pressure iterations with dt = 0.006075017499 In initial_iterations: iter = 0 MAC Projection: MLMG: Initial rhs = 1.281174304 MLMG: Initial residual (resid0) = 1.281174304 MLMG: Final Iter. 3 resid, resid/bnorm = 8.465450563e-13, 6.607571303e-13 MLMG: Timers: Solve = 0.008098642 Iter = 0.007384986 Bottom = 0.00700622 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.07799679507 MLMG: Initial rhs = 0.07799679507 MLMG: Initial residual (resid0) = 0.07799679507 MLMG: Final Iter. 3 resid, resid/bnorm = 5.215307353e-13, 6.686566221e-12 MLMG: Timers: Solve = 0.004569845 Iter = 0.004081169 Bottom = 0.00378382 >> After projection: * On lev 0 max(abs(rhs)) = 0.03443623279 In initial_iterations: iter = 1 MAC Projection: MLMG: Initial rhs = 1.288200724 MLMG: Initial residual (resid0) = 1.288200724 MLMG: Final Iter. 3 resid, resid/bnorm = 2.682298827e-13, 2.082205651e-13 MLMG: Timers: Solve = 0.007659643 Iter = 0.007418571 Bottom = 0.007057588 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.03555691119 MLMG: Initial rhs = 0.03555691119 MLMG: Initial residual (resid0) = 0.03555691119 MLMG: Final Iter. 3 resid, resid/bnorm = 7.160591564e-14, 2.013839596e-12 MLMG: Timers: Solve = 0.004563489 Iter = 0.004097308 Bottom = 0.00380291 >> After projection: * On lev 0 max(abs(rhs)) = 0.0158965414 Writing checkpoint tracer_advection_chk00000 Writing plotfile tracer_advection_plt00000 at time 0 Level 0 1 grids 1125 cells 100 % of domain ============ NEW TIME STEP ============ Step 1: from old_time 0 to new time 0.002976688659 with dt = 0.002976688659. MAC Projection: MLMG: Initial rhs = 1.293159099 MLMG: Initial residual (resid0) = 1.293159099 MLMG: Final Iter. 3 resid, resid/bnorm = 7.074341113e-13, 5.470588361e-13 MLMG: Timers: Solve = 0.0073095 Iter = 0.007046809 Bottom = 0.006666039 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.5003739384 MLMG: Initial rhs = 0.5003739384 MLMG: Initial residual (resid0) = 0.5003739384 MLMG: Final Iter. 3 resid, resid/bnorm = 1.504490976e-13, 3.006733287e-13 MLMG: Timers: Solve = 0.004725393 Iter = 0.004189848 Bottom = 0.00388046 >> After projection: * On lev 0 max(abs(rhs)) = 0.1307440403 Sum tracer volume wgt = 0.002976688659 1.256978381 Time per step 0.028205673 ============ NEW TIME STEP ============ Step 2: from old_time 0.002976688659 to new time 0.006251046185 with dt = 0.003274357525. MAC Projection: MLMG: Initial rhs = 1.90012723 MLMG: Initial residual (resid0) = 1.90012723 MLMG: Final Iter. 3 resid, resid/bnorm = 5.478950627e-13, 2.883465139e-13 MLMG: Timers: Solve = 0.007663593 Iter = 0.007410085 Bottom = 0.007045006 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1634967245 MLMG: Initial rhs = 0.1634967245 MLMG: Initial residual (resid0) = 0.1634967245 MLMG: Final Iter. 3 resid, resid/bnorm = 2.563435575e-13, 1.567881915e-12 MLMG: Timers: Solve = 0.004559374 Iter = 0.004061507 Bottom = 0.003755629 >> After projection: * On lev 0 max(abs(rhs)) = 0.06653742934 Sum tracer volume wgt = 0.006251046185 1.256978381 Time per step 0.027876763 ============ NEW TIME STEP ============ Step 3: from old_time 0.006251046185 to new time 0.009852839463 with dt = 0.003601793278. MAC Projection: MLMG: Initial rhs = 1.782506951 MLMG: Initial residual (resid0) = 1.782506951 MLMG: Final Iter. 3 resid, resid/bnorm = 6.869435576e-13, 3.853805771e-13 MLMG: Timers: Solve = 0.007743479 Iter = 0.007492917 Bottom = 0.007132572 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1484410134 MLMG: Initial rhs = 0.1484410134 MLMG: Initial residual (resid0) = 0.1484410134 MLMG: Final Iter. 3 resid, resid/bnorm = 6.578071421e-14, 4.431437962e-13 MLMG: Timers: Solve = 0.004212108 Iter = 0.003711351 Bottom = 0.003424902 >> After projection: * On lev 0 max(abs(rhs)) = 0.06773384638 Sum tracer volume wgt = 0.009852839463 1.256978381 Time per step 0.027417697 ============ NEW TIME STEP ============ Step 4: from old_time 0.009852839463 to new time 0.01381481207 with dt = 0.003961972606. MAC Projection: MLMG: Initial rhs = 1.588422369 MLMG: Initial residual (resid0) = 1.588422369 MLMG: Final Iter. 3 resid, resid/bnorm = 1.169619956e-13, 7.363406481e-14 MLMG: Timers: Solve = 0.00712612 Iter = 0.006880803 Bottom = 0.006539009 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1407745223 MLMG: Initial rhs = 0.1407745223 MLMG: Initial residual (resid0) = 0.1407745223 MLMG: Final Iter. 3 resid, resid/bnorm = 5.73770198e-13, 4.075809945e-12 MLMG: Timers: Solve = 0.004009813 Iter = 0.003552132 Bottom = 0.003267306 >> After projection: * On lev 0 max(abs(rhs)) = 0.06923815584 Sum tracer volume wgt = 0.01381481207 1.256978381 Time per step 0.025355127 ============ NEW TIME STEP ============ Step 5: from old_time 0.01381481207 to new time 0.01817298193 with dt = 0.004358169866. MAC Projection: MLMG: Initial rhs = 1.369871006 MLMG: Initial residual (resid0) = 1.369871006 MLMG: Final Iter. 3 resid, resid/bnorm = 3.820832539e-13, 2.78919148e-13 MLMG: Timers: Solve = 0.007575496 Iter = 0.007335957 Bottom = 0.006997695 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1347633448 MLMG: Initial rhs = 0.1347633448 MLMG: Initial residual (resid0) = 0.1347633448 MLMG: Final Iter. 3 resid, resid/bnorm = 2.566072355e-13, 1.904132284e-12 MLMG: Timers: Solve = 0.004231741 Iter = 0.003781138 Bottom = 0.003508023 >> After projection: * On lev 0 max(abs(rhs)) = 0.06769763019 Sum tracer volume wgt = 0.01817298193 1.256978381 Time per step 0.026410439 ============ NEW TIME STEP ============ Step 6: from old_time 0.01817298193 to new time 0.02296696879 with dt = 0.004793986853. MAC Projection: MLMG: Initial rhs = 1.155243571 MLMG: Initial residual (resid0) = 1.155243571 MLMG: Final Iter. 3 resid, resid/bnorm = 3.480826738e-13, 3.013067396e-13 MLMG: Timers: Solve = 0.007407008 Iter = 0.007164239 Bottom = 0.0068219 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1302280548 MLMG: Initial rhs = 0.1302280548 MLMG: Initial residual (resid0) = 0.1302280548 MLMG: Final Iter. 3 resid, resid/bnorm = 1.002840172e-12, 7.700646176e-12 MLMG: Timers: Solve = 0.004185699 Iter = 0.003724317 Bottom = 0.003440101 >> After projection: * On lev 0 max(abs(rhs)) = 0.06886871528 Sum tracer volume wgt = 0.02296696879 1.256978381 Time per step 0.026051132 ============ NEW TIME STEP ============ Step 7: from old_time 0.02296696879 to new time 0.02824035433 with dt = 0.005273385538. MAC Projection: MLMG: Initial rhs = 1.079165035 MLMG: Initial residual (resid0) = 1.079165035 MLMG: Final Iter. 3 resid, resid/bnorm = 1.397770788e-13, 1.295233577e-13 MLMG: Timers: Solve = 0.006931446 Iter = 0.006710985 Bottom = 0.006384951 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1254569799 MLMG: Initial rhs = 0.1254569799 MLMG: Initial residual (resid0) = 0.1254569799 MLMG: Final Iter. 3 resid, resid/bnorm = 2.173088098e-13, 1.732138061e-12 MLMG: Timers: Solve = 0.004209167 Iter = 0.003769945 Bottom = 0.003495252 >> After projection: * On lev 0 max(abs(rhs)) = 0.06943609635 Sum tracer volume wgt = 0.02824035433 1.256978381 Time per step 0.025377804 ============ NEW TIME STEP ============ Step 8: from old_time 0.02824035433 to new time 0.03404107842 with dt = 0.005800724092. MAC Projection: MLMG: Initial rhs = 1.10813588 MLMG: Initial residual (resid0) = 1.10813588 MLMG: Final Iter. 3 resid, resid/bnorm = 3.752553823e-13, 3.38636614e-13 MLMG: Timers: Solve = 0.007624504 Iter = 0.007405384 Bottom = 0.00708332 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1185834123 MLMG: Initial rhs = 0.1185834123 MLMG: Initial residual (resid0) = 0.1185834123 MLMG: Final Iter. 3 resid, resid/bnorm = 4.235223283e-13, 3.571514093e-12 MLMG: Timers: Solve = 0.004603742 Iter = 0.004163858 Bottom = 0.00387054 >> After projection: * On lev 0 max(abs(rhs)) = 0.06900048026 Sum tracer volume wgt = 0.03404107842 1.256978381 Time per step 0.026785402 ============ NEW TIME STEP ============ Step 9: from old_time 0.03404107842 to new time 0.04042187492 with dt = 0.006380796501. MAC Projection: MLMG: Initial rhs = 1.141078222 MLMG: Initial residual (resid0) = 1.141078222 MLMG: Final Iter. 3 resid, resid/bnorm = 4.218847494e-15, 3.697246528e-15 MLMG: Timers: Solve = 0.007665514 Iter = 0.007425954 Bottom = 0.007088776 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1110860561 MLMG: Initial rhs = 0.1110860561 MLMG: Initial residual (resid0) = 0.1110860561 MLMG: Final Iter. 4 resid, resid/bnorm = 6.938893904e-17, 6.246413051e-16 MLMG: Timers: Solve = 0.00555142 Iter = 0.005118893 Bottom = 0.004750092 >> After projection: * On lev 0 max(abs(rhs)) = 0.06818242353 Sum tracer volume wgt = 0.04042187492 1.256978381 Time per step 0.027829535 ============ NEW TIME STEP ============ Step 10: from old_time 0.04042187492 to new time 0.04744075107 with dt = 0.007018876151. MAC Projection: MLMG: Initial rhs = 1.170182965 MLMG: Initial residual (resid0) = 1.170182965 MLMG: Final Iter. 3 resid, resid/bnorm = 2.277067424e-13, 1.945907171e-13 MLMG: Timers: Solve = 0.007423068 Iter = 0.007188671 Bottom = 0.006853078 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1140859542 MLMG: Initial rhs = 0.1140859542 MLMG: Initial residual (resid0) = 0.1140859542 MLMG: Final Iter. 3 resid, resid/bnorm = 2.111297248e-13, 1.850619792e-12 MLMG: Timers: Solve = 0.004322082 Iter = 0.003881383 Bottom = 0.003597273 >> After projection: * On lev 0 max(abs(rhs)) = 0.06871379533 Sum tracer volume wgt = 0.04744075107 1.256978381 Time per step 0.026429778 Writing plotfile tracer_advection_plt00010 at time 0.04744075107 Writing checkpoint tracer_advection_chk00010 Time spent in InitData(): 0.103438615 Time spent in Evolve(): 0.280076065 Unused ParmParse Variables: [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [6689 ... 6689] [The Arena] max space (MB) allocated spread across MPI: [25 ... 25] [The Arena] max space (MB) used spread across MPI: [21 ... 21] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Pinned Arena] max space (MB) used spread across MPI: [0 ... 0] AMReX (26.10-57-g6c637e9855a0) finalized