Initializing AMReX (26.11-11-g97505cf371eb)... MPI initialized with 1 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.11-11-g97505cf371eb) initialized incflo git hash: 24.11-65-g18045d08 Scalar diffusion coefficients Tracer diffusion coeff: 0:0 Newtonian fluid with mu = 0.001 incflo.geometry_filename: Building cylinder geometry. Internal Flow: 1 Radius: 0.49 Direction: 0 Rotation angle(rad): 0 Rotation axe: 0 Center: 0.5, 1.5, 1.5 Done making the EB geometry index space. ylo set to no-slip wall. yhi set to no-slip wall. zlo set to no-slip wall. zhi set to no-slip wall. Making new level 0 from scratch Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 4.62842735 MLMG: Initial rhs = 4.62842735 MLMG: Initial residual (resid0) = 4.62842735 MLMG: Final Iter. 3 resid, resid/bnorm = 3.455014053e-13, 7.464768898e-14 MLMG: Timers: Solve = 0.006238659 Iter = 0.004886895 Bottom = 0.004517724 >> After projection: * On lev 0 max(abs(rhs)) = 0.4897860472 Doing initial pressure iterations with dt = 0.006075017499 In initial_iterations: iter = 0 MAC Projection: MLMG: Initial rhs = 1.281174304 MLMG: Initial residual (resid0) = 1.281174304 MLMG: Final Iter. 3 resid, resid/bnorm = 8.466005674e-13, 6.608004587e-13 MLMG: Timers: Solve = 0.007942979 Iter = 0.007258869 Bottom = 0.006895091 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.07799679507 MLMG: Initial rhs = 0.07799679507 MLMG: Initial residual (resid0) = 0.07799679507 MLMG: Final Iter. 3 resid, resid/bnorm = 5.215463478e-13, 6.68676639e-12 MLMG: Timers: Solve = 0.004526655 Iter = 0.004057622 Bottom = 0.003751218 >> After projection: * On lev 0 max(abs(rhs)) = 0.03443623279 In initial_iterations: iter = 1 MAC Projection: MLMG: Initial rhs = 1.288200724 MLMG: Initial residual (resid0) = 1.288200724 MLMG: Final Iter. 3 resid, resid/bnorm = 2.682298827e-13, 2.082205651e-13 MLMG: Timers: Solve = 0.007521289 Iter = 0.007286171 Bottom = 0.0069245 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.03555691119 MLMG: Initial rhs = 0.03555691119 MLMG: Initial residual (resid0) = 0.03555691119 MLMG: Final Iter. 3 resid, resid/bnorm = 7.159897675e-14, 2.013644447e-12 MLMG: Timers: Solve = 0.004548548 Iter = 0.004082103 Bottom = 0.003775785 >> After projection: * On lev 0 max(abs(rhs)) = 0.0158965414 Writing checkpoint tracer_advection_chk00000 Writing plotfile tracer_advection_plt00000 at time 0 Level 0 1 grids 1125 cells 100 % of domain ============ NEW TIME STEP ============ Step 1: from old_time 0 to new time 0.002976688659 with dt = 0.002976688659. MAC Projection: MLMG: Initial rhs = 1.293159099 MLMG: Initial residual (resid0) = 1.293159099 MLMG: Final Iter. 3 resid, resid/bnorm = 7.075451336e-13, 5.471446896e-13 MLMG: Timers: Solve = 0.007326788 Iter = 0.007081456 Bottom = 0.006685968 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.5003739384 MLMG: Initial rhs = 0.5003739384 MLMG: Initial residual (resid0) = 0.5003739384 MLMG: Final Iter. 3 resid, resid/bnorm = 1.504629754e-13, 3.007010635e-13 MLMG: Timers: Solve = 0.004574929 Iter = 0.004111052 Bottom = 0.003804021 >> After projection: * On lev 0 max(abs(rhs)) = 0.1307440403 Sum tracer volume wgt = 0.002976688659 1.256978381 Time per step 0.0250721 ============ NEW TIME STEP ============ Step 2: from old_time 0.002976688659 to new time 0.006251046185 with dt = 0.003274357525. MAC Projection: MLMG: Initial rhs = 1.90012723 MLMG: Initial residual (resid0) = 1.90012723 MLMG: Final Iter. 3 resid, resid/bnorm = 5.477840404e-13, 2.88288085e-13 MLMG: Timers: Solve = 0.007498196 Iter = 0.007264663 Bottom = 0.006904595 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1634967245 MLMG: Initial rhs = 0.1634967245 MLMG: Initial residual (resid0) = 0.1634967245 MLMG: Final Iter. 3 resid, resid/bnorm = 2.563574353e-13, 1.567966796e-12 MLMG: Timers: Solve = 0.004438421 Iter = 0.003981319 Bottom = 0.003684504 >> After projection: * On lev 0 max(abs(rhs)) = 0.06653742934 Sum tracer volume wgt = 0.006251046185 1.256978381 Time per step 0.024648296 ============ NEW TIME STEP ============ Step 3: from old_time 0.006251046185 to new time 0.009852839463 with dt = 0.003601793278. MAC Projection: MLMG: Initial rhs = 1.782506951 MLMG: Initial residual (resid0) = 1.782506951 MLMG: Final Iter. 3 resid, resid/bnorm = 6.872315217e-13, 3.855421272e-13 MLMG: Timers: Solve = 0.007676502 Iter = 0.007443113 Bottom = 0.007079123 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1484410134 MLMG: Initial rhs = 0.1484410134 MLMG: Initial residual (resid0) = 0.1484410134 MLMG: Final Iter. 3 resid, resid/bnorm = 6.573908085e-14, 4.428633254e-13 MLMG: Timers: Solve = 0.00438493 Iter = 0.003918676 Bottom = 0.003614772 >> After projection: * On lev 0 max(abs(rhs)) = 0.06773384638 Sum tracer volume wgt = 0.009852839463 1.256978381 Time per step 0.024791935 ============ NEW TIME STEP ============ Step 4: from old_time 0.009852839463 to new time 0.01381481207 with dt = 0.003961972606. MAC Projection: MLMG: Initial rhs = 1.588422369 MLMG: Initial residual (resid0) = 1.588422369 MLMG: Final Iter. 3 resid, resid/bnorm = 1.169342401e-13, 7.361659114e-14 MLMG: Timers: Solve = 0.007498918 Iter = 0.007263418 Bottom = 0.006904152 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1407745223 MLMG: Initial rhs = 0.1407745223 MLMG: Initial residual (resid0) = 0.1407745223 MLMG: Final Iter. 3 resid, resid/bnorm = 5.737632591e-13, 4.075760654e-12 MLMG: Timers: Solve = 0.004148548 Iter = 0.003699435 Bottom = 0.003393248 >> After projection: * On lev 0 max(abs(rhs)) = 0.06923815584 Sum tracer volume wgt = 0.01381481207 1.256978381 Time per step 0.024354965 ============ NEW TIME STEP ============ Step 5: from old_time 0.01381481207 to new time 0.01817298193 with dt = 0.004358169866. MAC Projection: MLMG: Initial rhs = 1.369871006 MLMG: Initial residual (resid0) = 1.369871006 MLMG: Final Iter. 3 resid, resid/bnorm = 3.822497874e-13, 2.790407167e-13 MLMG: Timers: Solve = 0.008048015 Iter = 0.007812754 Bottom = 0.007453948 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1347633448 MLMG: Initial rhs = 0.1347633448 MLMG: Initial residual (resid0) = 0.1347633448 MLMG: Final Iter. 3 resid, resid/bnorm = 2.565794799e-13, 1.903926326e-12 MLMG: Timers: Solve = 0.004471772 Iter = 0.004016596 Bottom = 0.003709686 >> After projection: * On lev 0 max(abs(rhs)) = 0.06769763019 Sum tracer volume wgt = 0.01817298193 1.256978381 Time per step 0.025249448 ============ NEW TIME STEP ============ Step 6: from old_time 0.01817298193 to new time 0.02296696879 with dt = 0.004793986853. MAC Projection: MLMG: Initial rhs = 1.155243571 MLMG: Initial residual (resid0) = 1.155243571 MLMG: Final Iter. 3 resid, resid/bnorm = 3.480965516e-13, 3.013187525e-13 MLMG: Timers: Solve = 0.007746995 Iter = 0.007513913 Bottom = 0.007154817 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1302280548 MLMG: Initial rhs = 0.1302280548 MLMG: Initial residual (resid0) = 0.1302280548 MLMG: Final Iter. 3 resid, resid/bnorm = 1.002843641e-12, 7.700672818e-12 MLMG: Timers: Solve = 0.004328426 Iter = 0.003875345 Bottom = 0.003570857 >> After projection: * On lev 0 max(abs(rhs)) = 0.06886871528 Sum tracer volume wgt = 0.02296696879 1.256978381 Time per step 0.024806232 ============ NEW TIME STEP ============ Step 7: from old_time 0.02296696879 to new time 0.02824035433 with dt = 0.005273385538. MAC Projection: MLMG: Initial rhs = 1.079165035 MLMG: Initial residual (resid0) = 1.079165035 MLMG: Final Iter. 3 resid, resid/bnorm = 1.398881011e-13, 1.296262356e-13 MLMG: Timers: Solve = 0.007436637 Iter = 0.007201166 Bottom = 0.006842272 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1254569799 MLMG: Initial rhs = 0.1254569799 MLMG: Initial residual (resid0) = 0.1254569799 MLMG: Final Iter. 3 resid, resid/bnorm = 2.173157487e-13, 1.73219337e-12 MLMG: Timers: Solve = 0.004506536 Iter = 0.004064178 Bottom = 0.003757261 >> After projection: * On lev 0 max(abs(rhs)) = 0.06943609635 Sum tracer volume wgt = 0.02824035433 1.256978381 Time per step 0.024656251 ============ NEW TIME STEP ============ Step 8: from old_time 0.02824035433 to new time 0.03404107842 with dt = 0.005800724092. MAC Projection: MLMG: Initial rhs = 1.10813588 MLMG: Initial residual (resid0) = 1.10813588 MLMG: Final Iter. 3 resid, resid/bnorm = 3.752553823e-13, 3.38636614e-13 MLMG: Timers: Solve = 0.007392307 Iter = 0.007170344 Bottom = 0.006836262 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1185834123 MLMG: Initial rhs = 0.1185834123 MLMG: Initial residual (resid0) = 0.1185834123 MLMG: Final Iter. 3 resid, resid/bnorm = 4.235084505e-13, 3.571397064e-12 MLMG: Timers: Solve = 0.004374151 Iter = 0.003947186 Bottom = 0.003664742 >> After projection: * On lev 0 max(abs(rhs)) = 0.06900048026 Sum tracer volume wgt = 0.03404107842 1.256978381 Time per step 0.023285572 ============ NEW TIME STEP ============ Step 9: from old_time 0.03404107842 to new time 0.04042187492 with dt = 0.006380796501. MAC Projection: MLMG: Initial rhs = 1.141078222 MLMG: Initial residual (resid0) = 1.141078222 MLMG: Final Iter. 3 resid, resid/bnorm = 4.260480857e-15, 3.733732514e-15 MLMG: Timers: Solve = 0.007443517 Iter = 0.007219101 Bottom = 0.006868016 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1110860561 MLMG: Initial rhs = 0.1110860561 MLMG: Initial residual (resid0) = 0.1110860561 MLMG: Final Iter. 4 resid, resid/bnorm = 5.551115123e-17, 4.997130441e-16 MLMG: Timers: Solve = 0.005491962 Iter = 0.00505739 Bottom = 0.004691002 >> After projection: * On lev 0 max(abs(rhs)) = 0.06818242353 Sum tracer volume wgt = 0.04042187492 1.256978381 Time per step 0.02463334 ============ NEW TIME STEP ============ Step 10: from old_time 0.04042187492 to new time 0.04744075107 with dt = 0.007018876151. MAC Projection: MLMG: Initial rhs = 1.170182965 MLMG: Initial residual (resid0) = 1.170182965 MLMG: Final Iter. 3 resid, resid/bnorm = 2.2759572e-13, 1.944958411e-13 MLMG: Timers: Solve = 0.007176977 Iter = 0.006955308 Bottom = 0.006625891 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1140859542 MLMG: Initial rhs = 0.1140859542 MLMG: Initial residual (resid0) = 0.1140859542 MLMG: Final Iter. 3 resid, resid/bnorm = 2.111505415e-13, 1.850802257e-12 MLMG: Timers: Solve = 0.00410529 Iter = 0.003680749 Bottom = 0.003397773 >> After projection: * On lev 0 max(abs(rhs)) = 0.06871379533 Sum tracer volume wgt = 0.04744075107 1.256978381 Time per step 0.022965595 Writing plotfile tracer_advection_plt00010 at time 0.04744075107 Writing checkpoint tracer_advection_chk00010 Time spent in InitData(): 0.095083702 Time spent in Evolve(): 0.256560573 Unused ParmParse Variables: [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] Total GPU global memory (MB) spread across MPI: [7784 ... 7784] Free GPU global memory (MB) spread across MPI: [6508 ... 6508] [The Arena] max space (MB) allocated spread across MPI: [25 ... 25] [The Arena] max space (MB) used spread across MPI: [21 ... 21] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Pinned Arena] max space (MB) used spread across MPI: [0 ... 0] AMReX (26.11-11-g97505cf371eb) finalized