Initializing AMReX (26.04-116-g93329ebb8af9)... MPI initialized with 1 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.04-116-g93329ebb8af9) initialized incflo git hash: 24.11-16-g13031713 Scalar diffusion coefficients Tracer diffusion coeff: 0:0 Newtonian fluid with mu = 0.001 incflo.geometry_filename: Building cylinder geometry. Internal Flow: 1 Radius: 0.49 Direction: 0 Rotation angle(rad): 0 Rotation axe: 0 Center: 0.5, 1.5, 1.5 Done making the EB geometry index space. ylo set to no-slip wall. yhi set to no-slip wall. zlo set to no-slip wall. zhi set to no-slip wall. Making new level 0 from scratch Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 4.62842735 MLMG: Initial rhs = 4.62842735 MLMG: Initial residual (resid0) = 4.62842735 MLMG: Final Iter. 3 resid, resid/bnorm = 3.459454945e-13, 7.474363716e-14 MLMG: Timers: Solve = 0.006866179 Iter = 0.004927906 Bottom = 0.004549368 >> After projection: * On lev 0 max(abs(rhs)) = 0.4897860472 Doing initial pressure iterations with dt = 0.006075017499 In initial_iterations: iter = 0 MAC Projection: MLMG: Initial rhs = 1.281174304 MLMG: Initial residual (resid0) = 1.281174304 MLMG: Final Iter. 3 resid, resid/bnorm = 8.465450563e-13, 6.607571303e-13 MLMG: Timers: Solve = 0.008164668 Iter = 0.007474684 Bottom = 0.007100403 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.07799679507 MLMG: Initial rhs = 0.07799679507 MLMG: Initial residual (resid0) = 0.07799679507 MLMG: Final Iter. 3 resid, resid/bnorm = 5.215394089e-13, 6.686677426e-12 MLMG: Timers: Solve = 0.004635406 Iter = 0.004155125 Bottom = 0.003852576 >> After projection: * On lev 0 max(abs(rhs)) = 0.03443623279 In initial_iterations: iter = 1 MAC Projection: MLMG: Initial rhs = 1.288200724 MLMG: Initial residual (resid0) = 1.288200724 MLMG: Final Iter. 3 resid, resid/bnorm = 2.681188604e-13, 2.08134381e-13 MLMG: Timers: Solve = 0.007768836 Iter = 0.007488979 Bottom = 0.007113752 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.03555691119 MLMG: Initial rhs = 0.03555691119 MLMG: Initial residual (resid0) = 0.03555691119 MLMG: Final Iter. 3 resid, resid/bnorm = 7.159897675e-14, 2.013644447e-12 MLMG: Timers: Solve = 0.004716478 Iter = 0.004198519 Bottom = 0.003895731 >> After projection: * On lev 0 max(abs(rhs)) = 0.0158965414 Writing checkpoint tracer_advection_chk00000 Writing plotfile tracer_advection_plt00000 at time 0 Level 0 1 grids 1125 cells 100 % of domain ============ NEW TIME STEP ============ Step 1: from old_time 0 to new time 0.002976688659 with dt = 0.002976688659. MAC Projection: MLMG: Initial rhs = 1.293159099 MLMG: Initial residual (resid0) = 1.293159099 MLMG: Final Iter. 3 resid, resid/bnorm = 7.07323089e-13, 5.469729825e-13 MLMG: Timers: Solve = 0.007356255 Iter = 0.007073765 Bottom = 0.006705067 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.5003739384 MLMG: Initial rhs = 0.5003739384 MLMG: Initial residual (resid0) = 0.5003739384 MLMG: Final Iter. 3 resid, resid/bnorm = 1.504490976e-13, 3.006733287e-13 MLMG: Timers: Solve = 0.004701736 Iter = 0.004216426 Bottom = 0.003909179 >> After projection: * On lev 0 max(abs(rhs)) = 0.1307440403 Time per step 0.025651207 ============ NEW TIME STEP ============ Step 2: from old_time 0.002976688659 to new time 0.006251046185 with dt = 0.003274357525. MAC Projection: MLMG: Initial rhs = 1.90012723 MLMG: Initial residual (resid0) = 1.90012723 MLMG: Final Iter. 3 resid, resid/bnorm = 5.478950627e-13, 2.883465139e-13 MLMG: Timers: Solve = 0.007658708 Iter = 0.007418554 Bottom = 0.007062045 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1634967245 MLMG: Initial rhs = 0.1634967245 MLMG: Initial residual (resid0) = 0.1634967245 MLMG: Final Iter. 3 resid, resid/bnorm = 2.563296797e-13, 1.567797034e-12 MLMG: Timers: Solve = 0.004538183 Iter = 0.004075489 Bottom = 0.003787134 >> After projection: * On lev 0 max(abs(rhs)) = 0.06653742934 Time per step 0.025653358 ============ NEW TIME STEP ============ Step 3: from old_time 0.006251046185 to new time 0.009852839463 with dt = 0.003601793278. MAC Projection: MLMG: Initial rhs = 1.782506951 MLMG: Initial residual (resid0) = 1.782506951 MLMG: Final Iter. 3 resid, resid/bnorm = 6.871066216e-13, 3.854720573e-13 MLMG: Timers: Solve = 0.007749357 Iter = 0.007512418 Bottom = 0.007154644 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1484410134 MLMG: Initial rhs = 0.1484410134 MLMG: Initial residual (resid0) = 0.1484410134 MLMG: Final Iter. 3 resid, resid/bnorm = 6.5794592e-14, 4.432372865e-13 MLMG: Timers: Solve = 0.004472329 Iter = 0.004000894 Bottom = 0.003691944 >> After projection: * On lev 0 max(abs(rhs)) = 0.06773384638 Time per step 0.025963022 ============ NEW TIME STEP ============ Step 4: from old_time 0.009852839463 to new time 0.01381481207 with dt = 0.003961972606. MAC Projection: MLMG: Initial rhs = 1.588422369 MLMG: Initial residual (resid0) = 1.588422369 MLMG: Final Iter. 3 resid, resid/bnorm = 1.169064845e-13, 7.359911746e-14 MLMG: Timers: Solve = 0.007775564 Iter = 0.007539452 Bottom = 0.00718261 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1407745223 MLMG: Initial rhs = 0.1407745223 MLMG: Initial residual (resid0) = 0.1407745223 MLMG: Final Iter. 3 resid, resid/bnorm = 5.737632591e-13, 4.075760654e-12 MLMG: Timers: Solve = 0.004297532 Iter = 0.003818374 Bottom = 0.003529932 >> After projection: * On lev 0 max(abs(rhs)) = 0.06923815584 Time per step 0.025744751 ============ NEW TIME STEP ============ Step 5: from old_time 0.01381481207 to new time 0.01817298193 with dt = 0.004358169866. MAC Projection: MLMG: Initial rhs = 1.369871006 MLMG: Initial residual (resid0) = 1.369871006 MLMG: Final Iter. 3 resid, resid/bnorm = 3.820832539e-13, 2.78919148e-13 MLMG: Timers: Solve = 0.008138123 Iter = 0.007901263 Bottom = 0.007543638 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1347633448 MLMG: Initial rhs = 0.1347633448 MLMG: Initial residual (resid0) = 0.1347633448 MLMG: Final Iter. 3 resid, resid/bnorm = 2.565933577e-13, 1.904029305e-12 MLMG: Timers: Solve = 0.004589427 Iter = 0.004118834 Bottom = 0.003814482 >> After projection: * On lev 0 max(abs(rhs)) = 0.06769763019 Time per step 0.026332977 ============ NEW TIME STEP ============ Step 6: from old_time 0.01817298193 to new time 0.02296696879 with dt = 0.004793986853. MAC Projection: MLMG: Initial rhs = 1.155243571 MLMG: Initial residual (resid0) = 1.155243571 MLMG: Final Iter. 3 resid, resid/bnorm = 3.480132849e-13, 3.012466753e-13 MLMG: Timers: Solve = 0.007910134 Iter = 0.007672996 Bottom = 0.007310453 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1302280548 MLMG: Initial rhs = 0.1302280548 MLMG: Initial residual (resid0) = 0.1302280548 MLMG: Final Iter. 3 resid, resid/bnorm = 1.002826294e-12, 7.700539611e-12 MLMG: Timers: Solve = 0.004527734 Iter = 0.004055251 Bottom = 0.003743996 >> After projection: * On lev 0 max(abs(rhs)) = 0.06886871528 Time per step 0.026128225 ============ NEW TIME STEP ============ Step 7: from old_time 0.02296696879 to new time 0.02824035433 with dt = 0.005273385538. MAC Projection: MLMG: Initial rhs = 1.079165035 MLMG: Initial residual (resid0) = 1.079165035 MLMG: Final Iter. 3 resid, resid/bnorm = 1.397215676e-13, 1.294719187e-13 MLMG: Timers: Solve = 0.007524947 Iter = 0.007285897 Bottom = 0.006930263 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1254569799 MLMG: Initial rhs = 0.1254569799 MLMG: Initial residual (resid0) = 0.1254569799 MLMG: Final Iter. 3 resid, resid/bnorm = 2.173122793e-13, 1.732165716e-12 MLMG: Timers: Solve = 0.004579636 Iter = 0.004088776 Bottom = 0.003799594 >> After projection: * On lev 0 max(abs(rhs)) = 0.06943609635 Time per step 0.025718863 ============ NEW TIME STEP ============ Step 8: from old_time 0.02824035433 to new time 0.03404107842 with dt = 0.005800724092. MAC Projection: MLMG: Initial rhs = 1.10813588 MLMG: Initial residual (resid0) = 1.10813588 MLMG: Final Iter. 3 resid, resid/bnorm = 3.754774269e-13, 3.388369907e-13 MLMG: Timers: Solve = 0.008262134 Iter = 0.008023948 Bottom = 0.007662051 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1185834123 MLMG: Initial rhs = 0.1185834123 MLMG: Initial residual (resid0) = 0.1185834123 MLMG: Final Iter. 3 resid, resid/bnorm = 4.235223283e-13, 3.571514093e-12 MLMG: Timers: Solve = 0.00487153 Iter = 0.004391507 Bottom = 0.004083138 >> After projection: * On lev 0 max(abs(rhs)) = 0.06900048026 Time per step 0.026658632 ============ NEW TIME STEP ============ Step 9: from old_time 0.03404107842 to new time 0.04042187492 with dt = 0.006380796501. MAC Projection: MLMG: Initial rhs = 1.141078222 MLMG: Initial residual (resid0) = 1.141078222 MLMG: Final Iter. 3 resid, resid/bnorm = 4.288236433e-15, 3.758056504e-15 MLMG: Timers: Solve = 0.008275084 Iter = 0.008039073 Bottom = 0.00766797 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1110860561 MLMG: Initial rhs = 0.1110860561 MLMG: Initial residual (resid0) = 0.1110860561 MLMG: Final Iter. 4 resid, resid/bnorm = 5.551115123e-17, 4.997130441e-16 MLMG: Timers: Solve = 0.005599447 Iter = 0.00516324 Bottom = 0.0048101 >> After projection: * On lev 0 max(abs(rhs)) = 0.06818242353 Time per step 0.027817599 ============ NEW TIME STEP ============ Step 10: from old_time 0.04042187492 to new time 0.04744075107 with dt = 0.007018876151. MAC Projection: MLMG: Initial rhs = 1.170182965 MLMG: Initial residual (resid0) = 1.170182965 MLMG: Final Iter. 3 resid, resid/bnorm = 2.2759572e-13, 1.944958411e-13 MLMG: Timers: Solve = 0.007333467 Iter = 0.007084591 Bottom = 0.00674595 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1140859542 MLMG: Initial rhs = 0.1140859542 MLMG: Initial residual (resid0) = 0.1140859542 MLMG: Final Iter. 3 resid, resid/bnorm = 2.111019692e-13, 1.850376505e-12 MLMG: Timers: Solve = 0.004245622 Iter = 0.003790712 Bottom = 0.00352359 >> After projection: * On lev 0 max(abs(rhs)) = 0.06871379533 Time per step 0.024012373 Writing plotfile tracer_advection_plt00010 at time 0.04744075107 Writing checkpoint tracer_advection_chk00010 Time spent in InitData(): 0.098517404 Time spent in Evolve(): 0.272024786 Unused ParmParse Variables: [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] [TOP]::cylinder.height(nvals = 1) :: [-1.0] Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [6691 ... 6691] [The Arena] max space (MB) allocated spread across MPI: [25 ... 25] [The Arena] max space (MB) used spread across MPI: [20 ... 20] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Pinned Arena] max space (MB) used spread across MPI: [0 ... 0] AMReX (26.04-116-g93329ebb8af9) finalized