Initializing AMReX (26.09-166-g29e408043123)... MPI initialized with 1 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.09-166-g29e408043123) initialized incflo git hash: 24.11-55-g878827de Scalar diffusion coefficients Tracer diffusion coeff: 0:0.1 Tracer diffusion coeff: 1:0.1 Newtonian fluid with mu = 0.001 incflo.geometry_filename: Building cylinder geometry. Internal Flow: 1 Radius: 0.49 Direction: 0 Rotation angle(rad): 0 Rotation axe: 0 Center: 0.5, 1.5, 1.5 Done making the EB geometry index space. ylo set to no-slip wall. yhi set to no-slip wall. zlo set to no-slip wall. zhi set to no-slip wall. Making new level 0 from scratch Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 4.62842735 MLMG: Initial rhs = 4.62842735 MLMG: Initial residual (resid0) = 4.62842735 MLMG: Final Iter. 3 resid, resid/bnorm = 3.420180805e-12, 7.389509539e-13 MLMG: Timers: Solve = 0.006672935 Iter = 0.004733474 Bottom = 0.00435771 >> After projection: * On lev 0 max(abs(rhs)) = 0.4996273493 Doing initial pressure iterations with dt = 0.006119268311 In initial_iterations: iter = 0 MAC Projection: MLMG: Initial rhs = 1.290170413 MLMG: Initial residual (resid0) = 1.290170413 MLMG: Final Iter. 3 resid, resid/bnorm = 2.648992137e-13, 2.053211041e-13 MLMG: Timers: Solve = 0.008332085 Iter = 0.007646032 Bottom = 0.007277723 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.07856558092 MLMG: Initial rhs = 0.07856558092 MLMG: Initial residual (resid0) = 0.07856558092 MLMG: Final Iter. 3 resid, resid/bnorm = 2.69326228e-13, 3.428043487e-12 MLMG: Timers: Solve = 0.004624458 Iter = 0.004136784 Bottom = 0.003834414 >> After projection: * On lev 0 max(abs(rhs)) = 0.03449786837 In initial_iterations: iter = 1 MAC Projection: MLMG: Initial rhs = 1.297401151 MLMG: Initial residual (resid0) = 1.297401151 MLMG: Final Iter. 3 resid, resid/bnorm = 7.041034422e-13, 5.427029579e-13 MLMG: Timers: Solve = 0.007815764 Iter = 0.007567582 Bottom = 0.00720238 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.03561001467 MLMG: Initial rhs = 0.03561001467 MLMG: Initial residual (resid0) = 0.03561001467 MLMG: Final Iter. 3 resid, resid/bnorm = 6.133982211e-15, 1.722544141e-13 MLMG: Timers: Solve = 0.004840879 Iter = 0.00436936 Bottom = 0.004032451 >> After projection: * On lev 0 max(abs(rhs)) = 0.01647872459 Writing checkpoint tracer_adv_diff_cn_chk00000 Writing plotfile tracer_adv_diff_cn_plt00000 at time 0 Level 0 1 grids 1125 cells 100 % of domain ============ NEW TIME STEP ============ Step 1: from old_time 0 to new time 0.002978909251 with dt = 0.002978909251. MAC Projection: MLMG: Initial rhs = 1.302344167 MLMG: Initial residual (resid0) = 1.302344167 MLMG: Final Iter. 3 resid, resid/bnorm = 1.345867862e-12, 1.033419503e-12 MLMG: Timers: Solve = 0.007656978 Iter = 0.007408983 Bottom = 0.007045437 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.5108751487 MLMG: Initial rhs = 0.5108751487 MLMG: Initial residual (resid0) = 0.5108751487 MLMG: Final Iter. 3 resid, resid/bnorm = 1.039723863e-13, 2.035181913e-13 MLMG: Timers: Solve = 0.004870527 Iter = 0.00432538 Bottom = 0.004022734 >> After projection: * On lev 0 max(abs(rhs)) = 0.1349060665 Sum tracer volume wgt = 0.002978909251 1.257421091 Time per step 0.032095382 ============ NEW TIME STEP ============ Step 2: from old_time 0.002978909251 to new time 0.006255709428 with dt = 0.003276800176. MAC Projection: MLMG: Initial rhs = 1.977363317 MLMG: Initial residual (resid0) = 1.977363317 MLMG: Final Iter. 3 resid, resid/bnorm = 1.305622277e-13, 6.602844637e-14 MLMG: Timers: Solve = 0.007770225 Iter = 0.007523916 Bottom = 0.007161196 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1689293101 MLMG: Initial rhs = 0.1689293101 MLMG: Initial residual (resid0) = 0.1689293101 MLMG: Final Iter. 3 resid, resid/bnorm = 4.322792124e-13, 2.558935522e-12 MLMG: Timers: Solve = 0.004576787 Iter = 0.004106224 Bottom = 0.003788624 >> After projection: * On lev 0 max(abs(rhs)) = 0.06650527097 Sum tracer volume wgt = 0.006255709428 1.257794602 Time per step 0.030894295 ============ NEW TIME STEP ============ Step 3: from old_time 0.006255709428 to new time 0.009860189622 with dt = 0.003604480194. MAC Projection: MLMG: Initial rhs = 1.81642647 MLMG: Initial residual (resid0) = 1.81642647 MLMG: Final Iter. 3 resid, resid/bnorm = 9.325595851e-13, 5.134034327e-13 MLMG: Timers: Solve = 0.007764799 Iter = 0.007521655 Bottom = 0.007159234 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1479891147 MLMG: Initial rhs = 0.1479891147 MLMG: Initial residual (resid0) = 0.1479891147 MLMG: Final Iter. 4 resid, resid/bnorm = 5.551115123e-17, 3.751029348e-16 MLMG: Timers: Solve = 0.006014638 Iter = 0.005485252 Bottom = 0.005088735 >> After projection: * On lev 0 max(abs(rhs)) = 0.065544134 Sum tracer volume wgt = 0.009860189622 1.258162434 Time per step 0.032340815 ============ NEW TIME STEP ============ Step 4: from old_time 0.009860189622 to new time 0.01382511784 with dt = 0.003964928213. MAC Projection: MLMG: Initial rhs = 1.598863752 MLMG: Initial residual (resid0) = 1.598863752 MLMG: Final Iter. 3 resid, resid/bnorm = 2.091660178e-13, 1.308216648e-13 MLMG: Timers: Solve = 0.008076915 Iter = 0.007833426 Bottom = 0.007483637 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1407154109 MLMG: Initial rhs = 0.1407154109 MLMG: Initial residual (resid0) = 0.1407154109 MLMG: Final Iter. 3 resid, resid/bnorm = 5.587058594e-13, 3.970466744e-12 MLMG: Timers: Solve = 0.004616088 Iter = 0.004118498 Bottom = 0.003829302 >> After projection: * On lev 0 max(abs(rhs)) = 0.06723414489 Sum tracer volume wgt = 0.01382511784 1.258526581 Time per step 0.031508126 ============ NEW TIME STEP ============ Step 5: from old_time 0.01382511784 to new time 0.01818653887 with dt = 0.004361421035. MAC Projection: MLMG: Initial rhs = 1.364677503 MLMG: Initial residual (resid0) = 1.364677503 MLMG: Final Iter. 3 resid, resid/bnorm = 9.922895838e-13, 7.271238675e-13 MLMG: Timers: Solve = 0.007953523 Iter = 0.007719465 Bottom = 0.007372579 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1345098419 MLMG: Initial rhs = 0.1345098419 MLMG: Initial residual (resid0) = 0.1345098419 MLMG: Final Iter. 3 resid, resid/bnorm = 4.332992298e-13, 3.221319895e-12 MLMG: Timers: Solve = 0.004390234 Iter = 0.003909883 Bottom = 0.003612333 >> After projection: * On lev 0 max(abs(rhs)) = 0.06776130438 Sum tracer volume wgt = 0.01818653887 1.258884935 Time per step 0.0309679 ============ NEW TIME STEP ============ Step 6: from old_time 0.01818653887 to new time 0.02298410201 with dt = 0.004797563138. MAC Projection: MLMG: Initial rhs = 1.146996614 MLMG: Initial residual (resid0) = 1.146996614 MLMG: Final Iter. 3 resid, resid/bnorm = 1.032368635e-13, 9.000624954e-14 MLMG: Timers: Solve = 0.007415358 Iter = 0.007197305 Bottom = 0.006878017 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1302241621 MLMG: Initial rhs = 0.1302241621 MLMG: Initial residual (resid0) = 0.1302241621 MLMG: Final Iter. 3 resid, resid/bnorm = 4.946043575e-14, 3.798099749e-13 MLMG: Timers: Solve = 0.004522827 Iter = 0.003997198 Bottom = 0.003725784 >> After projection: * On lev 0 max(abs(rhs)) = 0.06933923632 Sum tracer volume wgt = 0.02298410201 1.259239314 Time per step 0.029042756 ============ NEW TIME STEP ============ Step 7: from old_time 0.02298410201 to new time 0.02826142146 with dt = 0.005277319452. MAC Projection: MLMG: Initial rhs = 1.101931247 MLMG: Initial residual (resid0) = 1.101931247 MLMG: Final Iter. 3 resid, resid/bnorm = 3.874678356e-14, 3.516261443e-14 MLMG: Timers: Solve = 0.00737785 Iter = 0.007160289 Bottom = 0.006836756 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1247660479 MLMG: Initial rhs = 0.1247660479 MLMG: Initial residual (resid0) = 0.1247660479 MLMG: Final Iter. 3 resid, resid/bnorm = 1.100300406e-13, 8.818908867e-13 MLMG: Timers: Solve = 0.004181196 Iter = 0.00374093 Bottom = 0.003460523 >> After projection: * On lev 0 max(abs(rhs)) = 0.06976688893 Sum tracer volume wgt = 0.02826142146 1.259597738 Time per step 0.028650359 ============ NEW TIME STEP ============ Step 8: from old_time 0.02826142146 to new time 0.03406647286 with dt = 0.005805051397. MAC Projection: MLMG: Initial rhs = 1.137162249 MLMG: Initial residual (resid0) = 1.137162249 MLMG: Final Iter. 3 resid, resid/bnorm = 4.728439862e-13, 4.158104848e-13 MLMG: Timers: Solve = 0.006941737 Iter = 0.006723432 Bottom = 0.00640268 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1170033188 MLMG: Initial rhs = 0.1170033188 MLMG: Initial residual (resid0) = 0.1170033188 MLMG: Final Iter. 3 resid, resid/bnorm = 4.465872117e-13, 3.816876446e-12 MLMG: Timers: Solve = 0.004158833 Iter = 0.003725972 Bottom = 0.003447906 >> After projection: * On lev 0 max(abs(rhs)) = 0.06993305665 Sum tracer volume wgt = 0.03406647286 1.25996062 Time per step 0.027996741 ============ NEW TIME STEP ============ Step 9: from old_time 0.03406647286 to new time 0.04045202939 with dt = 0.006385556537. MAC Projection: MLMG: Initial rhs = 1.169798487 MLMG: Initial residual (resid0) = 1.169798487 MLMG: Final Iter. 3 resid, resid/bnorm = 4.996003611e-14, 4.270824133e-14 MLMG: Timers: Solve = 0.006861115 Iter = 0.006633984 Bottom = 0.006299291 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1130781347 MLMG: Initial rhs = 0.1130781347 MLMG: Initial residual (resid0) = 0.1130781347 MLMG: Final Iter. 3 resid, resid/bnorm = 5.161149286e-14, 4.564232775e-13 MLMG: Timers: Solve = 0.004488384 Iter = 0.00397582 Bottom = 0.003688047 >> After projection: * On lev 0 max(abs(rhs)) = 0.06942829172 Sum tracer volume wgt = 0.04045202939 1.260329525 Time per step 0.028491831 ============ NEW TIME STEP ============ Step 10: from old_time 0.04045202939 to new time 0.04747614159 with dt = 0.007024112191. MAC Projection: MLMG: Initial rhs = 1.199083705 MLMG: Initial residual (resid0) = 1.199083705 MLMG: Final Iter. 3 resid, resid/bnorm = 2.347011474e-13, 1.957337478e-13 MLMG: Timers: Solve = 0.007177882 Iter = 0.006951148 Bottom = 0.006614125 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1157115259 MLMG: Initial rhs = 0.1157115259 MLMG: Initial residual (resid0) = 0.1157115259 MLMG: Final Iter. 3 resid, resid/bnorm = 5.758588051e-14, 4.976676269e-13 MLMG: Timers: Solve = 0.004248508 Iter = 0.00382019 Bottom = 0.003551698 >> After projection: * On lev 0 max(abs(rhs)) = 0.06994389923 Sum tracer volume wgt = 0.04747614159 1.260699763 Time per step 0.029126313 Writing plotfile tracer_adv_diff_cn_plt00010 at time 0.04747614159 Writing checkpoint tracer_adv_diff_cn_chk00010 Time spent in InitData(): 0.107089694 Time spent in Evolve(): 0.313397877 Unused ParmParse Variables: [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [6689 ... 6689] [The Arena] max space (MB) allocated spread across MPI: [25 ... 25] [The Arena] max space (MB) used spread across MPI: [21 ... 21] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Pinned Arena] max space (MB) used spread across MPI: [0 ... 0] AMReX (26.09-166-g29e408043123) finalized