Initializing AMReX (26.09-136-g53fb957f5e13)... MPI initialized with 1 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.09-136-g53fb957f5e13) initialized incflo git hash: 24.11-52-g37c2cc1c Scalar diffusion coefficients Tracer diffusion coeff: 0:0.1 Tracer diffusion coeff: 1:0.1 Newtonian fluid with mu = 0.001 incflo.geometry_filename: Building cylinder geometry. Internal Flow: 1 Radius: 0.49 Direction: 0 Rotation angle(rad): 0 Rotation axe: 0 Center: 0.5, 1.5, 1.5 Done making the EB geometry index space. ylo set to no-slip wall. yhi set to no-slip wall. zlo set to no-slip wall. zhi set to no-slip wall. Making new level 0 from scratch Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 4.62842735 MLMG: Initial rhs = 4.62842735 MLMG: Initial residual (resid0) = 4.62842735 MLMG: Final Iter. 3 resid, resid/bnorm = 3.420180805e-12, 7.389509539e-13 MLMG: Timers: Solve = 0.006709425 Iter = 0.004771066 Bottom = 0.004336916 >> After projection: * On lev 0 max(abs(rhs)) = 0.4996273493 Doing initial pressure iterations with dt = 0.006119268311 In initial_iterations: iter = 0 MAC Projection: MLMG: Initial rhs = 1.290170413 MLMG: Initial residual (resid0) = 1.290170413 MLMG: Final Iter. 3 resid, resid/bnorm = 2.648992137e-13, 2.053211041e-13 MLMG: Timers: Solve = 0.008325841 Iter = 0.007648108 Bottom = 0.007275799 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.07856558092 MLMG: Initial rhs = 0.07856558092 MLMG: Initial residual (resid0) = 0.07856558092 MLMG: Final Iter. 3 resid, resid/bnorm = 2.69326228e-13, 3.428043487e-12 MLMG: Timers: Solve = 0.004635113 Iter = 0.004164442 Bottom = 0.003871409 >> After projection: * On lev 0 max(abs(rhs)) = 0.03449786837 In initial_iterations: iter = 1 MAC Projection: MLMG: Initial rhs = 1.297401151 MLMG: Initial residual (resid0) = 1.297401151 MLMG: Final Iter. 3 resid, resid/bnorm = 7.041034422e-13, 5.427029579e-13 MLMG: Timers: Solve = 0.007808323 Iter = 0.00756365 Bottom = 0.007198143 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.03561001467 MLMG: Initial rhs = 0.03561001467 MLMG: Initial residual (resid0) = 0.03561001467 MLMG: Final Iter. 3 resid, resid/bnorm = 6.133982211e-15, 1.722544141e-13 MLMG: Timers: Solve = 0.004815066 Iter = 0.004318151 Bottom = 0.004027719 >> After projection: * On lev 0 max(abs(rhs)) = 0.01647872459 Writing checkpoint tracer_adv_diff_cn_chk00000 Writing plotfile tracer_adv_diff_cn_plt00000 at time 0 Level 0 1 grids 1125 cells 100 % of domain ============ NEW TIME STEP ============ Step 1: from old_time 0 to new time 0.002978909251 with dt = 0.002978909251. MAC Projection: MLMG: Initial rhs = 1.302344167 MLMG: Initial residual (resid0) = 1.302344167 MLMG: Final Iter. 3 resid, resid/bnorm = 1.345867862e-12, 1.033419503e-12 MLMG: Timers: Solve = 0.007775676 Iter = 0.007522451 Bottom = 0.00716066 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.5108751487 MLMG: Initial rhs = 0.5108751487 MLMG: Initial residual (resid0) = 0.5108751487 MLMG: Final Iter. 3 resid, resid/bnorm = 1.039723863e-13, 2.035181913e-13 MLMG: Timers: Solve = 0.004859447 Iter = 0.004370053 Bottom = 0.004079194 >> After projection: * On lev 0 max(abs(rhs)) = 0.1349060665 Sum tracer volume wgt = 0.002978909251 1.257421091 Time per step 0.03188031 ============ NEW TIME STEP ============ Step 2: from old_time 0.002978909251 to new time 0.006255709428 with dt = 0.003276800176. MAC Projection: MLMG: Initial rhs = 1.977363317 MLMG: Initial residual (resid0) = 1.977363317 MLMG: Final Iter. 3 resid, resid/bnorm = 1.305622277e-13, 6.602844637e-14 MLMG: Timers: Solve = 0.007795518 Iter = 0.007559625 Bottom = 0.007208117 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1689293101 MLMG: Initial rhs = 0.1689293101 MLMG: Initial residual (resid0) = 0.1689293101 MLMG: Final Iter. 3 resid, resid/bnorm = 4.322792124e-13, 2.558935522e-12 MLMG: Timers: Solve = 0.004539367 Iter = 0.004047198 Bottom = 0.003757633 >> After projection: * On lev 0 max(abs(rhs)) = 0.06650527097 Sum tracer volume wgt = 0.006255709428 1.257794602 Time per step 0.030613166 ============ NEW TIME STEP ============ Step 3: from old_time 0.006255709428 to new time 0.009860189622 with dt = 0.003604480194. MAC Projection: MLMG: Initial rhs = 1.81642647 MLMG: Initial residual (resid0) = 1.81642647 MLMG: Final Iter. 3 resid, resid/bnorm = 9.325595851e-13, 5.134034327e-13 MLMG: Timers: Solve = 0.007763296 Iter = 0.007528882 Bottom = 0.007175005 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1479891147 MLMG: Initial rhs = 0.1479891147 MLMG: Initial residual (resid0) = 0.1479891147 MLMG: Final Iter. 4 resid, resid/bnorm = 5.551115123e-17, 3.751029348e-16 MLMG: Timers: Solve = 0.005608492 Iter = 0.005166551 Bottom = 0.004802474 >> After projection: * On lev 0 max(abs(rhs)) = 0.065544134 Sum tracer volume wgt = 0.009860189622 1.258162434 Time per step 0.030896419 ============ NEW TIME STEP ============ Step 4: from old_time 0.009860189622 to new time 0.01382511784 with dt = 0.003964928213. MAC Projection: MLMG: Initial rhs = 1.598863752 MLMG: Initial residual (resid0) = 1.598863752 MLMG: Final Iter. 3 resid, resid/bnorm = 2.091660178e-13, 1.308216648e-13 MLMG: Timers: Solve = 0.007802719 Iter = 0.007547065 Bottom = 0.007205022 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1407154109 MLMG: Initial rhs = 0.1407154109 MLMG: Initial residual (resid0) = 0.1407154109 MLMG: Final Iter. 3 resid, resid/bnorm = 5.587058594e-13, 3.970466744e-12 MLMG: Timers: Solve = 0.004383976 Iter = 0.00393776 Bottom = 0.003662344 >> After projection: * On lev 0 max(abs(rhs)) = 0.06723414489 Sum tracer volume wgt = 0.01382511784 1.258526581 Time per step 0.029654793 ============ NEW TIME STEP ============ Step 5: from old_time 0.01382511784 to new time 0.01818653887 with dt = 0.004361421035. MAC Projection: MLMG: Initial rhs = 1.364677503 MLMG: Initial residual (resid0) = 1.364677503 MLMG: Final Iter. 3 resid, resid/bnorm = 9.922895838e-13, 7.271238675e-13 MLMG: Timers: Solve = 0.007535273 Iter = 0.007310701 Bottom = 0.00697728 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1345098419 MLMG: Initial rhs = 0.1345098419 MLMG: Initial residual (resid0) = 0.1345098419 MLMG: Final Iter. 3 resid, resid/bnorm = 4.332992298e-13, 3.221319895e-12 MLMG: Timers: Solve = 0.004224064 Iter = 0.003776508 Bottom = 0.003501476 >> After projection: * On lev 0 max(abs(rhs)) = 0.06776130438 Sum tracer volume wgt = 0.01818653887 1.258884935 Time per step 0.028985865 ============ NEW TIME STEP ============ Step 6: from old_time 0.01818653887 to new time 0.02298410201 with dt = 0.004797563138. MAC Projection: MLMG: Initial rhs = 1.146996614 MLMG: Initial residual (resid0) = 1.146996614 MLMG: Final Iter. 3 resid, resid/bnorm = 1.032368635e-13, 9.000624954e-14 MLMG: Timers: Solve = 0.007768587 Iter = 0.007491138 Bottom = 0.007146257 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1302241621 MLMG: Initial rhs = 0.1302241621 MLMG: Initial residual (resid0) = 0.1302241621 MLMG: Final Iter. 3 resid, resid/bnorm = 4.946043575e-14, 3.798099749e-13 MLMG: Timers: Solve = 0.004494091 Iter = 0.004050738 Bottom = 0.003774192 >> After projection: * On lev 0 max(abs(rhs)) = 0.06933923632 Sum tracer volume wgt = 0.02298410201 1.259239314 Time per step 0.029655422 ============ NEW TIME STEP ============ Step 7: from old_time 0.02298410201 to new time 0.02826142146 with dt = 0.005277319452. MAC Projection: MLMG: Initial rhs = 1.101931247 MLMG: Initial residual (resid0) = 1.101931247 MLMG: Final Iter. 3 resid, resid/bnorm = 3.874678356e-14, 3.516261443e-14 MLMG: Timers: Solve = 0.007658303 Iter = 0.007433985 Bottom = 0.007102154 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1247660479 MLMG: Initial rhs = 0.1247660479 MLMG: Initial residual (resid0) = 0.1247660479 MLMG: Final Iter. 3 resid, resid/bnorm = 1.100300406e-13, 8.818908867e-13 MLMG: Timers: Solve = 0.004315168 Iter = 0.003845035 Bottom = 0.003570267 >> After projection: * On lev 0 max(abs(rhs)) = 0.06976688893 Sum tracer volume wgt = 0.02826142146 1.259597738 Time per step 0.02946562 ============ NEW TIME STEP ============ Step 8: from old_time 0.02826142146 to new time 0.03406647286 with dt = 0.005805051397. MAC Projection: MLMG: Initial rhs = 1.137162249 MLMG: Initial residual (resid0) = 1.137162249 MLMG: Final Iter. 3 resid, resid/bnorm = 4.728439862e-13, 4.158104848e-13 MLMG: Timers: Solve = 0.007219454 Iter = 0.006996356 Bottom = 0.006663373 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1170033188 MLMG: Initial rhs = 0.1170033188 MLMG: Initial residual (resid0) = 0.1170033188 MLMG: Final Iter. 3 resid, resid/bnorm = 4.465872117e-13, 3.816876446e-12 MLMG: Timers: Solve = 0.00429315 Iter = 0.003845986 Bottom = 0.003572229 >> After projection: * On lev 0 max(abs(rhs)) = 0.06993305665 Sum tracer volume wgt = 0.03406647286 1.25996062 Time per step 0.028787821 ============ NEW TIME STEP ============ Step 9: from old_time 0.03406647286 to new time 0.04045202939 with dt = 0.006385556537. MAC Projection: MLMG: Initial rhs = 1.169798487 MLMG: Initial residual (resid0) = 1.169798487 MLMG: Final Iter. 3 resid, resid/bnorm = 4.996003611e-14, 4.270824133e-14 MLMG: Timers: Solve = 0.007079914 Iter = 0.00685566 Bottom = 0.006524661 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1130781347 MLMG: Initial rhs = 0.1130781347 MLMG: Initial residual (resid0) = 0.1130781347 MLMG: Final Iter. 3 resid, resid/bnorm = 5.161149286e-14, 4.564232775e-13 MLMG: Timers: Solve = 0.004479231 Iter = 0.00401465 Bottom = 0.003737655 >> After projection: * On lev 0 max(abs(rhs)) = 0.06942829172 Sum tracer volume wgt = 0.04045202939 1.260329525 Time per step 0.029091548 ============ NEW TIME STEP ============ Step 10: from old_time 0.04045202939 to new time 0.04747614159 with dt = 0.007024112191. MAC Projection: MLMG: Initial rhs = 1.199083705 MLMG: Initial residual (resid0) = 1.199083705 MLMG: Final Iter. 3 resid, resid/bnorm = 2.347011474e-13, 1.957337478e-13 MLMG: Timers: Solve = 0.007265134 Iter = 0.00701501 Bottom = 0.006687409 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1157115259 MLMG: Initial rhs = 0.1157115259 MLMG: Initial residual (resid0) = 0.1157115259 MLMG: Final Iter. 3 resid, resid/bnorm = 5.758588051e-14, 4.976676269e-13 MLMG: Timers: Solve = 0.004305458 Iter = 0.003870746 Bottom = 0.003589395 >> After projection: * On lev 0 max(abs(rhs)) = 0.06994389923 Sum tracer volume wgt = 0.04747614159 1.260699763 Time per step 0.028621436 Writing plotfile tracer_adv_diff_cn_plt00010 at time 0.04747614159 Writing checkpoint tracer_adv_diff_cn_chk00010 Time spent in InitData(): 0.106962025 Time spent in Evolve(): 0.309996861 Unused ParmParse Variables: [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] [TOP]::cylinder.height(nvals = 1) :: [-1.0] Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [6689 ... 6689] [The Arena] max space (MB) allocated spread across MPI: [25 ... 25] [The Arena] max space (MB) used spread across MPI: [21 ... 21] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Pinned Arena] max space (MB) used spread across MPI: [0 ... 0] AMReX (26.09-136-g53fb957f5e13) finalized