Initializing AMReX (26.09-173-ga0da80d18121)... MPI initialized with 1 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.09-173-ga0da80d18121) initialized incflo git hash: 24.11-55-g878827de Scalar diffusion coefficients Tracer diffusion coeff: 0:0.1 Tracer diffusion coeff: 1:0.1 Newtonian fluid with mu = 0.001 incflo.geometry_filename: Building cylinder geometry. Internal Flow: 1 Radius: 0.49 Direction: 0 Rotation angle(rad): 0 Rotation axe: 0 Center: 0.5, 1.5, 1.5 Done making the EB geometry index space. ylo set to no-slip wall. yhi set to no-slip wall. zlo set to no-slip wall. zhi set to no-slip wall. Making new level 0 from scratch Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 4.62842735 MLMG: Initial rhs = 4.62842735 MLMG: Initial residual (resid0) = 4.62842735 MLMG: Final Iter. 3 resid, resid/bnorm = 3.420180805e-12, 7.389509539e-13 MLMG: Timers: Solve = 0.006599835 Iter = 0.004671779 Bottom = 0.004293047 >> After projection: * On lev 0 max(abs(rhs)) = 0.4996273493 Doing initial pressure iterations with dt = 0.006119268311 In initial_iterations: iter = 0 MAC Projection: MLMG: Initial rhs = 1.290170413 MLMG: Initial residual (resid0) = 1.290170413 MLMG: Final Iter. 3 resid, resid/bnorm = 2.648992137e-13, 2.053211041e-13 MLMG: Timers: Solve = 0.008250282 Iter = 0.007547164 Bottom = 0.007178021 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.07856558092 MLMG: Initial rhs = 0.07856558092 MLMG: Initial residual (resid0) = 0.07856558092 MLMG: Final Iter. 3 resid, resid/bnorm = 2.69326228e-13, 3.428043487e-12 MLMG: Timers: Solve = 0.004607412 Iter = 0.004138856 Bottom = 0.003820168 >> After projection: * On lev 0 max(abs(rhs)) = 0.03449786837 In initial_iterations: iter = 1 MAC Projection: MLMG: Initial rhs = 1.297401151 MLMG: Initial residual (resid0) = 1.297401151 MLMG: Final Iter. 3 resid, resid/bnorm = 7.041034422e-13, 5.427029579e-13 MLMG: Timers: Solve = 0.007770763 Iter = 0.007512633 Bottom = 0.007150177 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.03561001467 MLMG: Initial rhs = 0.03561001467 MLMG: Initial residual (resid0) = 0.03561001467 MLMG: Final Iter. 3 resid, resid/bnorm = 6.133982211e-15, 1.722544141e-13 MLMG: Timers: Solve = 0.004801317 Iter = 0.004335477 Bottom = 0.004040886 >> After projection: * On lev 0 max(abs(rhs)) = 0.01647872459 Writing checkpoint tracer_adv_diff_cn_chk00000 Writing plotfile tracer_adv_diff_cn_plt00000 at time 0 Level 0 1 grids 1125 cells 100 % of domain ============ NEW TIME STEP ============ Step 1: from old_time 0 to new time 0.002978909251 with dt = 0.002978909251. MAC Projection: MLMG: Initial rhs = 1.302344167 MLMG: Initial residual (resid0) = 1.302344167 MLMG: Final Iter. 3 resid, resid/bnorm = 1.345867862e-12, 1.033419503e-12 MLMG: Timers: Solve = 0.007880143 Iter = 0.007574207 Bottom = 0.007205833 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.5108751487 MLMG: Initial rhs = 0.5108751487 MLMG: Initial residual (resid0) = 0.5108751487 MLMG: Final Iter. 3 resid, resid/bnorm = 1.039723863e-13, 2.035181913e-13 MLMG: Timers: Solve = 0.004805154 Iter = 0.004317777 Bottom = 0.004018091 >> After projection: * On lev 0 max(abs(rhs)) = 0.1349060665 Sum tracer volume wgt = 0.002978909251 1.257421091 Time per step 0.032005765 ============ NEW TIME STEP ============ Step 2: from old_time 0.002978909251 to new time 0.006255709428 with dt = 0.003276800176. MAC Projection: MLMG: Initial rhs = 1.977363317 MLMG: Initial residual (resid0) = 1.977363317 MLMG: Final Iter. 3 resid, resid/bnorm = 1.305622277e-13, 6.602844637e-14 MLMG: Timers: Solve = 0.007710654 Iter = 0.007470477 Bottom = 0.007102969 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1689293101 MLMG: Initial rhs = 0.1689293101 MLMG: Initial residual (resid0) = 0.1689293101 MLMG: Final Iter. 3 resid, resid/bnorm = 4.322792124e-13, 2.558935522e-12 MLMG: Timers: Solve = 0.004491729 Iter = 0.004022002 Bottom = 0.003730048 >> After projection: * On lev 0 max(abs(rhs)) = 0.06650527097 Sum tracer volume wgt = 0.006255709428 1.257794602 Time per step 0.030654691 ============ NEW TIME STEP ============ Step 3: from old_time 0.006255709428 to new time 0.009860189622 with dt = 0.003604480194. MAC Projection: MLMG: Initial rhs = 1.81642647 MLMG: Initial residual (resid0) = 1.81642647 MLMG: Final Iter. 3 resid, resid/bnorm = 9.325595851e-13, 5.134034327e-13 MLMG: Timers: Solve = 0.007704122 Iter = 0.007459563 Bottom = 0.007101501 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1479891147 MLMG: Initial rhs = 0.1479891147 MLMG: Initial residual (resid0) = 0.1479891147 MLMG: Final Iter. 4 resid, resid/bnorm = 5.551115123e-17, 3.751029348e-16 MLMG: Timers: Solve = 0.00587086 Iter = 0.005374398 Bottom = 0.004981192 >> After projection: * On lev 0 max(abs(rhs)) = 0.065544134 Sum tracer volume wgt = 0.009860189622 1.258162434 Time per step 0.032080753 ============ NEW TIME STEP ============ Step 4: from old_time 0.009860189622 to new time 0.01382511784 with dt = 0.003964928213. MAC Projection: MLMG: Initial rhs = 1.598863752 MLMG: Initial residual (resid0) = 1.598863752 MLMG: Final Iter. 3 resid, resid/bnorm = 2.091660178e-13, 1.308216648e-13 MLMG: Timers: Solve = 0.007605826 Iter = 0.007362026 Bottom = 0.007023043 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1407154109 MLMG: Initial rhs = 0.1407154109 MLMG: Initial residual (resid0) = 0.1407154109 MLMG: Final Iter. 3 resid, resid/bnorm = 5.587058594e-13, 3.970466744e-12 MLMG: Timers: Solve = 0.004343972 Iter = 0.003900329 Bottom = 0.003623276 >> After projection: * On lev 0 max(abs(rhs)) = 0.06723414489 Sum tracer volume wgt = 0.01382511784 1.258526581 Time per step 0.029519583 ============ NEW TIME STEP ============ Step 5: from old_time 0.01382511784 to new time 0.01818653887 with dt = 0.004361421035. MAC Projection: MLMG: Initial rhs = 1.364677503 MLMG: Initial residual (resid0) = 1.364677503 MLMG: Final Iter. 3 resid, resid/bnorm = 9.922895838e-13, 7.271238675e-13 MLMG: Timers: Solve = 0.007467862 Iter = 0.007247562 Bottom = 0.006913888 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1345098419 MLMG: Initial rhs = 0.1345098419 MLMG: Initial residual (resid0) = 0.1345098419 MLMG: Final Iter. 3 resid, resid/bnorm = 4.332992298e-13, 3.221319895e-12 MLMG: Timers: Solve = 0.0041714 Iter = 0.003727406 Bottom = 0.003451298 >> After projection: * On lev 0 max(abs(rhs)) = 0.06776130438 Sum tracer volume wgt = 0.01818653887 1.258884935 Time per step 0.029187497 ============ NEW TIME STEP ============ Step 6: from old_time 0.01818653887 to new time 0.02298410201 with dt = 0.004797563138. MAC Projection: MLMG: Initial rhs = 1.146996614 MLMG: Initial residual (resid0) = 1.146996614 MLMG: Final Iter. 3 resid, resid/bnorm = 1.032368635e-13, 9.000624954e-14 MLMG: Timers: Solve = 0.007566523 Iter = 0.007333948 Bottom = 0.007003996 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1302241621 MLMG: Initial rhs = 0.1302241621 MLMG: Initial residual (resid0) = 0.1302241621 MLMG: Final Iter. 3 resid, resid/bnorm = 4.946043575e-14, 3.798099749e-13 MLMG: Timers: Solve = 0.004404588 Iter = 0.003970182 Bottom = 0.003696948 >> After projection: * On lev 0 max(abs(rhs)) = 0.06933923632 Sum tracer volume wgt = 0.02298410201 1.259239314 Time per step 0.02902618 ============ NEW TIME STEP ============ Step 7: from old_time 0.02298410201 to new time 0.02826142146 with dt = 0.005277319452. MAC Projection: MLMG: Initial rhs = 1.101931247 MLMG: Initial residual (resid0) = 1.101931247 MLMG: Final Iter. 3 resid, resid/bnorm = 3.874678356e-14, 3.516261443e-14 MLMG: Timers: Solve = 0.007537615 Iter = 0.007316866 Bottom = 0.006983018 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1247660479 MLMG: Initial rhs = 0.1247660479 MLMG: Initial residual (resid0) = 0.1247660479 MLMG: Final Iter. 3 resid, resid/bnorm = 1.100300406e-13, 8.818908867e-13 MLMG: Timers: Solve = 0.004238417 Iter = 0.003803039 Bottom = 0.003522531 >> After projection: * On lev 0 max(abs(rhs)) = 0.06976688893 Sum tracer volume wgt = 0.02826142146 1.259597738 Time per step 0.029291188 ============ NEW TIME STEP ============ Step 8: from old_time 0.02826142146 to new time 0.03406647286 with dt = 0.005805051397. MAC Projection: MLMG: Initial rhs = 1.137162249 MLMG: Initial residual (resid0) = 1.137162249 MLMG: Final Iter. 3 resid, resid/bnorm = 4.728439862e-13, 4.158104848e-13 MLMG: Timers: Solve = 0.007059651 Iter = 0.0068397 Bottom = 0.006513827 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1170033188 MLMG: Initial rhs = 0.1170033188 MLMG: Initial residual (resid0) = 0.1170033188 MLMG: Final Iter. 3 resid, resid/bnorm = 4.465872117e-13, 3.816876446e-12 MLMG: Timers: Solve = 0.004274015 Iter = 0.003831855 Bottom = 0.003553733 >> After projection: * On lev 0 max(abs(rhs)) = 0.06993305665 Sum tracer volume wgt = 0.03406647286 1.25996062 Time per step 0.028974011 ============ NEW TIME STEP ============ Step 9: from old_time 0.03406647286 to new time 0.04045202939 with dt = 0.006385556537. MAC Projection: MLMG: Initial rhs = 1.169798487 MLMG: Initial residual (resid0) = 1.169798487 MLMG: Final Iter. 3 resid, resid/bnorm = 4.996003611e-14, 4.270824133e-14 MLMG: Timers: Solve = 0.006968128 Iter = 0.006721012 Bottom = 0.006394949 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1130781347 MLMG: Initial rhs = 0.1130781347 MLMG: Initial residual (resid0) = 0.1130781347 MLMG: Final Iter. 3 resid, resid/bnorm = 5.161149286e-14, 4.564232775e-13 MLMG: Timers: Solve = 0.004412314 Iter = 0.003969502 Bottom = 0.003693996 >> After projection: * On lev 0 max(abs(rhs)) = 0.06942829172 Sum tracer volume wgt = 0.04045202939 1.260329525 Time per step 0.02869805 ============ NEW TIME STEP ============ Step 10: from old_time 0.04045202939 to new time 0.04747614159 with dt = 0.007024112191. MAC Projection: MLMG: Initial rhs = 1.199083705 MLMG: Initial residual (resid0) = 1.199083705 MLMG: Final Iter. 3 resid, resid/bnorm = 2.347011474e-13, 1.957337478e-13 MLMG: Timers: Solve = 0.007219042 Iter = 0.006965598 Bottom = 0.006639628 REDISTRIBUTION TYPE StateRedist Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 0.1157115259 MLMG: Initial rhs = 0.1157115259 MLMG: Initial residual (resid0) = 0.1157115259 MLMG: Final Iter. 3 resid, resid/bnorm = 5.758588051e-14, 4.976676269e-13 MLMG: Timers: Solve = 0.004397164 Iter = 0.003944279 Bottom = 0.003669654 >> After projection: * On lev 0 max(abs(rhs)) = 0.06994389923 Sum tracer volume wgt = 0.04747614159 1.260699763 Time per step 0.02916294 Writing plotfile tracer_adv_diff_cn_plt00010 at time 0.04747614159 Writing checkpoint tracer_adv_diff_cn_chk00010 Time spent in InitData(): 0.113781998 Time spent in Evolve(): 0.311118069 Unused ParmParse Variables: [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [6689 ... 6689] [The Arena] max space (MB) allocated spread across MPI: [25 ... 25] [The Arena] max space (MB) used spread across MPI: [21 ... 21] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Pinned Arena] max space (MB) used spread across MPI: [0 ... 0] AMReX (26.09-173-ga0da80d18121) finalized