Initializing AMReX (26.06-5-g65db2e4e678a)... MPI initialized with 4 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.06-5-g65db2e4e678a) initialized MFIX git describe: 26.06-5-g3b77775f31fc AMReX-Hydro git hash: 75da770ea36e4064b5947d7e56baa19f5bc92263 Number of levels: 1 RunType is Standard Auto-generating level-set parameters: eb_refinement = 1 levelset_pad = 2 eb_pad = 2 ================================================================================ Warning: Overwriting amr.plt_regtest with value from mfix.plt_regtest ================================================================================ ================================================================================ Warning: Overwriting amr.plot_int with value from mfix.plot_int ================================================================================ ================================================================================ Warning: Overwriting amr.plot_file with value from mfix.plot_file ================================================================================ ================================================================================ Warning: Overwriting amr.check_file with value from mfix.check_file ================================================================================ Simulation is transient -------------------------------------------------------------------------------- Info: Max effective viscosity factor not specified. Using default 1e+06 -------------------------------------------------------------------------------- Load balance setup: Type: DualGrid Strategy: KnapSack Weighting: ParticleCount Drag model: BVK2 Convection model not specified. Setting default: mfix.convection.model = RanzMarshall Building cylinder geometry. Internal Flow: 1 Radius: 0.0039 Height: -1 Direction: 0 Rotation angle: 0 Rotation axis: 0 Center: 0.004, 0.004, 0.004 Done making the fluid eb levels ... On level 0 updated BC areas: BC: 0 area: 4.776607274e-05 BC: 1 area: 4.776607274e-05 ================================================================================ Warning: Setting particle max grid size to fluid max grid size ================================================================================ In MakeBaseGrids: BA HAS 16 GRIDS Auto generating particles ... Total number of generated particles: 215,120 Time spent in initializing particles 0.814510231 **************************************** Coverage report: Grids Cells regular: 4 44960 covered: 0 12800 cut: 12 6240 **************************************** Bounding box for levelset imposed walls: Lo: 1e-15 -0.008 -0.008 Hi: 0.016 0.016 0.016 Clean up auto-generated particles. IC Region Generated Removed Remaining **************** **************** **************** **************** full-domain 0 0 0 bed 215,120 58,061 157,059 ---------------- ---------------- ---------------- ---------------- Total 215,120 58,061 157,059 **************** **************** **************** **************** Setting original sum_vol to 2.998926818e-07 Initial projection: Before projection: max(abs(u/v/w)) = 0.015 0 0 max(abs(gpx/gpy/gpz)) = 0 0 0 Min and Max of epf 0.2712117833 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 44.6112468 MLMG: Initial rhs = 22.3056234 MLMG: Initial residual (resid0) = 22.3056234 MLMG: Final Iter. 21 resid, resid/bnorm = 1.628481794e-10, 7.300767903e-12 MLMG: Timers: Solve = 0.406752094 Iter = 0.372604888 Bottom = 0.031316561 After projection: max(abs(u/v/w)) = 0.02199251829 0.001131161342 0.001189525564 Doing initial pressure iterations with dt = 0.0002 In initial_iterations: iter = 0 Before projection: max(abs(u/v/w)) = 0.01421158501 0.004882459188 0.004977002287 max(abs(gpx/gpy/gpz)) = 0 0 0 Min and Max of epf 0.2712117833 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 148.002174 MLMG: Initial rhs = 74.00108702 MLMG: Initial residual (resid0) = 74.00108702 MLMG: Final Iter. 21 resid, resid/bnorm = 4.100075279e-10, 5.540560881e-12 MLMG: Timers: Solve = 0.402487727 Iter = 0.374040401 Bottom = 0.031251787 After projection: max(abs(u/v/w)) = 0.02182750948 0.003257541671 0.00341417942 In initial_iterations: iter = 1 Before projection: max(abs(u/v/w)) = 0.0171546002 0.004848895969 0.004937791092 max(abs(gpx/gpy/gpz)) = 7.86389307 1.409047578 1.423944432 Min and Max of epf 0.2712117833 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 147.5196537 MLMG: Initial rhs = 73.75982686 MLMG: Initial residual (resid0) = 73.75982686 MLMG: Final Iter. 21 resid, resid/bnorm = 4.474678406e-10, 6.066552209e-12 MLMG: Timers: Solve = 0.4038606 Iter = 0.375158897 Bottom = 0.031675041 After projection: max(abs(u/v/w)) = 0.02177110344 0.003233518523 0.003393322353 In initial_iterations: iter = 2 Before projection: max(abs(u/v/w)) = 0.0177426968 0.00481581808 0.004898945493 max(abs(gpx/gpy/gpz)) = 15.69526012 2.807721902 2.836717293 Min and Max of epf 0.2712117833 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 147.038584 MLMG: Initial rhs = 73.519292 MLMG: Initial residual (resid0) = 73.519292 MLMG: Final Iter. 21 resid, resid/bnorm = 4.281713872e-10, 5.823932408e-12 MLMG: Timers: Solve = 0.404289732 Iter = 0.375674487 Bottom = 0.032164935 After projection: max(abs(u/v/w)) = 0.02178343022 0.00320998773 0.00337294207 Enclosed domain volume is 2.998926818e-07 Time spent in init 7.179006137 Writing plotfile BENCH05-Size0008_wide-Chemistry_plt00000 at time 0 Regridding at step 0 Updating particle ebfactory Regridding level-set on lev = 0 Also regridding refined level-set On level 0 updated BC areas: BC: 0 area: 4.776607274e-05 BC: 1 area: 4.776607274e-05 ============ NEW TIME STEP ============ Step 1: from old_time 0 to new time 1.807175125e-05 with dt = 1.807175125e-05 Before projection (with small dt modification): max(abs(u/v/w)) = 0.01505648444 0.005329910363 0.005403699662 max(abs(gpx/gpy/gpz)) = 23.46624449 4.196155297 4.238468346 Min and Max of epf 0.2712117833 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 182.2931522 MLMG: Initial rhs = 91.14657612 MLMG: Initial residual (resid0) = 91.14657612 MLMG: Final Iter. 21 resid, resid/bnorm = 4.844945556e-10, 5.315554091e-12 MLMG: Timers: Solve = 0.402618815 Iter = 0.373975918 Bottom = 0.031643428 After projection (with small dt modification): max(abs(u/v/w)) = 0.02278377928 0.003461130333 0.003571149442 Evolving particles on level: 0 ... with fluid dt 1.807175125e-05 done. Time per fluid step 1.644757842 Time per 38 particle steps 0.631389186 Coupling time per step 0.124148855 Time per step 2.523449491 Regridding at step 1 On level 0 updated BC areas: BC: 0 area: 4.776607274e-05 BC: 1 area: 4.776607274e-05 ============ NEW TIME STEP ============ Step 2: from old_time 1.807175125e-05 to new time 3.604330969e-05 with dt = 1.797155844e-05 Before projection: max(abs(u/v/w)) = 0.02683197833 0.008176814279 0.008205723778 max(abs(gpx/gpy/gpz)) = 107.9786094 16.82539024 16.88966325 Min and Max of epf 0.2712174507 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 318.5391155 MLMG: Initial rhs = 159.2695577 MLMG: Initial residual (resid0) = 159.2695577 MLMG: Final Iter. 21 resid, resid/bnorm = 8.173628441e-10, 5.131946466e-12 MLMG: Timers: Solve = 0.402646939 Iter = 0.373876858 Bottom = 0.031073834 After projection: max(abs(u/v/w)) = 0.02520309237 0.004360964199 0.004673968672 Evolving particles on level: 0 ... with fluid dt 1.797155844e-05 done. Time per fluid step 1.668179619 Time per 38 particle steps 0.579623193 Coupling time per step 0.121733318 Time per step 2.419120817 Regridding at step 2 On level 0 updated BC areas: BC: 0 area: 4.776607274e-05 BC: 1 area: 4.776607274e-05 ============ NEW TIME STEP ============ Step 3: from old_time 3.604330969e-05 to new time 5.391480952e-05 with dt = 1.787149982e-05 Before projection: max(abs(u/v/w)) = 0.047577514 0.009959406588 0.009923317863 max(abs(gpx/gpy/gpz)) = 192.3264757 24.73779616 24.75242563 Min and Max of epf 0.2712339692 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 452.0701138 MLMG: Initial rhs = 226.0350569 MLMG: Initial residual (resid0) = 226.0350569 MLMG: Final Iter. 21 resid, resid/bnorm = 1.125973648e-09, 4.98141157e-12 MLMG: Timers: Solve = 0.403070898 Iter = 0.374322767 Bottom = 0.031169904 After projection: max(abs(u/v/w)) = 0.02761727253 0.004754436146 0.005169830342 Evolving particles on level: 0 ... with fluid dt 1.787149982e-05 done. Time per fluid step 1.668033394 Time per 37 particle steps 0.567990977 Coupling time per step 0.121748041 Time per step 2.407387753 Regridding at step 3 On level 0 updated BC areas: BC: 0 area: 4.776607274e-05 BC: 1 area: 4.776607274e-05 ============ NEW TIME STEP ============ Step 4: from old_time 5.391480952e-05 to new time 7.168446886e-05 with dt = 1.776965934e-05 Before projection: max(abs(u/v/w)) = 0.06767685734 0.0112003651 0.01106395262 max(abs(gpx/gpy/gpz)) = 275.5914687 30.35199963 30.16238202 Min and Max of epf 0.2712610448 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 581.8119724 MLMG: Initial rhs = 290.9059862 MLMG: Initial residual (resid0) = 290.9059862 MLMG: Final Iter. 21 resid, resid/bnorm = 1.418187234e-09, 4.875070647e-12 MLMG: Timers: Solve = 0.403617334 Iter = 0.37483791 Bottom = 0.03166286 After projection: max(abs(u/v/w)) = 0.02998394916 0.004932315462 0.005390151975 Evolving particles on level: 0 ... with fluid dt 1.776965934e-05 done. Time per fluid step 1.670047133 Time per 37 particle steps 0.567961969 Coupling time per step 0.121865429 Time per step 2.40967026 Regridding at step 4 On level 0 updated BC areas: BC: 0 area: 4.776607274e-05 BC: 1 area: 4.776607274e-05 ============ NEW TIME STEP ============ Step 5: from old_time 7.168446886e-05 to new time 8.934981363e-05 with dt = 1.766534477e-05 Before projection: max(abs(u/v/w)) = 0.08721132193 0.01210817984 0.01185815599 max(abs(gpx/gpy/gpz)) = 357.8644136 34.50829179 34.06072698 Min and Max of epf 0.2712983842 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 707.7223889 MLMG: Initial rhs = 353.8611944 MLMG: Initial residual (resid0) = 353.8611944 MLMG: Final Iter. 21 resid, resid/bnorm = 1.689704821e-09, 4.775049785e-12 MLMG: Timers: Solve = 0.402722726 Iter = 0.374110734 Bottom = 0.031355873 After projection: max(abs(u/v/w)) = 0.03229966596 0.00542112622 0.006050648303 Evolving particles on level: 0 ... with fluid dt 1.766534477e-05 done. Time per fluid step 1.666209363 Time per 37 particle steps 0.56789087 Coupling time per step 0.121791475 Time per step 2.4051669 Regridding at step 5 On level 0 updated BC areas: BC: 0 area: 4.776607274e-05 BC: 1 area: 4.776607274e-05 ============ NEW TIME STEP ============ Step 6: from old_time 8.934981363e-05 to new time 0.0001069100894 with dt = 1.756027573e-05 Before projection: max(abs(u/v/w)) = 0.1062119692 0.012804629 0.01244131263 max(abs(gpx/gpy/gpz)) = 439.1464109 37.73144709 39.39367342 Min and Max of epf 0.2713456842 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 829.8057219 MLMG: Initial rhs = 414.902861 MLMG: Initial residual (resid0) = 414.902861 MLMG: Final Iter. 21 resid, resid/bnorm = 1.951766082e-09, 4.704151901e-12 MLMG: Timers: Solve = 0.402505199 Iter = 0.373902391 Bottom = 0.031251262 After projection: max(abs(u/v/w)) = 0.03456444953 0.005812253367 0.006537938619 Evolving particles on level: 0 ... with fluid dt 1.756027573e-05 done. Time per fluid step 1.663163332 Time per 37 particle steps 0.568070041 Coupling time per step 0.121515796 Time per step 2.402110947 Regridding at step 6 On level 0 updated BC areas: BC: 0 area: 4.776607274e-05 BC: 1 area: 4.776607274e-05 ============ NEW TIME STEP ============ Step 7: from old_time 0.0001069100894 to new time 0.0001243655039 with dt = 1.745541458e-05 Before projection: max(abs(u/v/w)) = 0.1247015721 0.01336594923 0.01289518241 max(abs(gpx/gpy/gpz)) = 519.4209155 45.73815078 48.15298553 Min and Max of epf 0.2714026399 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 947.9092872 MLMG: Initial rhs = 473.9546436 MLMG: Initial residual (resid0) = 473.9546436 MLMG: Final Iter. 21 resid, resid/bnorm = 2.181624659e-09, 4.603024125e-12 MLMG: Timers: Solve = 0.402151665 Iter = 0.37354354 Bottom = 0.031168151 After projection: max(abs(u/v/w)) = 0.03677890423 0.006111997682 0.006913788524 Evolving particles on level: 0 ... with fluid dt 1.745541458e-05 done. Time per fluid step 1.663734728 Time per 36 particle steps 0.556414181 Coupling time per step 0.121730084 Time per step 2.391049017 Regridding at step 7 On level 0 updated BC areas: BC: 0 area: 4.776607274e-05 BC: 1 area: 4.776607274e-05 ============ NEW TIME STEP ============ Step 8: from old_time 0.0001243655039 to new time 0.0001417169227 with dt = 1.735141875e-05 Before projection: max(abs(u/v/w)) = 0.1426955987 0.01384080962 0.01326956329 max(abs(gpx/gpy/gpz)) = 598.6668902 54.2878509 57.11421361 Min and Max of epf 0.2714689522 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1062.091607 MLMG: Initial rhs = 531.0458034 MLMG: Initial residual (resid0) = 531.0458034 MLMG: Final Iter. 21 resid, resid/bnorm = 2.3911646e-09, 4.502746438e-12 MLMG: Timers: Solve = 0.403650948 Iter = 0.375053058 Bottom = 0.031811933 After projection: max(abs(u/v/w)) = 0.03894398438 0.006346603767 0.007220170986 Evolving particles on level: 0 ... with fluid dt 1.735141875e-05 done. Time per fluid step 1.665482918 Time per 36 particle steps 0.55632958 Coupling time per step 0.121696964 Time per step 2.392749136 Regridding at step 8 On level 0 updated BC areas: BC: 0 area: 4.776607274e-05 BC: 1 area: 4.776607274e-05 ============ NEW TIME STEP ============ Step 9: from old_time 0.0001417169227 to new time 0.0001589656621 with dt = 1.724873944e-05 Before projection: max(abs(u/v/w)) = 0.1602084219 0.01426036682 0.01489108713 max(abs(gpx/gpy/gpz)) = 676.8660339 63.01725842 66.23639732 Min and Max of epf 0.2715443201 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1172.445058 MLMG: Initial rhs = 586.2225292 MLMG: Initial residual (resid0) = 586.2225292 MLMG: Final Iter. 21 resid, resid/bnorm = 2.676629515e-09, 4.565893295e-12 MLMG: Timers: Solve = 0.402915754 Iter = 0.374216345 Bottom = 0.030992549 After projection: max(abs(u/v/w)) = 0.04106038607 0.006589722683 0.007482817992 Evolving particles on level: 0 ... with fluid dt 1.724873944e-05 done. Time per fluid step 1.66393199 Time per 36 particle steps 0.556445929 Coupling time per step 0.121582715 Time per step 2.391183207 Regridding at step 9 On level 0 updated BC areas: BC: 0 area: 4.776607274e-05 BC: 1 area: 4.776607274e-05 ============ NEW TIME STEP ============ Step 10: from old_time 0.0001589656621 to new time 0.0001761134581 with dt = 1.7147796e-05 Before projection: max(abs(u/v/w)) = 0.1772533555 0.01602370882 0.01708026345 max(abs(gpx/gpy/gpz)) = 754.0015071 71.89928527 75.48343923 Min and Max of epf 0.2716284532 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1279.076636 MLMG: Initial rhs = 639.5383178 MLMG: Initial residual (resid0) = 639.5383178 MLMG: Final Iter. 21 resid, resid/bnorm = 2.94793101e-09, 4.609467374e-12 MLMG: Timers: Solve = 0.40321404 Iter = 0.374548255 Bottom = 0.031536201 After projection: max(abs(u/v/w)) = 0.04312888062 0.006913951039 0.007715913955 Evolving particles on level: 0 ... with fluid dt 1.7147796e-05 done. Time per fluid step 1.663508719 Time per 36 particle steps 0.556354697 Coupling time per step 0.121596743 Time per step 2.390770539 ************************************************************************************************************** Species mass balance for interval: 0.000000 to 0.000176 Species mass(t+dt) mass(t) production mass(in) mass(out) net accu flux CH4 2.1642e-09 2.1642e-09 0.0000e+00 8.9444e-13 9.0817e-13 4.1359e-25 -1.3734e-14 H2 4.3284e-09 4.3284e-09 0.0000e+00 1.7889e-12 1.8163e-12 8.2718e-25 -2.7468e-14 CO 2.1642e-09 2.1642e-09 0.0000e+00 8.9444e-13 9.0817e-13 4.1359e-25 -1.3734e-14 H2O 4.3284e-09 4.3284e-09 0.0000e+00 1.7889e-12 1.8163e-12 8.2718e-25 -2.7468e-14 CO2 2.1642e-09 2.1642e-09 0.0000e+00 8.9444e-13 9.0817e-13 4.1359e-25 -1.3734e-14 O2 2.1642e-09 2.1642e-09 0.0000e+00 8.9444e-13 9.0817e-13 4.1359e-25 -1.3734e-14 N2 4.3284e-09 4.3284e-09 0.0000e+00 1.7889e-12 1.8163e-12 8.2718e-25 -2.7468e-14 Fe2O3 4.9342e-05 4.9342e-05 0.0000e+00 0.0000e+00 0.0000e+00 -6.7763e-21 0.0000e+00 FeO 4.9342e-05 4.9342e-05 0.0000e+00 0.0000e+00 0.0000e+00 -6.7763e-21 0.0000e+00 inert 6.5789e-05 6.5789e-05 0.0000e+00 0.0000e+00 0.0000e+00 -1.3553e-20 0.0000e+00 -------------------------------------------------------------------------------------------------------------- Total 1.6449e-04 1.6449e-04 0.0000e+00 8.9444e-12 9.0817e-12 -2.7101e-20 -1.3734e-13 total number of particles = 157,059 |(total acc) - (net flux)| = 1.3734e-13 ************************************************************************************************************** Writing plotfile BENCH05-Size0008_wide-Chemistry_plt00010 at time 0.0001761134581 Time spent in main (after init) 24.36713643 Time spent in main 31.54614257 Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [1915 ... 2085] [The Arena] max space (MB) allocated spread across MPI: [238 ... 278] [The Arena] max space (MB) used spread across MPI: [206 ... 223] [The Device Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Device Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [16 ... 24] [The Pinned Arena] max space (MB) used spread across MPI: [8 ... 15] AMReX (26.06-5-g65db2e4e678a) finalized