Initializing AMReX (26.05-41-gba3cb0c68650)... MPI initialized with 4 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.05-41-gba3cb0c68650) initialized MFIX git describe: 26.05-9-g65f01d9996eb AMReX-Hydro git hash: 75da770ea36e4064b5947d7e56baa19f5bc92263 Number of levels: 1 RunType is Standard Auto-generating level-set parameters: eb_refinement = 1 levelset_pad = 2 eb_pad = 2 ================================================================================ Warning: Overwriting amr.plot_int with value from mfix.plot_int ================================================================================ ================================================================================ Warning: Overwriting amr.plot_file with value from mfix.plot_file ================================================================================ ================================================================================ Warning: Overwriting amr.check_file with value from mfix.check_file ================================================================================ Simulation is transient -------------------------------------------------------------------------------- Info: Max effective viscosity factor not specified. Using default 1e+06 -------------------------------------------------------------------------------- EB with constant temperature: bc.hot-walls Temperature of wall .................... 900 Load balance setup: Type: DualGrid Strategy: KnapSack Weighting: ParticleCount Drag model: BVK2 Convection model not specified. Setting default: mfix.convection.model = RanzMarshall Building cylinder geometry. Internal Flow: 1 Radius: 0.0039 Height: -1 Direction: 0 Rotation angle: 0 Rotation axis: 0 Center: 0.004, 0.004, 0.004 Done making the fluid eb levels ... On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ================================================================================ Warning: Setting particle max grid size to fluid max grid size ================================================================================ In MakeBaseGrids: BA HAS 16 GRIDS Auto generating particles ... Total number of generated particles: 215,120 Time spent in initializing particles 1.406940614 **************************************** Coverage report: Grids Cells regular: 4 44960 covered: 0 12800 cut: 12 6240 **************************************** Bounding box for levelset imposed walls: Lo: 1e-15 -0.008 -0.008 Hi: 0.016 0.016 0.016 Clean up auto-generated particles. IC Region Generated Removed Remaining **************** **************** **************** **************** full-domain 0 0 0 bed 215,120 58,061 157,059 ---------------- ---------------- ---------------- ---------------- Total 215,120 58,061 157,059 **************** **************** **************** **************** Setting original sum_vol to 2.998926818e-07 Initial projection: Before projection: max(abs(u/v/w)) = 0.015 0 0 max(abs(gpx/gpy/gpz)) = 0 0 0 Min and Max of epf 0.404821315 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 44.6112468 MLMG: Initial rhs = 22.3056234 MLMG: Initial residual (resid0) = 22.3056234 MLMG: Final Iter. 13 resid, resid/bnorm = 6.121664287e-11, 2.744448867e-12 MLMG: Timers: Solve = 2.55066736 Iter = 2.305672907 Bottom = 0.018972519 After projection: max(abs(u/v/w)) = 0.02199663394 0.00113116282 0.00118949404 Doing initial pressure iterations with dt = 0.008211321795 In initial_iterations: iter = 0 Before projection: max(abs(u/v/w)) = 0.01864847553 0.004888276558 0.004999766061 max(abs(gpx/gpy/gpz)) = 0 0 0 Min and Max of epf 0.404821315 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 148.0070194 MLMG: Initial rhs = 74.00350969 MLMG: Initial residual (resid0) = 74.00350969 MLMG: Final Iter. 13 resid, resid/bnorm = 2.851711367e-10, 3.853481246e-12 MLMG: Timers: Solve = 2.563426433 Iter = 2.32474788 Bottom = 0.019302714 After projection: max(abs(u/v/w)) = 0.02180310583 0.003545677848 0.003618610057 In initial_iterations: iter = 1 Before projection: max(abs(u/v/w)) = 0.01904173908 0.004872212339 0.004978278826 max(abs(gpx/gpy/gpz)) = 2.64979077 0.4857109379 0.4902803414 Min and Max of epf 0.404821315 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 147.7900726 MLMG: Initial rhs = 73.8950363 MLMG: Initial residual (resid0) = 73.8950363 MLMG: Final Iter. 13 resid, resid/bnorm = 2.599956361e-10, 3.518445205e-12 MLMG: Timers: Solve = 2.555637371 Iter = 2.31803656 Bottom = 0.018701829 After projection: max(abs(u/v/w)) = 0.02181407035 0.003500651848 0.003581062482 In initial_iterations: iter = 2 Before projection: max(abs(u/v/w)) = 0.01920306989 0.004856607747 0.004957911497 max(abs(gpx/gpy/gpz)) = 5.297760837 0.9673546565 0.9768213121 Min and Max of epf 0.404821315 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 147.5557461 MLMG: Initial rhs = 73.77787307 MLMG: Initial residual (resid0) = 73.77787307 MLMG: Final Iter. 13 resid, resid/bnorm = 2.481563011e-10, 3.363559977e-12 MLMG: Timers: Solve = 2.56148928 Iter = 2.323927159 Bottom = 0.019101515 After projection: max(abs(u/v/w)) = 0.02177215786 0.003462239656 0.003543364448 Enclosed domain volume is 2.998926818e-07 Time spent in init 80.78037685 Writing plotfile BENCH05-Size0008_wide-Godunov_plt00000 at time 0 Regridding at step 0 Updating particle ebfactory Regridding level-set on lev = 0 Also regridding refined level-set On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 1: from old_time 0 to new time 0.0001478172962 with dt = 0.0001478172962 Before projection (with small dt modification): max(abs(u/v/w)) = 0.01509374597 0.003121148662 0.003199308726 max(abs(gpx/gpy/gpz)) = 7.930323103 1.445591671 1.459484702 Min and Max of epf 0.404821315 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 139.7655748 MLMG: Initial rhs = 69.8827874 MLMG: Initial residual (resid0) = 69.8827874 MLMG: Final Iter. 13 resid, resid/bnorm = 2.21766272e-10, 3.173403355e-12 MLMG: Timers: Solve = 2.56969098 Iter = 2.332048301 Bottom = 0.018960749 After projection (with small dt modification): max(abs(u/v/w)) = 0.02569673942 0.002494217087 0.002499819391 Evolving particles on level: 0 ... with fluid dt 0.0001478172962 done. Time per fluid step 15.08806666 Time per 325 particle steps 42.75711091 Coupling time per step 0.831886688 Time per step 59.90299739 Regridding at step 1 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 2: from old_time 0.0001478172962 to new time 0.0002933301982 with dt = 0.0001455129019 Before projection: max(abs(u/v/w)) = 0.0209965405 0.004864591379 0.004839302441 max(abs(gpx/gpy/gpz)) = 144.5526288 18.25535987 18.34755284 Min and Max of epf 0.4048417166 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 265.8204166 MLMG: Initial rhs = 132.9102083 MLMG: Initial residual (resid0) = 132.9102083 MLMG: Final Iter. 13 resid, resid/bnorm = 4.115578989e-10, 3.096510826e-12 MLMG: Timers: Solve = 2.54343277 Iter = 2.306869712 Bottom = 0.019148399 After projection: max(abs(u/v/w)) = 0.03276515051 0.003487109732 0.003729435166 Evolving particles on level: 0 ... with fluid dt 0.0001455129019 done. Time per fluid step 15.02572339 Time per 320 particle steps 41.66400099 Coupling time per step 0.836645545 Time per step 58.13336192 Regridding at step 2 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 3: from old_time 0.0002933301982 to new time 0.0004343813894 with dt = 0.0001410511912 Before projection: max(abs(u/v/w)) = 0.03958602022 0.005821162882 0.005630740104 max(abs(gpx/gpy/gpz)) = 282.6338351 31.42487451 32.7406019 Min and Max of epf 0.4049034693 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 378.8590083 MLMG: Initial rhs = 189.4295041 MLMG: Initial residual (resid0) = 189.4295041 MLMG: Final Iter. 13 resid, resid/bnorm = 5.891380717e-10, 3.110065005e-12 MLMG: Timers: Solve = 2.573383911 Iter = 2.335693144 Bottom = 0.019231448 After projection: max(abs(u/v/w)) = 0.04006855111 0.004507343728 0.005581240311 Evolving particles on level: 0 ... with fluid dt 0.0001410511912 done. Time per fluid step 15.08842382 Time per 310 particle steps 40.5879671 Coupling time per step 0.838705329 Time per step 57.11561073 Regridding at step 3 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 4: from old_time 0.0004343813894 to new time 0.000570453873 with dt = 0.0001360724836 Before projection: max(abs(u/v/w)) = 0.05632381484 0.006445008244 0.006080978195 max(abs(gpx/gpy/gpz)) = 420.7849947 51.5244487 53.67347508 Min and Max of epf 0.4050059935 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 480.0316438 MLMG: Initial rhs = 240.0158219 MLMG: Initial residual (resid0) = 240.0158219 MLMG: Final Iter. 13 resid, resid/bnorm = 7.784599632e-10, 3.243369362e-12 MLMG: Timers: Solve = 2.545236391 Iter = 2.307583949 Bottom = 0.01886339 After projection: max(abs(u/v/w)) = 0.04720919796 0.005618105744 0.007351092436 Evolving particles on level: 0 ... with fluid dt 0.0001360724836 done. Time per fluid step 15.04539026 Time per 299 particle steps 38.65516139 Coupling time per step 0.840809886 Time per step 55.1477082 Regridding at step 4 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 5: from old_time 0.000570453873 to new time 0.0007019987326 with dt = 0.0001315448596 Before projection: max(abs(u/v/w)) = 0.07208554722 0.007525684289 0.0083412651 max(abs(gpx/gpy/gpz)) = 560.0641723 73.48867424 76.37189522 Min and Max of epf 0.4001478934 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 572.0187382 MLMG: Initial rhs = 286.0093691 MLMG: Initial residual (resid0) = 286.0093691 MLMG: Final Iter. 13 resid, resid/bnorm = 1.010608486e-09, 3.533480351e-12 MLMG: Timers: Solve = 2.55877047 Iter = 2.321101209 Bottom = 0.019843804 After projection: max(abs(u/v/w)) = 0.05465912775 0.006830419359 0.008966172658 Evolving particles on level: 0 ... with fluid dt 0.0001315448596 done. Time per fluid step 15.04020059 Time per 289 particle steps 37.79302565 Coupling time per step 0.840342444 Time per step 54.27264591 Regridding at step 5 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 6: from old_time 0.0007019987326 to new time 0.0008293744932 with dt = 0.0001273757606 Before projection: max(abs(u/v/w)) = 0.08668857046 0.009723692316 0.01094490078 max(abs(gpx/gpy/gpz)) = 698.9101826 97.56806603 102.2421546 Min and Max of epf 0.3995004434 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 655.2065855 MLMG: Initial rhs = 327.6032927 MLMG: Initial residual (resid0) = 327.6032927 MLMG: Final Iter. 13 resid, resid/bnorm = 1.274682582e-09, 3.890933364e-12 MLMG: Timers: Solve = 2.568243069 Iter = 2.329405342 Bottom = 0.020254114 After projection: max(abs(u/v/w)) = 0.06184558425 0.007923711707 0.01043753046 Evolving particles on level: 0 ... with fluid dt 0.0001273757606 done. Time per fluid step 15.05563141 Time per 280 particle steps 36.81441546 Coupling time per step 0.845073319 Time per step 53.3127983 Regridding at step 6 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 7: from old_time 0.0008293744932 to new time 0.0009529155442 with dt = 0.000123541051 Before projection: max(abs(u/v/w)) = 0.1001293075 0.01189562411 0.01364493692 max(abs(gpx/gpy/gpz)) = 836.2650798 122.9056095 131.2437344 Min and Max of epf 0.4003090488 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 728.0152802 MLMG: Initial rhs = 364.0076401 MLMG: Initial residual (resid0) = 364.0076401 MLMG: Final Iter. 13 resid, resid/bnorm = 1.546728967e-09, 4.249166218e-12 MLMG: Timers: Solve = 2.564928889 Iter = 2.326100739 Bottom = 0.02019651 After projection: max(abs(u/v/w)) = 0.06874755978 0.008913682427 0.01178857482 Evolving particles on level: 0 ... with fluid dt 0.000123541051 done. Time per fluid step 14.96216224 Time per 272 particle steps 35.42320756 Coupling time per step 0.841976143 Time per step 51.83150962 Regridding at step 7 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 8: from old_time 0.0009529155442 to new time 0.0010728442 with dt = 0.0001199286561 Before projection: max(abs(u/v/w)) = 0.1123814385 0.01402352443 0.01634062032 max(abs(gpx/gpy/gpz)) = 971.2882066 148.8443859 162.0044707 Min and Max of epf 0.3973553886 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 792.5099673 MLMG: Initial rhs = 396.2549836 MLMG: Initial residual (resid0) = 396.2549836 MLMG: Final Iter. 13 resid, resid/bnorm = 1.509892655e-09, 3.810406727e-12 MLMG: Timers: Solve = 2.564413748 Iter = 2.325589427 Bottom = 0.020311314 After projection: max(abs(u/v/w)) = 0.07538002713 0.009820501211 0.01304854926 Evolving particles on level: 0 ... with fluid dt 0.0001199286561 done. Time per fluid step 14.96417747 Time per 264 particle steps 34.55208057 Coupling time per step 0.843708118 Time per step 50.96030595 Regridding at step 8 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 9: from old_time 0.0010728442 to new time 0.001189465435 with dt = 0.0001166212352 Before projection: max(abs(u/v/w)) = 0.1235957942 0.01616853471 0.01895376602 max(abs(gpx/gpy/gpz)) = 1103.283628 175.0822296 193.0112928 Min and Max of epf 0.3980925352 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 852.1708501 MLMG: Initial rhs = 426.0854251 MLMG: Initial residual (resid0) = 426.0854251 MLMG: Final Iter. 13 resid, resid/bnorm = 1.318150922e-09, 3.093630629e-12 MLMG: Timers: Solve = 2.57152558 Iter = 2.332730165 Bottom = 0.018857538 After projection: max(abs(u/v/w)) = 0.0817304056 0.01065954759 0.01422961345 Evolving particles on level: 0 ... with fluid dt 0.0001166212352 done. Time per fluid step 14.98391973 Time per 256 particle steps 33.66537462 Coupling time per step 0.840560531 Time per step 50.09282034 Regridding at step 9 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 10: from old_time 0.001189465435 to new time 0.00130301226 with dt = 0.0001135468241 Before projection: max(abs(u/v/w)) = 0.1337996729 0.01842571573 0.02151431794 max(abs(gpx/gpy/gpz)) = 1231.565276 201.5025298 225.0833014 Min and Max of epf 0.3998083548 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 907.0326594 MLMG: Initial rhs = 453.5163297 MLMG: Initial residual (resid0) = 453.5163297 MLMG: Final Iter. 13 resid, resid/bnorm = 1.219557788e-09, 2.689115492e-12 MLMG: Timers: Solve = 2.569819245 Iter = 2.332242526 Bottom = 0.018552453 After projection: max(abs(u/v/w)) = 0.08780774774 0.01143802589 0.01533160632 Evolving particles on level: 0 ... with fluid dt 0.0001135468241 done. Time per fluid step 14.94848381 Time per 250 particle steps 32.49582774 Coupling time per step 0.839977422 Time per step 48.88819951 Regridding at step 10 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 11: from old_time 0.00130301226 to new time 0.001412920146 with dt = 0.0001099078863 Before projection: max(abs(u/v/w)) = 0.1423000075 0.02034839486 0.02380345731 max(abs(gpx/gpy/gpz)) = 1355.656407 227.9181196 257.7477047 Min and Max of epf 0.4016032747 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 945.8636941 MLMG: Initial rhs = 472.9318471 MLMG: Initial residual (resid0) = 472.9318471 MLMG: Final Iter. 13 resid, resid/bnorm = 1.155003204e-09, 2.44221913e-12 MLMG: Timers: Solve = 2.551499734 Iter = 2.315042201 Bottom = 0.018539736 After projection: max(abs(u/v/w)) = 0.09359305087 0.01217341266 0.01636555505 Evolving particles on level: 0 ... with fluid dt 0.0001099078863 done. Time per fluid step 14.63702792 Time per 242 particle steps 31.63140607 Coupling time per step 0.838804275 Time per step 47.71465204 Regridding at step 11 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 12: from old_time 0.001412920146 to new time 0.001519455024 with dt = 0.000106534878 Before projection: max(abs(u/v/w)) = 0.1502557402 0.02218718524 0.02605309518 max(abs(gpx/gpy/gpz)) = 1476.175449 254.4756296 291.3660766 Min and Max of epf 0.4003766965 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 982.3925097 MLMG: Initial rhs = 491.1962548 MLMG: Initial residual (resid0) = 491.1962548 MLMG: Final Iter. 13 resid, resid/bnorm = 1.135363803e-09, 2.311426017e-12 MLMG: Timers: Solve = 2.561778957 Iter = 2.325321242 Bottom = 0.019375843 After projection: max(abs(u/v/w)) = 0.09912534274 0.01286278339 0.0173426701 Evolving particles on level: 0 ... with fluid dt 0.000106534878 done. Time per fluid step 14.59608707 Time per 234 particle steps 30.76619661 Coupling time per step 0.836982083 Time per step 46.80960084 Regridding at step 12 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 13: from old_time 0.001519455024 to new time 0.001622842592 with dt = 0.0001033875678 Before projection: max(abs(u/v/w)) = 0.1572693067 0.02384413078 0.0281764083 max(abs(gpx/gpy/gpz)) = 1592.593368 281.0341903 325.0104553 Min and Max of epf 0.4033854945 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1016.62761 MLMG: Initial rhs = 508.3138051 MLMG: Initial residual (resid0) = 508.3138051 MLMG: Final Iter. 13 resid, resid/bnorm = 1.140097794e-09, 2.242901496e-12 MLMG: Timers: Solve = 2.547334474 Iter = 2.310869724 Bottom = 0.020064062 After projection: max(abs(u/v/w)) = 0.1044063683 0.01350160015 0.01826749504 Evolving particles on level: 0 ... with fluid dt 0.0001033875678 done. Time per fluid step 14.66782159 Time per 227 particle steps 30.00719441 Coupling time per step 0.84108951 Time per step 46.12631558 Regridding at step 13 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 14: from old_time 0.001622842592 to new time 0.001723303427 with dt = 0.000100460835 Before projection: max(abs(u/v/w)) = 0.1635915358 0.02549678257 0.03016559271 max(abs(gpx/gpy/gpz)) = 1704.571019 309.2292948 358.2530775 Min and Max of epf 0.4001223446 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1048.459173 MLMG: Initial rhs = 524.2295867 MLMG: Initial residual (resid0) = 524.2295867 MLMG: Final Iter. 13 resid, resid/bnorm = 1.196372779e-09, 2.282154249e-12 MLMG: Timers: Solve = 2.561595011 Iter = 2.325040055 Bottom = 0.019053153 After projection: max(abs(u/v/w)) = 0.1094524145 0.01409873636 0.01914847838 Evolving particles on level: 0 ... with fluid dt 0.000100460835 done. Time per fluid step 14.54237688 Time per 221 particle steps 28.8309186 Coupling time per step 0.838940642 Time per step 44.81175319 Regridding at step 14 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 15: from old_time 0.001723303427 to new time 0.001808813522 with dt = 8.551009506e-05 Before projection: max(abs(u/v/w)) = 0.1556301066 0.02307610314 0.02747612293 max(abs(gpx/gpy/gpz)) = 1811.923148 336.1975341 391.4162649 Min and Max of epf 0.4002170255 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 945.3081431 MLMG: Initial rhs = 472.6540715 MLMG: Initial residual (resid0) = 472.6540715 MLMG: Final Iter. 13 resid, resid/bnorm = 1.137589578e-09, 2.406812184e-12 MLMG: Timers: Solve = 2.565284959 Iter = 2.327747648 Bottom = 0.019481196 After projection: max(abs(u/v/w)) = 0.1136095595 0.01468424937 0.0199526782 Evolving particles on level: 0 ... with fluid dt 8.551009506e-05 done. Time per fluid step 14.65722694 Time per 188 particle steps 24.72869252 Coupling time per step 0.839764567 Time per step 40.83163338 Regridding at step 15 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 16: from old_time 0.001808813522 to new time 0.001897878386 with dt = 8.906486426e-05 Before projection: max(abs(u/v/w)) = 0.174137361 0.02688262286 0.03210032241 max(abs(gpx/gpy/gpz)) = 1933.106504 370.3890953 433.2595732 Min and Max of epf 0.3997272253 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1033.122983 MLMG: Initial rhs = 516.5614917 MLMG: Initial residual (resid0) = 516.5614917 MLMG: Final Iter. 13 resid, resid/bnorm = 1.317907561e-09, 2.551308183e-12 MLMG: Timers: Solve = 2.542878341 Iter = 2.307457905 Bottom = 0.018952852 After projection: max(abs(u/v/w)) = 0.1183573942 0.01517806975 0.0207747209 Evolving particles on level: 0 ... with fluid dt 8.906486426e-05 done. Time per fluid step 14.6631734 Time per 196 particle steps 25.59361477 Coupling time per step 0.836980071 Time per step 41.69674287 Regridding at step 16 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 17: from old_time 0.001897878386 to new time 0.001987919075 with dt = 9.004068858e-05 Before projection: max(abs(u/v/w)) = 0.1857513957 0.02949543321 0.03529201636 max(abs(gpx/gpy/gpz)) = 2034.153465 398.6850707 468.1095979 Min and Max of epf 0.3994713838 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1084.613119 MLMG: Initial rhs = 542.3065596 MLMG: Initial residual (resid0) = 542.3065596 MLMG: Final Iter. 13 resid, resid/bnorm = 1.452114873e-09, 2.677664223e-12 MLMG: Timers: Solve = 2.568449796 Iter = 2.33086614 Bottom = 0.019437833 After projection: max(abs(u/v/w)) = 0.1228341674 0.015650234 0.0215544722 Evolving particles on level: 0 ... with fluid dt 9.004068858e-05 done. Time per fluid step 14.68341534 Time per 198 particle steps 25.81330633 Coupling time per step 0.837345985 Time per step 41.93900439 Regridding at step 17 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 18: from old_time 0.001987919075 to new time 0.002078529275 with dt = 9.061019992e-05 Before projection: max(abs(u/v/w)) = 0.1953813766 0.03218008381 0.0381982348 max(abs(gpx/gpy/gpz)) = 2125.508566 422.7491174 500.8243115 Min and Max of epf 0.4013402867 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1130.092466 MLMG: Initial rhs = 565.0462332 MLMG: Initial residual (resid0) = 565.0462332 MLMG: Final Iter. 13 resid, resid/bnorm = 1.538055017e-09, 2.721998531e-12 MLMG: Timers: Solve = 2.557066771 Iter = 2.321680155 Bottom = 0.019848767 After projection: max(abs(u/v/w)) = 0.1270307235 0.01610052351 0.02229055252 Evolving particles on level: 0 ... with fluid dt 9.061019992e-05 done. Time per fluid step 14.66652057 Time per 199 particle steps 25.92446172 Coupling time per step 0.840342761 Time per step 42.0345719 Regridding at step 18 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 19: from old_time 0.002078529275 to new time 0.002166725162 with dt = 8.819588777e-05 Before projection: max(abs(u/v/w)) = 0.1977239932 0.03375493024 0.03938697994 max(abs(gpx/gpy/gpz)) = 2208.898488 448.2672957 530.7031772 Min and Max of epf 0.4020653538 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1139.454148 MLMG: Initial rhs = 569.7270739 MLMG: Initial residual (resid0) = 569.7270739 MLMG: Final Iter. 13 resid, resid/bnorm = 1.561417662e-09, 2.740641499e-12 MLMG: Timers: Solve = 2.559693183 Iter = 2.32100911 Bottom = 0.019562805 After projection: max(abs(u/v/w)) = 0.1307724684 0.01653344184 0.02297413095 Evolving particles on level: 0 ... with fluid dt 8.819588777e-05 done. Time per fluid step 14.29376511 Time per 194 particle steps 25.37854222 Coupling time per step 0.83641616 Time per step 41.114695 Regridding at step 19 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 20: from old_time 0.002166725162 to new time 0.00224915921 with dt = 8.243404753e-05 Before projection: max(abs(u/v/w)) = 0.1918210519 0.03337015277 0.03849387503 max(abs(gpx/gpy/gpz)) = 2289.390592 473.9255025 558.7095994 Min and Max of epf 0.3995016258 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1103.321607 MLMG: Initial rhs = 551.6608036 MLMG: Initial residual (resid0) = 551.6608036 MLMG: Final Iter. 13 resid, resid/bnorm = 1.40876466e-09, 2.553679093e-12 MLMG: Timers: Solve = 2.557141982 Iter = 2.319386957 Bottom = 0.01858318 After projection: max(abs(u/v/w)) = 0.1340063056 0.01694639241 0.0236016135 Evolving particles on level: 0 ... with fluid dt 8.243404753e-05 done. Time per fluid step 14.64351553 Time per 181 particle steps 23.9726228 Coupling time per step 0.839021265 Time per step 40.06095395 Regridding at step 20 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 21: from old_time 0.00224915921 to new time 0.002333380174 with dt = 8.422096427e-05 Before projection: max(abs(u/v/w)) = 0.2024934281 0.0365667579 0.04194664011 max(abs(gpx/gpy/gpz)) = 2371.23717 502.0311671 589.7849722 Min and Max of epf 0.3999196734 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1162.149008 MLMG: Initial rhs = 581.0745042 MLMG: Initial residual (resid0) = 581.0745042 MLMG: Final Iter. 13 resid, resid/bnorm = 1.479122602e-09, 2.545495614e-12 MLMG: Timers: Solve = 2.563707614 Iter = 2.325006999 Bottom = 0.018884197 After projection: max(abs(u/v/w)) = 0.1375246829 0.01731088422 0.02421869798 Evolving particles on level: 0 ... with fluid dt 8.422096427e-05 done. Time per fluid step 14.64094775 Time per 185 particle steps 24.40368843 Coupling time per step 0.841478029 Time per step 40.48962938 Regridding at step 21 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 22: from old_time 0.002333380174 to new time 0.002415512264 with dt = 8.213208972e-05 Before projection: max(abs(u/v/w)) = 0.2032122511 0.03803423343 0.04282075395 max(abs(gpx/gpy/gpz)) = 2441.586146 529.020364 616.8068327 Min and Max of epf 0.4008113616 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1167.52759 MLMG: Initial rhs = 583.7637949 MLMG: Initial residual (resid0) = 583.7637949 MLMG: Final Iter. 13 resid, resid/bnorm = 1.562440843e-09, 2.67649494e-12 MLMG: Timers: Solve = 2.543525987 Iter = 2.305960537 Bottom = 0.018464845 After projection: max(abs(u/v/w)) = 0.1406954205 0.01767531707 0.0247730421 Evolving particles on level: 0 ... with fluid dt 8.213208972e-05 done. Time per fluid step 14.62668058 Time per 181 particle steps 23.97030726 Coupling time per step 0.83900094 Time per step 40.04538375 Regridding at step 22 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 23: from old_time 0.002415512264 to new time 0.002495821926 with dt = 8.030966248e-05 Before projection: max(abs(u/v/w)) = 0.2040816672 0.03980403358 0.04367747517 max(abs(gpx/gpy/gpz)) = 2509.827924 563.6063573 643.9810991 Min and Max of epf 0.4009279459 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1165.059984 MLMG: Initial rhs = 582.5299922 MLMG: Initial residual (resid0) = 582.5299922 MLMG: Final Iter. 13 resid, resid/bnorm = 1.516490045e-09, 2.603282346e-12 MLMG: Timers: Solve = 2.531591795 Iter = 2.296118579 Bottom = 0.019543187 After projection: max(abs(u/v/w)) = 0.1437126094 0.01802093747 0.02528586017 Evolving particles on level: 0 ... with fluid dt 8.030966248e-05 done. Time per fluid step 14.35624168 Time per 177 particle steps 23.53651566 Coupling time per step 0.840984977 Time per step 39.33948197 Regridding at step 23 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 24: from old_time 0.002495821926 to new time 0.002581545366 with dt = 8.572343949e-05 Before projection: max(abs(u/v/w)) = 0.2226038488 0.04527991608 0.04934554385 max(abs(gpx/gpy/gpz)) = 2574.663267 596.449616 671.0628226 Min and Max of epf 0.4010579275 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1267.224987 MLMG: Initial rhs = 633.6124936 MLMG: Initial residual (resid0) = 633.6124936 MLMG: Final Iter. 13 resid, resid/bnorm = 1.293358309e-09, 2.04124496e-12 MLMG: Timers: Solve = 2.541754721 Iter = 2.305143193 Bottom = 0.018766725 After projection: max(abs(u/v/w)) = 0.1472053897 0.01832667993 0.02580698901 Evolving particles on level: 0 ... with fluid dt 8.572343949e-05 done. Time per fluid step 14.63513541 Time per 189 particle steps 24.84151418 Coupling time per step 0.835556519 Time per step 40.9161503 Regridding at step 24 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 25: from old_time 0.002581545366 to new time 0.002667350087 with dt = 8.580472126e-05 Before projection: max(abs(u/v/w)) = 0.2269782582 0.04709077073 0.05104562594 max(abs(gpx/gpy/gpz)) = 2626.40096 619.1913553 695.0117402 Min and Max of epf 0.400096488 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1295.319028 MLMG: Initial rhs = 647.6595142 MLMG: Initial residual (resid0) = 647.6595142 MLMG: Final Iter. 13 resid, resid/bnorm = 1.083868995e-09, 1.673516672e-12 MLMG: Timers: Solve = 2.564365863 Iter = 2.327870606 Bottom = 0.018323716 After projection: max(abs(u/v/w)) = 0.1502760419 0.01863704407 0.02646271098 Evolving particles on level: 0 ... with fluid dt 8.580472126e-05 done. Time per fluid step 14.6300189 Time per 189 particle steps 24.83679094 Coupling time per step 0.84006752 Time per step 40.91203895 Regridding at step 25 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 26: from old_time 0.002667350087 to new time 0.00275368064 with dt = 8.633055255e-05 Before projection: max(abs(u/v/w)) = 0.2324137583 0.04920833495 0.05306478576 max(abs(gpx/gpy/gpz)) = 2677.197434 639.8725652 718.7665934 Min and Max of epf 0.4001694653 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1332.358149 MLMG: Initial rhs = 666.1790747 MLMG: Initial residual (resid0) = 666.1790747 MLMG: Final Iter. 13 resid, resid/bnorm = 1.056363885e-09, 1.585705594e-12 MLMG: Timers: Solve = 2.546022312 Iter = 2.308442317 Bottom = 0.018933199 After projection: max(abs(u/v/w)) = 0.153252248 0.01892437599 0.02711675176 Evolving particles on level: 0 ... with fluid dt 8.633055255e-05 done. Time per fluid step 14.62223657 Time per 190 particle steps 24.94930381 Coupling time per step 0.838855625 Time per step 41.01511386 Regridding at step 26 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 27: from old_time 0.00275368064 to new time 0.002840456242 with dt = 8.677560213e-05 Before projection: max(abs(u/v/w)) = 0.237436559 0.05199784951 0.05432951941 max(abs(gpx/gpy/gpz)) = 2725.067676 660.8354106 740.6356887 Min and Max of epf 0.4017275205 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1373.756687 MLMG: Initial rhs = 686.8783434 MLMG: Initial residual (resid0) = 686.8783434 MLMG: Final Iter. 13 resid, resid/bnorm = 1.124870863e-09, 1.637656616e-12 MLMG: Timers: Solve = 2.563780361 Iter = 2.328359913 Bottom = 0.01890523 After projection: max(abs(u/v/w)) = 0.156118055 0.01919419444 0.0277656138 Evolving particles on level: 0 ... with fluid dt 8.677560213e-05 done. Time per fluid step 14.64919962 Time per 191 particle steps 25.05888055 Coupling time per step 0.838486768 Time per step 41.1492882 Regridding at step 27 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 28: from old_time 0.002840456242 to new time 0.002926071424 with dt = 8.561518205e-05 Before projection: max(abs(u/v/w)) = 0.2379439688 0.05376582085 0.0548062682 max(abs(gpx/gpy/gpz)) = 2770.798783 681.563982 759.6135664 Min and Max of epf 0.4023699457 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1386.464317 MLMG: Initial rhs = 693.2321586 MLMG: Initial residual (resid0) = 693.2321586 MLMG: Final Iter. 13 resid, resid/bnorm = 1.273008365e-09, 1.836337726e-12 MLMG: Timers: Solve = 2.53873583 Iter = 2.303233344 Bottom = 0.018928687 After projection: max(abs(u/v/w)) = 0.1588011037 0.01944981576 0.02842030242 Evolving particles on level: 0 ... with fluid dt 8.561518205e-05 done. Time per fluid step 14.61670465 Time per 188 particle steps 24.73505392 Coupling time per step 0.833803462 Time per step 40.7922115 Regridding at step 28 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 29: from old_time 0.002926071424 to new time 0.003002174817 with dt = 7.610339361e-05 Before projection: max(abs(u/v/w)) = 0.2153791672 0.05033278045 0.04902728739 max(abs(gpx/gpy/gpz)) = 2816.158157 702.8428122 778.4422952 Min and Max of epf 0.3986810448 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1265.16271 MLMG: Initial rhs = 632.5813552 MLMG: Initial residual (resid0) = 632.5813552 MLMG: Final Iter. 13 resid, resid/bnorm = 1.181827969e-09, 1.868262413e-12 MLMG: Timers: Solve = 2.560157727 Iter = 2.323681783 Bottom = 0.01964059 After projection: max(abs(u/v/w)) = 0.1605722895 0.0197328266 0.02904167369 Evolving particles on level: 0 ... with fluid dt 7.610339361e-05 done. Time per fluid step 14.33719476 Time per 167 particle steps 21.92942973 Coupling time per step 0.833593247 Time per step 37.70941413 Regridding at step 29 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 30: from old_time 0.003002174817 to new time 0.003083466812 with dt = 8.129199461e-05 Before projection: max(abs(u/v/w)) = 0.2337856203 0.05621695713 0.05493721936 max(abs(gpx/gpy/gpz)) = 2870.511667 736.2321435 803.7203082 Min and Max of epf 0.398830716 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1376.054613 MLMG: Initial rhs = 688.0273063 MLMG: Initial residual (resid0) = 688.0273063 MLMG: Final Iter. 13 resid, resid/bnorm = 1.326903032e-09, 1.928561584e-12 MLMG: Timers: Solve = 2.557617745 Iter = 2.321100639 Bottom = 0.019202431 After projection: max(abs(u/v/w)) = 0.1635484993 0.0200108925 0.02965916915 Evolving particles on level: 0 ... with fluid dt 8.129199461e-05 done. Time per fluid step 14.3455093 Time per 179 particle steps 23.75438336 Coupling time per step 0.838172569 Time per step 39.54189662 Writing plotfile BENCH05-Size0008_wide-Godunov_plt00030 at time 0.003083466812 Time spent in main (after init) 1376.264205 Time spent in main 1457.044582 Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [2419 ... 2503] [The Arena] max space (MB) allocated spread across MPI: [161 ... 169] [The Arena] max space (MB) used spread across MPI: [159 ... 167] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [16 ... 16] [The Pinned Arena] max space (MB) used spread across MPI: [7 ... 13] AMReX (26.05-41-gba3cb0c68650) finalized