Initializing AMReX (26.08-4-gcb098067c32e)... MPI initialized with 4 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.08-4-gcb098067c32e) initialized MFIX git describe: 26.08 AMReX-Hydro git hash: 9446740c59feca3bf007a6e6d95a6080816c33ec Number of levels: 1 RunType is Standard Auto-generating level-set parameters: eb_refinement = 1 levelset_pad = 2 eb_pad = 2 ================================================================================ Warning: Overwriting amr.plot_int with value from mfix.plot_int ================================================================================ ================================================================================ Warning: Overwriting amr.plot_file with value from mfix.plot_file ================================================================================ ================================================================================ Warning: Overwriting amr.check_file with value from mfix.check_file ================================================================================ Simulation is transient -------------------------------------------------------------------------------- Info: Max effective viscosity factor not specified. Using default 1e+06 -------------------------------------------------------------------------------- Particle-particle conduction is disabled. Particle-fluid-particle conduction is disabled. EB with constant temperature: bc.hot-walls Temperature of wall .................... 900 Load balance setup: Type: DualGrid Strategy: KnapSack Weighting: ParticleCount Drag model: BVK2 Convection model not specified. Setting default: mfix.convection.model = RanzMarshall Building cylinder geometry. Internal Flow: 1 Radius: 0.0039 Height: -1 Direction: 0 Rotation angle: 0 Rotation axis: 0 Center: 0.004, 0.004, 0.004 Done making the fluid eb levels ... On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ================================================================================ Warning: Setting particle max grid size to fluid max grid size ================================================================================ In MakeBaseGrids: BA HAS 16 GRIDS Auto generating particles ... Total number of generated particles: 215,120 Time spent in initializing particles 0.802802174 **************************************** Coverage report: Grids Cells regular: 4 44960 covered: 0 12800 cut: 12 6240 **************************************** Bounding box for levelset imposed walls: Lo: 1e-15 -0.008 -0.008 Hi: 0.016 0.016 0.016 Clean up auto-generated particles. IC Region Generated Removed Remaining **************** **************** **************** **************** full-domain 0 0 0 bed 215,120 58,061 157,059 ---------------- ---------------- ---------------- ---------------- Total 215,120 58,061 157,059 **************** **************** **************** **************** Setting original sum_vol to 2.998926818e-07 Initial projection: Before projection: max(abs(u/v/w)) = 0.015 0 0 max(abs(gpx/gpy/gpz)) = 0 0 0 Min and Max of epf 0.404821315 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 44.6112468 MLMG: Initial rhs = 22.3056234 MLMG: Initial residual (resid0) = 22.3056234 MLMG: Final Iter. 13 resid, resid/bnorm = 6.107153672e-11, 2.737943505e-12 MLMG: Timers: Solve = 0.300461533 Iter = 0.242260639 Bottom = 0.019106667 After projection: max(abs(u/v/w)) = 0.02199663394 0.00113116282 0.00118949404 Doing initial pressure iterations with dt = 0.008211321795 In initial_iterations: iter = 0 Before projection: max(abs(u/v/w)) = 0.01864847553 0.004888276558 0.004999766061 max(abs(gpx/gpy/gpz)) = 0 0 0 Min and Max of epf 0.404821315 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 148.0070194 MLMG: Initial rhs = 74.00350969 MLMG: Initial residual (resid0) = 74.00350969 MLMG: Final Iter. 13 resid, resid/bnorm = 2.85392765e-10, 3.85647608e-12 MLMG: Timers: Solve = 0.271126546 Iter = 0.241959299 Bottom = 0.018868841 After projection: max(abs(u/v/w)) = 0.02180310583 0.003545677848 0.003618610057 In initial_iterations: iter = 1 Before projection: max(abs(u/v/w)) = 0.01904173908 0.004872212339 0.004978278826 max(abs(gpx/gpy/gpz)) = 2.64979077 0.4857109379 0.4902803414 Min and Max of epf 0.404821315 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 147.7900726 MLMG: Initial rhs = 73.8950363 MLMG: Initial residual (resid0) = 73.8950363 MLMG: Final Iter. 13 resid, resid/bnorm = 2.598964932e-10, 3.517103532e-12 MLMG: Timers: Solve = 0.271677457 Iter = 0.242594801 Bottom = 0.018830855 After projection: max(abs(u/v/w)) = 0.02181407035 0.003500651848 0.003581062482 In initial_iterations: iter = 2 Before projection: max(abs(u/v/w)) = 0.01920306989 0.004856607747 0.004957911497 max(abs(gpx/gpy/gpz)) = 5.297760837 0.9673546565 0.9768213121 Min and Max of epf 0.404821315 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 147.5557461 MLMG: Initial rhs = 73.77787307 MLMG: Initial residual (resid0) = 73.77787307 MLMG: Final Iter. 13 resid, resid/bnorm = 2.482932748e-10, 3.365416547e-12 MLMG: Timers: Solve = 0.271663633 Iter = 0.242604793 Bottom = 0.018861326 After projection: max(abs(u/v/w)) = 0.02177215786 0.003462239656 0.003543364448 Enclosed domain volume is 2.998926818e-07 Time spent in init 9.01396083 Writing plotfile BENCH05-Size0008_wide-Godunov_plt00000 at time 0 Regridding at step 0 Updating particle ebfactory Regridding level-set on lev = 0 Also regridding refined level-set On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 1: from old_time 0 to new time 0.0001478172962 with dt = 0.0001478172962 Before projection (with small dt modification): max(abs(u/v/w)) = 0.01509374597 0.003121148662 0.003199308726 max(abs(gpx/gpy/gpz)) = 7.930323103 1.445591671 1.459484702 Min and Max of epf 0.404821315 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 139.7655748 MLMG: Initial rhs = 69.8827874 MLMG: Initial residual (resid0) = 69.8827874 MLMG: Final Iter. 13 resid, resid/bnorm = 2.217835915e-10, 3.173651191e-12 MLMG: Timers: Solve = 0.271549392 Iter = 0.242464938 Bottom = 0.018873844 After projection (with small dt modification): max(abs(u/v/w)) = 0.02569673942 0.002494217087 0.002499819391 Evolving particles on level: 0 ... with fluid dt 0.0001478172962 done. Time per fluid step 1.576199487 Time per 325 particle steps 4.199128641 Coupling time per step 0.086098391 Time per step 6.004363836 Regridding at step 1 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 2: from old_time 0.0001478172962 to new time 0.0002933301982 with dt = 0.0001455129019 Before projection: max(abs(u/v/w)) = 0.0209965405 0.004864591379 0.004839302441 max(abs(gpx/gpy/gpz)) = 144.5526288 18.25535987 18.34755284 Min and Max of epf 0.4048417166 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 265.8204166 MLMG: Initial rhs = 132.9102083 MLMG: Initial residual (resid0) = 132.9102083 MLMG: Final Iter. 13 resid, resid/bnorm = 4.124451891e-10, 3.103186688e-12 MLMG: Timers: Solve = 0.27154878 Iter = 0.242373554 Bottom = 0.019728806 After projection: max(abs(u/v/w)) = 0.03276515051 0.003487109732 0.003729435166 Evolving particles on level: 0 ... with fluid dt 0.0001455129019 done. Time per fluid step 1.572561946 Time per 320 particle steps 4.098060406 Coupling time per step 0.085375237 Time per step 5.811269416 Regridding at step 2 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 3: from old_time 0.0002933301982 to new time 0.0004343813894 with dt = 0.0001410511912 Before projection: max(abs(u/v/w)) = 0.03958602022 0.005821162882 0.005630740104 max(abs(gpx/gpy/gpz)) = 282.6338351 31.42487451 32.7406019 Min and Max of epf 0.4049034693 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 378.8590083 MLMG: Initial rhs = 189.4295041 MLMG: Initial residual (resid0) = 189.4295041 MLMG: Final Iter. 13 resid, resid/bnorm = 5.883027399e-10, 3.105655281e-12 MLMG: Timers: Solve = 0.271751263 Iter = 0.242694637 Bottom = 0.019330188 After projection: max(abs(u/v/w)) = 0.04006855111 0.004507343728 0.005581240311 Evolving particles on level: 0 ... with fluid dt 0.0001410511912 done. Time per fluid step 1.571853382 Time per 310 particle steps 3.99028452 Coupling time per step 0.085362654 Time per step 5.702171214 Regridding at step 3 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 4: from old_time 0.0004343813894 to new time 0.000570453873 with dt = 0.0001360724836 Before projection: max(abs(u/v/w)) = 0.05632381484 0.006445008244 0.006080978195 max(abs(gpx/gpy/gpz)) = 420.7849947 51.5244487 53.67347508 Min and Max of epf 0.4050059935 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 480.0316438 MLMG: Initial rhs = 240.0158219 MLMG: Initial residual (resid0) = 240.0158219 MLMG: Final Iter. 13 resid, resid/bnorm = 7.778542255e-10, 3.240845621e-12 MLMG: Timers: Solve = 0.27137738 Iter = 0.242374917 Bottom = 0.019360923 After projection: max(abs(u/v/w)) = 0.04720919796 0.005618105744 0.007351092436 Evolving particles on level: 0 ... with fluid dt 0.0001360724836 done. Time per fluid step 1.573724791 Time per 299 particle steps 3.819772332 Coupling time per step 0.085602052 Time per step 5.533716794 Regridding at step 4 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 5: from old_time 0.000570453873 to new time 0.0007019987326 with dt = 0.0001315448596 Before projection: max(abs(u/v/w)) = 0.07208554722 0.007525684289 0.0083412651 max(abs(gpx/gpy/gpz)) = 560.0641723 73.48867424 76.37189522 Min and Max of epf 0.4001478934 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 572.0187382 MLMG: Initial rhs = 286.0093691 MLMG: Initial residual (resid0) = 286.0093691 MLMG: Final Iter. 13 resid, resid/bnorm = 1.011908779e-09, 3.538026681e-12 MLMG: Timers: Solve = 0.273084272 Iter = 0.24401043 Bottom = 0.020269928 After projection: max(abs(u/v/w)) = 0.05465912775 0.006830419359 0.008966172658 Evolving particles on level: 0 ... with fluid dt 0.0001315448596 done. Time per fluid step 1.571391891 Time per 289 particle steps 3.711960451 Coupling time per step 0.084774483 Time per step 5.423077255 Regridding at step 5 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 6: from old_time 0.0007019987326 to new time 0.0008293744932 with dt = 0.0001273757606 Before projection: max(abs(u/v/w)) = 0.08668857046 0.009723692316 0.01094490078 max(abs(gpx/gpy/gpz)) = 698.9101826 97.56806603 102.2421546 Min and Max of epf 0.3995004434 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 655.2065855 MLMG: Initial rhs = 327.6032927 MLMG: Initial residual (resid0) = 327.6032927 MLMG: Final Iter. 13 resid, resid/bnorm = 1.274353956e-09, 3.889930242e-12 MLMG: Timers: Solve = 0.272125265 Iter = 0.24297308 Bottom = 0.020157999 After projection: max(abs(u/v/w)) = 0.06184558425 0.007923711707 0.01043753046 Evolving particles on level: 0 ... with fluid dt 0.0001273757606 done. Time per fluid step 1.570715588 Time per 280 particle steps 3.619389563 Coupling time per step 0.085648398 Time per step 5.330222238 Regridding at step 6 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 7: from old_time 0.0008293744932 to new time 0.0009529155442 with dt = 0.000123541051 Before projection: max(abs(u/v/w)) = 0.1001293075 0.01189562411 0.01364493692 max(abs(gpx/gpy/gpz)) = 836.2650798 122.9056095 131.2437344 Min and Max of epf 0.4003090488 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 728.0152802 MLMG: Initial rhs = 364.0076401 MLMG: Initial residual (resid0) = 364.0076401 MLMG: Final Iter. 13 resid, resid/bnorm = 1.547297401e-09, 4.250727817e-12 MLMG: Timers: Solve = 0.272039239 Iter = 0.243031353 Bottom = 0.019871128 After projection: max(abs(u/v/w)) = 0.06874755978 0.008913682427 0.01178857482 Evolving particles on level: 0 ... with fluid dt 0.000123541051 done. Time per fluid step 1.563873566 Time per 272 particle steps 3.482030636 Coupling time per step 0.085076396 Time per step 5.18588147 Regridding at step 7 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 8: from old_time 0.0009529155442 to new time 0.0010728442 with dt = 0.0001199286561 Before projection: max(abs(u/v/w)) = 0.1123814385 0.01402352443 0.01634062032 max(abs(gpx/gpy/gpz)) = 971.2882066 148.8443859 162.0044707 Min and Max of epf 0.3973553886 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 792.5099673 MLMG: Initial rhs = 396.2549836 MLMG: Initial residual (resid0) = 396.2549836 MLMG: Final Iter. 13 resid, resid/bnorm = 1.511800463e-09, 3.815221322e-12 MLMG: Timers: Solve = 0.272750559 Iter = 0.243581628 Bottom = 0.020036003 After projection: max(abs(u/v/w)) = 0.07538002713 0.009820501211 0.01304854926 Evolving particles on level: 0 ... with fluid dt 0.0001199286561 done. Time per fluid step 1.564392538 Time per 264 particle steps 3.396845117 Coupling time per step 0.085521765 Time per step 5.101481531 Regridding at step 8 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 9: from old_time 0.0010728442 to new time 0.001189465435 with dt = 0.0001166212352 Before projection: max(abs(u/v/w)) = 0.1235957942 0.01616853471 0.01895376602 max(abs(gpx/gpy/gpz)) = 1103.283628 175.0822296 193.0112928 Min and Max of epf 0.3980925352 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 852.1708501 MLMG: Initial rhs = 426.0854251 MLMG: Initial residual (resid0) = 426.0854251 MLMG: Final Iter. 13 resid, resid/bnorm = 1.318392506e-09, 3.094197616e-12 MLMG: Timers: Solve = 0.27136861 Iter = 0.242219419 Bottom = 0.018993311 After projection: max(abs(u/v/w)) = 0.0817304056 0.01065954759 0.01422961345 Evolving particles on level: 0 ... with fluid dt 0.0001166212352 done. Time per fluid step 1.562056649 Time per 256 particle steps 3.313181285 Coupling time per step 0.085503939 Time per step 5.015635789 Regridding at step 9 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 10: from old_time 0.001189465435 to new time 0.00130301226 with dt = 0.0001135468241 Before projection: max(abs(u/v/w)) = 0.1337996729 0.01842571573 0.02151431794 max(abs(gpx/gpy/gpz)) = 1231.565276 201.5025298 225.0833014 Min and Max of epf 0.3998083548 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 907.0326594 MLMG: Initial rhs = 453.5163297 MLMG: Initial residual (resid0) = 453.5163297 MLMG: Final Iter. 13 resid, resid/bnorm = 1.218353418e-09, 2.686459866e-12 MLMG: Timers: Solve = 0.271325116 Iter = 0.242157447 Bottom = 0.018480944 After projection: max(abs(u/v/w)) = 0.08780774774 0.01143802589 0.01533160632 Evolving particles on level: 0 ... with fluid dt 0.0001135468241 done. Time per fluid step 1.564008629 Time per 250 particle steps 3.195847117 Coupling time per step 0.085424094 Time per step 4.899993911 Regridding at step 10 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 11: from old_time 0.00130301226 to new time 0.001412920146 with dt = 0.0001099078863 Before projection: max(abs(u/v/w)) = 0.1423000075 0.02034839486 0.02380345731 max(abs(gpx/gpy/gpz)) = 1355.656407 227.9181196 257.7477047 Min and Max of epf 0.4016032747 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 945.8636941 MLMG: Initial rhs = 472.9318471 MLMG: Initial residual (resid0) = 472.9318471 MLMG: Final Iter. 13 resid, resid/bnorm = 1.157783203e-09, 2.448097352e-12 MLMG: Timers: Solve = 0.271474124 Iter = 0.242301869 Bottom = 0.018616356 After projection: max(abs(u/v/w)) = 0.09359305087 0.01217341266 0.01636555505 Evolving particles on level: 0 ... with fluid dt 0.0001099078863 done. Time per fluid step 1.529903073 Time per 242 particle steps 3.111221837 Coupling time per step 0.085727373 Time per step 4.781732125 Regridding at step 11 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 12: from old_time 0.001412920146 to new time 0.001519455024 with dt = 0.000106534878 Before projection: max(abs(u/v/w)) = 0.1502557402 0.02218718524 0.02605309518 max(abs(gpx/gpy/gpz)) = 1476.175449 254.4756296 291.3660766 Min and Max of epf 0.4003766965 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 982.3925097 MLMG: Initial rhs = 491.1962548 MLMG: Initial residual (resid0) = 491.1962548 MLMG: Final Iter. 13 resid, resid/bnorm = 1.134473848e-09, 2.309614206e-12 MLMG: Timers: Solve = 0.271989466 Iter = 0.242832774 Bottom = 0.019236481 After projection: max(abs(u/v/w)) = 0.09912534274 0.01286278339 0.0173426701 Evolving particles on level: 0 ... with fluid dt 0.000106534878 done. Time per fluid step 1.52643632 Time per 234 particle steps 3.025261189 Coupling time per step 0.085487586 Time per step 4.69220797 Regridding at step 12 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 13: from old_time 0.001519455024 to new time 0.001622842592 with dt = 0.0001033875678 Before projection: max(abs(u/v/w)) = 0.1572693067 0.02384413078 0.0281764083 max(abs(gpx/gpy/gpz)) = 1592.593368 281.0341903 325.0104553 Min and Max of epf 0.4033854945 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1016.62761 MLMG: Initial rhs = 508.3138051 MLMG: Initial residual (resid0) = 508.3138051 MLMG: Final Iter. 13 resid, resid/bnorm = 1.141845729e-09, 2.246340189e-12 MLMG: Timers: Solve = 0.272841135 Iter = 0.243774876 Bottom = 0.020105458 After projection: max(abs(u/v/w)) = 0.1044063683 0.01350160015 0.01826749504 Evolving particles on level: 0 ... with fluid dt 0.0001033875678 done. Time per fluid step 1.533393531 Time per 227 particle steps 2.951240142 Coupling time per step 0.085560681 Time per step 4.625094214 Regridding at step 13 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 14: from old_time 0.001622842592 to new time 0.001723303427 with dt = 0.000100460835 Before projection: max(abs(u/v/w)) = 0.1635915358 0.02549678257 0.03016559271 max(abs(gpx/gpy/gpz)) = 1704.571019 309.2292948 358.2530775 Min and Max of epf 0.4001223446 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1048.459173 MLMG: Initial rhs = 524.2295867 MLMG: Initial residual (resid0) = 524.2295867 MLMG: Final Iter. 13 resid, resid/bnorm = 1.196887922e-09, 2.283136917e-12 MLMG: Timers: Solve = 0.271236474 Iter = 0.242072586 Bottom = 0.018794814 After projection: max(abs(u/v/w)) = 0.1094524145 0.01409873636 0.01914847838 Evolving particles on level: 0 ... with fluid dt 0.000100460835 done. Time per fluid step 1.521078262 Time per 221 particle steps 2.837777123 Coupling time per step 0.085750182 Time per step 4.499134571 Regridding at step 14 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 15: from old_time 0.001723303427 to new time 0.001808813522 with dt = 8.551009506e-05 Before projection: max(abs(u/v/w)) = 0.1556301066 0.02307610314 0.02747612293 max(abs(gpx/gpy/gpz)) = 1811.923148 336.1975341 391.4162649 Min and Max of epf 0.4002170255 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 945.3081431 MLMG: Initial rhs = 472.6540715 MLMG: Initial residual (resid0) = 472.6540715 MLMG: Final Iter. 13 resid, resid/bnorm = 1.138470651e-09, 2.408676281e-12 MLMG: Timers: Solve = 0.271648036 Iter = 0.242495678 Bottom = 0.019091059 After projection: max(abs(u/v/w)) = 0.1136095595 0.01468424937 0.0199526782 Evolving particles on level: 0 ... with fluid dt 8.551009506e-05 done. Time per fluid step 1.52918654 Time per 188 particle steps 2.431843151 Coupling time per step 0.085441115 Time per step 4.101088159 Regridding at step 15 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 16: from old_time 0.001808813522 to new time 0.001897878386 with dt = 8.906486426e-05 Before projection: max(abs(u/v/w)) = 0.174137361 0.02688262286 0.03210032241 max(abs(gpx/gpy/gpz)) = 1933.106504 370.3890953 433.2595732 Min and Max of epf 0.3997272253 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1033.122983 MLMG: Initial rhs = 516.5614917 MLMG: Initial residual (resid0) = 516.5614917 MLMG: Final Iter. 13 resid, resid/bnorm = 1.318149145e-09, 2.551775861e-12 MLMG: Timers: Solve = 0.271615641 Iter = 0.242448326 Bottom = 0.019142111 After projection: max(abs(u/v/w)) = 0.1183573942 0.01517806975 0.0207747209 Evolving particles on level: 0 ... with fluid dt 8.906486426e-05 done. Time per fluid step 1.531790533 Time per 196 particle steps 2.517242083 Coupling time per step 0.085373568 Time per step 4.189110734 Regridding at step 16 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 17: from old_time 0.001897878386 to new time 0.001987919075 with dt = 9.004068858e-05 Before projection: max(abs(u/v/w)) = 0.1857513957 0.02949543321 0.03529201636 max(abs(gpx/gpy/gpz)) = 2034.153465 398.6850707 468.1095979 Min and Max of epf 0.3994713838 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1084.613119 MLMG: Initial rhs = 542.3065596 MLMG: Initial residual (resid0) = 542.3065596 MLMG: Final Iter. 13 resid, resid/bnorm = 1.451290643e-09, 2.676144364e-12 MLMG: Timers: Solve = 0.272023497 Iter = 0.242860326 Bottom = 0.019195993 After projection: max(abs(u/v/w)) = 0.1228341674 0.015650234 0.0215544722 Evolving particles on level: 0 ... with fluid dt 9.004068858e-05 done. Time per fluid step 1.532915496 Time per 198 particle steps 2.538753059 Coupling time per step 0.085586921 Time per step 4.212142475 Regridding at step 17 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 18: from old_time 0.001987919075 to new time 0.002078529275 with dt = 9.061019992e-05 Before projection: max(abs(u/v/w)) = 0.1953813766 0.03218008381 0.0381982348 max(abs(gpx/gpy/gpz)) = 2125.508566 422.7491174 500.8243115 Min and Max of epf 0.4013402867 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1130.092466 MLMG: Initial rhs = 565.0462332 MLMG: Initial residual (resid0) = 565.0462332 MLMG: Final Iter. 13 resid, resid/bnorm = 1.539000039e-09, 2.723670999e-12 MLMG: Timers: Solve = 0.272753269 Iter = 0.243673912 Bottom = 0.019993065 After projection: max(abs(u/v/w)) = 0.1270307235 0.01610052351 0.02229055252 Evolving particles on level: 0 ... with fluid dt 9.061019992e-05 done. Time per fluid step 1.533825795 Time per 199 particle steps 2.550031452 Coupling time per step 0.085341136 Time per step 4.223707711 Regridding at step 18 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 19: from old_time 0.002078529275 to new time 0.002166725162 with dt = 8.819588777e-05 Before projection: max(abs(u/v/w)) = 0.1977239932 0.03375493024 0.03938697994 max(abs(gpx/gpy/gpz)) = 2208.898488 448.2672957 530.7031772 Min and Max of epf 0.4020653538 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1139.454148 MLMG: Initial rhs = 569.7270739 MLMG: Initial residual (resid0) = 569.7270739 MLMG: Final Iter. 13 resid, resid/bnorm = 1.562209917e-09, 2.742032086e-12 MLMG: Timers: Solve = 0.271923405 Iter = 0.242850171 Bottom = 0.019403194 After projection: max(abs(u/v/w)) = 0.1307724684 0.01653344184 0.02297413095 Evolving particles on level: 0 ... with fluid dt 8.819588777e-05 done. Time per fluid step 1.499102615 Time per 194 particle steps 2.496968063 Coupling time per step 0.085196309 Time per step 4.136228507 Regridding at step 19 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 20: from old_time 0.002166725162 to new time 0.00224915921 with dt = 8.243404753e-05 Before projection: max(abs(u/v/w)) = 0.1918210519 0.03337015277 0.03849387503 max(abs(gpx/gpy/gpz)) = 2289.390592 473.9255025 558.7095994 Min and Max of epf 0.3995016258 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1103.321607 MLMG: Initial rhs = 551.6608036 MLMG: Initial residual (resid0) = 551.6608036 MLMG: Final Iter. 13 resid, resid/bnorm = 1.411390116e-09, 2.558438277e-12 MLMG: Timers: Solve = 0.27043144 Iter = 0.241278562 Bottom = 0.018934326 After projection: max(abs(u/v/w)) = 0.1340063056 0.01694639241 0.0236016135 Evolving particles on level: 0 ... with fluid dt 8.243404753e-05 done. Time per fluid step 1.527835967 Time per 181 particle steps 2.357966062 Coupling time per step 0.085145191 Time per step 4.025636541 Regridding at step 20 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 21: from old_time 0.00224915921 to new time 0.002333380174 with dt = 8.422096427e-05 Before projection: max(abs(u/v/w)) = 0.2024934281 0.0365667579 0.04194664011 max(abs(gpx/gpy/gpz)) = 2371.23717 502.0311671 589.7849722 Min and Max of epf 0.3999196734 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1162.149008 MLMG: Initial rhs = 581.0745042 MLMG: Initial residual (resid0) = 581.0745042 MLMG: Final Iter. 13 resid, resid/bnorm = 1.479726564e-09, 2.546535001e-12 MLMG: Timers: Solve = 0.271906274 Iter = 0.242757868 Bottom = 0.019112022 After projection: max(abs(u/v/w)) = 0.1375246829 0.01731088422 0.02421869798 Evolving particles on level: 0 ... with fluid dt 8.422096427e-05 done. Time per fluid step 1.529290923 Time per 185 particle steps 2.399945671 Coupling time per step 0.085484845 Time per step 4.069694224 Regridding at step 21 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 22: from old_time 0.002333380174 to new time 0.002415512264 with dt = 8.213208972e-05 Before projection: max(abs(u/v/w)) = 0.2032122511 0.03803423343 0.04282075395 max(abs(gpx/gpy/gpz)) = 2441.586146 529.020364 616.8068327 Min and Max of epf 0.4008113616 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1167.52759 MLMG: Initial rhs = 583.7637949 MLMG: Initial residual (resid0) = 583.7637949 MLMG: Final Iter. 13 resid, resid/bnorm = 1.563115859e-09, 2.677651256e-12 MLMG: Timers: Solve = 0.270941817 Iter = 0.241719848 Bottom = 0.019142437 After projection: max(abs(u/v/w)) = 0.1406954205 0.01767531707 0.0247730421 Evolving particles on level: 0 ... with fluid dt 8.213208972e-05 done. Time per fluid step 1.527833077 Time per 181 particle steps 2.357848922 Coupling time per step 0.08524814 Time per step 4.025515917 Regridding at step 22 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 23: from old_time 0.002415512264 to new time 0.002495821926 with dt = 8.030966248e-05 Before projection: max(abs(u/v/w)) = 0.2040816672 0.03980403358 0.04367747517 max(abs(gpx/gpy/gpz)) = 2509.827924 563.6063573 643.9810991 Min and Max of epf 0.4009279459 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1165.059984 MLMG: Initial rhs = 582.5299922 MLMG: Initial residual (resid0) = 582.5299922 MLMG: Final Iter. 13 resid, resid/bnorm = 1.516376358e-09, 2.603087186e-12 MLMG: Timers: Solve = 0.272346343 Iter = 0.24318743 Bottom = 0.019740066 After projection: max(abs(u/v/w)) = 0.1437126094 0.01802093747 0.02528586017 Evolving particles on level: 0 ... with fluid dt 8.030966248e-05 done. Time per fluid step 1.499007909 Time per 177 particle steps 2.314868332 Coupling time per step 0.084977851 Time per step 3.953714437 Regridding at step 23 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 24: from old_time 0.002495821926 to new time 0.002581545366 with dt = 8.572343949e-05 Before projection: max(abs(u/v/w)) = 0.2226038488 0.04527991608 0.04934554385 max(abs(gpx/gpy/gpz)) = 2574.663267 596.449616 671.0628226 Min and Max of epf 0.4010579275 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1267.224987 MLMG: Initial rhs = 633.6124936 MLMG: Initial residual (resid0) = 633.6124936 MLMG: Final Iter. 13 resid, resid/bnorm = 1.293564367e-09, 2.041570171e-12 MLMG: Timers: Solve = 0.271458636 Iter = 0.242308745 Bottom = 0.018777288 After projection: max(abs(u/v/w)) = 0.1472053897 0.01832667993 0.02580698901 Evolving particles on level: 0 ... with fluid dt 8.572343949e-05 done. Time per fluid step 1.528882336 Time per 189 particle steps 2.449602361 Coupling time per step 0.085235871 Time per step 4.11908265 Regridding at step 24 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 25: from old_time 0.002581545366 to new time 0.002667350087 with dt = 8.580472126e-05 Before projection: max(abs(u/v/w)) = 0.2269782582 0.04709077073 0.05104562594 max(abs(gpx/gpy/gpz)) = 2626.40096 619.1913553 695.0117402 Min and Max of epf 0.400096488 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1295.319028 MLMG: Initial rhs = 647.6595142 MLMG: Initial residual (resid0) = 647.6595142 MLMG: Final Iter. 13 resid, resid/bnorm = 1.084536905e-09, 1.674547939e-12 MLMG: Timers: Solve = 0.272215745 Iter = 0.242849342 Bottom = 0.01848117 After projection: max(abs(u/v/w)) = 0.1502760419 0.01863704407 0.02646271098 Evolving particles on level: 0 ... with fluid dt 8.580472126e-05 done. Time per fluid step 1.537621351 Time per 189 particle steps 2.460278737 Coupling time per step 0.085741597 Time per step 4.139004998 Regridding at step 25 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 26: from old_time 0.002667350087 to new time 0.00275368064 with dt = 8.633055255e-05 Before projection: max(abs(u/v/w)) = 0.2324137583 0.04920833495 0.05306478576 max(abs(gpx/gpy/gpz)) = 2677.197434 639.8725652 718.7665934 Min and Max of epf 0.4001694653 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1332.358149 MLMG: Initial rhs = 666.1790747 MLMG: Initial residual (resid0) = 666.1790747 MLMG: Final Iter. 13 resid, resid/bnorm = 1.054552001e-09, 1.582985779e-12 MLMG: Timers: Solve = 0.273442378 Iter = 0.244078046 Bottom = 0.019226946 After projection: max(abs(u/v/w)) = 0.153252248 0.01892437599 0.02711675176 Evolving particles on level: 0 ... with fluid dt 8.633055255e-05 done. Time per fluid step 1.538466214 Time per 190 particle steps 2.472540703 Coupling time per step 0.086172686 Time per step 4.152089045 Regridding at step 26 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 27: from old_time 0.00275368064 to new time 0.002840456242 with dt = 8.677560213e-05 Before projection: max(abs(u/v/w)) = 0.237436559 0.05199784951 0.05432951941 max(abs(gpx/gpy/gpz)) = 2725.067676 660.8354106 740.6356887 Min and Max of epf 0.4017275205 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1373.756687 MLMG: Initial rhs = 686.8783434 MLMG: Initial residual (resid0) = 686.8783434 MLMG: Final Iter. 13 resid, resid/bnorm = 1.124433879e-09, 1.637020428e-12 MLMG: Timers: Solve = 0.273199869 Iter = 0.24382339 Bottom = 0.019356216 After projection: max(abs(u/v/w)) = 0.156118055 0.01919419444 0.0277656138 Evolving particles on level: 0 ... with fluid dt 8.677560213e-05 done. Time per fluid step 1.537093933 Time per 191 particle steps 2.483008289 Coupling time per step 0.085812039 Time per step 4.160704044 Regridding at step 27 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 28: from old_time 0.002840456242 to new time 0.002926071424 with dt = 8.561518205e-05 Before projection: max(abs(u/v/w)) = 0.2379439688 0.05376582085 0.0548062682 max(abs(gpx/gpy/gpz)) = 2770.798783 681.563982 759.6135664 Min and Max of epf 0.4023699457 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1386.464317 MLMG: Initial rhs = 693.2321586 MLMG: Initial residual (resid0) = 693.2321586 MLMG: Final Iter. 13 resid, resid/bnorm = 1.272329797e-09, 1.835358878e-12 MLMG: Timers: Solve = 0.27334361 Iter = 0.244057507 Bottom = 0.019669114 After projection: max(abs(u/v/w)) = 0.1588011037 0.01944981576 0.02842030242 Evolving particles on level: 0 ... with fluid dt 8.561518205e-05 done. Time per fluid step 1.538052797 Time per 188 particle steps 2.451741646 Coupling time per step 0.085999977 Time per step 4.131228953 Regridding at step 28 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 29: from old_time 0.002926071424 to new time 0.003002174817 with dt = 7.610339361e-05 Before projection: max(abs(u/v/w)) = 0.2153791672 0.05033278045 0.04902728739 max(abs(gpx/gpy/gpz)) = 2816.158157 702.8428122 778.4422952 Min and Max of epf 0.3986810448 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1265.16271 MLMG: Initial rhs = 632.5813552 MLMG: Initial residual (resid0) = 632.5813552 MLMG: Final Iter. 13 resid, resid/bnorm = 1.179543574e-09, 1.864651186e-12 MLMG: Timers: Solve = 0.274234778 Iter = 0.24486921 Bottom = 0.01973735 After projection: max(abs(u/v/w)) = 0.1605722895 0.0197328266 0.02904167369 Evolving particles on level: 0 ... with fluid dt 7.610339361e-05 done. Time per fluid step 1.506225506 Time per 167 particle steps 2.174719597 Coupling time per step 0.085841003 Time per step 3.821731992 Regridding at step 29 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 30: from old_time 0.003002174817 to new time 0.003083466812 with dt = 8.129199461e-05 Before projection: max(abs(u/v/w)) = 0.2337856203 0.05621695713 0.05493721936 max(abs(gpx/gpy/gpz)) = 2870.511667 736.2321435 803.7203082 Min and Max of epf 0.398830716 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1376.054613 MLMG: Initial rhs = 688.0273063 MLMG: Initial residual (resid0) = 688.0273063 MLMG: Final Iter. 13 resid, resid/bnorm = 1.327112642e-09, 1.928866238e-12 MLMG: Timers: Solve = 0.27347466 Iter = 0.244119302 Bottom = 0.019354495 After projection: max(abs(u/v/w)) = 0.1635484993 0.0200108925 0.02965916915 Evolving particles on level: 0 ... with fluid dt 8.129199461e-05 done. Time per fluid step 1.503789663 Time per 179 particle steps 2.354565827 Coupling time per step 0.086046081 Time per step 3.999534635 Writing plotfile BENCH05-Size0008_wide-Godunov_plt00030 at time 0.003083466812 Time spent in main (after init) 138.207104 Time spent in main 147.2210648 Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [2363 ... 2471] [The Arena] max space (MB) allocated spread across MPI: [153 ... 177] [The Arena] max space (MB) used spread across MPI: [152 ... 175] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [16 ... 16] [The Pinned Arena] max space (MB) used spread across MPI: [7 ... 13] AMReX (26.08-4-gcb098067c32e) finalized