Initializing AMReX (26.08-31-g06424932b757)... MPI initialized with 4 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.08-31-g06424932b757) initialized MFIX git describe: 26.08-12-g28648126aeb6 AMReX-Hydro git hash: 9446740c59feca3bf007a6e6d95a6080816c33ec Number of levels: 1 RunType is Standard Auto-generating level-set parameters: eb_refinement = 1 levelset_pad = 2 eb_pad = 2 ================================================================================ Warning: Overwriting amr.plot_int with value from mfix.plot_int ================================================================================ ================================================================================ Warning: Overwriting amr.plot_file with value from mfix.plot_file ================================================================================ ================================================================================ Warning: Overwriting amr.check_file with value from mfix.check_file ================================================================================ Simulation is transient -------------------------------------------------------------------------------- Info: Max effective viscosity factor not specified. Using default 1e+06 -------------------------------------------------------------------------------- Particle-particle conduction is disabled. Particle-fluid-particle conduction is disabled. EB with constant temperature: bc.hot-walls Temperature of wall .................... 900 Load balance setup: Type: DualGrid Strategy: KnapSack Weighting: ParticleCount Drag model: BVK2 Convection model not specified. Setting default: mfix.convection.model = RanzMarshall Building cylinder geometry. Internal Flow: 1 Radius: 0.0039 Height: -1 Direction: 0 Rotation angle: 0 Rotation axis: 0 Center: 0.004, 0.004, 0.004 Done making the fluid eb levels ... On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ================================================================================ Warning: Setting particle max grid size to fluid max grid size ================================================================================ In MakeBaseGrids: BA HAS 16 GRIDS Auto generating particles ... Total number of generated particles: 215,120 Time spent in initializing particles 0.78794663 **************************************** Coverage report: Grids Cells regular: 4 44960 covered: 0 12800 cut: 12 6240 **************************************** Bounding box for levelset imposed walls: Lo: 1e-15 -0.008 -0.008 Hi: 0.016 0.016 0.016 Clean up auto-generated particles. IC Region Generated Removed Remaining **************** **************** **************** **************** full-domain 0 0 0 bed 215,120 58,061 157,059 ---------------- ---------------- ---------------- ---------------- Total 215,120 58,061 157,059 **************** **************** **************** **************** Setting original sum_vol to 2.998926818e-07 Initial projection: Before projection: max(abs(u/v/w)) = 0.015 0 0 max(abs(gpx/gpy/gpz)) = 0 0 0 Min and Max of epf 0.404821315 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 44.6112468 MLMG: Initial rhs = 22.3056234 MLMG: Initial residual (resid0) = 22.3056234 MLMG: Final Iter. 13 resid, resid/bnorm = 6.106570805e-11, 2.737682196e-12 MLMG: Timers: Solve = 0.274521273 Iter = 0.241751266 Bottom = 0.019134855 After projection: max(abs(u/v/w)) = 0.02199663394 0.00113116282 0.00118949404 Doing initial pressure iterations with dt = 0.008211321795 In initial_iterations: iter = 0 Before projection: max(abs(u/v/w)) = 0.01864847553 0.004888276558 0.004999766061 max(abs(gpx/gpy/gpz)) = 0 0 0 Min and Max of epf 0.404821315 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 148.0070194 MLMG: Initial rhs = 74.00350969 MLMG: Initial residual (resid0) = 74.00350969 MLMG: Final Iter. 13 resid, resid/bnorm = 2.853107195e-10, 3.85536741e-12 MLMG: Timers: Solve = 0.269435285 Iter = 0.240652206 Bottom = 0.01896202 After projection: max(abs(u/v/w)) = 0.02180310583 0.003545677848 0.003618610057 In initial_iterations: iter = 1 Before projection: max(abs(u/v/w)) = 0.01904173908 0.004872212339 0.004978278826 max(abs(gpx/gpy/gpz)) = 2.64979077 0.4857109379 0.4902803414 Min and Max of epf 0.404821315 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 147.7900726 MLMG: Initial rhs = 73.8950363 MLMG: Initial residual (resid0) = 73.8950363 MLMG: Final Iter. 13 resid, resid/bnorm = 2.598309901e-10, 3.516217097e-12 MLMG: Timers: Solve = 0.269568084 Iter = 0.240694791 Bottom = 0.018947129 After projection: max(abs(u/v/w)) = 0.02181407035 0.003500651848 0.003581062482 In initial_iterations: iter = 2 Before projection: max(abs(u/v/w)) = 0.01920306989 0.004856607747 0.004957911497 max(abs(gpx/gpy/gpz)) = 5.297760837 0.9673546565 0.9768213121 Min and Max of epf 0.404821315 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 147.5557461 MLMG: Initial rhs = 73.77787307 MLMG: Initial residual (resid0) = 73.77787307 MLMG: Final Iter. 13 resid, resid/bnorm = 2.484325801e-10, 3.367304718e-12 MLMG: Timers: Solve = 0.269427948 Iter = 0.240551799 Bottom = 0.018924994 After projection: max(abs(u/v/w)) = 0.02177215786 0.003462239656 0.003543364448 Enclosed domain volume is 2.998926818e-07 Time spent in init 8.938913297 Writing plotfile BENCH05-Size0008_wide-Godunov_plt00000 at time 0 Regridding at step 0 Updating particle ebfactory Regridding level-set on lev = 0 Also regridding refined level-set On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 1: from old_time 0 to new time 0.0001478172962 with dt = 0.0001478172962 Before projection (with small dt modification): max(abs(u/v/w)) = 0.01509374597 0.003121148662 0.003199308726 max(abs(gpx/gpy/gpz)) = 7.930323103 1.445591671 1.459484702 Min and Max of epf 0.404821315 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 139.7655748 MLMG: Initial rhs = 69.8827874 MLMG: Initial residual (resid0) = 69.8827874 MLMG: Final Iter. 13 resid, resid/bnorm = 2.220064133e-10, 3.176839698e-12 MLMG: Timers: Solve = 0.268373944 Iter = 0.239727222 Bottom = 0.019041083 After projection (with small dt modification): max(abs(u/v/w)) = 0.02569673942 0.002494217087 0.002499819391 Evolving particles on level: 0 ... with fluid dt 0.0001478172962 done. Time per fluid step 1.564217783 Time per 325 particle steps 4.194559264 Coupling time per step 0.085304973 Time per step 5.981379631 Regridding at step 1 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 2: from old_time 0.0001478172962 to new time 0.0002933301982 with dt = 0.0001455129019 Before projection: max(abs(u/v/w)) = 0.0209965405 0.004864591379 0.004839302441 max(abs(gpx/gpy/gpz)) = 144.5526288 18.25535987 18.34755284 Min and Max of epf 0.4048417166 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 265.8204166 MLMG: Initial rhs = 132.9102083 MLMG: Initial residual (resid0) = 132.9102083 MLMG: Final Iter. 13 resid, resid/bnorm = 4.12215595e-10, 3.10145925e-12 MLMG: Timers: Solve = 0.271956322 Iter = 0.242950003 Bottom = 0.01952161 After projection: max(abs(u/v/w)) = 0.03276515051 0.003487109732 0.003729435166 Evolving particles on level: 0 ... with fluid dt 0.0001455129019 done. Time per fluid step 1.573751464 Time per 320 particle steps 4.100549418 Coupling time per step 0.085570469 Time per step 5.814301143 Regridding at step 2 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 3: from old_time 0.0002933301982 to new time 0.0004343813894 with dt = 0.0001410511912 Before projection: max(abs(u/v/w)) = 0.03958602022 0.005821162882 0.005630740104 max(abs(gpx/gpy/gpz)) = 282.6338351 31.42487451 32.7406019 Min and Max of epf 0.4049034693 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 378.8590083 MLMG: Initial rhs = 189.4295041 MLMG: Initial residual (resid0) = 189.4295041 MLMG: Final Iter. 13 resid, resid/bnorm = 5.886389154e-10, 3.107429954e-12 MLMG: Timers: Solve = 0.273194761 Iter = 0.244194137 Bottom = 0.01956671 After projection: max(abs(u/v/w)) = 0.04006855111 0.004507343728 0.005581240311 Evolving particles on level: 0 ... with fluid dt 0.0001410511912 done. Time per fluid step 1.573158826 Time per 310 particle steps 3.992828826 Coupling time per step 0.085342251 Time per step 5.70592228 Regridding at step 3 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 4: from old_time 0.0004343813894 to new time 0.000570453873 with dt = 0.0001360724836 Before projection: max(abs(u/v/w)) = 0.05632381484 0.006445008244 0.006080978195 max(abs(gpx/gpy/gpz)) = 420.7849947 51.5244487 53.67347508 Min and Max of epf 0.4050059935 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 480.0316438 MLMG: Initial rhs = 240.0158219 MLMG: Initial residual (resid0) = 240.0158219 MLMG: Final Iter. 13 resid, resid/bnorm = 7.783631517e-10, 3.242966008e-12 MLMG: Timers: Solve = 0.271853381 Iter = 0.242857533 Bottom = 0.019282907 After projection: max(abs(u/v/w)) = 0.04720919796 0.005618105744 0.007351092436 Evolving particles on level: 0 ... with fluid dt 0.0001360724836 done. Time per fluid step 1.572537855 Time per 299 particle steps 3.82026843 Coupling time per step 0.085604978 Time per step 5.53274506 Regridding at step 4 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 5: from old_time 0.000570453873 to new time 0.0007019987326 with dt = 0.0001315448596 Before projection: max(abs(u/v/w)) = 0.07208554722 0.007525684289 0.0083412651 max(abs(gpx/gpy/gpz)) = 560.0641723 73.48867424 76.37189522 Min and Max of epf 0.4001478934 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 572.0187382 MLMG: Initial rhs = 286.0093691 MLMG: Initial residual (resid0) = 286.0093691 MLMG: Final Iter. 13 resid, resid/bnorm = 1.011336792e-09, 3.536026793e-12 MLMG: Timers: Solve = 0.273166957 Iter = 0.244079616 Bottom = 0.020246028 After projection: max(abs(u/v/w)) = 0.05465912775 0.006830419359 0.008966172658 Evolving particles on level: 0 ... with fluid dt 0.0001315448596 done. Time per fluid step 1.570570701 Time per 289 particle steps 3.712804905 Coupling time per step 0.085207281 Time per step 5.423280899 Regridding at step 5 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 6: from old_time 0.0007019987326 to new time 0.0008293744932 with dt = 0.0001273757606 Before projection: max(abs(u/v/w)) = 0.08668857046 0.009723692316 0.01094490078 max(abs(gpx/gpy/gpz)) = 698.9101826 97.56806603 102.2421546 Min and Max of epf 0.3995004434 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 655.2065855 MLMG: Initial rhs = 327.6032927 MLMG: Initial residual (resid0) = 327.6032927 MLMG: Final Iter. 13 resid, resid/bnorm = 1.273962269e-09, 3.888734629e-12 MLMG: Timers: Solve = 0.272634556 Iter = 0.243525705 Bottom = 0.020357428 After projection: max(abs(u/v/w)) = 0.06184558425 0.007923711707 0.01043753046 Evolving particles on level: 0 ... with fluid dt 0.0001273757606 done. Time per fluid step 1.57101915 Time per 280 particle steps 3.619105673 Coupling time per step 0.085554187 Time per step 5.330042118 Regridding at step 6 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 7: from old_time 0.0008293744932 to new time 0.0009529155442 with dt = 0.000123541051 Before projection: max(abs(u/v/w)) = 0.1001293075 0.01189562411 0.01364493692 max(abs(gpx/gpy/gpz)) = 836.2650798 122.9056095 131.2437344 Min and Max of epf 0.4003090488 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 728.0152802 MLMG: Initial rhs = 364.0076401 MLMG: Initial residual (resid0) = 364.0076401 MLMG: Final Iter. 13 resid, resid/bnorm = 1.546982986e-09, 4.249864057e-12 MLMG: Timers: Solve = 0.272320366 Iter = 0.243404157 Bottom = 0.020080879 After projection: max(abs(u/v/w)) = 0.06874755978 0.008913682427 0.01178857482 Evolving particles on level: 0 ... with fluid dt 0.000123541051 done. Time per fluid step 1.563559989 Time per 272 particle steps 3.480930901 Coupling time per step 0.085542383 Time per step 5.184661662 Regridding at step 7 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 8: from old_time 0.0009529155442 to new time 0.0010728442 with dt = 0.0001199286561 Before projection: max(abs(u/v/w)) = 0.1123814385 0.01402352443 0.01634062032 max(abs(gpx/gpy/gpz)) = 971.2882066 148.8443859 162.0044707 Min and Max of epf 0.3973553886 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 792.5099673 MLMG: Initial rhs = 396.2549836 MLMG: Initial residual (resid0) = 396.2549836 MLMG: Final Iter. 13 resid, resid/bnorm = 1.51175783e-09, 3.815113733e-12 MLMG: Timers: Solve = 0.272902279 Iter = 0.243893435 Bottom = 0.020478979 After projection: max(abs(u/v/w)) = 0.07538002713 0.009820501211 0.01304854926 Evolving particles on level: 0 ... with fluid dt 0.0001199286561 done. Time per fluid step 1.564264765 Time per 264 particle steps 3.396070314 Coupling time per step 0.085135806 Time per step 5.099827617 Regridding at step 8 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 9: from old_time 0.0010728442 to new time 0.001189465435 with dt = 0.0001166212352 Before projection: max(abs(u/v/w)) = 0.1235957942 0.01616853471 0.01895376602 max(abs(gpx/gpy/gpz)) = 1103.283628 175.0822296 193.0112928 Min and Max of epf 0.3980925352 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 852.1708501 MLMG: Initial rhs = 426.0854251 MLMG: Initial residual (resid0) = 426.0854251 MLMG: Final Iter. 13 resid, resid/bnorm = 1.315948239e-09, 3.08846105e-12 MLMG: Timers: Solve = 0.271824101 Iter = 0.242973489 Bottom = 0.019157994 After projection: max(abs(u/v/w)) = 0.0817304056 0.01065954759 0.01422961345 Evolving particles on level: 0 ... with fluid dt 0.0001166212352 done. Time per fluid step 1.561443084 Time per 256 particle steps 3.312549902 Coupling time per step 0.085302474 Time per step 5.013961073 Regridding at step 9 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 10: from old_time 0.001189465435 to new time 0.00130301226 with dt = 0.0001135468241 Before projection: max(abs(u/v/w)) = 0.1337996729 0.01842571573 0.02151431794 max(abs(gpx/gpy/gpz)) = 1231.565276 201.5025298 225.0833014 Min and Max of epf 0.3998083548 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 907.0326594 MLMG: Initial rhs = 453.5163297 MLMG: Initial residual (resid0) = 453.5163297 MLMG: Final Iter. 13 resid, resid/bnorm = 1.217772549e-09, 2.685179055e-12 MLMG: Timers: Solve = 0.271678456 Iter = 0.242585252 Bottom = 0.018964755 After projection: max(abs(u/v/w)) = 0.08780774774 0.01143802589 0.01533160632 Evolving particles on level: 0 ... with fluid dt 0.0001135468241 done. Time per fluid step 1.563479674 Time per 250 particle steps 3.196883566 Coupling time per step 0.085366082 Time per step 4.900142391 Regridding at step 10 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 11: from old_time 0.00130301226 to new time 0.001412920146 with dt = 0.0001099078863 Before projection: max(abs(u/v/w)) = 0.1423000075 0.02034839486 0.02380345731 max(abs(gpx/gpy/gpz)) = 1355.656407 227.9181196 257.7477047 Min and Max of epf 0.4016032747 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 945.8636941 MLMG: Initial rhs = 472.9318471 MLMG: Initial residual (resid0) = 472.9318471 MLMG: Final Iter. 13 resid, resid/bnorm = 1.156259088e-09, 2.444874659e-12 MLMG: Timers: Solve = 0.271454866 Iter = 0.242366324 Bottom = 0.019180022 After projection: max(abs(u/v/w)) = 0.09359305087 0.01217341266 0.01636555505 Evolving particles on level: 0 ... with fluid dt 0.0001099078863 done. Time per fluid step 1.528959573 Time per 242 particle steps 3.11164627 Coupling time per step 0.085666718 Time per step 4.780762271 Regridding at step 11 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 12: from old_time 0.001412920146 to new time 0.001519455024 with dt = 0.000106534878 Before projection: max(abs(u/v/w)) = 0.1502557402 0.02218718524 0.02605309518 max(abs(gpx/gpy/gpz)) = 1476.175449 254.4756296 291.3660766 Min and Max of epf 0.4003766965 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 982.3925097 MLMG: Initial rhs = 491.1962548 MLMG: Initial residual (resid0) = 491.1962548 MLMG: Final Iter. 13 resid, resid/bnorm = 1.132478999e-09, 2.305553001e-12 MLMG: Timers: Solve = 0.272060416 Iter = 0.243048674 Bottom = 0.019823456 After projection: max(abs(u/v/w)) = 0.09912534274 0.01286278339 0.0173426701 Evolving particles on level: 0 ... with fluid dt 0.000106534878 done. Time per fluid step 1.525390874 Time per 234 particle steps 3.026621779 Coupling time per step 0.0857939 Time per step 4.692642747 Regridding at step 12 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 13: from old_time 0.001519455024 to new time 0.001622842592 with dt = 0.0001033875678 Before projection: max(abs(u/v/w)) = 0.1572693067 0.02384413078 0.0281764083 max(abs(gpx/gpy/gpz)) = 1592.593368 281.0341903 325.0104553 Min and Max of epf 0.4033854945 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1016.62761 MLMG: Initial rhs = 508.3138051 MLMG: Initial residual (resid0) = 508.3138051 MLMG: Final Iter. 13 resid, resid/bnorm = 1.141003736e-09, 2.244683746e-12 MLMG: Timers: Solve = 0.272978829 Iter = 0.244049062 Bottom = 0.020331644 After projection: max(abs(u/v/w)) = 0.1044063683 0.01350160015 0.01826749504 Evolving particles on level: 0 ... with fluid dt 0.0001033875678 done. Time per fluid step 1.533761785 Time per 227 particle steps 2.951145311 Coupling time per step 0.085339782 Time per step 4.624699567 Regridding at step 13 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 14: from old_time 0.001622842592 to new time 0.001723303427 with dt = 0.000100460835 Before projection: max(abs(u/v/w)) = 0.1635915358 0.02549678257 0.03016559271 max(abs(gpx/gpy/gpz)) = 1704.571019 309.2292948 358.2530775 Min and Max of epf 0.4001223446 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1048.459173 MLMG: Initial rhs = 524.2295867 MLMG: Initial residual (resid0) = 524.2295867 MLMG: Final Iter. 13 resid, resid/bnorm = 1.19850796e-09, 2.286227237e-12 MLMG: Timers: Solve = 0.271809756 Iter = 0.242710342 Bottom = 0.019167956 After projection: max(abs(u/v/w)) = 0.1094524145 0.01409873636 0.01914847838 Evolving particles on level: 0 ... with fluid dt 0.000100460835 done. Time per fluid step 1.521663204 Time per 221 particle steps 2.834762737 Coupling time per step 0.085636231 Time per step 4.49626712 Regridding at step 14 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 15: from old_time 0.001723303427 to new time 0.001808813522 with dt = 8.551009506e-05 Before projection: max(abs(u/v/w)) = 0.1556301066 0.02307610314 0.02747612293 max(abs(gpx/gpy/gpz)) = 1811.923148 336.1975341 391.4162649 Min and Max of epf 0.4002170255 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 945.3081431 MLMG: Initial rhs = 472.6540715 MLMG: Initial residual (resid0) = 472.6540715 MLMG: Final Iter. 13 resid, resid/bnorm = 1.138474204e-09, 2.408683797e-12 MLMG: Timers: Solve = 0.271642624 Iter = 0.242550774 Bottom = 0.019289772 After projection: max(abs(u/v/w)) = 0.1136095595 0.01468424937 0.0199526782 Evolving particles on level: 0 ... with fluid dt 8.551009506e-05 done. Time per fluid step 1.529933336 Time per 188 particle steps 2.432040206 Coupling time per step 0.085109275 Time per step 4.101779709 Regridding at step 15 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 16: from old_time 0.001808813522 to new time 0.001897878386 with dt = 8.906486426e-05 Before projection: max(abs(u/v/w)) = 0.174137361 0.02688262286 0.03210032241 max(abs(gpx/gpy/gpz)) = 1933.106504 370.3890953 433.2595732 Min and Max of epf 0.3997272253 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1033.122983 MLMG: Initial rhs = 516.5614917 MLMG: Initial residual (resid0) = 516.5614917 MLMG: Final Iter. 13 resid, resid/bnorm = 1.31760558e-09, 2.550723585e-12 MLMG: Timers: Solve = 0.271418233 Iter = 0.242415854 Bottom = 0.019380964 After projection: max(abs(u/v/w)) = 0.1183573942 0.01517806975 0.0207747209 Evolving particles on level: 0 ... with fluid dt 8.906486426e-05 done. Time per fluid step 1.531379614 Time per 196 particle steps 2.517156801 Coupling time per step 0.085315053 Time per step 4.188422041 Regridding at step 16 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 17: from old_time 0.001897878386 to new time 0.001987919075 with dt = 9.004068858e-05 Before projection: max(abs(u/v/w)) = 0.1857513957 0.02949543321 0.03529201636 max(abs(gpx/gpy/gpz)) = 2034.153465 398.6850707 468.1095979 Min and Max of epf 0.3994713838 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1084.613119 MLMG: Initial rhs = 542.3065596 MLMG: Initial residual (resid0) = 542.3065596 MLMG: Final Iter. 13 resid, resid/bnorm = 1.451795129e-09, 2.677074623e-12 MLMG: Timers: Solve = 0.271670334 Iter = 0.242672677 Bottom = 0.019638028 After projection: max(abs(u/v/w)) = 0.1228341674 0.015650234 0.0215544722 Evolving particles on level: 0 ... with fluid dt 9.004068858e-05 done. Time per fluid step 1.531536904 Time per 198 particle steps 2.538288078 Coupling time per step 0.085164407 Time per step 4.209809957 Regridding at step 17 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 18: from old_time 0.001987919075 to new time 0.002078529275 with dt = 9.061019992e-05 Before projection: max(abs(u/v/w)) = 0.1953813766 0.03218008381 0.0381982348 max(abs(gpx/gpy/gpz)) = 2125.508566 422.7491174 500.8243115 Min and Max of epf 0.4013402867 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1130.092466 MLMG: Initial rhs = 565.0462332 MLMG: Initial residual (resid0) = 565.0462332 MLMG: Final Iter. 13 resid, resid/bnorm = 1.538012384e-09, 2.721923081e-12 MLMG: Timers: Solve = 0.272310943 Iter = 0.243297849 Bottom = 0.020493715 After projection: max(abs(u/v/w)) = 0.1270307235 0.01610052351 0.02229055252 Evolving particles on level: 0 ... with fluid dt 9.061019992e-05 done. Time per fluid step 1.532886506 Time per 199 particle steps 2.550518399 Coupling time per step 0.08564143 Time per step 4.223366822 Regridding at step 18 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 19: from old_time 0.002078529275 to new time 0.002166725162 with dt = 8.819588777e-05 Before projection: max(abs(u/v/w)) = 0.1977239932 0.03375493024 0.03938697994 max(abs(gpx/gpy/gpz)) = 2208.898488 448.2672957 530.7031772 Min and Max of epf 0.4020653538 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1139.454148 MLMG: Initial rhs = 569.7270739 MLMG: Initial residual (resid0) = 569.7270739 MLMG: Final Iter. 13 resid, resid/bnorm = 1.559968155e-09, 2.738097286e-12 MLMG: Timers: Solve = 0.271221266 Iter = 0.242215953 Bottom = 0.019953681 After projection: max(abs(u/v/w)) = 0.1307724684 0.01653344184 0.02297413095 Evolving particles on level: 0 ... with fluid dt 8.819588777e-05 done. Time per fluid step 1.495941867 Time per 194 particle steps 2.496757964 Coupling time per step 0.085670762 Time per step 4.132572033 Regridding at step 19 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 20: from old_time 0.002166725162 to new time 0.00224915921 with dt = 8.243404753e-05 Before projection: max(abs(u/v/w)) = 0.1918210519 0.03337015277 0.03849387503 max(abs(gpx/gpy/gpz)) = 2289.390592 473.9255025 558.7095994 Min and Max of epf 0.3995016258 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1103.321607 MLMG: Initial rhs = 551.6608036 MLMG: Initial residual (resid0) = 551.6608036 MLMG: Final Iter. 13 resid, resid/bnorm = 1.408821504e-09, 2.553782134e-12 MLMG: Timers: Solve = 0.271829218 Iter = 0.242818891 Bottom = 0.01899541 After projection: max(abs(u/v/w)) = 0.1340063056 0.01694639241 0.0236016135 Evolving particles on level: 0 ... with fluid dt 8.243404753e-05 done. Time per fluid step 1.528521302 Time per 181 particle steps 2.357199351 Coupling time per step 0.086068202 Time per step 4.025755847 Regridding at step 20 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 21: from old_time 0.00224915921 to new time 0.002333380174 with dt = 8.422096427e-05 Before projection: max(abs(u/v/w)) = 0.2024934281 0.0365667579 0.04194664011 max(abs(gpx/gpy/gpz)) = 2371.23717 502.0311671 589.7849722 Min and Max of epf 0.3999196734 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1162.149008 MLMG: Initial rhs = 581.0745042 MLMG: Initial residual (resid0) = 581.0745042 MLMG: Final Iter. 13 resid, resid/bnorm = 1.477019396e-09, 2.541876102e-12 MLMG: Timers: Solve = 0.270147966 Iter = 0.241057797 Bottom = 0.019258939 After projection: max(abs(u/v/w)) = 0.1375246829 0.01731088422 0.02421869798 Evolving particles on level: 0 ... with fluid dt 8.422096427e-05 done. Time per fluid step 1.527006864 Time per 185 particle steps 2.401409218 Coupling time per step 0.085102007 Time per step 4.068001172 Regridding at step 21 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 22: from old_time 0.002333380174 to new time 0.002415512264 with dt = 8.213208972e-05 Before projection: max(abs(u/v/w)) = 0.2032122511 0.03803423343 0.04282075395 max(abs(gpx/gpy/gpz)) = 2441.586146 529.020364 616.8068327 Min and Max of epf 0.4008113616 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1167.52759 MLMG: Initial rhs = 583.7637949 MLMG: Initial residual (resid0) = 583.7637949 MLMG: Final Iter. 13 resid, resid/bnorm = 1.563321916e-09, 2.678004237e-12 MLMG: Timers: Solve = 0.271266553 Iter = 0.242260945 Bottom = 0.018966263 After projection: max(abs(u/v/w)) = 0.1406954205 0.01767531707 0.0247730421 Evolving particles on level: 0 ... with fluid dt 8.213208972e-05 done. Time per fluid step 1.527659986 Time per 181 particle steps 2.357604612 Coupling time per step 0.08573118 Time per step 4.025157683 Regridding at step 22 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 23: from old_time 0.002415512264 to new time 0.002495821926 with dt = 8.030966248e-05 Before projection: max(abs(u/v/w)) = 0.2040816672 0.03980403358 0.04367747517 max(abs(gpx/gpy/gpz)) = 2509.827924 563.6063573 643.9810991 Min and Max of epf 0.4009279459 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1165.059984 MLMG: Initial rhs = 582.5299922 MLMG: Initial residual (resid0) = 582.5299922 MLMG: Final Iter. 13 resid, resid/bnorm = 1.518074555e-09, 2.606002395e-12 MLMG: Timers: Solve = 0.272648802 Iter = 0.243542236 Bottom = 0.020108464 After projection: max(abs(u/v/w)) = 0.1437126094 0.01802093747 0.02528586017 Evolving particles on level: 0 ... with fluid dt 8.030966248e-05 done. Time per fluid step 1.499346738 Time per 177 particle steps 2.315532889 Coupling time per step 0.08504939 Time per step 3.954490826 Regridding at step 23 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 24: from old_time 0.002495821926 to new time 0.002581545366 with dt = 8.572343949e-05 Before projection: max(abs(u/v/w)) = 0.2226038488 0.04527991608 0.04934554385 max(abs(gpx/gpy/gpz)) = 2574.663267 596.449616 671.0628226 Min and Max of epf 0.4010579275 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1267.224987 MLMG: Initial rhs = 633.6124936 MLMG: Initial residual (resid0) = 633.6124936 MLMG: Final Iter. 13 resid, resid/bnorm = 1.294047536e-09, 2.042332733e-12 MLMG: Timers: Solve = 0.270433304 Iter = 0.241507401 Bottom = 0.019364082 After projection: max(abs(u/v/w)) = 0.1472053897 0.01832667993 0.02580698901 Evolving particles on level: 0 ... with fluid dt 8.572343949e-05 done. Time per fluid step 1.527671425 Time per 189 particle steps 2.444285672 Coupling time per step 0.085086918 Time per step 4.112010204 Regridding at step 24 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 25: from old_time 0.002581545366 to new time 0.002667350087 with dt = 8.580472126e-05 Before projection: max(abs(u/v/w)) = 0.2269782582 0.04709077073 0.05104562594 max(abs(gpx/gpy/gpz)) = 2626.40096 619.1913553 695.0117402 Min and Max of epf 0.400096488 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1295.319028 MLMG: Initial rhs = 647.6595142 MLMG: Initial residual (resid0) = 647.6595142 MLMG: Final Iter. 13 resid, resid/bnorm = 1.083030554e-09, 1.672222102e-12 MLMG: Timers: Solve = 0.270025209 Iter = 0.241181741 Bottom = 0.018482685 After projection: max(abs(u/v/w)) = 0.1502760419 0.01863704407 0.02646271098 Evolving particles on level: 0 ... with fluid dt 8.580472126e-05 done. Time per fluid step 1.52514628 Time per 189 particle steps 2.44491855 Coupling time per step 0.085511311 Time per step 4.110028326 Regridding at step 25 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 26: from old_time 0.002667350087 to new time 0.00275368064 with dt = 8.633055255e-05 Before projection: max(abs(u/v/w)) = 0.2324137583 0.04920833495 0.05306478576 max(abs(gpx/gpy/gpz)) = 2677.197434 639.8725652 718.7665934 Min and Max of epf 0.4001694653 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1332.358149 MLMG: Initial rhs = 666.1790747 MLMG: Initial residual (resid0) = 666.1790747 MLMG: Final Iter. 13 resid, resid/bnorm = 1.053265919e-09, 1.581055243e-12 MLMG: Timers: Solve = 0.269998672 Iter = 0.240989118 Bottom = 0.019231936 After projection: max(abs(u/v/w)) = 0.153252248 0.01892437599 0.02711675176 Evolving particles on level: 0 ... with fluid dt 8.633055255e-05 done. Time per fluid step 1.526567706 Time per 190 particle steps 2.456762781 Coupling time per step 0.085725067 Time per step 4.12346697 Regridding at step 26 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 27: from old_time 0.00275368064 to new time 0.002840456242 with dt = 8.677560213e-05 Before projection: max(abs(u/v/w)) = 0.237436559 0.05199784951 0.05432951941 max(abs(gpx/gpy/gpz)) = 2725.067676 660.8354106 740.6356887 Min and Max of epf 0.4017275205 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1373.756687 MLMG: Initial rhs = 686.8783434 MLMG: Initial residual (resid0) = 686.8783434 MLMG: Final Iter. 13 resid, resid/bnorm = 1.123993343e-09, 1.636379067e-12 MLMG: Timers: Solve = 0.270812797 Iter = 0.241802402 Bottom = 0.019255067 After projection: max(abs(u/v/w)) = 0.156118055 0.01919419444 0.0277656138 Evolving particles on level: 0 ... with fluid dt 8.677560213e-05 done. Time per fluid step 1.526575938 Time per 191 particle steps 2.465013447 Coupling time per step 0.085878651 Time per step 4.132170608 Regridding at step 27 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 28: from old_time 0.002840456242 to new time 0.002926071424 with dt = 8.561518205e-05 Before projection: max(abs(u/v/w)) = 0.2379439688 0.05376582085 0.0548062682 max(abs(gpx/gpy/gpz)) = 2770.798783 681.563982 759.6135664 Min and Max of epf 0.4023699457 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1386.464317 MLMG: Initial rhs = 693.2321586 MLMG: Initial residual (resid0) = 693.2321586 MLMG: Final Iter. 13 resid, resid/bnorm = 1.2729231e-09, 1.836214729e-12 MLMG: Timers: Solve = 0.270822777 Iter = 0.241809695 Bottom = 0.019579064 After projection: max(abs(u/v/w)) = 0.1588011037 0.01944981576 0.02842030242 Evolving particles on level: 0 ... with fluid dt 8.561518205e-05 done. Time per fluid step 1.527157802 Time per 188 particle steps 2.435830684 Coupling time per step 0.085446572 Time per step 4.102953929 Regridding at step 28 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 29: from old_time 0.002926071424 to new time 0.003002174817 with dt = 7.610339361e-05 Before projection: max(abs(u/v/w)) = 0.2153791672 0.05033278045 0.04902728739 max(abs(gpx/gpy/gpz)) = 2816.158157 702.8428122 778.4422952 Min and Max of epf 0.3986810448 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1265.16271 MLMG: Initial rhs = 632.5813552 MLMG: Initial residual (resid0) = 632.5813552 MLMG: Final Iter. 13 resid, resid/bnorm = 1.179323306e-09, 1.86430298e-12 MLMG: Timers: Solve = 0.271179612 Iter = 0.242156456 Bottom = 0.019881583 After projection: max(abs(u/v/w)) = 0.1605722895 0.0197328266 0.02904167369 Evolving particles on level: 0 ... with fluid dt 7.610339361e-05 done. Time per fluid step 1.493908824 Time per 167 particle steps 2.159858493 Coupling time per step 0.085003457 Time per step 3.793172308 Regridding at step 29 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 30: from old_time 0.003002174817 to new time 0.003083466812 with dt = 8.129199461e-05 Before projection: max(abs(u/v/w)) = 0.2337856203 0.05621695713 0.05493721936 max(abs(gpx/gpy/gpz)) = 2870.511667 736.2321435 803.7203082 Min and Max of epf 0.398830716 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1376.054613 MLMG: Initial rhs = 688.0273063 MLMG: Initial residual (resid0) = 688.0273063 MLMG: Final Iter. 13 resid, resid/bnorm = 1.326061039e-09, 1.927337806e-12 MLMG: Timers: Solve = 0.271229364 Iter = 0.242209695 Bottom = 0.019473632 After projection: max(abs(u/v/w)) = 0.1635484993 0.0200108925 0.02965916915 Evolving particles on level: 0 ... with fluid dt 8.129199461e-05 done. Time per fluid step 1.493768488 Time per 179 particle steps 2.339374984 Coupling time per step 0.085241907 Time per step 3.972530374 Writing plotfile BENCH05-Size0008_wide-Godunov_plt00030 at time 0.003083466812 Time spent in main (after init) 138.0012757 Time spent in main 146.940189 Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [2363 ... 2471] [The Arena] max space (MB) allocated spread across MPI: [153 ... 177] [The Arena] max space (MB) used spread across MPI: [152 ... 175] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [16 ... 16] [The Pinned Arena] max space (MB) used spread across MPI: [7 ... 13] AMReX (26.08-31-g06424932b757) finalized