Initializing AMReX (26.09-125-g523e7305089a)... MPI initialized with 4 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.09-125-g523e7305089a) initialized MFIX git describe: 26.09-8-g1f6ffc02157b AMReX-Hydro git hash: e49df248aabd2cc11865eb5be734a2f5f2f65ee5 Number of levels: 1 RunType is Standard Auto-generating level-set parameters: eb_refinement = 1 levelset_pad = 2 eb_pad = 2 ================================================================================ Warning: Overwriting amr.check_file with value from mfix.check_file ================================================================================ ================================================================================ Warning: Overwriting amr.plot_int with value from output.plot.int ================================================================================ ================================================================================ Warning: Overwriting amr.plot_file with value from output.plot.file ================================================================================ Simulation is transient -------------------------------------------------------------------------------- Info: Max effective viscosity factor not specified. Using default 1e+06 -------------------------------------------------------------------------------- Particle-particle conduction is disabled. Particle-fluid-particle conduction is disabled. EB with constant temperature: bc.hot-walls Temperature of wall .................... 900 Load balance setup: Type: DualGrid Strategy: KnapSack Weighting: ParticleCount Drag model: BVK2 Convection model not specified. Setting default: mfix.convection.model = RanzMarshall Building cylinder geometry. Internal Flow: 1 Radius: 0.0039 Height: -1 Direction: 0 Rotation angle: 0 Rotation axis: 0 Center: 0.004, 0.004, 0.004 Done making the fluid eb levels ... On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ================================================================================ Warning: Setting particle max grid size to fluid max grid size ================================================================================ In MakeBaseGrids: BA HAS 16 GRIDS Auto generating particles ... Total number of generated particles: 215,120 Time spent in initializing particles 0.783673193 **************************************** Coverage report: Grids Cells regular: 4 44960 covered: 0 12800 cut: 12 6240 **************************************** Bounding box for levelset imposed walls: Lo: 1e-15 -0.008 -0.008 Hi: 0.016 0.016 0.016 Clean up auto-generated particles. IC Region Generated Removed Remaining **************** **************** **************** **************** full-domain 0 0 0 bed 215,120 58,061 157,059 ---------------- ---------------- ---------------- ---------------- Total 215,120 58,061 157,059 **************** **************** **************** **************** Setting original sum_vol to 2.998926818e-07 Initial projection: Before projection: max(abs(u/v/w)) = 0.015 0 0 max(abs(gpx/gpy/gpz)) = 0 0 0 Min and Max of epf 0.404821315 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 44.6112468 MLMG: Initial rhs = 22.3056234 MLMG: Initial residual (resid0) = 22.3056234 MLMG: Final Iter. 13 resid, resid/bnorm = 6.110190132e-11, 2.739304803e-12 MLMG: Timers: Solve = 0.27533148 Iter = 0.241336178 Bottom = 0.019512801 After projection: max(abs(u/v/w)) = 0.02199663394 0.00113116282 0.00118949404 Doing initial pressure iterations with dt = 0.008211321795 In initial_iterations: iter = 0 Before projection: max(abs(u/v/w)) = 0.01864847553 0.004888276558 0.004999766061 max(abs(gpx/gpy/gpz)) = 0 0 0 Min and Max of epf 0.404821315 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 148.0070194 MLMG: Initial rhs = 74.00350969 MLMG: Initial residual (resid0) = 74.00350969 MLMG: Final Iter. 13 resid, resid/bnorm = 2.856010983e-10, 3.859291262e-12 MLMG: Timers: Solve = 0.268322002 Iter = 0.239707609 Bottom = 0.019161616 After projection: max(abs(u/v/w)) = 0.02180310583 0.003545677848 0.003618610057 In initial_iterations: iter = 1 Before projection: max(abs(u/v/w)) = 0.01904173908 0.004872212339 0.004978278826 max(abs(gpx/gpy/gpz)) = 2.64979077 0.4857109379 0.4902803414 Min and Max of epf 0.404821315 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 147.7900726 MLMG: Initial rhs = 73.8950363 MLMG: Initial residual (resid0) = 73.8950363 MLMG: Final Iter. 13 resid, resid/bnorm = 2.598184445e-10, 3.516047322e-12 MLMG: Timers: Solve = 0.269871001 Iter = 0.241161529 Bottom = 0.019259562 After projection: max(abs(u/v/w)) = 0.02181407035 0.003500651848 0.003581062482 In initial_iterations: iter = 2 Before projection: max(abs(u/v/w)) = 0.01920306989 0.004856607747 0.004957911497 max(abs(gpx/gpy/gpz)) = 5.297760837 0.9673546565 0.9768213121 Min and Max of epf 0.404821315 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 147.5557461 MLMG: Initial rhs = 73.77787307 MLMG: Initial residual (resid0) = 73.77787307 MLMG: Final Iter. 13 resid, resid/bnorm = 2.483630246e-10, 3.366361949e-12 MLMG: Timers: Solve = 0.270230893 Iter = 0.24136667 Bottom = 0.01933469 After projection: max(abs(u/v/w)) = 0.02177215786 0.003462239656 0.003543364448 Enclosed domain volume is 2.998926818e-07 Time spent in init 8.670139613 Writing plotfile BENCH05-Size0008_wide-Godunov_plt00000 at time 0 Regridding at step 0 Updating particle ebfactory Regridding level-set on lev = 0 Also regridding refined level-set On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 1: from old_time 0 to new time 0.0001478172962 with dt = 0.0001478172962 Before projection (with small dt modification): max(abs(u/v/w)) = 0.01509374597 0.003121148662 0.003199308726 max(abs(gpx/gpy/gpz)) = 7.930323103 1.445591671 1.459484702 Min and Max of epf 0.404821315 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 139.7655748 MLMG: Initial rhs = 69.8827874 MLMG: Initial residual (resid0) = 69.8827874 MLMG: Final Iter. 13 resid, resid/bnorm = 2.215351236e-10, 3.170095696e-12 MLMG: Timers: Solve = 0.270142549 Iter = 0.24133059 Bottom = 0.019424931 After projection (with small dt modification): max(abs(u/v/w)) = 0.02569673942 0.002494217087 0.002499819391 Evolving particles on level: 0 ... with fluid dt 0.0001478172962 done. Time per fluid step 1.524743007 Time per 325 particle steps 4.175715184 Coupling time per step 0.085793638 Time per step 5.908929906 Regridding at step 1 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 2: from old_time 0.0001478172962 to new time 0.0002933301982 with dt = 0.0001455129019 Before projection: max(abs(u/v/w)) = 0.0209965405 0.004864591379 0.004839302441 max(abs(gpx/gpy/gpz)) = 144.5526288 18.25535987 18.34755284 Min and Max of epf 0.4048417166 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 265.8204166 MLMG: Initial rhs = 132.9102083 MLMG: Initial residual (resid0) = 132.9102083 MLMG: Final Iter. 13 resid, resid/bnorm = 4.122746589e-10, 3.101903639e-12 MLMG: Timers: Solve = 0.270298038 Iter = 0.241623368 Bottom = 0.019806373 After projection: max(abs(u/v/w)) = 0.03276515051 0.003487109732 0.003729435166 Evolving particles on level: 0 ... with fluid dt 0.0001455129019 done. Time per fluid step 1.526206767 Time per 320 particle steps 4.072528176 Coupling time per step 0.084662051 Time per step 5.737725736 Regridding at step 2 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 3: from old_time 0.0002933301982 to new time 0.0004343813894 with dt = 0.0001410511912 Before projection: max(abs(u/v/w)) = 0.03958602022 0.005821162882 0.005630740104 max(abs(gpx/gpy/gpz)) = 282.6338351 31.42487451 32.7406019 Min and Max of epf 0.4049034693 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 378.8590083 MLMG: Initial rhs = 189.4295041 MLMG: Initial residual (resid0) = 189.4295041 MLMG: Final Iter. 13 resid, resid/bnorm = 5.88308513e-10, 3.105685757e-12 MLMG: Timers: Solve = 0.271104778 Iter = 0.242211939 Bottom = 0.020129363 After projection: max(abs(u/v/w)) = 0.04006855111 0.004507343728 0.005581240311 Evolving particles on level: 0 ... with fluid dt 0.0001410511912 done. Time per fluid step 1.525030056 Time per 310 particle steps 3.964319603 Coupling time per step 0.085100727 Time per step 5.628686116 Regridding at step 3 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 4: from old_time 0.0004343813894 to new time 0.000570453873 with dt = 0.0001360724836 Before projection: max(abs(u/v/w)) = 0.05632381484 0.006445008244 0.006080978195 max(abs(gpx/gpy/gpz)) = 420.7849947 51.5244487 53.67347508 Min and Max of epf 0.4050059935 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 480.0316438 MLMG: Initial rhs = 240.0158219 MLMG: Initial residual (resid0) = 240.0158219 MLMG: Final Iter. 13 resid, resid/bnorm = 7.791149947e-10, 3.24609848e-12 MLMG: Timers: Solve = 0.270492415 Iter = 0.24158317 Bottom = 0.019409164 After projection: max(abs(u/v/w)) = 0.04720919796 0.005618105744 0.007351092436 Evolving particles on level: 0 ... with fluid dt 0.0001360724836 done. Time per fluid step 1.525716091 Time per 299 particle steps 3.795405082 Coupling time per step 0.084959413 Time per step 5.460005501 Regridding at step 4 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 5: from old_time 0.000570453873 to new time 0.0007019987326 with dt = 0.0001315448596 Before projection: max(abs(u/v/w)) = 0.07208554722 0.007525684289 0.0083412651 max(abs(gpx/gpy/gpz)) = 560.0641723 73.48867424 76.37189522 Min and Max of epf 0.4001478934 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 572.0187382 MLMG: Initial rhs = 286.0093691 MLMG: Initial residual (resid0) = 286.0093691 MLMG: Final Iter. 13 resid, resid/bnorm = 1.011621897e-09, 3.537023632e-12 MLMG: Timers: Solve = 0.271870191 Iter = 0.242979571 Bottom = 0.020524648 After projection: max(abs(u/v/w)) = 0.05465912775 0.00683041936 0.008966172658 Evolving particles on level: 0 ... with fluid dt 0.0001315448596 done. Time per fluid step 1.52369286 Time per 289 particle steps 3.695096086 Coupling time per step 0.084816331 Time per step 5.357918694 Regridding at step 5 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 6: from old_time 0.0007019987326 to new time 0.0008293744932 with dt = 0.0001273757606 Before projection: max(abs(u/v/w)) = 0.08668857046 0.009723692316 0.01094490078 max(abs(gpx/gpy/gpz)) = 698.9101826 97.56806603 102.2421546 Min and Max of epf 0.3995004434 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 655.2065855 MLMG: Initial rhs = 327.6032927 MLMG: Initial residual (resid0) = 327.6032927 MLMG: Final Iter. 13 resid, resid/bnorm = 1.274582218e-09, 3.890627005e-12 MLMG: Timers: Solve = 0.273059992 Iter = 0.243952676 Bottom = 0.020858674 After projection: max(abs(u/v/w)) = 0.06184558425 0.007923711707 0.01043753046 Evolving particles on level: 0 ... with fluid dt 0.0001273757606 done. Time per fluid step 1.534636236 Time per 280 particle steps 3.619663806 Coupling time per step 0.085660771 Time per step 5.294218771 Regridding at step 6 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 7: from old_time 0.0008293744932 to new time 0.0009529155442 with dt = 0.000123541051 Before projection: max(abs(u/v/w)) = 0.1001293075 0.01189562411 0.01364493692 max(abs(gpx/gpy/gpz)) = 836.2650798 122.9056095 131.2437344 Min and Max of epf 0.4003090488 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 728.0152802 MLMG: Initial rhs = 364.0076401 MLMG: Initial residual (resid0) = 364.0076401 MLMG: Final Iter. 13 resid, resid/bnorm = 1.545897632e-09, 4.246882378e-12 MLMG: Timers: Solve = 0.273471327 Iter = 0.244382835 Bottom = 0.020698149 After projection: max(abs(u/v/w)) = 0.06874755978 0.008913682427 0.01178857482 Evolving particles on level: 0 ... with fluid dt 0.000123541051 done. Time per fluid step 1.527655925 Time per 272 particle steps 3.482687502 Coupling time per step 0.085438614 Time per step 5.150527603 Regridding at step 7 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 8: from old_time 0.0009529155442 to new time 0.0010728442 with dt = 0.0001199286561 Before projection: max(abs(u/v/w)) = 0.1123814385 0.01402352443 0.01634062032 max(abs(gpx/gpy/gpz)) = 971.2882066 148.8443859 162.0044707 Min and Max of epf 0.3973553886 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 792.5099673 MLMG: Initial rhs = 396.2549836 MLMG: Initial residual (resid0) = 396.2549836 MLMG: Final Iter. 13 resid, resid/bnorm = 1.51059254e-09, 3.812172975e-12 MLMG: Timers: Solve = 0.273543057 Iter = 0.244445116 Bottom = 0.020820256 After projection: max(abs(u/v/w)) = 0.07538002713 0.009820501211 0.01304854926 Evolving particles on level: 0 ... with fluid dt 0.0001199286561 done. Time per fluid step 1.526453953 Time per 264 particle steps 3.397139252 Coupling time per step 0.085512706 Time per step 5.063716468 Regridding at step 8 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 9: from old_time 0.0010728442 to new time 0.001189465435 with dt = 0.0001166212352 Before projection: max(abs(u/v/w)) = 0.1235957942 0.01616853471 0.01895376602 max(abs(gpx/gpy/gpz)) = 1103.283628 175.0822296 193.0112928 Min and Max of epf 0.3980925352 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 852.1708501 MLMG: Initial rhs = 426.0854251 MLMG: Initial residual (resid0) = 426.0854251 MLMG: Final Iter. 13 resid, resid/bnorm = 1.317316034e-09, 3.091671192e-12 MLMG: Timers: Solve = 0.271658083 Iter = 0.242503572 Bottom = 0.019092936 After projection: max(abs(u/v/w)) = 0.0817304056 0.01065954759 0.01422961345 Evolving particles on level: 0 ... with fluid dt 0.0001166212352 done. Time per fluid step 1.52485722 Time per 256 particle steps 3.311932904 Coupling time per step 0.085768401 Time per step 4.976429533 Regridding at step 9 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 10: from old_time 0.001189465435 to new time 0.00130301226 with dt = 0.0001135468241 Before projection: max(abs(u/v/w)) = 0.1337996729 0.01842571573 0.02151431794 max(abs(gpx/gpy/gpz)) = 1231.565276 201.5025298 225.0833014 Min and Max of epf 0.3998083548 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 907.0326594 MLMG: Initial rhs = 453.5163297 MLMG: Initial residual (resid0) = 453.5163297 MLMG: Final Iter. 13 resid, resid/bnorm = 1.219380152e-09, 2.688723807e-12 MLMG: Timers: Solve = 0.271621175 Iter = 0.242527994 Bottom = 0.019203179 After projection: max(abs(u/v/w)) = 0.08780774774 0.01143802589 0.01533160632 Evolving particles on level: 0 ... with fluid dt 0.0001135468241 done. Time per fluid step 1.525814329 Time per 250 particle steps 3.195714812 Coupling time per step 0.085453537 Time per step 4.861560677 Regridding at step 10 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 11: from old_time 0.00130301226 to new time 0.001412920146 with dt = 0.0001099078863 Before projection: max(abs(u/v/w)) = 0.1423000075 0.02034839486 0.02380345731 max(abs(gpx/gpy/gpz)) = 1355.656407 227.9181196 257.7477047 Min and Max of epf 0.4016032747 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 945.8636941 MLMG: Initial rhs = 472.9318471 MLMG: Initial residual (resid0) = 472.9318471 MLMG: Final Iter. 13 resid, resid/bnorm = 1.154981888e-09, 2.442174058e-12 MLMG: Timers: Solve = 0.271998866 Iter = 0.242990702 Bottom = 0.019270245 After projection: max(abs(u/v/w)) = 0.09359305087 0.01217341266 0.01636555505 Evolving particles on level: 0 ... with fluid dt 0.0001099078863 done. Time per fluid step 1.494924149 Time per 242 particle steps 3.110646743 Coupling time per step 0.085283547 Time per step 4.745056031 Regridding at step 11 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 12: from old_time 0.001412920146 to new time 0.001519455024 with dt = 0.000106534878 Before projection: max(abs(u/v/w)) = 0.1502557402 0.02218718524 0.02605309518 max(abs(gpx/gpy/gpz)) = 1476.175449 254.4756296 291.3660766 Min and Max of epf 0.4003766965 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 982.3925097 MLMG: Initial rhs = 491.1962548 MLMG: Initial residual (resid0) = 491.1962548 MLMG: Final Iter. 13 resid, resid/bnorm = 1.132578475e-09, 2.305755519e-12 MLMG: Timers: Solve = 0.27259217 Iter = 0.243659291 Bottom = 0.019927309 After projection: max(abs(u/v/w)) = 0.09912534274 0.01286278339 0.0173426701 Evolving particles on level: 0 ... with fluid dt 0.000106534878 done. Time per fluid step 1.490485632 Time per 234 particle steps 3.026006258 Coupling time per step 0.0853231 Time per step 4.656398276 Regridding at step 12 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 13: from old_time 0.001519455024 to new time 0.001622842592 with dt = 0.0001033875678 Before projection: max(abs(u/v/w)) = 0.1572693067 0.02384413078 0.0281764083 max(abs(gpx/gpy/gpz)) = 1592.593368 281.0341903 325.0104553 Min and Max of epf 0.4033854945 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1016.62761 MLMG: Initial rhs = 508.3138051 MLMG: Initial residual (resid0) = 508.3138051 MLMG: Final Iter. 13 resid, resid/bnorm = 1.141131634e-09, 2.244935357e-12 MLMG: Timers: Solve = 0.273533082 Iter = 0.244412455 Bottom = 0.020762338 After projection: max(abs(u/v/w)) = 0.1044063683 0.01350160015 0.01826749504 Evolving particles on level: 0 ... with fluid dt 0.0001033875678 done. Time per fluid step 1.4977334 Time per 227 particle steps 2.951965194 Coupling time per step 0.085721204 Time per step 4.589973202 Regridding at step 13 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 14: from old_time 0.001622842592 to new time 0.001723303427 with dt = 0.000100460835 Before projection: max(abs(u/v/w)) = 0.1635915358 0.02549678257 0.03016559271 max(abs(gpx/gpy/gpz)) = 1704.571019 309.2292948 358.2530775 Min and Max of epf 0.4001223446 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1048.459173 MLMG: Initial rhs = 524.2295867 MLMG: Initial residual (resid0) = 524.2295867 MLMG: Final Iter. 13 resid, resid/bnorm = 1.197143717e-09, 2.283624862e-12 MLMG: Timers: Solve = 0.27241207 Iter = 0.243649949 Bottom = 0.019807058 After projection: max(abs(u/v/w)) = 0.1094524145 0.01409873636 0.01914847838 Evolving particles on level: 0 ... with fluid dt 0.000100460835 done. Time per fluid step 1.485329836 Time per 221 particle steps 2.835561578 Coupling time per step 0.085139927 Time per step 4.461020247 Regridding at step 14 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 15: from old_time 0.001723303427 to new time 0.001808813522 with dt = 8.551009506e-05 Before projection: max(abs(u/v/w)) = 0.1556301066 0.02307610314 0.02747612293 max(abs(gpx/gpy/gpz)) = 1811.923148 336.1975341 391.4162649 Min and Max of epf 0.4002170255 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 945.3081431 MLMG: Initial rhs = 472.6540715 MLMG: Initial residual (resid0) = 472.6540715 MLMG: Final Iter. 13 resid, resid/bnorm = 1.139337513e-09, 2.410510311e-12 MLMG: Timers: Solve = 0.272747369 Iter = 0.243852982 Bottom = 0.020068256 After projection: max(abs(u/v/w)) = 0.1136095595 0.01468424937 0.0199526782 Evolving particles on level: 0 ... with fluid dt 8.551009506e-05 done. Time per fluid step 1.493775065 Time per 188 particle steps 2.43293015 Coupling time per step 0.085468855 Time per step 4.06657162 Regridding at step 15 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 16: from old_time 0.001808813522 to new time 0.001897878386 with dt = 8.906486426e-05 Before projection: max(abs(u/v/w)) = 0.174137361 0.02688262286 0.03210032241 max(abs(gpx/gpy/gpz)) = 1933.106504 370.3890953 433.2595732 Min and Max of epf 0.3997272253 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1033.122983 MLMG: Initial rhs = 516.5614917 MLMG: Initial residual (resid0) = 516.5614917 MLMG: Final Iter. 13 resid, resid/bnorm = 1.317946641e-09, 2.551383837e-12 MLMG: Timers: Solve = 0.272947616 Iter = 0.243936216 Bottom = 0.020271723 After projection: max(abs(u/v/w)) = 0.1183573942 0.01517806975 0.0207747209 Evolving particles on level: 0 ... with fluid dt 8.906486426e-05 done. Time per fluid step 1.495975391 Time per 196 particle steps 2.518020699 Coupling time per step 0.085609117 Time per step 4.154097195 Regridding at step 16 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 17: from old_time 0.001897878386 to new time 0.001987919075 with dt = 9.004068858e-05 Before projection: max(abs(u/v/w)) = 0.1857513957 0.02949543321 0.03529201636 max(abs(gpx/gpy/gpz)) = 2034.153465 398.6850707 468.1095979 Min and Max of epf 0.3994713838 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1084.613119 MLMG: Initial rhs = 542.3065596 MLMG: Initial residual (resid0) = 542.3065596 MLMG: Final Iter. 13 resid, resid/bnorm = 1.452889364e-09, 2.679092367e-12 MLMG: Timers: Solve = 0.273141482 Iter = 0.244051441 Bottom = 0.020191112 After projection: max(abs(u/v/w)) = 0.1228341674 0.015650234 0.0215544722 Evolving particles on level: 0 ... with fluid dt 9.004068858e-05 done. Time per fluid step 1.496158695 Time per 198 particle steps 2.539211505 Coupling time per step 0.085637701 Time per step 4.175259794 Regridding at step 17 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 18: from old_time 0.001987919075 to new time 0.002078529275 with dt = 9.061019992e-05 Before projection: max(abs(u/v/w)) = 0.1953813766 0.03218008381 0.0381982348 max(abs(gpx/gpy/gpz)) = 2125.508566 422.7491174 500.8243115 Min and Max of epf 0.4013402867 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1130.092466 MLMG: Initial rhs = 565.0462332 MLMG: Initial residual (resid0) = 565.0462332 MLMG: Final Iter. 13 resid, resid/bnorm = 1.538118966e-09, 2.722111705e-12 MLMG: Timers: Solve = 0.273334552 Iter = 0.24424677 Bottom = 0.020687118 After projection: max(abs(u/v/w)) = 0.1270307235 0.01610052351 0.02229055252 Evolving particles on level: 0 ... with fluid dt 9.061019992e-05 done. Time per fluid step 1.496814176 Time per 199 particle steps 2.550180677 Coupling time per step 0.085209239 Time per step 4.187077506 Regridding at step 18 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 19: from old_time 0.002078529275 to new time 0.002166725162 with dt = 8.819588777e-05 Before projection: max(abs(u/v/w)) = 0.1977239932 0.03375493024 0.03938697994 max(abs(gpx/gpy/gpz)) = 2208.898488 448.2672957 530.7031772 Min and Max of epf 0.4020653538 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1139.454148 MLMG: Initial rhs = 569.7270739 MLMG: Initial residual (resid0) = 569.7270739 MLMG: Final Iter. 13 resid, resid/bnorm = 1.55976565e-09, 2.737741844e-12 MLMG: Timers: Solve = 0.272772233 Iter = 0.243773262 Bottom = 0.020093833 After projection: max(abs(u/v/w)) = 0.1307724684 0.01653344184 0.02297413095 Evolving particles on level: 0 ... with fluid dt 8.819588777e-05 done. Time per fluid step 1.461628626 Time per 194 particle steps 2.49736493 Coupling time per step 0.085573206 Time per step 4.09902136 Regridding at step 19 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 20: from old_time 0.002166725162 to new time 0.00224915921 with dt = 8.243404753e-05 Before projection: max(abs(u/v/w)) = 0.1918210519 0.03337015277 0.03849387503 max(abs(gpx/gpy/gpz)) = 2289.390592 473.9255025 558.7095994 Min and Max of epf 0.3995016258 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1103.321607 MLMG: Initial rhs = 551.6608036 MLMG: Initial residual (resid0) = 551.6608036 MLMG: Final Iter. 13 resid, resid/bnorm = 1.411894601e-09, 2.559352762e-12 MLMG: Timers: Solve = 0.272429809 Iter = 0.243344575 Bottom = 0.019431105 After projection: max(abs(u/v/w)) = 0.1340063056 0.01694639241 0.0236016135 Evolving particles on level: 0 ... with fluid dt 8.243404753e-05 done. Time per fluid step 1.491613999 Time per 181 particle steps 2.358115267 Coupling time per step 0.085125975 Time per step 3.989087307 Regridding at step 20 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 21: from old_time 0.00224915921 to new time 0.002333380174 with dt = 8.422096427e-05 Before projection: max(abs(u/v/w)) = 0.2024934281 0.0365667579 0.04194664011 max(abs(gpx/gpy/gpz)) = 2371.23717 502.0311671 589.7849722 Min and Max of epf 0.3999196734 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1162.149008 MLMG: Initial rhs = 581.0745042 MLMG: Initial residual (resid0) = 581.0745042 MLMG: Final Iter. 13 resid, resid/bnorm = 1.479754985e-09, 2.546583914e-12 MLMG: Timers: Solve = 0.272097682 Iter = 0.243019213 Bottom = 0.019418497 After projection: max(abs(u/v/w)) = 0.1375246829 0.01731088422 0.02421869798 Evolving particles on level: 0 ... with fluid dt 8.422096427e-05 done. Time per fluid step 1.490509969 Time per 185 particle steps 2.401557324 Coupling time per step 0.085436427 Time per step 4.032270795 Regridding at step 21 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 22: from old_time 0.002333380174 to new time 0.002415512264 with dt = 8.213208972e-05 Before projection: max(abs(u/v/w)) = 0.2032122511 0.03803423343 0.04282075395 max(abs(gpx/gpy/gpz)) = 2441.586146 529.020364 616.8068327 Min and Max of epf 0.4008113616 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1167.52759 MLMG: Initial rhs = 583.7637949 MLMG: Initial residual (resid0) = 583.7637949 MLMG: Final Iter. 13 resid, resid/bnorm = 1.562682428e-09, 2.67690878e-12 MLMG: Timers: Solve = 0.271181683 Iter = 0.24209176 Bottom = 0.018667609 After projection: max(abs(u/v/w)) = 0.1406954205 0.01767531707 0.0247730421 Evolving particles on level: 0 ... with fluid dt 8.213208972e-05 done. Time per fluid step 1.488798869 Time per 181 particle steps 2.357336135 Coupling time per step 0.085390525 Time per step 3.98647512 Regridding at step 22 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 23: from old_time 0.002415512264 to new time 0.002495821926 with dt = 8.030966248e-05 Before projection: max(abs(u/v/w)) = 0.2040816672 0.03980403358 0.04367747517 max(abs(gpx/gpy/gpz)) = 2509.827924 563.6063573 643.9810991 Min and Max of epf 0.4009279459 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1165.059984 MLMG: Initial rhs = 582.5299922 MLMG: Initial residual (resid0) = 582.5299922 MLMG: Final Iter. 13 resid, resid/bnorm = 1.517854287e-09, 2.605624272e-12 MLMG: Timers: Solve = 0.273076724 Iter = 0.24399242 Bottom = 0.020098504 After projection: max(abs(u/v/w)) = 0.1437126094 0.01802093747 0.02528586017 Evolving particles on level: 0 ... with fluid dt 8.030966248e-05 done. Time per fluid step 1.464016307 Time per 177 particle steps 2.315385091 Coupling time per step 0.08532042 Time per step 3.919106361 Regridding at step 23 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 24: from old_time 0.002495821926 to new time 0.002581545366 with dt = 8.572343949e-05 Before projection: max(abs(u/v/w)) = 0.2226038488 0.04527991608 0.04934554385 max(abs(gpx/gpy/gpz)) = 2574.663267 596.449616 671.0628226 Min and Max of epf 0.4010579275 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1267.224987 MLMG: Initial rhs = 633.6124936 MLMG: Initial residual (resid0) = 633.6124936 MLMG: Final Iter. 13 resid, resid/bnorm = 1.294743868e-09, 2.04343172e-12 MLMG: Timers: Solve = 0.272007066 Iter = 0.243001315 Bottom = 0.019583366 After projection: max(abs(u/v/w)) = 0.1472053897 0.01832667993 0.02580698901 Evolving particles on level: 0 ... with fluid dt 8.572343949e-05 done. Time per fluid step 1.489634768 Time per 189 particle steps 2.443682817 Coupling time per step 0.085771736 Time per step 4.073624662 Regridding at step 24 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 25: from old_time 0.002581545366 to new time 0.002667350087 with dt = 8.580472126e-05 Before projection: max(abs(u/v/w)) = 0.2269782582 0.04709077073 0.05104562594 max(abs(gpx/gpy/gpz)) = 2626.40096 619.1913553 695.0117402 Min and Max of epf 0.400096488 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1295.319028 MLMG: Initial rhs = 647.6595142 MLMG: Initial residual (resid0) = 647.6595142 MLMG: Final Iter. 13 resid, resid/bnorm = 1.085382451e-09, 1.67585348e-12 MLMG: Timers: Solve = 0.27123484 Iter = 0.242136926 Bottom = 0.018681329 After projection: max(abs(u/v/w)) = 0.1502760419 0.01863704407 0.02646271098 Evolving particles on level: 0 ... with fluid dt 8.580472126e-05 done. Time per fluid step 1.490377385 Time per 189 particle steps 2.443112429 Coupling time per step 0.085710985 Time per step 4.073403102 Regridding at step 25 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 26: from old_time 0.002667350087 to new time 0.00275368064 with dt = 8.633055255e-05 Before projection: max(abs(u/v/w)) = 0.2324137583 0.04920833495 0.05306478576 max(abs(gpx/gpy/gpz)) = 2677.197434 639.8725652 718.7665934 Min and Max of epf 0.4001694653 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1332.358149 MLMG: Initial rhs = 666.1790747 MLMG: Initial residual (resid0) = 666.1790747 MLMG: Final Iter. 13 resid, resid/bnorm = 1.054843324e-09, 1.583423082e-12 MLMG: Timers: Solve = 0.271872233 Iter = 0.242854895 Bottom = 0.01926284 After projection: max(abs(u/v/w)) = 0.153252248 0.01892437599 0.02711675176 Evolving particles on level: 0 ... with fluid dt 8.633055255e-05 done. Time per fluid step 1.491050372 Time per 190 particle steps 2.454929229 Coupling time per step 0.085598368 Time per step 4.085598382 Regridding at step 26 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 27: from old_time 0.00275368064 to new time 0.002840456242 with dt = 8.677560213e-05 Before projection: max(abs(u/v/w)) = 0.237436559 0.05199784951 0.05432951941 max(abs(gpx/gpy/gpz)) = 2725.067676 660.8354106 740.6356887 Min and Max of epf 0.4017275205 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1373.756687 MLMG: Initial rhs = 686.8783434 MLMG: Initial residual (resid0) = 686.8783434 MLMG: Final Iter. 13 resid, resid/bnorm = 1.125819438e-09, 1.639037609e-12 MLMG: Timers: Solve = 0.273037126 Iter = 0.243930174 Bottom = 0.019935301 After projection: max(abs(u/v/w)) = 0.156118055 0.01919419444 0.0277656138 Evolving particles on level: 0 ... with fluid dt 8.677560213e-05 done. Time per fluid step 1.492501797 Time per 191 particle steps 2.465274949 Coupling time per step 0.085210552 Time per step 4.097609277 Regridding at step 27 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 28: from old_time 0.002840456242 to new time 0.002926071424 with dt = 8.561518205e-05 Before projection: max(abs(u/v/w)) = 0.2379439688 0.05376582085 0.0548062682 max(abs(gpx/gpy/gpz)) = 2770.798783 681.563982 759.6135664 Min and Max of epf 0.4023699457 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1386.464317 MLMG: Initial rhs = 693.2321586 MLMG: Initial residual (resid0) = 693.2321586 MLMG: Final Iter. 13 resid, resid/bnorm = 1.273264161e-09, 1.836706715e-12 MLMG: Timers: Solve = 0.272441953 Iter = 0.243510735 Bottom = 0.019690263 After projection: max(abs(u/v/w)) = 0.1588011037 0.01944981576 0.02842030242 Evolving particles on level: 0 ... with fluid dt 8.561518205e-05 done. Time per fluid step 1.491853185 Time per 188 particle steps 2.434520754 Coupling time per step 0.085450548 Time per step 4.066564711 Regridding at step 28 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 29: from old_time 0.002926071424 to new time 0.003002174817 with dt = 7.610339361e-05 Before projection: max(abs(u/v/w)) = 0.2153791672 0.05033278045 0.04902728739 max(abs(gpx/gpy/gpz)) = 2816.158157 702.8428122 778.4422952 Min and Max of epf 0.3986810448 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1265.16271 MLMG: Initial rhs = 632.5813552 MLMG: Initial residual (resid0) = 632.5813552 MLMG: Final Iter. 13 resid, resid/bnorm = 1.181405196e-09, 1.867594083e-12 MLMG: Timers: Solve = 0.273047872 Iter = 0.243957692 Bottom = 0.020258795 After projection: max(abs(u/v/w)) = 0.1605722895 0.0197328266 0.02904167369 Evolving particles on level: 0 ... with fluid dt 7.610339361e-05 done. Time per fluid step 1.461572534 Time per 167 particle steps 2.159111251 Coupling time per step 0.085407877 Time per step 3.760686701 Regridding at step 29 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 30: from old_time 0.003002174817 to new time 0.003083466812 with dt = 8.129199461e-05 Before projection: max(abs(u/v/w)) = 0.2337856203 0.05621695713 0.05493721936 max(abs(gpx/gpy/gpz)) = 2870.511667 736.2321435 803.7203082 Min and Max of epf 0.398830716 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1376.054613 MLMG: Initial rhs = 688.0273063 MLMG: Initial residual (resid0) = 688.0273063 MLMG: Final Iter. 13 resid, resid/bnorm = 1.327070009e-09, 1.928804275e-12 MLMG: Timers: Solve = 0.272477003 Iter = 0.243377051 Bottom = 0.019862745 After projection: max(abs(u/v/w)) = 0.1635484993 0.0200108925 0.02965916915 Evolving particles on level: 0 ... with fluid dt 8.129199461e-05 done. Time per fluid step 1.459039658 Time per 179 particle steps 2.338045596 Coupling time per step 0.08587833 Time per step 3.93749106 Writing plotfile BENCH05-Size0008_wide-Godunov_plt00030 at time 0.003083466812 Time spent in main (after init) 136.7547377 Time spent in main 145.4248773 Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [2363 ... 2407] [The Arena] max space (MB) allocated spread across MPI: [161 ... 169] [The Arena] max space (MB) used spread across MPI: [159 ... 168] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [16 ... 16] [The Pinned Arena] max space (MB) used spread across MPI: [8 ... 13] AMReX (26.09-125-g523e7305089a) finalized