Initializing AMReX (26.08-26-g2cf4fbcde02a)... MPI initialized with 4 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.08-26-g2cf4fbcde02a) initialized MFIX git describe: 26.08-11-g382b3987bce8 AMReX-Hydro git hash: 9446740c59feca3bf007a6e6d95a6080816c33ec Number of levels: 1 RunType is Standard Auto-generating level-set parameters: eb_refinement = 1 levelset_pad = 2 eb_pad = 2 ================================================================================ Warning: Overwriting amr.plot_int with value from mfix.plot_int ================================================================================ ================================================================================ Warning: Overwriting amr.plot_file with value from mfix.plot_file ================================================================================ ================================================================================ Warning: Overwriting amr.check_file with value from mfix.check_file ================================================================================ Simulation is transient -------------------------------------------------------------------------------- Info: Max effective viscosity factor not specified. Using default 1e+06 -------------------------------------------------------------------------------- Particle-particle conduction is disabled. Particle-fluid-particle conduction is disabled. EB with constant temperature: bc.hot-walls Temperature of wall .................... 900 Load balance setup: Type: DualGrid Strategy: KnapSack Weighting: ParticleCount Drag model: BVK2 Convection model not specified. Setting default: mfix.convection.model = RanzMarshall Building cylinder geometry. Internal Flow: 1 Radius: 0.0039 Height: -1 Direction: 0 Rotation angle: 0 Rotation axis: 0 Center: 0.004, 0.004, 0.004 Done making the fluid eb levels ... On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ================================================================================ Warning: Setting particle max grid size to fluid max grid size ================================================================================ In MakeBaseGrids: BA HAS 16 GRIDS Auto generating particles ... Total number of generated particles: 215,120 Time spent in initializing particles 0.778972106 **************************************** Coverage report: Grids Cells regular: 4 44960 covered: 0 12800 cut: 12 6240 **************************************** Bounding box for levelset imposed walls: Lo: 1e-15 -0.008 -0.008 Hi: 0.016 0.016 0.016 Clean up auto-generated particles. IC Region Generated Removed Remaining **************** **************** **************** **************** full-domain 0 0 0 bed 215,120 58,061 157,059 ---------------- ---------------- ---------------- ---------------- Total 215,120 58,061 157,059 **************** **************** **************** **************** Setting original sum_vol to 2.998926818e-07 Initial projection: Before projection: max(abs(u/v/w)) = 0.015 0 0 max(abs(gpx/gpy/gpz)) = 0 0 0 Min and Max of epf 0.404821315 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 44.6112468 MLMG: Initial rhs = 22.3056234 MLMG: Initial residual (resid0) = 22.3056234 MLMG: Final Iter. 13 resid, resid/bnorm = 6.107159223e-11, 2.737945994e-12 MLMG: Timers: Solve = 0.273797939 Iter = 0.240335201 Bottom = 0.018949074 After projection: max(abs(u/v/w)) = 0.02199663394 0.00113116282 0.00118949404 Doing initial pressure iterations with dt = 0.008211321795 In initial_iterations: iter = 0 Before projection: max(abs(u/v/w)) = 0.01864847553 0.004888276558 0.004999766061 max(abs(gpx/gpy/gpz)) = 0 0 0 Min and Max of epf 0.404821315 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 148.0070194 MLMG: Initial rhs = 74.00350969 MLMG: Initial residual (resid0) = 74.00350969 MLMG: Final Iter. 13 resid, resid/bnorm = 2.855424786e-10, 3.858499141e-12 MLMG: Timers: Solve = 0.268234773 Iter = 0.239568574 Bottom = 0.019448804 After projection: max(abs(u/v/w)) = 0.02180310583 0.003545677848 0.003618610057 In initial_iterations: iter = 1 Before projection: max(abs(u/v/w)) = 0.01904173908 0.004872212339 0.004978278826 max(abs(gpx/gpy/gpz)) = 2.64979077 0.4857109379 0.4902803414 Min and Max of epf 0.404821315 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 147.7900726 MLMG: Initial rhs = 73.8950363 MLMG: Initial residual (resid0) = 73.8950363 MLMG: Final Iter. 13 resid, resid/bnorm = 2.594904569e-10, 3.511608761e-12 MLMG: Timers: Solve = 0.269327354 Iter = 0.24039067 Bottom = 0.018852115 After projection: max(abs(u/v/w)) = 0.02181407035 0.003500651848 0.003581062482 In initial_iterations: iter = 2 Before projection: max(abs(u/v/w)) = 0.01920306989 0.004856607747 0.004957911497 max(abs(gpx/gpy/gpz)) = 5.297760837 0.9673546565 0.9768213121 Min and Max of epf 0.404821315 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 147.5557461 MLMG: Initial rhs = 73.77787307 MLMG: Initial residual (resid0) = 73.77787307 MLMG: Final Iter. 13 resid, resid/bnorm = 2.486493234e-10, 3.3702425e-12 MLMG: Timers: Solve = 0.268600335 Iter = 0.239828397 Bottom = 0.018903429 After projection: max(abs(u/v/w)) = 0.02177215786 0.003462239656 0.003543364448 Enclosed domain volume is 2.998926818e-07 Time spent in init 8.925483054 Writing plotfile BENCH05-Size0008_wide-Godunov_plt00000 at time 0 Regridding at step 0 Updating particle ebfactory Regridding level-set on lev = 0 Also regridding refined level-set On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 1: from old_time 0 to new time 0.0001478172962 with dt = 0.0001478172962 Before projection (with small dt modification): max(abs(u/v/w)) = 0.01509374597 0.003121148662 0.003199308726 max(abs(gpx/gpy/gpz)) = 7.930323103 1.445591671 1.459484702 Min and Max of epf 0.404821315 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 139.7655748 MLMG: Initial rhs = 69.8827874 MLMG: Initial residual (resid0) = 69.8827874 MLMG: Final Iter. 13 resid, resid/bnorm = 2.21890506e-10, 3.175181103e-12 MLMG: Timers: Solve = 0.268987083 Iter = 0.24013128 Bottom = 0.018836811 After projection (with small dt modification): max(abs(u/v/w)) = 0.02569673942 0.002494217087 0.002499819391 Evolving particles on level: 0 ... with fluid dt 0.0001478172962 done. Time per fluid step 1.563775556 Time per 325 particle steps 4.1719873 Coupling time per step 0.085569422 Time per step 5.945462667 Regridding at step 1 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 2: from old_time 0.0001478172962 to new time 0.0002933301982 with dt = 0.0001455129019 Before projection: max(abs(u/v/w)) = 0.0209965405 0.004864591379 0.004839302441 max(abs(gpx/gpy/gpz)) = 144.5526288 18.25535987 18.34755284 Min and Max of epf 0.4048417166 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 265.8204166 MLMG: Initial rhs = 132.9102083 MLMG: Initial residual (resid0) = 132.9102083 MLMG: Final Iter. 13 resid, resid/bnorm = 4.114741881e-10, 3.095880996e-12 MLMG: Timers: Solve = 0.269449515 Iter = 0.240673492 Bottom = 0.019534364 After projection: max(abs(u/v/w)) = 0.03276515051 0.003487109732 0.003729435166 Evolving particles on level: 0 ... with fluid dt 0.0001455129019 done. Time per fluid step 1.562569527 Time per 320 particle steps 4.070648453 Coupling time per step 0.084825322 Time per step 5.772245685 Regridding at step 2 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 3: from old_time 0.0002933301982 to new time 0.0004343813894 with dt = 0.0001410511912 Before projection: max(abs(u/v/w)) = 0.03958602022 0.005821162882 0.005630740104 max(abs(gpx/gpy/gpz)) = 282.6338351 31.42487451 32.7406019 Min and Max of epf 0.4049034693 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 378.8590083 MLMG: Initial rhs = 189.4295041 MLMG: Initial residual (resid0) = 189.4295041 MLMG: Final Iter. 13 resid, resid/bnorm = 5.887854648e-10, 3.10820359e-12 MLMG: Timers: Solve = 0.27002587 Iter = 0.241078879 Bottom = 0.019606259 After projection: max(abs(u/v/w)) = 0.04006855111 0.004507343728 0.005581240311 Evolving particles on level: 0 ... with fluid dt 0.0001410511912 done. Time per fluid step 1.561771486 Time per 310 particle steps 3.961730155 Coupling time per step 0.084878672 Time per step 5.662310675 Regridding at step 3 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 4: from old_time 0.0004343813894 to new time 0.000570453873 with dt = 0.0001360724836 Before projection: max(abs(u/v/w)) = 0.05632381484 0.006445008244 0.006080978195 max(abs(gpx/gpy/gpz)) = 420.7849947 51.5244487 53.67347508 Min and Max of epf 0.4050059935 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 480.0316438 MLMG: Initial rhs = 240.0158219 MLMG: Initial residual (resid0) = 240.0158219 MLMG: Final Iter. 13 resid, resid/bnorm = 7.788232281e-10, 3.244882866e-12 MLMG: Timers: Solve = 0.269716942 Iter = 0.240766733 Bottom = 0.019119112 After projection: max(abs(u/v/w)) = 0.04720919796 0.005618105744 0.007351092436 Evolving particles on level: 0 ... with fluid dt 0.0001360724836 done. Time per fluid step 1.561366943 Time per 299 particle steps 3.794682518 Coupling time per step 0.08490461 Time per step 5.495066201 Regridding at step 4 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 5: from old_time 0.000570453873 to new time 0.0007019987326 with dt = 0.0001315448596 Before projection: max(abs(u/v/w)) = 0.07208554722 0.007525684289 0.0083412651 max(abs(gpx/gpy/gpz)) = 560.0641723 73.48867424 76.37189522 Min and Max of epf 0.4001478934 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 572.0187382 MLMG: Initial rhs = 286.0093691 MLMG: Initial residual (resid0) = 286.0093691 MLMG: Final Iter. 13 resid, resid/bnorm = 1.010702633e-09, 3.533809525e-12 MLMG: Timers: Solve = 0.271101363 Iter = 0.242232987 Bottom = 0.020383712 After projection: max(abs(u/v/w)) = 0.05465912775 0.006830419359 0.008966172658 Evolving particles on level: 0 ... with fluid dt 0.0001315448596 done. Time per fluid step 1.561147368 Time per 289 particle steps 3.703934856 Coupling time per step 0.085005892 Time per step 5.40439107 Regridding at step 5 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 6: from old_time 0.0007019987326 to new time 0.0008293744932 with dt = 0.0001273757606 Before projection: max(abs(u/v/w)) = 0.08668857046 0.009723692316 0.01094490078 max(abs(gpx/gpy/gpz)) = 698.9101826 97.56806603 102.2421546 Min and Max of epf 0.3995004434 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 655.2065855 MLMG: Initial rhs = 327.6032927 MLMG: Initial residual (resid0) = 327.6032927 MLMG: Final Iter. 13 resid, resid/bnorm = 1.275026307e-09, 3.891982575e-12 MLMG: Timers: Solve = 0.273306618 Iter = 0.24422393 Bottom = 0.020314429 After projection: max(abs(u/v/w)) = 0.06184558425 0.007923711707 0.01043753046 Evolving particles on level: 0 ... with fluid dt 0.0001273757606 done. Time per fluid step 1.572286941 Time per 280 particle steps 3.619005289 Coupling time per step 0.08540213 Time per step 5.331316904 Regridding at step 6 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 7: from old_time 0.0008293744932 to new time 0.0009529155442 with dt = 0.000123541051 Before projection: max(abs(u/v/w)) = 0.1001293075 0.01189562411 0.01364493692 max(abs(gpx/gpy/gpz)) = 836.2650798 122.9056095 131.2437344 Min and Max of epf 0.4003090488 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 728.0152802 MLMG: Initial rhs = 364.0076401 MLMG: Initial residual (resid0) = 364.0076401 MLMG: Final Iter. 13 resid, resid/bnorm = 1.546547779e-09, 4.248668458e-12 MLMG: Timers: Solve = 0.272870951 Iter = 0.243801619 Bottom = 0.020225346 After projection: max(abs(u/v/w)) = 0.06874755978 0.008913682427 0.01178857482 Evolving particles on level: 0 ... with fluid dt 0.000123541051 done. Time per fluid step 1.565526201 Time per 272 particle steps 3.481987379 Coupling time per step 0.085438753 Time per step 5.187581208 Regridding at step 7 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 8: from old_time 0.0009529155442 to new time 0.0010728442 with dt = 0.0001199286561 Before projection: max(abs(u/v/w)) = 0.1123814385 0.01402352443 0.01634062032 max(abs(gpx/gpy/gpz)) = 971.2882066 148.8443859 162.0044707 Min and Max of epf 0.3973553886 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 792.5099673 MLMG: Initial rhs = 396.2549836 MLMG: Initial residual (resid0) = 396.2549836 MLMG: Final Iter. 13 resid, resid/bnorm = 1.510063186e-09, 3.810837082e-12 MLMG: Timers: Solve = 0.273040114 Iter = 0.2439895 Bottom = 0.020375256 After projection: max(abs(u/v/w)) = 0.07538002713 0.009820501211 0.01304854926 Evolving particles on level: 0 ... with fluid dt 0.0001199286561 done. Time per fluid step 1.564872315 Time per 264 particle steps 3.395492902 Coupling time per step 0.085337331 Time per step 5.100468718 Regridding at step 8 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 9: from old_time 0.0010728442 to new time 0.001189465435 with dt = 0.0001166212352 Before projection: max(abs(u/v/w)) = 0.1235957942 0.01616853471 0.01895376602 max(abs(gpx/gpy/gpz)) = 1103.283628 175.0822296 193.0112928 Min and Max of epf 0.3980925352 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 852.1708501 MLMG: Initial rhs = 426.0854251 MLMG: Initial residual (resid0) = 426.0854251 MLMG: Final Iter. 13 resid, resid/bnorm = 1.318715803e-09, 3.094956376e-12 MLMG: Timers: Solve = 0.271744914 Iter = 0.242686908 Bottom = 0.019085211 After projection: max(abs(u/v/w)) = 0.0817304056 0.01065954759 0.01422961345 Evolving particles on level: 0 ... with fluid dt 0.0001166212352 done. Time per fluid step 1.562992508 Time per 256 particle steps 3.310203845 Coupling time per step 0.085381648 Time per step 5.012745306 Regridding at step 9 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 10: from old_time 0.001189465435 to new time 0.00130301226 with dt = 0.0001135468241 Before projection: max(abs(u/v/w)) = 0.1337996729 0.01842571573 0.02151431794 max(abs(gpx/gpy/gpz)) = 1231.565276 201.5025298 225.0833014 Min and Max of epf 0.3998083548 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 907.0326594 MLMG: Initial rhs = 453.5163297 MLMG: Initial residual (resid0) = 453.5163297 MLMG: Final Iter. 13 resid, resid/bnorm = 1.217907553e-09, 2.685476736e-12 MLMG: Timers: Solve = 0.270775103 Iter = 0.241717986 Bottom = 0.018842812 After projection: max(abs(u/v/w)) = 0.08780774774 0.01143802589 0.01533160632 Evolving particles on level: 0 ... with fluid dt 0.0001135468241 done. Time per fluid step 1.563465099 Time per 250 particle steps 3.194952955 Coupling time per step 0.085437877 Time per step 4.898246771 Regridding at step 10 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 11: from old_time 0.00130301226 to new time 0.001412920146 with dt = 0.0001099078863 Before projection: max(abs(u/v/w)) = 0.1423000075 0.02034839486 0.02380345731 max(abs(gpx/gpy/gpz)) = 1355.656407 227.9181196 257.7477047 Min and Max of epf 0.4016032747 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 945.8636941 MLMG: Initial rhs = 472.9318471 MLMG: Initial residual (resid0) = 472.9318471 MLMG: Final Iter. 13 resid, resid/bnorm = 1.155072482e-09, 2.442365616e-12 MLMG: Timers: Solve = 0.270840713 Iter = 0.241961758 Bottom = 0.018710775 After projection: max(abs(u/v/w)) = 0.09359305087 0.01217341266 0.01636555505 Evolving particles on level: 0 ... with fluid dt 0.0001099078863 done. Time per fluid step 1.529923611 Time per 242 particle steps 3.109562555 Coupling time per step 0.085728279 Time per step 4.779512761 Regridding at step 11 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 12: from old_time 0.001412920146 to new time 0.001519455024 with dt = 0.000106534878 Before projection: max(abs(u/v/w)) = 0.1502557402 0.02218718524 0.02605309518 max(abs(gpx/gpy/gpz)) = 1476.175449 254.4756296 291.3660766 Min and Max of epf 0.4003766965 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 982.3925097 MLMG: Initial rhs = 491.1962548 MLMG: Initial residual (resid0) = 491.1962548 MLMG: Final Iter. 13 resid, resid/bnorm = 1.133138028e-09, 2.306894681e-12 MLMG: Timers: Solve = 0.271867885 Iter = 0.242732258 Bottom = 0.019492038 After projection: max(abs(u/v/w)) = 0.09912534274 0.01286278339 0.0173426701 Evolving particles on level: 0 ... with fluid dt 0.000106534878 done. Time per fluid step 1.52509971 Time per 234 particle steps 3.024621057 Coupling time per step 0.08580438 Time per step 4.690323585 Regridding at step 12 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 13: from old_time 0.001519455024 to new time 0.001622842592 with dt = 0.0001033875678 Before projection: max(abs(u/v/w)) = 0.1572693067 0.02384413078 0.0281764083 max(abs(gpx/gpy/gpz)) = 1592.593368 281.0341903 325.0104553 Min and Max of epf 0.4033854945 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1016.62761 MLMG: Initial rhs = 508.3138051 MLMG: Initial residual (resid0) = 508.3138051 MLMG: Final Iter. 13 resid, resid/bnorm = 1.140641359e-09, 2.243970846e-12 MLMG: Timers: Solve = 0.272986366 Iter = 0.243891907 Bottom = 0.020401195 After projection: max(abs(u/v/w)) = 0.1044063683 0.01350160015 0.01826749504 Evolving particles on level: 0 ... with fluid dt 0.0001033875678 done. Time per fluid step 1.533660427 Time per 227 particle steps 2.95028176 Coupling time per step 0.085669589 Time per step 4.624188414 Regridding at step 13 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 14: from old_time 0.001622842592 to new time 0.001723303427 with dt = 0.000100460835 Before projection: max(abs(u/v/w)) = 0.1635915358 0.02549678257 0.03016559271 max(abs(gpx/gpy/gpz)) = 1704.571019 309.2292948 358.2530775 Min and Max of epf 0.4001223446 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1048.459173 MLMG: Initial rhs = 524.2295867 MLMG: Initial residual (resid0) = 524.2295867 MLMG: Final Iter. 13 resid, resid/bnorm = 1.196941213e-09, 2.283238572e-12 MLMG: Timers: Solve = 0.271491775 Iter = 0.242512927 Bottom = 0.019182442 After projection: max(abs(u/v/w)) = 0.1094524145 0.01409873636 0.01914847838 Evolving particles on level: 0 ... with fluid dt 0.000100460835 done. Time per fluid step 1.520729064 Time per 221 particle steps 2.8343829 Coupling time per step 0.085390387 Time per step 4.494702042 Regridding at step 14 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 15: from old_time 0.001723303427 to new time 0.001808813522 with dt = 8.551009506e-05 Before projection: max(abs(u/v/w)) = 0.1556301066 0.02307610314 0.02747612293 max(abs(gpx/gpy/gpz)) = 1811.923148 336.1975341 391.4162649 Min and Max of epf 0.4002170255 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 945.3081431 MLMG: Initial rhs = 472.6540715 MLMG: Initial residual (resid0) = 472.6540715 MLMG: Final Iter. 13 resid, resid/bnorm = 1.139444095e-09, 2.410735807e-12 MLMG: Timers: Solve = 0.2717802 Iter = 0.242730941 Bottom = 0.019158554 After projection: max(abs(u/v/w)) = 0.1136095595 0.01468424937 0.0199526782 Evolving particles on level: 0 ... with fluid dt 8.551009506e-05 done. Time per fluid step 1.528995367 Time per 188 particle steps 2.43180306 Coupling time per step 0.085314206 Time per step 4.100895288 Regridding at step 15 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 16: from old_time 0.001808813522 to new time 0.001897878386 with dt = 8.906486426e-05 Before projection: max(abs(u/v/w)) = 0.174137361 0.02688262286 0.03210032241 max(abs(gpx/gpy/gpz)) = 1933.106504 370.3890953 433.2595732 Min and Max of epf 0.3997272253 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1033.122983 MLMG: Initial rhs = 516.5614917 MLMG: Initial residual (resid0) = 516.5614917 MLMG: Final Iter. 13 resid, resid/bnorm = 1.318241516e-09, 2.551954679e-12 MLMG: Timers: Solve = 0.271974833 Iter = 0.242830864 Bottom = 0.019454481 After projection: max(abs(u/v/w)) = 0.1183573942 0.01517806975 0.0207747209 Evolving particles on level: 0 ... with fluid dt 8.906486426e-05 done. Time per fluid step 1.531896806 Time per 196 particle steps 2.517267914 Coupling time per step 0.085594397 Time per step 4.189253059 Regridding at step 16 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 17: from old_time 0.001897878386 to new time 0.001987919075 with dt = 9.004068858e-05 Before projection: max(abs(u/v/w)) = 0.1857513957 0.02949543321 0.03529201636 max(abs(gpx/gpy/gpz)) = 2034.153465 398.6850707 468.1095979 Min and Max of epf 0.3994713838 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1084.613119 MLMG: Initial rhs = 542.3065596 MLMG: Initial residual (resid0) = 542.3065596 MLMG: Final Iter. 13 resid, resid/bnorm = 1.453322795e-09, 2.679891603e-12 MLMG: Timers: Solve = 0.271395743 Iter = 0.242416632 Bottom = 0.01959136 After projection: max(abs(u/v/w)) = 0.1228341674 0.015650234 0.0215544722 Evolving particles on level: 0 ... with fluid dt 9.004068858e-05 done. Time per fluid step 1.532395772 Time per 198 particle steps 2.537840351 Coupling time per step 0.085465873 Time per step 4.209569843 Regridding at step 17 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 18: from old_time 0.001987919075 to new time 0.002078529275 with dt = 9.061019992e-05 Before projection: max(abs(u/v/w)) = 0.1953813766 0.03218008381 0.0381982348 max(abs(gpx/gpy/gpz)) = 2125.508566 422.7491174 500.8243115 Min and Max of epf 0.4013402867 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1130.092466 MLMG: Initial rhs = 565.0462332 MLMG: Initial residual (resid0) = 565.0462332 MLMG: Final Iter. 13 resid, resid/bnorm = 1.538978722e-09, 2.723633274e-12 MLMG: Timers: Solve = 0.273054168 Iter = 0.243995944 Bottom = 0.020510621 After projection: max(abs(u/v/w)) = 0.1270307235 0.01610052351 0.02229055252 Evolving particles on level: 0 ... with fluid dt 9.061019992e-05 done. Time per fluid step 1.534310506 Time per 199 particle steps 2.549129184 Coupling time per step 0.085133993 Time per step 4.223258176 Regridding at step 18 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 19: from old_time 0.002078529275 to new time 0.002166725162 with dt = 8.819588777e-05 Before projection: max(abs(u/v/w)) = 0.1977239932 0.03375493024 0.03938697994 max(abs(gpx/gpy/gpz)) = 2208.898488 448.2672957 530.7031772 Min and Max of epf 0.4020653538 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1139.454148 MLMG: Initial rhs = 569.7270739 MLMG: Initial residual (resid0) = 569.7270739 MLMG: Final Iter. 13 resid, resid/bnorm = 1.5596342e-09, 2.737511119e-12 MLMG: Timers: Solve = 0.271775291 Iter = 0.242632437 Bottom = 0.01969914 After projection: max(abs(u/v/w)) = 0.1307724684 0.01653344184 0.02297413095 Evolving particles on level: 0 ... with fluid dt 8.819588777e-05 done. Time per fluid step 1.498124616 Time per 194 particle steps 2.496143429 Coupling time per step 0.085604077 Time per step 4.134091957 Regridding at step 19 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 20: from old_time 0.002166725162 to new time 0.00224915921 with dt = 8.243404753e-05 Before projection: max(abs(u/v/w)) = 0.1918210519 0.03337015277 0.03849387503 max(abs(gpx/gpy/gpz)) = 2289.390592 473.9255025 558.7095994 Min and Max of epf 0.3995016258 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1103.321607 MLMG: Initial rhs = 551.6608036 MLMG: Initial residual (resid0) = 551.6608036 MLMG: Final Iter. 13 resid, resid/bnorm = 1.409187433e-09, 2.554445457e-12 MLMG: Timers: Solve = 0.271094152 Iter = 0.242036434 Bottom = 0.018922327 After projection: max(abs(u/v/w)) = 0.1340063056 0.01694639241 0.0236016135 Evolving particles on level: 0 ... with fluid dt 8.243404753e-05 done. Time per fluid step 1.528068114 Time per 181 particle steps 2.357038257 Coupling time per step 0.085307333 Time per step 4.024984413 Regridding at step 20 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 21: from old_time 0.00224915921 to new time 0.002333380174 with dt = 8.422096427e-05 Before projection: max(abs(u/v/w)) = 0.2024934281 0.0365667579 0.04194664011 max(abs(gpx/gpy/gpz)) = 2371.23717 502.0311671 589.7849722 Min and Max of epf 0.3999196734 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1162.149008 MLMG: Initial rhs = 581.0745042 MLMG: Initial residual (resid0) = 581.0745042 MLMG: Final Iter. 13 resid, resid/bnorm = 1.478078104e-09, 2.543698086e-12 MLMG: Timers: Solve = 0.271345741 Iter = 0.242118501 Bottom = 0.019134129 After projection: max(abs(u/v/w)) = 0.1375246829 0.01731088422 0.02421869798 Evolving particles on level: 0 ... with fluid dt 8.422096427e-05 done. Time per fluid step 1.529248076 Time per 185 particle steps 2.399721063 Coupling time per step 0.085190766 Time per step 4.068133517 Regridding at step 21 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 22: from old_time 0.002333380174 to new time 0.002415512264 with dt = 8.213208972e-05 Before projection: max(abs(u/v/w)) = 0.2032122511 0.03803423343 0.04282075395 max(abs(gpx/gpy/gpz)) = 2441.586146 529.020364 616.8068327 Min and Max of epf 0.4008113616 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1167.52759 MLMG: Initial rhs = 583.7637949 MLMG: Initial residual (resid0) = 583.7637949 MLMG: Final Iter. 13 resid, resid/bnorm = 1.56272506e-09, 2.67698181e-12 MLMG: Timers: Solve = 0.27120789 Iter = 0.242222586 Bottom = 0.018942678 After projection: max(abs(u/v/w)) = 0.1406954205 0.01767531707 0.0247730421 Evolving particles on level: 0 ... with fluid dt 8.213208972e-05 done. Time per fluid step 1.527814447 Time per 181 particle steps 2.356906055 Coupling time per step 0.085522111 Time per step 4.024877046 Regridding at step 22 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 23: from old_time 0.002415512264 to new time 0.002495821926 with dt = 8.030966248e-05 Before projection: max(abs(u/v/w)) = 0.2040816672 0.03980403358 0.04367747517 max(abs(gpx/gpy/gpz)) = 2509.827924 563.6063573 643.9810991 Min and Max of epf 0.4009279459 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1165.059984 MLMG: Initial rhs = 582.5299922 MLMG: Initial residual (resid0) = 582.5299922 MLMG: Final Iter. 13 resid, resid/bnorm = 1.518266401e-09, 2.606331729e-12 MLMG: Timers: Solve = 0.272425654 Iter = 0.243284195 Bottom = 0.019775461 After projection: max(abs(u/v/w)) = 0.1437126094 0.01802093747 0.02528586017 Evolving particles on level: 0 ... with fluid dt 8.030966248e-05 done. Time per fluid step 1.500078247 Time per 177 particle steps 2.315292141 Coupling time per step 0.085967409 Time per step 3.955367117 Regridding at step 23 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 24: from old_time 0.002495821926 to new time 0.002581545366 with dt = 8.572343949e-05 Before projection: max(abs(u/v/w)) = 0.2226038488 0.04527991608 0.04934554385 max(abs(gpx/gpy/gpz)) = 2574.663267 596.449616 671.0628226 Min and Max of epf 0.4010579275 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1267.224987 MLMG: Initial rhs = 633.6124936 MLMG: Initial residual (resid0) = 633.6124936 MLMG: Final Iter. 13 resid, resid/bnorm = 1.294473861e-09, 2.043005582e-12 MLMG: Timers: Solve = 0.271720253 Iter = 0.242592778 Bottom = 0.019157354 After projection: max(abs(u/v/w)) = 0.1472053897 0.01832667993 0.02580698901 Evolving particles on level: 0 ... with fluid dt 8.572343949e-05 done. Time per fluid step 1.527665717 Time per 189 particle steps 2.443226288 Coupling time per step 0.085371864 Time per step 4.11058979 Regridding at step 24 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 25: from old_time 0.002581545366 to new time 0.002667350087 with dt = 8.580472126e-05 Before projection: max(abs(u/v/w)) = 0.2269782582 0.04709077073 0.05104562594 max(abs(gpx/gpy/gpz)) = 2626.40096 619.1913553 695.0117402 Min and Max of epf 0.400096488 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1295.319028 MLMG: Initial rhs = 647.6595142 MLMG: Initial residual (resid0) = 647.6595142 MLMG: Final Iter. 13 resid, resid/bnorm = 1.083350298e-09, 1.672715794e-12 MLMG: Timers: Solve = 0.269784166 Iter = 0.240636192 Bottom = 0.01830856 After projection: max(abs(u/v/w)) = 0.1502760419 0.01863704407 0.02646271098 Evolving particles on level: 0 ... with fluid dt 8.580472126e-05 done. Time per fluid step 1.526775088 Time per 189 particle steps 2.44256154 Coupling time per step 0.085302421 Time per step 4.109274177 Regridding at step 25 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 26: from old_time 0.002667350087 to new time 0.00275368064 with dt = 8.633055255e-05 Before projection: max(abs(u/v/w)) = 0.2324137583 0.04920833495 0.05306478576 max(abs(gpx/gpy/gpz)) = 2677.197434 639.8725652 718.7665934 Min and Max of epf 0.4001694653 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1332.358149 MLMG: Initial rhs = 666.1790747 MLMG: Initial residual (resid0) = 666.1790747 MLMG: Final Iter. 13 resid, resid/bnorm = 1.055710186e-09, 1.584724327e-12 MLMG: Timers: Solve = 0.27123651 Iter = 0.242166091 Bottom = 0.019145622 After projection: max(abs(u/v/w)) = 0.153252248 0.01892437599 0.02711675176 Evolving particles on level: 0 ... with fluid dt 8.633055255e-05 done. Time per fluid step 1.528114092 Time per 190 particle steps 2.454463689 Coupling time per step 0.085445498 Time per step 4.122596344 Regridding at step 26 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 27: from old_time 0.00275368064 to new time 0.002840456242 with dt = 8.677560213e-05 Before projection: max(abs(u/v/w)) = 0.237436559 0.05199784951 0.05432951941 max(abs(gpx/gpy/gpz)) = 2725.067676 660.8354106 740.6356887 Min and Max of epf 0.4017275205 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1373.756687 MLMG: Initial rhs = 686.8783434 MLMG: Initial residual (resid0) = 686.8783434 MLMG: Final Iter. 13 resid, resid/bnorm = 1.1246577e-09, 1.63734628e-12 MLMG: Timers: Solve = 0.271430637 Iter = 0.242280852 Bottom = 0.01919142 After projection: max(abs(u/v/w)) = 0.156118055 0.01919419444 0.0277656138 Evolving particles on level: 0 ... with fluid dt 8.677560213e-05 done. Time per fluid step 1.528058347 Time per 191 particle steps 2.464602866 Coupling time per step 0.085270319 Time per step 4.132426411 Regridding at step 27 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 28: from old_time 0.002840456242 to new time 0.002926071424 with dt = 8.561518205e-05 Before projection: max(abs(u/v/w)) = 0.2379439688 0.05376582085 0.0548062682 max(abs(gpx/gpy/gpz)) = 2770.798783 681.563982 759.6135664 Min and Max of epf 0.4023699457 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1386.464317 MLMG: Initial rhs = 693.2321586 MLMG: Initial residual (resid0) = 693.2321586 MLMG: Final Iter. 13 resid, resid/bnorm = 1.270947791e-09, 1.83336531e-12 MLMG: Timers: Solve = 0.272478612 Iter = 0.243340327 Bottom = 0.019524161 After projection: max(abs(u/v/w)) = 0.1588011037 0.01944981576 0.02842030242 Evolving particles on level: 0 ... with fluid dt 8.561518205e-05 done. Time per fluid step 1.529295286 Time per 188 particle steps 2.43739645 Coupling time per step 0.085541573 Time per step 4.107021589 Regridding at step 28 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 29: from old_time 0.002926071424 to new time 0.003002174817 with dt = 7.610339361e-05 Before projection: max(abs(u/v/w)) = 0.2153791672 0.05033278045 0.04902728739 max(abs(gpx/gpy/gpz)) = 2816.158157 702.8428122 778.4422952 Min and Max of epf 0.3986810448 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1265.16271 MLMG: Initial rhs = 632.5813552 MLMG: Initial residual (resid0) = 632.5813552 MLMG: Final Iter. 13 resid, resid/bnorm = 1.180655573e-09, 1.866409061e-12 MLMG: Timers: Solve = 0.274063981 Iter = 0.244685957 Bottom = 0.020085106 After projection: max(abs(u/v/w)) = 0.1605722895 0.0197328266 0.02904167369 Evolving particles on level: 0 ... with fluid dt 7.610339361e-05 done. Time per fluid step 1.50647323 Time per 167 particle steps 2.174922018 Coupling time per step 0.086159167 Time per step 3.822549351 Regridding at step 29 On level 0 updated BC areas: BC: 0 area: 0 BC: 1 area: 0 BC: 2 area: 0.0001960173782 ============ NEW TIME STEP ============ Step 30: from old_time 0.003002174817 to new time 0.003083466812 with dt = 8.129199461e-05 Before projection: max(abs(u/v/w)) = 0.2337856203 0.05621695713 0.05493721936 max(abs(gpx/gpy/gpz)) = 2870.511667 736.2321435 803.7203082 Min and Max of epf 0.398830716 1 Nodal Projection: >> Before projection: * On lev 0 max(abs(rhs)) = 1376.054613 MLMG: Initial rhs = 688.0273063 MLMG: Initial residual (resid0) = 688.0273063 MLMG: Final Iter. 13 resid, resid/bnorm = 1.327606469e-09, 1.929583982e-12 MLMG: Timers: Solve = 0.273296347 Iter = 0.244100602 Bottom = 0.019445532 After projection: max(abs(u/v/w)) = 0.1635484993 0.0200108925 0.02965916915 Evolving particles on level: 0 ... with fluid dt 8.129199461e-05 done. Time per fluid step 1.505149684 Time per 179 particle steps 2.355343388 Coupling time per step 0.085948677 Time per step 4.001425508 Writing plotfile BENCH05-Size0008_wide-Godunov_plt00030 at time 0.003083466812 Time spent in main (after init) 137.8818881 Time spent in main 146.8073711 Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [2363 ... 2471] [The Arena] max space (MB) allocated spread across MPI: [153 ... 177] [The Arena] max space (MB) used spread across MPI: [152 ... 175] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [16 ... 16] [The Pinned Arena] max space (MB) used spread across MPI: [7 ... 13] AMReX (26.08-26-g2cf4fbcde02a) finalized