Initializing AMReX (26.11-4-g1fa9e82374c4)...
MPI initialized with 1 MPI processes
MPI initialized with thread support level 0
Initializing CUDA...
CUDA initialized with 1 device.
AMReX (26.11-4-g1fa9e82374c4) initialized
   MFIX git describe: 26.11-10-ge24e853095d0
AMReX-Hydro git hash: 154572aa6cf22c35a69729c74a0276909b96d5e3
Number of levels: 2
RunType is Standard
Auto-generating level-set parameters:
  eb_refinement = 1
  levelset_pad  = 2
  eb_pad        = 2

================================================================================
Warning: Overwriting amr.check_file with value from mfix.check_file
================================================================================

Simulation is transient
Fluid constraint not specified. Setting default:
  mfix.constraint = IncompressibleFluid

--------------------------------------------------------------------------------
Info: Max effective viscosity factor not specified.
Using default 1e+06
--------------------------------------------------------------------------------


Load balance setup:
   Type:      SingleGrid
   Strategy:  KnapSack
   Weighting: CellCount


 Building cylinder geometry.
 
 Internal Flow: 0
 Radius:    0.2
 Height:    -1
 Direction: 2
 Rotation angle: 0
 Rotation axis: 0
 Center:    0.5, 0.5, 0.5
Done making the fluid eb levels ...
PostProcessBaseGrids
Making new level 0 from scratch

On level 0 updated BC areas:
ErrorErr on level 0
Making new level 1 from scratch

On level 1 updated BC areas:


****************************************
  Coverage report:  Grids        Cells
          regular:      0         6944
          covered:      0          832
              cut:      1          416
****************************************

On level 0 fillpatch epf
On level 0 fillpatch rho
On level 0 fillpatch vel
On level 1 fillpatch epf
On level 1 fillpatch rho
On level 1 fillpatch vel
On level 0 fillpatch vel
On level 0 fillpatch rho
On level 1 fillpatch vel
On level 1 fillpatch rho
Initial projection:
Before projection:
   max(abs(u/v/w))  = 0.70710678  0.70710678  0
   max(abs(gpx/gpy/gpz))  = 0  0  0
Min and Max of epf 1 1
On level 0: set velocity bcs
Before projection:
   max(abs(u/v/w))  = 0.70710678  0.70710678  0
   max(abs(gpx/gpy/gpz))  = 0  0  0
Min and Max of epf 1 1
On level 1: set velocity bcs
On level 0: set vec bcs
On level 1: set vec bcs
Nodal Projection:
 >> Before projection:
  * On lev 0 max(abs(rhs)) = 29.77431549
  * On lev 1 max(abs(rhs)) = 59.74347518

MLMG: # of AMR levels: 2
      # of MG levels on the coarsest AMR level: 2
MLMG: Initial rhs               = 59.74347518
MLMG: Initial residual (resid0) = 59.74347518
MLMG: Iteration   1 Fine resid/bnorm = 0.03956425674
MLMG: Iteration   2 Fine resid/bnorm = 0.000421647964
MLMG: Iteration   3 Fine resid/bnorm = 7.203495227e-06
MLMG: Iteration   4 Fine resid/bnorm = 7.434409574e-08
MLMG: Iteration   5 Fine resid/bnorm = 4.76970816e-09
MLMG: Iteration   6 Fine resid/bnorm = 3.801865907e-10
MLMG: Iteration   7 Fine resid/bnorm = 3.374727358e-11
MLMG: Iteration   8 Fine resid/bnorm = 3.817709148e-12
MLMG: Iteration   8 Crse resid/bnorm = 7.918059158e-10
MLMG: Iteration   9 Fine resid/bnorm = 4.46573843e-13
MLMG: Iteration   9 Crse resid/bnorm = 1.120774937e-10
MLMG: Iteration  10 Fine resid/bnorm = 5.415292334e-14
MLMG: Iteration  10 Crse resid/bnorm = 1.601390396e-11
MLMG: Iteration  11 Fine resid/bnorm = 1.704262319e-14
MLMG: Iteration  11 Crse resid/bnorm = 2.304105009e-12
MLMG: Final Iter. 11 resid, resid/bnorm = 1.376552404e-10, 2.304105009e-12
MLMG: Timers: Solve = 0.057397936 Iter = 0.050235717 Bottom = 0.026655466
On level 0: set velocity bcs
After  projection:
   max(abs(u/v/w))  = 1.47877986  1.47877986  4.84482246e-13
On level 1: set velocity bcs
After  projection:
   max(abs(u/v/w))  = 1.526266743  1.526266743  1.345788064e-12
Doing initial pressure iterations with dt = 0.004606829071
On level 0: set velocity bcs
On level 0: set density bcs
On level 1: set velocity bcs
On level 1: set density bcs
On level 0 fillpatch vel
On level 0 fillpatch rho
On level 1 fillpatch vel
On level 1 fillpatch rho

In initial_iterations: iter = 0
On level 0: set density bcs
On level 1: set density bcs
MAC Projection:
On level 0 fillpatch none
On level 1 fillpatch none
 >> Before projection
  * On level 0 max(abs(diveu)) = 1703.813941
  * On level 1 max(abs(diveu)) = 1154.780884
MLMG: # of AMR levels: 2
      # of MG levels on the coarsest AMR level: 2
MLMG: Initial rhs               = 3.578916976
MLMG: Initial residual (resid0) = 3.578916976
MLMG: Iteration   1 Fine resid/bnorm = 0.08218565634
MLMG: Iteration   2 Fine resid/bnorm = 0.003375906967
MLMG: Iteration   3 Fine resid/bnorm = 0.0001787232057
MLMG: Iteration   4 Fine resid/bnorm = 9.994412775e-06
MLMG: Iteration   5 Fine resid/bnorm = 5.802450983e-07
MLMG: Iteration   6 Fine resid/bnorm = 3.452090747e-08
MLMG: Iteration   7 Fine resid/bnorm = 2.071191865e-09
MLMG: Iteration   8 Fine resid/bnorm = 1.243461622e-10
MLMG: Iteration   9 Fine resid/bnorm = 7.452356377e-12
MLMG: Iteration   9 Crse resid/bnorm = 3.592852463e-13
MLMG: Final Iter. 9 resid, resid/bnorm = 2.667136475e-11, 7.452356377e-12
MLMG: Timers: Solve = 0.061802397 Iter = 0.059963127 Bottom = 0.042709623
 >> After projection
  * On level 0 max(abs(diveu)) = 2.527145822e-10
  * On level 1 max(abs(diveu)) = 2.590041758e-10
On level 0 fillpatch none
On level 1 fillpatch none
On level 0: set velocity bcs
On level 1: set velocity bcs
On level 0: set velocity bcs
On level 1: set velocity bcs
Before projection:
   max(abs(u/v/w))  = 1.422205574  1.422205574  3.192990316e-11
   max(abs(gpx/gpy/gpz))  = 0  0  0
Min and Max of epf 1 1
On level 0: set velocity bcs
Before projection:
   max(abs(u/v/w))  = 1.449630343  1.449630343  6.686145254e-11
   max(abs(gpx/gpy/gpz))  = 0  0  0
Min and Max of epf 1 1
On level 1: set velocity bcs
On level 0: set velocity bcs
On level 1: set velocity bcs
Nodal Projection:
 >> Before projection:
  * On lev 0 max(abs(rhs)) = 1.867782749
  * On lev 1 max(abs(rhs)) = 4.449545874

MLMG: # of AMR levels: 2
      # of MG levels on the coarsest AMR level: 2
MLMG: Initial rhs               = 4.449545874
MLMG: Initial residual (resid0) = 4.449545874
MLMG: Iteration   1 Fine resid/bnorm = 0.02638538928
MLMG: Iteration   2 Fine resid/bnorm = 0.0003114231446
MLMG: Iteration   3 Fine resid/bnorm = 5.508609671e-06
MLMG: Iteration   4 Fine resid/bnorm = 6.139801573e-08
MLMG: Iteration   5 Fine resid/bnorm = 1.893992238e-09
MLMG: Iteration   6 Fine resid/bnorm = 1.915772145e-10
MLMG: Iteration   7 Fine resid/bnorm = 2.109269835e-11
MLMG: Iteration   8 Fine resid/bnorm = 2.39764422e-12
MLMG: Iteration   8 Crse resid/bnorm = 5.56057473e-10
MLMG: Iteration   9 Fine resid/bnorm = 2.796488104e-13
MLMG: Iteration   9 Crse resid/bnorm = 7.871488902e-11
MLMG: Iteration  10 Fine resid/bnorm = 3.390346503e-14
MLMG: Iteration  10 Crse resid/bnorm = 1.124627471e-11
MLMG: Iteration  11 Fine resid/bnorm = 1.089439556e-14
MLMG: Iteration  11 Crse resid/bnorm = 1.617866864e-12
MLMG: Final Iter. 11 resid, resid/bnorm = 7.198772828e-12, 1.617866864e-12
MLMG: Timers: Solve = 0.05586259 Iter = 0.05206247 Bottom = 0.029025673
On level 0: set velocity bcs
After  projection:
   max(abs(u/v/w))  = 1.413131257  1.413131257  3.176547385e-11
On level 1: set velocity bcs
After  projection:
   max(abs(u/v/w))  = 1.444629562  1.444629562  6.707555636e-11
On level 0: set velocity bcs
On level 0: set density bcs
On level 1: set velocity bcs
On level 1: set density bcs

In initial_iterations: iter = 1
On level 0: set density bcs
On level 1: set density bcs
MAC Projection:
On level 0 fillpatch none
On level 1 fillpatch none
 >> Before projection
  * On level 0 max(abs(diveu)) = 1268.151996
  * On level 1 max(abs(diveu)) = 804.0916384
MLMG: # of AMR levels: 2
      # of MG levels on the coarsest AMR level: 2
MLMG: Initial rhs               = 2.70324018
MLMG: Initial residual (resid0) = 2.70324018
MLMG: Iteration   1 Fine resid/bnorm = 0.02330004712
MLMG: Iteration   2 Fine resid/bnorm = 0.001326579901
MLMG: Iteration   3 Fine resid/bnorm = 5.940638537e-05
MLMG: Iteration   4 Fine resid/bnorm = 2.963861486e-06
MLMG: Iteration   5 Fine resid/bnorm = 1.565060127e-07
MLMG: Iteration   6 Fine resid/bnorm = 8.580977211e-09
MLMG: Iteration   7 Fine resid/bnorm = 4.818715498e-10
MLMG: Iteration   8 Fine resid/bnorm = 2.77085038e-11
MLMG: Iteration   9 Fine resid/bnorm = 1.591810143e-12
MLMG: Iteration   9 Crse resid/bnorm = 7.094022851e-14
MLMG: Final Iter. 9 resid, resid/bnorm = 4.303045138e-12, 1.591810143e-12
MLMG: Timers: Solve = 0.059039446 Iter = 0.058185364 Bottom = 0.043233254
 >> After projection
  * On level 0 max(abs(diveu)) = 4.994884703e-11
  * On level 1 max(abs(diveu)) = 5.254417049e-11
On level 0 fillpatch none
On level 1 fillpatch none
On level 0: set velocity bcs
On level 1: set velocity bcs
On level 0: set velocity bcs
On level 1: set velocity bcs
Before projection:
   max(abs(u/v/w))  = 1.413491111  1.413491111  2.652611183e-11
   max(abs(gpx/gpy/gpz))  = 14.29688751  14.29688751  3.580682153e-11
Min and Max of epf 1 1
On level 0: set velocity bcs
Before projection:
   max(abs(u/v/w))  = 1.447074151  1.447074151  5.058331808e-11
   max(abs(gpx/gpy/gpz))  = 23.00094001  23.00094001  1.178603401e-10
Min and Max of epf 1 1
On level 1: set velocity bcs
On level 0: set velocity bcs
On level 1: set velocity bcs
Nodal Projection:
 >> Before projection:
  * On lev 0 max(abs(rhs)) = 0.1509727113
  * On lev 1 max(abs(rhs)) = 0.6927293804

MLMG: # of AMR levels: 2
      # of MG levels on the coarsest AMR level: 2
MLMG: Initial rhs               = 0.6927293804
MLMG: Initial residual (resid0) = 0.6927293804
MLMG: Iteration   1 Fine resid/bnorm = 0.005130373494
MLMG: Iteration   2 Fine resid/bnorm = 0.0001111445902
MLMG: Iteration   3 Fine resid/bnorm = 2.159134709e-06
MLMG: Iteration   4 Fine resid/bnorm = 3.464097202e-08
MLMG: Iteration   5 Fine resid/bnorm = 1.216361513e-09
MLMG: Iteration   6 Fine resid/bnorm = 8.540309767e-11
MLMG: Iteration   7 Fine resid/bnorm = 6.595646275e-12
MLMG: Iteration   7 Crse resid/bnorm = 4.39939044e-10
MLMG: Iteration   8 Fine resid/bnorm = 6.162902836e-13
MLMG: Iteration   8 Crse resid/bnorm = 6.205956874e-11
MLMG: Iteration   9 Fine resid/bnorm = 5.780663828e-14
MLMG: Iteration   9 Crse resid/bnorm = 8.815497312e-12
MLMG: Final Iter. 9 resid, resid/bnorm = 6.106753991e-12, 8.815497312e-12
MLMG: Timers: Solve = 0.042261761 Iter = 0.038942352 Bottom = 0.022770401
On level 0: set velocity bcs
After  projection:
   max(abs(u/v/w))  = 1.411707841  1.411707841  2.646000865e-11
On level 1: set velocity bcs
After  projection:
   max(abs(u/v/w))  = 1.44368775  1.44368775  5.067059077e-11
On level 0: set velocity bcs
On level 0: set density bcs
On level 1: set velocity bcs
On level 1: set density bcs

In initial_iterations: iter = 2
On level 0: set density bcs
On level 1: set density bcs
MAC Projection:
On level 0 fillpatch none
On level 1 fillpatch none
 >> Before projection
  * On level 0 max(abs(diveu)) = 1241.202413
  * On level 1 max(abs(diveu)) = 804.0916384
MLMG: # of AMR levels: 2
      # of MG levels on the coarsest AMR level: 2
MLMG: Initial rhs               = 3.04626377
MLMG: Initial residual (resid0) = 3.04626377
MLMG: Iteration   1 Fine resid/bnorm = 0.02202839205
MLMG: Iteration   2 Fine resid/bnorm = 0.001134936928
MLMG: Iteration   3 Fine resid/bnorm = 4.931558355e-05
MLMG: Iteration   4 Fine resid/bnorm = 2.537534012e-06
MLMG: Iteration   5 Fine resid/bnorm = 1.383403754e-07
MLMG: Iteration   6 Fine resid/bnorm = 7.816077189e-09
MLMG: Iteration   7 Fine resid/bnorm = 4.513860281e-10
MLMG: Iteration   8 Fine resid/bnorm = 2.638550072e-11
MLMG: Iteration   9 Fine resid/bnorm = 1.55547727e-12
MLMG: Iteration   9 Crse resid/bnorm = 6.092033732e-14
MLMG: Final Iter. 9 resid, resid/bnorm = 4.738394054e-12, 1.55547727e-12
MLMG: Timers: Solve = 0.056572698 Iter = 0.055717438 Bottom = 0.040960479
 >> After projection
  * On level 0 max(abs(diveu)) = 5.028167875e-11
  * On level 1 max(abs(diveu)) = 5.532691158e-11
On level 0 fillpatch none
On level 1 fillpatch none
On level 0: set velocity bcs
On level 1: set velocity bcs
On level 0: set velocity bcs
On level 1: set velocity bcs
Before projection:
   max(abs(u/v/w))  = 1.41136956  1.41136956  3.424243587e-11
   max(abs(gpx/gpy/gpz))  = 13.64992201  13.64992201  4.515145369e-11
Min and Max of epf 1 1
On level 0: set velocity bcs
Before projection:
   max(abs(u/v/w))  = 1.44488668  1.44488668  5.220491218e-11
   max(abs(gpx/gpy/gpz))  = 22.90394394  22.90394394  1.727102805e-10
Min and Max of epf 1 1
On level 1: set velocity bcs
On level 0: set velocity bcs
On level 1: set velocity bcs
Nodal Projection:
 >> Before projection:
  * On lev 0 max(abs(rhs)) = 0.11766771
  * On lev 1 max(abs(rhs)) = 0.4624751242

MLMG: # of AMR levels: 2
      # of MG levels on the coarsest AMR level: 2
MLMG: Initial rhs               = 0.4624751242
MLMG: Initial residual (resid0) = 0.4624751242
MLMG: Iteration   1 Fine resid/bnorm = 0.006958443278
MLMG: Iteration   2 Fine resid/bnorm = 0.0001285664033
MLMG: Iteration   3 Fine resid/bnorm = 2.304012747e-06
MLMG: Iteration   4 Fine resid/bnorm = 4.004948122e-08
MLMG: Iteration   5 Fine resid/bnorm = 9.734349325e-10
MLMG: Iteration   6 Fine resid/bnorm = 7.03568469e-11
MLMG: Iteration   7 Fine resid/bnorm = 5.599039588e-12
MLMG: Iteration   7 Crse resid/bnorm = 1.224053263e-10
MLMG: Iteration   8 Fine resid/bnorm = 4.998597931e-13
MLMG: Iteration   8 Crse resid/bnorm = 1.37718193e-11
MLMG: Iteration   9 Fine resid/bnorm = 4.60167185e-14
MLMG: Iteration   9 Crse resid/bnorm = 1.618164363e-12
MLMG: Final Iter. 9 resid, resid/bnorm = 7.483607646e-13, 1.618164363e-12
MLMG: Timers: Solve = 0.04094477 Iter = 0.037626146 Bottom = 0.021463276
On level 0: set velocity bcs
After  projection:
   max(abs(u/v/w))  = 1.410898546  1.410898546  3.418015842e-11
On level 1: set velocity bcs
After  projection:
   max(abs(u/v/w))  = 1.443660869  1.443660869  5.216294067e-11
On level 0: set velocity bcs
On level 0: set density bcs
On level 1: set velocity bcs
On level 1: set density bcs
Time spent in init      0.600807499

On level 0 fillpatch vel
On level 1 fillpatch vel
  Writing plotfile BENCH09-refinement_plt00000 at time 0

 ============   NEW TIME STEP   ============ 
On level 0: set density bcs
On level 1: set density bcs

   Step 1: from old_time 0 to new time 0.004063119654 with dt = 0.004063119654

On level 0 fillpatch vel
On level 0 fillpatch rho
On level 1 fillpatch vel
On level 1 fillpatch rho
 Finished fillpatch before predictor
On level 0: set density bcs
On level 1: set density bcs
MAC Projection:
On level 0 fillpatch none
On level 1 fillpatch none
 >> Before projection
  * On level 0 max(abs(diveu)) = 1212.555318
  * On level 1 max(abs(diveu)) = 794.3420316
MLMG: # of AMR levels: 2
      # of MG levels on the coarsest AMR level: 2
MLMG: Initial rhs               = 3.032387192
MLMG: Initial residual (resid0) = 3.032387192
MLMG: Iteration   1 Fine resid/bnorm = 0.0216316705
MLMG: Iteration   2 Fine resid/bnorm = 0.001115244073
MLMG: Iteration   3 Fine resid/bnorm = 4.943698679e-05
MLMG: Iteration   4 Fine resid/bnorm = 2.541264525e-06
MLMG: Iteration   5 Fine resid/bnorm = 1.382182253e-07
MLMG: Iteration   6 Fine resid/bnorm = 7.798976657e-09
MLMG: Iteration   7 Fine resid/bnorm = 4.492841643e-10
MLMG: Iteration   8 Fine resid/bnorm = 2.628892478e-11
MLMG: Iteration   9 Fine resid/bnorm = 1.548973171e-12
MLMG: Iteration   9 Crse resid/bnorm = 5.971989847e-14
MLMG: Final Iter. 9 resid, resid/bnorm = 4.697086404e-12, 1.548973171e-12
MLMG: Timers: Solve = 0.056569196 Iter = 0.055698383 Bottom = 0.040873293
 >> After projection
  * On level 0 max(abs(diveu)) = 5.022572606e-11
  * On level 1 max(abs(diveu)) = 5.418732905e-11
On level 0 fillpatch none
On level 1 fillpatch none
On level 0: set velocity bcs
On level 1: set velocity bcs
On level 0: set velocity bcs
On level 1: set velocity bcs
Before projection:
   max(abs(u/v/w))  = 1.428759962  1.428759962  1.534217588e-11
   max(abs(gpx/gpy/gpz))  = 14.23448797  14.23448799  5.841964001e-11
Min and Max of epf 1 1
On level 0: set velocity bcs
Before projection:
   max(abs(u/v/w))  = 1.454205373  1.454205373  2.780915201e-11
   max(abs(gpx/gpy/gpz))  = 22.61989507  22.61989507  2.078469252e-10
Min and Max of epf 1 1
On level 1: set velocity bcs
On level 0: set vec bcs
On level 1: set vec bcs
Nodal Projection:
 >> Before projection:
  * On lev 0 max(abs(rhs)) = 1.736115617
  * On lev 1 max(abs(rhs)) = 4.278230169

MLMG: # of AMR levels: 2
      # of MG levels on the coarsest AMR level: 2
MLMG: Initial rhs               = 4.278230169
MLMG: Initial residual (resid0) = 4.278230169
MLMG: Iteration   1 Fine resid/bnorm = 0.02504966824
MLMG: Iteration   2 Fine resid/bnorm = 0.0002770456339
MLMG: Iteration   3 Fine resid/bnorm = 4.847767987e-06
MLMG: Iteration   4 Fine resid/bnorm = 5.120429851e-08
MLMG: Iteration   5 Fine resid/bnorm = 2.938109708e-09
MLMG: Iteration   6 Fine resid/bnorm = 2.611186802e-10
MLMG: Iteration   7 Fine resid/bnorm = 2.46071762e-11
MLMG: Iteration   8 Fine resid/bnorm = 2.379267043e-12
MLMG: Iteration   8 Crse resid/bnorm = 5.14545215e-10
MLMG: Iteration   9 Fine resid/bnorm = 2.622989472e-13
MLMG: Iteration   9 Crse resid/bnorm = 7.279711008e-11
MLMG: Iteration  10 Fine resid/bnorm = 3.153231605e-14
MLMG: Iteration  10 Crse resid/bnorm = 1.039794016e-11
MLMG: Iteration  11 Fine resid/bnorm = 6.12432299e-15
MLMG: Iteration  11 Crse resid/bnorm = 1.495730664e-12
MLMG: Final Iter. 11 resid, resid/bnorm = 6.399080051e-12, 1.495730664e-12
MLMG: Timers: Solve = 0.049938338 Iter = 0.046631657 Bottom = 0.026578673
On level 0: set velocity bcs
After  projection:
   max(abs(u/v/w))  = 1.424410448  1.424410448  1.525046053e-11
On level 1: set velocity bcs
After  projection:
   max(abs(u/v/w))  = 1.449945385  1.449945385  2.798988467e-11
   Time per fluid step      0.162652014
   Time per step        0.163517859
On level 0 fillpatch vel
On level 1 fillpatch vel
  Writing plotfile BENCH09-refinement_plt00001 at time 0.004063119654
On level 0 fillpatch vel
On level 1 fillpatch vel
Time spent in main (after init) 0.177276199
Time spent in main      0.778083698

Total GPU global memory (MB) spread across MPI: [7784 ... 7784]
Free  GPU global memory (MB) spread across MPI: [6338 ... 6338]
[The         Arena] max space (MB) allocated spread across MPI: [193 ... 193]
[The         Arena] max space (MB) used      spread across MPI: [154 ... 154]
[The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8]
[The Managed Arena] max space (MB) used      spread across MPI: [0 ... 0]
[The  Pinned Arena] max space (MB) allocated spread across MPI: [8 ... 8]
[The  Pinned Arena] max space (MB) used      spread across MPI: [2 ... 2]
AMReX (26.11-4-g1fa9e82374c4) finalized
