Initializing AMReX (26.11-5-g1d9bd90c3583)...
MPI initialized with 1 MPI processes
MPI initialized with thread support level 0
Initializing CUDA...
CUDA initialized with 1 device.
AMReX (26.11-5-g1d9bd90c3583) initialized
   MFIX git describe: 26.11-11-gbf4ab648cdd0
AMReX-Hydro git hash: 154572aa6cf22c35a69729c74a0276909b96d5e3
Number of levels: 2
RunType is Standard
Auto-generating level-set parameters:
  eb_refinement = 1
  levelset_pad  = 2
  eb_pad        = 2

================================================================================
Warning: Overwriting amr.check_file with value from mfix.check_file
================================================================================

Simulation is transient
Fluid constraint not specified. Setting default:
  mfix.constraint = IncompressibleFluid

--------------------------------------------------------------------------------
Info: Max effective viscosity factor not specified.
Using default 1e+06
--------------------------------------------------------------------------------


Load balance setup:
   Type:      SingleGrid
   Strategy:  KnapSack
   Weighting: CellCount


 Building cylinder geometry.
 
 Internal Flow: 0
 Radius:    0.2
 Height:    -1
 Direction: 2
 Rotation angle: 0
 Rotation axis: 0
 Center:    0.5, 0.5, 0.5
Done making the fluid eb levels ...
PostProcessBaseGrids
Making new level 0 from scratch

On level 0 updated BC areas:
ErrorErr on level 0
Making new level 1 from scratch

On level 1 updated BC areas:


****************************************
  Coverage report:  Grids        Cells
          regular:      0         6944
          covered:      0          832
              cut:      1          416
****************************************

On level 0 fillpatch epf
On level 0 fillpatch rho
On level 0 fillpatch vel
On level 1 fillpatch epf
On level 1 fillpatch rho
On level 1 fillpatch vel
On level 0 fillpatch vel
On level 0 fillpatch rho
On level 1 fillpatch vel
On level 1 fillpatch rho
Initial projection:
Before projection:
   max(abs(u/v/w))  = 0.70710678  0.70710678  0
   max(abs(gpx/gpy/gpz))  = 0  0  0
Min and Max of epf 1 1
On level 0: set velocity bcs
Before projection:
   max(abs(u/v/w))  = 0.70710678  0.70710678  0
   max(abs(gpx/gpy/gpz))  = 0  0  0
Min and Max of epf 1 1
On level 1: set velocity bcs
On level 0: set vec bcs
On level 1: set vec bcs
Nodal Projection:
 >> Before projection:
  * On lev 0 max(abs(rhs)) = 29.77431549
  * On lev 1 max(abs(rhs)) = 59.74347518

MLMG: # of AMR levels: 2
      # of MG levels on the coarsest AMR level: 2
MLMG: Initial rhs               = 59.74347518
MLMG: Initial residual (resid0) = 59.74347518
MLMG: Iteration   1 Fine resid/bnorm = 0.03956425674
MLMG: Iteration   2 Fine resid/bnorm = 0.000421647964
MLMG: Iteration   3 Fine resid/bnorm = 7.203495227e-06
MLMG: Iteration   4 Fine resid/bnorm = 7.434409574e-08
MLMG: Iteration   5 Fine resid/bnorm = 4.76970816e-09
MLMG: Iteration   6 Fine resid/bnorm = 3.801865907e-10
MLMG: Iteration   7 Fine resid/bnorm = 3.374727358e-11
MLMG: Iteration   8 Fine resid/bnorm = 3.817709148e-12
MLMG: Iteration   8 Crse resid/bnorm = 7.918059158e-10
MLMG: Iteration   9 Fine resid/bnorm = 4.46573843e-13
MLMG: Iteration   9 Crse resid/bnorm = 1.120774937e-10
MLMG: Iteration  10 Fine resid/bnorm = 5.415292334e-14
MLMG: Iteration  10 Crse resid/bnorm = 1.601390396e-11
MLMG: Iteration  11 Fine resid/bnorm = 1.704262319e-14
MLMG: Iteration  11 Crse resid/bnorm = 2.304105009e-12
MLMG: Final Iter. 11 resid, resid/bnorm = 1.376552404e-10, 2.304105009e-12
MLMG: Timers: Solve = 0.057322746 Iter = 0.050038891 Bottom = 0.026533397
On level 0: set velocity bcs
After  projection:
   max(abs(u/v/w))  = 1.47877986  1.47877986  4.84482246e-13
On level 1: set velocity bcs
After  projection:
   max(abs(u/v/w))  = 1.526266743  1.526266743  1.345788064e-12
Doing initial pressure iterations with dt = 0.004606829071
On level 0: set velocity bcs
On level 0: set density bcs
On level 1: set velocity bcs
On level 1: set density bcs
On level 0 fillpatch vel
On level 0 fillpatch rho
On level 1 fillpatch vel
On level 1 fillpatch rho

In initial_iterations: iter = 0
On level 0: set density bcs
On level 1: set density bcs
MAC Projection:
On level 0 fillpatch none
On level 1 fillpatch none
 >> Before projection
  * On level 0 max(abs(diveu)) = 1703.813941
  * On level 1 max(abs(diveu)) = 1154.780884
MLMG: # of AMR levels: 2
      # of MG levels on the coarsest AMR level: 2
MLMG: Initial rhs               = 3.578916976
MLMG: Initial residual (resid0) = 3.578916976
MLMG: Iteration   1 Fine resid/bnorm = 0.08233891251
MLMG: Iteration   2 Fine resid/bnorm = 0.00337953284
MLMG: Iteration   3 Fine resid/bnorm = 0.0001787227698
MLMG: Iteration   4 Fine resid/bnorm = 9.993479283e-06
MLMG: Iteration   5 Fine resid/bnorm = 5.811944156e-07
MLMG: Iteration   6 Fine resid/bnorm = 3.45717924e-08
MLMG: Iteration   7 Fine resid/bnorm = 2.0681896e-09
MLMG: Iteration   8 Fine resid/bnorm = 1.242768508e-10
MLMG: Iteration   9 Fine resid/bnorm = 7.4315151e-12
MLMG: Iteration   9 Crse resid/bnorm = 3.574598425e-13
MLMG: Final Iter. 9 resid, resid/bnorm = 2.659677555e-11, 7.4315151e-12
MLMG: Timers: Solve = 0.06195715 Iter = 0.060141924 Bottom = 0.042925985
 >> After projection
  * On level 0 max(abs(diveu)) = 2.513871044e-10
  * On level 1 max(abs(diveu)) = 2.532330578e-10
On level 0 fillpatch none
On level 1 fillpatch none
On level 0: set velocity bcs
On level 1: set velocity bcs
On level 0: set velocity bcs
On level 1: set velocity bcs
Before projection:
   max(abs(u/v/w))  = 1.422205574  1.422205574  4.852516717e-11
   max(abs(gpx/gpy/gpz))  = 0  0  0
Min and Max of epf 1 1
On level 0: set velocity bcs
Before projection:
   max(abs(u/v/w))  = 1.449630343  1.449630343  8.108030911e-11
   max(abs(gpx/gpy/gpz))  = 0  0  0
Min and Max of epf 1 1
On level 1: set velocity bcs
On level 0: set velocity bcs
On level 1: set velocity bcs
Nodal Projection:
 >> Before projection:
  * On lev 0 max(abs(rhs)) = 1.867782749
  * On lev 1 max(abs(rhs)) = 4.449545874

MLMG: # of AMR levels: 2
      # of MG levels on the coarsest AMR level: 2
MLMG: Initial rhs               = 4.449545874
MLMG: Initial residual (resid0) = 4.449545874
MLMG: Iteration   1 Fine resid/bnorm = 0.02638538928
MLMG: Iteration   2 Fine resid/bnorm = 0.0003114231446
MLMG: Iteration   3 Fine resid/bnorm = 5.508609671e-06
MLMG: Iteration   4 Fine resid/bnorm = 6.139801662e-08
MLMG: Iteration   5 Fine resid/bnorm = 1.893992177e-09
MLMG: Iteration   6 Fine resid/bnorm = 1.915770976e-10
MLMG: Iteration   7 Fine resid/bnorm = 2.10927849e-11
MLMG: Iteration   8 Fine resid/bnorm = 2.397300359e-12
MLMG: Iteration   8 Crse resid/bnorm = 5.560574418e-10
MLMG: Iteration   9 Fine resid/bnorm = 2.798663552e-13
MLMG: Iteration   9 Crse resid/bnorm = 7.871488746e-11
MLMG: Iteration  10 Fine resid/bnorm = 3.378260679e-14
MLMG: Iteration  10 Crse resid/bnorm = 1.124628563e-11
MLMG: Iteration  11 Fine resid/bnorm = 9.746632157e-15
MLMG: Iteration  11 Crse resid/bnorm = 1.617868423e-12
MLMG: Final Iter. 11 resid, resid/bnorm = 7.198779767e-12, 1.617868423e-12
MLMG: Timers: Solve = 0.055897922 Iter = 0.05208042 Bottom = 0.029133585
On level 0: set velocity bcs
After  projection:
   max(abs(u/v/w))  = 1.413131257  1.413131257  4.835764696e-11
On level 1: set velocity bcs
After  projection:
   max(abs(u/v/w))  = 1.444629562  1.444629562  8.095628477e-11
On level 0: set velocity bcs
On level 0: set density bcs
On level 1: set velocity bcs
On level 1: set density bcs

In initial_iterations: iter = 1
On level 0: set density bcs
On level 1: set density bcs
MAC Projection:
On level 0 fillpatch none
On level 1 fillpatch none
 >> Before projection
  * On level 0 max(abs(diveu)) = 1268.151996
  * On level 1 max(abs(diveu)) = 804.0916384
MLMG: # of AMR levels: 2
      # of MG levels on the coarsest AMR level: 2
MLMG: Initial rhs               = 2.70324018
MLMG: Initial residual (resid0) = 2.70324018
MLMG: Iteration   1 Fine resid/bnorm = 0.02334681188
MLMG: Iteration   2 Fine resid/bnorm = 0.001322827281
MLMG: Iteration   3 Fine resid/bnorm = 5.932522147e-05
MLMG: Iteration   4 Fine resid/bnorm = 2.964998333e-06
MLMG: Iteration   5 Fine resid/bnorm = 1.5604677e-07
MLMG: Iteration   6 Fine resid/bnorm = 8.578359534e-09
MLMG: Iteration   7 Fine resid/bnorm = 4.822550788e-10
MLMG: Iteration   8 Fine resid/bnorm = 2.76598804e-11
MLMG: Iteration   9 Fine resid/bnorm = 1.595279001e-12
MLMG: Iteration   9 Crse resid/bnorm = 7.068482392e-14
MLMG: Final Iter. 9 resid, resid/bnorm = 4.312422295e-12, 1.595279001e-12
MLMG: Timers: Solve = 0.056829793 Iter = 0.055978371 Bottom = 0.040952975
 >> After projection
  * On level 0 max(abs(diveu)) = 4.995005493e-11
  * On level 1 max(abs(diveu)) = 5.520342584e-11
On level 0 fillpatch none
On level 1 fillpatch none
On level 0: set velocity bcs
On level 1: set velocity bcs
On level 0: set velocity bcs
On level 1: set velocity bcs
Before projection:
   max(abs(u/v/w))  = 1.413491111  1.413491111  3.154634182e-11
   max(abs(gpx/gpy/gpz))  = 14.29688751  14.29688751  3.92508506e-11
Min and Max of epf 1 1
On level 0: set velocity bcs
Before projection:
   max(abs(u/v/w))  = 1.447074151  1.447074151  6.481055635e-11
   max(abs(gpx/gpy/gpz))  = 23.00094001  23.00094001  1.178355544e-10
Min and Max of epf 1 1
On level 1: set velocity bcs
On level 0: set velocity bcs
On level 1: set velocity bcs
Nodal Projection:
 >> Before projection:
  * On lev 0 max(abs(rhs)) = 0.1509727113
  * On lev 1 max(abs(rhs)) = 0.6927293804

MLMG: # of AMR levels: 2
      # of MG levels on the coarsest AMR level: 2
MLMG: Initial rhs               = 0.6927293804
MLMG: Initial residual (resid0) = 0.6927293804
MLMG: Iteration   1 Fine resid/bnorm = 0.005130373494
MLMG: Iteration   2 Fine resid/bnorm = 0.0001111445902
MLMG: Iteration   3 Fine resid/bnorm = 2.159134709e-06
MLMG: Iteration   4 Fine resid/bnorm = 3.46409717e-08
MLMG: Iteration   5 Fine resid/bnorm = 1.216361518e-09
MLMG: Iteration   6 Fine resid/bnorm = 8.540306262e-11
MLMG: Iteration   7 Fine resid/bnorm = 6.595616225e-12
MLMG: Iteration   7 Crse resid/bnorm = 4.399390446e-10
MLMG: Iteration   8 Fine resid/bnorm = 6.162902836e-13
MLMG: Iteration   8 Crse resid/bnorm = 6.205957313e-11
MLMG: Iteration   9 Fine resid/bnorm = 5.783168014e-14
MLMG: Iteration   9 Crse resid/bnorm = 8.815507329e-12
MLMG: Final Iter. 9 resid, resid/bnorm = 6.10676093e-12, 8.815507329e-12
MLMG: Timers: Solve = 0.042609974 Iter = 0.039284385 Bottom = 0.02296839
On level 0: set velocity bcs
After  projection:
   max(abs(u/v/w))  = 1.411707841  1.411707841  3.148053746e-11
On level 1: set velocity bcs
After  projection:
   max(abs(u/v/w))  = 1.44368775  1.44368775  6.495934108e-11
On level 0: set velocity bcs
On level 0: set density bcs
On level 1: set velocity bcs
On level 1: set density bcs

In initial_iterations: iter = 2
On level 0: set density bcs
On level 1: set density bcs
MAC Projection:
On level 0 fillpatch none
On level 1 fillpatch none
 >> Before projection
  * On level 0 max(abs(diveu)) = 1241.202413
  * On level 1 max(abs(diveu)) = 804.0916384
MLMG: # of AMR levels: 2
      # of MG levels on the coarsest AMR level: 2
MLMG: Initial rhs               = 3.04626377
MLMG: Initial residual (resid0) = 3.04626377
MLMG: Iteration   1 Fine resid/bnorm = 0.02188826542
MLMG: Iteration   2 Fine resid/bnorm = 0.001130168928
MLMG: Iteration   3 Fine resid/bnorm = 4.936113936e-05
MLMG: Iteration   4 Fine resid/bnorm = 2.533771375e-06
MLMG: Iteration   5 Fine resid/bnorm = 1.380993396e-07
MLMG: Iteration   6 Fine resid/bnorm = 7.792113748e-09
MLMG: Iteration   7 Fine resid/bnorm = 4.502941939e-10
MLMG: Iteration   8 Fine resid/bnorm = 2.633624875e-11
MLMG: Iteration   9 Fine resid/bnorm = 1.555898828e-12
MLMG: Iteration   9 Crse resid/bnorm = 6.084089773e-14
MLMG: Final Iter. 9 resid, resid/bnorm = 4.739678229e-12, 1.555898828e-12
MLMG: Timers: Solve = 0.057484754 Iter = 0.056627081 Bottom = 0.041701094
 >> After projection
  * On level 0 max(abs(diveu)) = 5.26828215e-11
  * On level 1 max(abs(diveu)) = 5.795820439e-11
On level 0 fillpatch none
On level 1 fillpatch none
On level 0: set velocity bcs
On level 1: set velocity bcs
On level 0: set velocity bcs
On level 1: set velocity bcs
Before projection:
   max(abs(u/v/w))  = 1.41136956  1.41136956  4.606564664e-11
   max(abs(gpx/gpy/gpz))  = 13.64992201  13.64992201  5.176440276e-11
Min and Max of epf 1 1
On level 0: set velocity bcs
Before projection:
   max(abs(u/v/w))  = 1.44488668  1.44488668  7.836053687e-11
   max(abs(gpx/gpy/gpz))  = 22.90394394  22.90394394  1.787002955e-10
Min and Max of epf 1 1
On level 1: set velocity bcs
On level 0: set velocity bcs
On level 1: set velocity bcs
Nodal Projection:
 >> Before projection:
  * On lev 0 max(abs(rhs)) = 0.11766771
  * On lev 1 max(abs(rhs)) = 0.4624751242

MLMG: # of AMR levels: 2
      # of MG levels on the coarsest AMR level: 2
MLMG: Initial rhs               = 0.4624751242
MLMG: Initial residual (resid0) = 0.4624751242
MLMG: Iteration   1 Fine resid/bnorm = 0.006958443278
MLMG: Iteration   2 Fine resid/bnorm = 0.0001285664033
MLMG: Iteration   3 Fine resid/bnorm = 2.304012747e-06
MLMG: Iteration   4 Fine resid/bnorm = 4.004948146e-08
MLMG: Iteration   5 Fine resid/bnorm = 9.734349325e-10
MLMG: Iteration   6 Fine resid/bnorm = 7.03568544e-11
MLMG: Iteration   7 Fine resid/bnorm = 5.599035837e-12
MLMG: Iteration   7 Crse resid/bnorm = 1.224053261e-10
MLMG: Iteration   8 Fine resid/bnorm = 4.998597931e-13
MLMG: Iteration   8 Crse resid/bnorm = 1.377181892e-11
MLMG: Iteration   9 Fine resid/bnorm = 4.602422041e-14
MLMG: Iteration   9 Crse resid/bnorm = 1.618161315e-12
MLMG: Final Iter. 9 resid, resid/bnorm = 7.483593552e-13, 1.618161315e-12
MLMG: Timers: Solve = 0.041152629 Iter = 0.03782029 Bottom = 0.021539868
On level 0: set velocity bcs
After  projection:
   max(abs(u/v/w))  = 1.410898546  1.410898546  4.594076183e-11
On level 1: set velocity bcs
After  projection:
   max(abs(u/v/w))  = 1.443660869  1.443660869  7.826249565e-11
On level 0: set velocity bcs
On level 0: set density bcs
On level 1: set velocity bcs
On level 1: set density bcs
Time spent in init      0.600577813

On level 0 fillpatch vel
On level 1 fillpatch vel
  Writing plotfile BENCH09-refinement_plt00000 at time 0

 ============   NEW TIME STEP   ============ 
On level 0: set density bcs
On level 1: set density bcs

   Step 1: from old_time 0 to new time 0.004063119654 with dt = 0.004063119654

On level 0 fillpatch vel
On level 0 fillpatch rho
On level 1 fillpatch vel
On level 1 fillpatch rho
 Finished fillpatch before predictor
On level 0: set density bcs
On level 1: set density bcs
MAC Projection:
On level 0 fillpatch none
On level 1 fillpatch none
 >> Before projection
  * On level 0 max(abs(diveu)) = 1212.555318
  * On level 1 max(abs(diveu)) = 794.3420316
MLMG: # of AMR levels: 2
      # of MG levels on the coarsest AMR level: 2
MLMG: Initial rhs               = 3.032387192
MLMG: Initial residual (resid0) = 3.032387192
MLMG: Iteration   1 Fine resid/bnorm = 0.02172771926
MLMG: Iteration   2 Fine resid/bnorm = 0.001111608104
MLMG: Iteration   3 Fine resid/bnorm = 4.951895043e-05
MLMG: Iteration   4 Fine resid/bnorm = 2.544114896e-06
MLMG: Iteration   5 Fine resid/bnorm = 1.384205623e-07
MLMG: Iteration   6 Fine resid/bnorm = 7.807711352e-09
MLMG: Iteration   7 Fine resid/bnorm = 4.49858624e-10
MLMG: Iteration   8 Fine resid/bnorm = 2.628631328e-11
MLMG: Iteration   9 Fine resid/bnorm = 1.549890726e-12
MLMG: Iteration   9 Crse resid/bnorm = 5.980628033e-14
MLMG: Final Iter. 9 resid, resid/bnorm = 4.699868785e-12, 1.549890726e-12
MLMG: Timers: Solve = 0.056932322 Iter = 0.05603984 Bottom = 0.041143255
 >> After projection
  * On level 0 max(abs(diveu)) = 4.993687926e-11
  * On level 1 max(abs(diveu)) = 5.50001628e-11
On level 0 fillpatch none
On level 1 fillpatch none
On level 0: set velocity bcs
On level 1: set velocity bcs
On level 0: set velocity bcs
On level 1: set velocity bcs
Before projection:
   max(abs(u/v/w))  = 1.428759962  1.428759962  1.542552336e-11
   max(abs(gpx/gpy/gpz))  = 14.23448798  14.23448799  6.056843689e-11
Min and Max of epf 1 1
On level 0: set velocity bcs
Before projection:
   max(abs(u/v/w))  = 1.454205373  1.454205373  2.755044027e-11
   max(abs(gpx/gpy/gpz))  = 22.61989507  22.61989507  2.075357017e-10
Min and Max of epf 1 1
On level 1: set velocity bcs
On level 0: set vec bcs
On level 1: set vec bcs
Nodal Projection:
 >> Before projection:
  * On lev 0 max(abs(rhs)) = 1.736115617
  * On lev 1 max(abs(rhs)) = 4.278230169

MLMG: # of AMR levels: 2
      # of MG levels on the coarsest AMR level: 2
MLMG: Initial rhs               = 4.278230169
MLMG: Initial residual (resid0) = 4.278230169
MLMG: Iteration   1 Fine resid/bnorm = 0.02504966824
MLMG: Iteration   2 Fine resid/bnorm = 0.0002770456339
MLMG: Iteration   3 Fine resid/bnorm = 4.84776799e-06
MLMG: Iteration   4 Fine resid/bnorm = 5.120429789e-08
MLMG: Iteration   5 Fine resid/bnorm = 2.938109743e-09
MLMG: Iteration   6 Fine resid/bnorm = 2.611189381e-10
MLMG: Iteration   7 Fine resid/bnorm = 2.4606954e-11
MLMG: Iteration   8 Fine resid/bnorm = 2.379299482e-12
MLMG: Iteration   8 Crse resid/bnorm = 5.145452335e-10
MLMG: Iteration   9 Fine resid/bnorm = 2.622032547e-13
MLMG: Iteration   9 Crse resid/bnorm = 7.279712204e-11
MLMG: Iteration  10 Fine resid/bnorm = 3.168639727e-14
MLMG: Iteration  10 Crse resid/bnorm = 1.03979651e-11
MLMG: Iteration  11 Fine resid/bnorm = 7.214244878e-15
MLMG: Iteration  11 Crse resid/bnorm = 1.49572965e-12
MLMG: Final Iter. 11 resid, resid/bnorm = 6.399075714e-12, 1.49572965e-12
MLMG: Timers: Solve = 0.050393459 Iter = 0.047055178 Bottom = 0.026965311
On level 0: set velocity bcs
After  projection:
   max(abs(u/v/w))  = 1.424410448  1.424410448  1.533152018e-11
On level 1: set velocity bcs
After  projection:
   max(abs(u/v/w))  = 1.449945385  1.449945385  2.773795235e-11
   Time per fluid step      0.163932047
   Time per step        0.164797503
On level 0 fillpatch vel
On level 1 fillpatch vel
  Writing plotfile BENCH09-refinement_plt00001 at time 0.004063119654
On level 0 fillpatch vel
On level 1 fillpatch vel
Time spent in main (after init) 0.178273928
Time spent in main      0.778851741

Total GPU global memory (MB) spread across MPI: [7784 ... 7784]
Free  GPU global memory (MB) spread across MPI: [6338 ... 6338]
[The         Arena] max space (MB) allocated spread across MPI: [193 ... 193]
[The         Arena] max space (MB) used      spread across MPI: [154 ... 154]
[The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8]
[The Managed Arena] max space (MB) used      spread across MPI: [0 ... 0]
[The  Pinned Arena] max space (MB) allocated spread across MPI: [8 ... 8]
[The  Pinned Arena] max space (MB) used      spread across MPI: [2 ... 2]
AMReX (26.11-5-g1d9bd90c3583) finalized
