Initializing AMReX (26.11-26-ga8db71f5aeb1)... MPI initialized with 4 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.11-26-ga8db71f5aeb1) initialized Successfully read inputs file ... Successfully read inputs file ... NavierStokesBase::init_additional_state_types()::have_divu = 0 NavierStokesBase::init_additional_state_types()::have_dsdt = 0 NavierStokesBase::init_additional_state_types: num_state_type = 3 estTimeStep :: LEV = 0 UMAX = 0.9856236289 0.9856236289 0 estimated timestep: dt = 0.02219407019 Multiplying dt by init_shrink: dt = 0.02219407019 grid_places() time: 0.008306349 new finest: 1 Now regridding at level lbase = 0 grid_places() time: 0.00873625 new finest: 1 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 32 grids 139264 cells 53.125 % of domain smallest grid: 16 x 16 x 8 biggest grid: 24 x 24 x 16 calling initialVelocityProject done calling initialVelocityProject estTimeStep :: LEV = 0 UMAX = 0.9823166749 0.9823166749 0.0013473997 estimated timestep: dt = 0.02226878619 Multiplying dt by init_shrink: dt = 0.02226878619 estTimeStep :: LEV = 1 UMAX = 0.9966408983 0.9966408983 0.001453837039 estimated timestep: dt = 0.010974364 Multiplying dt by init_shrink: dt = 0.010974364 post_init_press(): doing initial pressure iterations with dt = 0.010974364 post_init_press(): iter = 0 Advancing grids at level 0 : starting time = 0 with dt = 0.010974364 NavierStokes::advance(): before velocity update: max(abs(u/v/w)) = 0.9823166749 0.9823166749 0.0013473997 max(abs(gpx/gpy/gpz/p)) = 0 0 0 0 ... predict edge velocities ... mac_projection NavierStokesBase:mac_project(): lev: 0, time: 0.371168946 ... advect velocities ... advect scalars ... update scalars ... update scalars ... update velocities NavierStokes::advance(): exiting. max(abs(u/v/w)) = 0.982177355 0.982177355 0.001336712848 max(abs(gpx/gpy/gpz/p)) = 0 0 0 0 Advancing grids at level 1 : starting time = 0 with dt = 0.010974364 NavierStokes::advance(): before velocity update: max(abs(u/v/w)) = 0.9966408983 0.9966408983 0.001453837039 max(abs(gpx/gpy/gpz/p)) = 0 0 0 0 ... predict edge velocities ... mac_projection NavierStokesBase:mac_project(): lev: 1, time: 0.877077912 ... advect velocities ... advect scalars ... update scalars ... update scalars ... update velocities NavierStokes::advance(): exiting. max(abs(u/v/w)) = 0.9965080729 0.9965080729 0.001288787346 max(abs(gpx/gpy/gpz/p)) = 0 0 0 0 After sync projection and avgDown: max(abs(u/v/w)) = 0.9827403439 0.9827403439 0.01653422574 max(abs(gpx/gpy/gpz/p)) = 2.334574737 2.334574737 1.506618725 0.3775745867 post_init_press(): iter = 1 Advancing grids at level 0 : starting time = 0 with dt = 0.010974364 NavierStokes::advance(): before velocity update: max(abs(u/v/w)) = 0.9823166749 0.9823166749 0.0013473997 max(abs(gpx/gpy/gpz/p)) = 2.334574737 2.334574737 1.506618725 0.3775745867 ... predict edge velocities ... mac_projection NavierStokesBase:mac_project(): lev: 0, time: 0.338535211 ... advect velocities ... advect scalars ... update scalars ... update scalars ... update velocities NavierStokes:velocity_diffusion_update(): lev: 0, time: 0.18615988 NavierStokes::advance(): exiting. max(abs(u/v/w)) = 0.9832891568 0.9832891568 0.01649206672 max(abs(gpx/gpy/gpz/p)) = 2.334574737 2.334574737 1.506618725 0.3775745867 Advancing grids at level 1 : starting time = 0 with dt = 0.010974364 NavierStokes::advance(): before velocity update: max(abs(u/v/w)) = 0.9966408983 0.9966408983 0.001453837039 max(abs(gpx/gpy/gpz/p)) = 2.394801099 2.394801099 1.565905401 0.3775745867 ... predict edge velocities ... mac_projection NavierStokesBase:mac_project(): lev: 1, time: 0.830029792 ... advect velocities ... advect scalars ... update scalars ... update scalars ... update velocities NavierStokes:velocity_diffusion_update(): lev: 1, time: 0.636787862 NavierStokes::advance(): exiting. max(abs(u/v/w)) = 0.9974418018 0.9974418018 0.01717045686 max(abs(gpx/gpy/gpz/p)) = 2.394801099 2.394801099 1.565905401 0.3775745867 After sync projection and avgDown: max(abs(u/v/w)) = 0.9834678373 0.9834678373 0.0165367146 max(abs(gpx/gpy/gpz/p)) = 2.299569246 2.299569246 1.509632596 0.3798503046 post_init_press(): exiting after 2 iterations After initial iterations: max(abs(u/v/w)) = 0.9823166749 0.9823166749 0.0013473997 max(abs(gpx/gpy/gpz/p)) = 2.299569246 2.299569246 1.509632596 0.3798503046 INITIAL GRIDS Level 0 4 grids 32768 cells 100 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 16 x 16 Level 1 32 grids 139264 cells 53.125 % of domain smallest grid: 16 x 16 x 8 biggest grid: 24 x 24 x 16 PLOTFILE: file = TaylorGreen_plt00000 Write plotfile time = 0.018274348 seconds estTimeStep :: LEV = 0 UMAX = 0.9823166749 0.9823166749 0.0013473997 estimated timestep: dt = 0.02226878619 Multiplying dt by init_shrink: dt = 0.02226878619 estTimeStep :: LEV = 1 UMAX = 0.9966408983 0.9966408983 0.001453837039 estimated timestep: dt = 0.010974364 Multiplying dt by init_shrink: dt = 0.010974364 [Level 0 step 1] ADVANCE at time 0 with dt = 0.02194872801 Advancing grids at level 0 : starting time = 0 with dt = 0.02194872801 NavierStokes::advance(): before velocity update: max(abs(u/v/w)) = 0.9823166749 0.9823166749 0.0013473997 max(abs(gpx/gpy/gpz/p)) = 2.299569246 2.299569246 1.509632596 0.3798503046 ... predict edge velocities ... mac_projection NavierStokesBase:mac_project(): lev: 0, time: 0.368999177 ... advect velocities ... advect scalars ... update scalars ... update scalars ... update velocities NavierStokes:velocity_diffusion_update(): lev: 0, time: 0.185876832 NavierStokes::advance(): before nodal projection max(abs(u/v/w)) = 0.9794691529 0.9794691529 0.03301331331 max(abs(gpx/gpy/gpz/p)) = 2.299569246 2.299569246 1.509632596 0.3798503046 NavierStokes::advance(): exiting. max(abs(u/v/w)) = 0.9839408903 0.9839408903 0.03240883334 max(abs(gpx/gpy/gpz/p)) = 2.32413166 2.32413166 1.480577576 0.3772183403 [Level 0 step 1] Advanced 32768 cells [Level 1 step 1] ADVANCE at time 0 with dt = 0.010974364 Advancing grids at level 1 : starting time = 0 with dt = 0.010974364 NavierStokes::advance(): before velocity update: max(abs(u/v/w)) = 0.9966408983 0.9966408983 0.001453837039 max(abs(gpx/gpy/gpz/p)) = 2.460091285 2.460091285 1.567651583 0.3798503046 ... predict edge velocities ... mac_projection NavierStokesBase:mac_project(): lev: 1, time: 0.829075851 ... advect velocities ... advect scalars ... update scalars ... update scalars ... update velocities NavierStokes:velocity_diffusion_update(): lev: 1, time: 0.638196027 NavierStokes::advance(): before nodal projection max(abs(u/v/w)) = 0.9967146102 0.9967146102 0.01719003526 max(abs(gpx/gpy/gpz/p)) = 2.460091285 2.460091285 1.567651583 0.3798503046 NavierStokes::advance(): exiting. max(abs(u/v/w)) = 0.9971196294 0.9971196294 0.01752597465 max(abs(gpx/gpy/gpz/p)) = 2.425590541 2.425590541 1.598262868 0.3777117358 [Level 1 step 1] Advanced 139264 cells [Level 1 step 2] ADVANCE at time 0.010974364 with dt = 0.010974364 Advancing grids at level 1 : starting time = 0.010974364 with dt = 0.010974364 NavierStokes::advance(): before velocity update: max(abs(u/v/w)) = 0.9971196294 0.9971196294 0.01752597465 max(abs(gpx/gpy/gpz/p)) = 2.425590541 2.425590541 1.598262868 0.3777117358 ... predict edge velocities ... mac_projection NavierStokesBase:mac_project(): lev: 1, time: 0.830623044 ... advect velocities ... advect scalars ... update scalars ... update scalars ... update velocities NavierStokes:velocity_diffusion_update(): lev: 1, time: 0.637468627 NavierStokes::advance(): before nodal projection max(abs(u/v/w)) = 0.9966085373 0.9966085373 0.03502238539 max(abs(gpx/gpy/gpz/p)) = 2.425590541 2.425590541 1.598262868 0.3777117358 NavierStokes::advance(): exiting. max(abs(u/v/w)) = 0.9966757971 0.9966757971 0.03511073146 max(abs(gpx/gpy/gpz/p)) = 2.38455277 2.38455277 1.60631309 0.3768701832 [Level 1 step 2] Advanced 139264 cells mac_sync() on level 0 [STEP 1] Coarse TimeStep time: 9.133939127 [STEP 1] FAB kilobyte spread across MPI nodes: [33834 ... 45726] STEP = 1 TIME = 0.02194872801 DT = 0.02194872801 estTimeStep :: LEV = 0 UMAX = 0.98386054 0.98386054 0.03322556077 estimated timestep: dt = 0.02223384221 estTimeStep :: LEV = 1 UMAX = 0.9965220218 0.9965220218 0.03464801728 estimated timestep: dt = 0.01097567315 [Level 0 step 2] ADVANCE at time 0.02194872801 with dt = 0.02193819012 Advancing grids at level 0 : starting time = 0.02194872801 with dt = 0.02193819012 NavierStokes::advance(): before velocity update: max(abs(u/v/w)) = 0.98386054 0.98386054 0.03322556077 max(abs(gpx/gpy/gpz/p)) = 2.331981709 2.331981709 1.521560395 0.3775018429 ... predict edge velocities ... mac_projection NavierStokesBase:mac_project(): lev: 0, time: 0.340210043 ... advect velocities ... advect scalars ... update scalars ... update scalars ... update velocities NavierStokes:velocity_diffusion_update(): lev: 0, time: 0.187387667 NavierStokes::advance(): before nodal projection max(abs(u/v/w)) = 0.978287885 0.978287885 0.06619431094 max(abs(gpx/gpy/gpz/p)) = 2.331981709 2.331981709 1.521560395 0.3775018429 NavierStokes::advance(): exiting. max(abs(u/v/w)) = 0.9826152286 0.9826152286 0.06526602302 max(abs(gpx/gpy/gpz/p)) = 2.371746158 2.371746158 1.500039842 0.3738930128 [Level 0 step 2] Advanced 32768 cells [Level 1 step 3] ADVANCE at time 0.02194872801 with dt = 0.01096909506 Advancing grids at level 1 : starting time = 0.02194872801 with dt = 0.01096909506 NavierStokes::advance(): before velocity update: max(abs(u/v/w)) = 0.9965220218 0.9965220218 0.03464801728 max(abs(gpx/gpy/gpz/p)) = 2.41193999 2.41193999 1.58521706 0.3770810666 ... predict edge velocities ... mac_projection NavierStokesBase:mac_project(): lev: 1, time: 0.837471031 ... advect velocities ... advect scalars ... update scalars ... update scalars ... update velocities NavierStokes:velocity_diffusion_update(): lev: 1, time: 0.641430675 NavierStokes::advance(): before nodal projection max(abs(u/v/w)) = 0.9953502903 0.9953502903 0.05197440972 max(abs(gpx/gpy/gpz/p)) = 2.41193999 2.41193999 1.58521706 0.3770810666 NavierStokes::advance(): exiting. max(abs(u/v/w)) = 0.9955105043 0.9955105043 0.05211629843 max(abs(gpx/gpy/gpz/p)) = 2.397313477 2.397313477 1.598152375 0.3747491371 [Level 1 step 3] Advanced 139264 cells [Level 1 step 4] ADVANCE at time 0.03291782307 with dt = 0.01096909506 Advancing grids at level 1 : starting time = 0.03291782307 with dt = 0.01096909506 NavierStokes::advance(): before velocity update: max(abs(u/v/w)) = 0.9955105043 0.9955105043 0.05211629843 max(abs(gpx/gpy/gpz/p)) = 2.397313477 2.397313477 1.598152375 0.3747491371 ... predict edge velocities ... mac_projection NavierStokesBase:mac_project(): lev: 1, time: 0.836613212 ... advect velocities ... advect scalars ... update scalars ... update scalars ... update velocities NavierStokes:velocity_diffusion_update(): lev: 1, time: 0.641599192 NavierStokes::advance(): before nodal projection max(abs(u/v/w)) = 0.9939368006 0.9939368006 0.06955058574 max(abs(gpx/gpy/gpz/p)) = 2.397313477 2.397313477 1.598152375 0.3747491371 NavierStokes::advance(): exiting. max(abs(u/v/w)) = 0.9936270796 0.9936270796 0.06969865477 max(abs(gpx/gpy/gpz/p)) = 2.412001503 2.412001503 1.611651121 0.3749834765 [Level 1 step 4] Advanced 139264 cells mac_sync() on level 0 [STEP 2] Coarse TimeStep time: 9.081016543 [STEP 2] FAB kilobyte spread across MPI nodes: [33834 ... 45726] STEP = 2 TIME = 0.04388691813 DT = 0.02193819012 PLOTFILE: file = TaylorGreen_plt00002 Write plotfile time = 0.019593618 seconds Run time = 29.36632862 Total GPU global memory (MB) spread across MPI: [7784 ... 7784] Free GPU global memory (MB) spread across MPI: [5142 ... 5632] [The Arena] max space (MB) allocated spread across MPI: [488 ... 488] [The Arena] max space (MB) used spread across MPI: [43 ... 56] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Pinned Arena] max space (MB) used spread across MPI: [2 ... 3] AMReX (26.11-26-ga8db71f5aeb1) finalized