Initializing AMReX (26.04-97-gd10a21ad849d)... MPI initialized with 4 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.04-97-gd10a21ad849d) initialized Successfully read inputs file ... Successfully read inputs file ... NavierStokesBase::init_additional_state_types()::have_divu = 0 NavierStokesBase::init_additional_state_types()::have_dsdt = 0 NavierStokesBase::init_additional_state_types: num_state_type = 3 estTimeStep :: LEV = 0 UMAX = 0.9856236289 0.9856236289 0 estimated timestep: dt = 0.02219407019 Multiplying dt by init_shrink: dt = 0.02219407019 grid_places() time: 0.010527786 new finest: 1 Now regridding at level lbase = 0 grid_places() time: 0.009093724 new finest: 1 STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 32 grids 139264 cells 53.125 % of domain smallest grid: 16 x 16 x 8 biggest grid: 24 x 24 x 16 calling initialVelocityProject done calling initialVelocityProject estTimeStep :: LEV = 0 UMAX = 0.9823166749 0.9823166749 0.0013473997 estimated timestep: dt = 0.02226878619 Multiplying dt by init_shrink: dt = 0.02226878619 estTimeStep :: LEV = 1 UMAX = 0.9966408983 0.9966408983 0.001453837039 estimated timestep: dt = 0.010974364 Multiplying dt by init_shrink: dt = 0.010974364 post_init_press(): doing initial pressure iterations with dt = 0.010974364 post_init_press(): iter = 0 Advancing grids at level 0 : starting time = 0 with dt = 0.010974364 NavierStokes::advance(): before velocity update: max(abs(u/v/w)) = 0.9823166749 0.9823166749 0.0013473997 max(abs(gpx/gpy/gpz/p)) = 0 0 0 0 ... predict edge velocities ... mac_projection NavierStokesBase:mac_project(): lev: 0, time: 0.376417062 ... advect velocities ... advect scalars ... update scalars ... update scalars ... update velocities NavierStokes::advance(): exiting. max(abs(u/v/w)) = 0.982177355 0.982177355 0.001336712848 max(abs(gpx/gpy/gpz/p)) = 0 0 0 0 Advancing grids at level 1 : starting time = 0 with dt = 0.010974364 NavierStokes::advance(): before velocity update: max(abs(u/v/w)) = 0.9966408983 0.9966408983 0.001453837039 max(abs(gpx/gpy/gpz/p)) = 0 0 0 0 ... predict edge velocities ... mac_projection NavierStokesBase:mac_project(): lev: 1, time: 0.903909987 ... advect velocities ... advect scalars ... update scalars ... update scalars ... update velocities NavierStokes::advance(): exiting. max(abs(u/v/w)) = 0.9965080729 0.9965080729 0.001288787346 max(abs(gpx/gpy/gpz/p)) = 0 0 0 0 After sync projection and avgDown: max(abs(u/v/w)) = 0.9827403439 0.9827403439 0.01653422574 max(abs(gpx/gpy/gpz/p)) = 2.334574737 2.334574737 1.506618725 0.3775745867 post_init_press(): iter = 1 Advancing grids at level 0 : starting time = 0 with dt = 0.010974364 NavierStokes::advance(): before velocity update: max(abs(u/v/w)) = 0.9823166749 0.9823166749 0.0013473997 max(abs(gpx/gpy/gpz/p)) = 2.334574737 2.334574737 1.506618725 0.3775745867 ... predict edge velocities ... mac_projection NavierStokesBase:mac_project(): lev: 0, time: 0.345190766 ... advect velocities ... advect scalars ... update scalars ... update scalars ... update velocities NavierStokes:velocity_diffusion_update(): lev: 0, time: 0.198510449 NavierStokes::advance(): exiting. max(abs(u/v/w)) = 0.9832891568 0.9832891568 0.01649206672 max(abs(gpx/gpy/gpz/p)) = 2.334574737 2.334574737 1.506618725 0.3775745867 Advancing grids at level 1 : starting time = 0 with dt = 0.010974364 NavierStokes::advance(): before velocity update: max(abs(u/v/w)) = 0.9966408983 0.9966408983 0.001453837039 max(abs(gpx/gpy/gpz/p)) = 2.394801099 2.394801099 1.565905401 0.3775745867 ... predict edge velocities ... mac_projection NavierStokesBase:mac_project(): lev: 1, time: 0.856117776 ... advect velocities ... advect scalars ... update scalars ... update scalars ... update velocities NavierStokes:velocity_diffusion_update(): lev: 1, time: 0.689798414 NavierStokes::advance(): exiting. max(abs(u/v/w)) = 0.9974418018 0.9974418018 0.01717045686 max(abs(gpx/gpy/gpz/p)) = 2.394801099 2.394801099 1.565905401 0.3775745867 After sync projection and avgDown: max(abs(u/v/w)) = 0.9834678373 0.9834678373 0.0165367146 max(abs(gpx/gpy/gpz/p)) = 2.299569246 2.299569246 1.509632596 0.3798503046 post_init_press(): exiting after 2 iterations After initial iterations: max(abs(u/v/w)) = 0.9823166749 0.9823166749 0.0013473997 max(abs(gpx/gpy/gpz/p)) = 2.299569246 2.299569246 1.509632596 0.3798503046 INITIAL GRIDS Level 0 4 grids 32768 cells 100 % of domain smallest grid: 32 x 16 x 16 biggest grid: 32 x 16 x 16 Level 1 32 grids 139264 cells 53.125 % of domain smallest grid: 16 x 16 x 8 biggest grid: 24 x 24 x 16 PLOTFILE: file = TaylorGreen_plt00000 Write plotfile time = 0.041585913 seconds estTimeStep :: LEV = 0 UMAX = 0.9823166749 0.9823166749 0.0013473997 estimated timestep: dt = 0.02226878619 Multiplying dt by init_shrink: dt = 0.02226878619 estTimeStep :: LEV = 1 UMAX = 0.9966408983 0.9966408983 0.001453837039 estimated timestep: dt = 0.010974364 Multiplying dt by init_shrink: dt = 0.010974364 [Level 0 step 1] ADVANCE at time 0 with dt = 0.02194872801 Advancing grids at level 0 : starting time = 0 with dt = 0.02194872801 NavierStokes::advance(): before velocity update: max(abs(u/v/w)) = 0.9823166749 0.9823166749 0.0013473997 max(abs(gpx/gpy/gpz/p)) = 2.299569246 2.299569246 1.509632596 0.3798503046 ... predict edge velocities ... mac_projection NavierStokesBase:mac_project(): lev: 0, time: 0.375385799 ... advect velocities ... advect scalars ... update scalars ... update scalars ... update velocities NavierStokes:velocity_diffusion_update(): lev: 0, time: 0.198368123 NavierStokes::advance(): before nodal projection max(abs(u/v/w)) = 0.9794691529 0.9794691529 0.03301331331 max(abs(gpx/gpy/gpz/p)) = 2.299569246 2.299569246 1.509632596 0.3798503046 NavierStokes::advance(): exiting. max(abs(u/v/w)) = 0.9839408903 0.9839408903 0.03240883334 max(abs(gpx/gpy/gpz/p)) = 2.32413166 2.32413166 1.480577576 0.3772183403 [Level 0 step 1] Advanced 32768 cells [Level 1 step 1] ADVANCE at time 0 with dt = 0.010974364 Advancing grids at level 1 : starting time = 0 with dt = 0.010974364 NavierStokes::advance(): before velocity update: max(abs(u/v/w)) = 0.9966408983 0.9966408983 0.001453837039 max(abs(gpx/gpy/gpz/p)) = 2.460091285 2.460091285 1.567651583 0.3798503046 ... predict edge velocities ... mac_projection NavierStokesBase:mac_project(): lev: 1, time: 0.855452718 ... advect velocities ... advect scalars ... update scalars ... update scalars ... update velocities NavierStokes:velocity_diffusion_update(): lev: 1, time: 0.690470926 NavierStokes::advance(): before nodal projection max(abs(u/v/w)) = 0.9967146102 0.9967146102 0.01719003526 max(abs(gpx/gpy/gpz/p)) = 2.460091285 2.460091285 1.567651583 0.3798503046 NavierStokes::advance(): exiting. max(abs(u/v/w)) = 0.9971196294 0.9971196294 0.01752597465 max(abs(gpx/gpy/gpz/p)) = 2.425590541 2.425590541 1.598262868 0.3777117358 [Level 1 step 1] Advanced 139264 cells [Level 1 step 2] ADVANCE at time 0.010974364 with dt = 0.010974364 Advancing grids at level 1 : starting time = 0.010974364 with dt = 0.010974364 NavierStokes::advance(): before velocity update: max(abs(u/v/w)) = 0.9971196294 0.9971196294 0.01752597465 max(abs(gpx/gpy/gpz/p)) = 2.425590541 2.425590541 1.598262868 0.3777117358 ... predict edge velocities ... mac_projection NavierStokesBase:mac_project(): lev: 1, time: 0.856513212 ... advect velocities ... advect scalars ... update scalars ... update scalars ... update velocities NavierStokes:velocity_diffusion_update(): lev: 1, time: 0.691847748 NavierStokes::advance(): before nodal projection max(abs(u/v/w)) = 0.9966085373 0.9966085373 0.03502238539 max(abs(gpx/gpy/gpz/p)) = 2.425590541 2.425590541 1.598262868 0.3777117358 NavierStokes::advance(): exiting. max(abs(u/v/w)) = 0.9966757971 0.9966757971 0.03511073146 max(abs(gpx/gpy/gpz/p)) = 2.38455277 2.38455277 1.60631309 0.3768701832 [Level 1 step 2] Advanced 139264 cells mac_sync() on level 0 [STEP 1] Coarse TimeStep time: 10.10096007 [STEP 1] FAB kilobyte spread across MPI nodes: [33834 ... 45726] STEP = 1 TIME = 0.02194872801 DT = 0.02194872801 estTimeStep :: LEV = 0 UMAX = 0.9838676822 0.9838676822 0.03322134694 estimated timestep: dt = 0.02223368081 estTimeStep :: LEV = 1 UMAX = 0.9965264989 0.9965264989 0.03464200602 estimated timestep: dt = 0.01097562384 [Level 0 step 2] ADVANCE at time 0.02194872801 with dt = 0.02193819012 Advancing grids at level 0 : starting time = 0.02194872801 with dt = 0.02193819012 NavierStokes::advance(): before velocity update: max(abs(u/v/w)) = 0.9838676822 0.9838676822 0.03322134694 max(abs(gpx/gpy/gpz/p)) = 2.313260442 2.313260442 1.521240913 0.377345732 ... predict edge velocities ... mac_projection NavierStokesBase:mac_project(): lev: 0, time: 0.344176065 ... advect velocities ... advect scalars ... update scalars ... update scalars ... update velocities NavierStokes:velocity_diffusion_update(): lev: 0, time: 0.198565948 NavierStokes::advance(): before nodal projection max(abs(u/v/w)) = 0.9782889205 0.9782889205 0.06618358103 max(abs(gpx/gpy/gpz/p)) = 2.313260442 2.313260442 1.521240913 0.377345732 NavierStokes::advance(): exiting. max(abs(u/v/w)) = 0.982616534 0.982616534 0.06525855656 max(abs(gpx/gpy/gpz/p)) = 2.362373609 2.362373609 1.500141383 0.3738966654 [Level 0 step 2] Advanced 32768 cells [Level 1 step 3] ADVANCE at time 0.02194872801 with dt = 0.01096909506 Advancing grids at level 1 : starting time = 0.02194872801 with dt = 0.01096909506 NavierStokes::advance(): before velocity update: max(abs(u/v/w)) = 0.9965264989 0.9965264989 0.03464200602 max(abs(gpx/gpy/gpz/p)) = 2.403032417 2.403032417 1.584802479 0.3769249557 ... predict edge velocities ... mac_projection NavierStokesBase:mac_project(): lev: 1, time: 0.857249296 ... advect velocities ... advect scalars ... update scalars ... update scalars ... update velocities NavierStokes:velocity_diffusion_update(): lev: 1, time: 0.692304164 NavierStokes::advance(): before nodal projection max(abs(u/v/w)) = 0.9953511881 0.9953511881 0.05196399346 max(abs(gpx/gpy/gpz/p)) = 2.403032417 2.403032417 1.584802479 0.3769249557 NavierStokes::advance(): exiting. max(abs(u/v/w)) = 0.9955138919 0.9955138919 0.05210977946 max(abs(gpx/gpy/gpz/p)) = 2.398325863 2.398325863 1.598093092 0.374739776 [Level 1 step 3] Advanced 139264 cells [Level 1 step 4] ADVANCE at time 0.03291782307 with dt = 0.01096909506 Advancing grids at level 1 : starting time = 0.03291782307 with dt = 0.01096909506 NavierStokes::advance(): before velocity update: max(abs(u/v/w)) = 0.9955138919 0.9955138919 0.05210977946 max(abs(gpx/gpy/gpz/p)) = 2.398325863 2.398325863 1.598093092 0.374739776 ... predict edge velocities ... mac_projection NavierStokesBase:mac_project(): lev: 1, time: 0.857326773 ... advect velocities ... advect scalars ... update scalars ... update scalars ... update velocities NavierStokes:velocity_diffusion_update(): lev: 1, time: 0.693862441 NavierStokes::advance(): before nodal projection max(abs(u/v/w)) = 0.9939398811 0.9939398811 0.06954354643 max(abs(gpx/gpy/gpz/p)) = 2.398325863 2.398325863 1.598093092 0.374739776 NavierStokes::advance(): exiting. max(abs(u/v/w)) = 0.9936307204 0.9936307204 0.06969212376 max(abs(gpx/gpy/gpz/p)) = 2.411957835 2.411957835 1.611638177 0.374987924 [Level 1 step 4] Advanced 139264 cells mac_sync() on level 0 [STEP 2] Coarse TimeStep time: 10.08805229 [STEP 2] FAB kilobyte spread across MPI nodes: [33834 ... 45726] STEP = 2 TIME = 0.04388691813 DT = 0.02193819012 PLOTFILE: file = TaylorGreen_plt00002 Write plotfile time = 0.039531942 seconds Run time = 32.4339319 Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [5337 ... 6317] [The Arena] max space (MB) allocated spread across MPI: [488 ... 488] [The Arena] max space (MB) used spread across MPI: [44 ... 56] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Pinned Arena] max space (MB) used spread across MPI: [3 ... 3] AMReX (26.04-97-gd10a21ad849d) finalized