Initializing AMReX (26.06-1-g65060875b0e4)... MPI initialized with 2 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.06-1-g65060875b0e4) initialized Successfully read inputs file ... AMReX git describe: 26.06-1-g65060875b0 Nyx git describe: 21.02.1-290-g1aa9dc38 Nyx::hydro_tile_size unset, using fabarray.mfiter_tile_size default: (1024000,1024000,1024000) Suggested default for currently compiled CPU / GPU: nyx.hydro_tile_size=(1048576,1048576,1048576) Nyx::sundials_tile_size unset, using fabarray.mfiter_tile_size default: (1024000,1024000,1024000) Suggested default for currently compiled CPU / GPU: nyx.sundials_tile_size=(1048576,1048576,1048576) Nyx::setting init_sb_vels to 0 since do_santa_barbara = 0 2 Species: H He Successfully read inputs file ... Getting Gconst from nyx_constants: 4.300927161e-09 Using -5.404704468e-08 for 4 pi G in Gravity.cpp Initializing the data at level 0 ... setting particle_initrandom_mass to 2.123188769e+11 by dividing 8.696581196e+14 by 4096 Initializing DM particles from "particle_file.2line" ... Redistributing from processor 0 to 0 Redistributing from processor 1 to 1 Total number of particles: 16 Average gas density 1 Average dm density 0.0048828125 Average total density 1.004882812 Done initializing the level 0 data ...estdt from hydro at level 0: 0.54 ...estdt from particles at level 0: 0.003125 Nyx::est_time_step at level 0: estdt = 0.003125 Integrating a from time 0 by dt = 0.003125 Old / new A time 0 0.003125 Old / new A 1 1 Old / new z 0 0 grid_places() time: 0.005496628 new finest: 1 Initializing the data at level 1 BA SIZE 0 FLEV 1 Calling redistribute because the size of BoxArray changed Done initializing the level 1 data grid_places() time: 0.011976264 new finest: 2 Initializing the data at level 2 BA SIZE 2 FLEV 2 Calling redistribute because the size of BoxArray changed Done initializing the level 2 data Now regridding at level lbase = 0 grid_places() time: 0.046586538 new finest: 2 Initializing the data at level 1 Calling redistribute because BoxArray changed Done initializing the level 1 data Initializing the data at level 2 Calling redistribute because BoxArray changed Done initializing the level 2 data NOT calling redistribute because NOT changed STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 Now regridding at level lbase = 0 grid_places() time: 0.051835432 new finest: 2 Regridding at level lbase = 0 but grids unchanged Setting the current time in the state data to 0 Setting the current time in the state data to 0 Setting the current time in the state data to 0 NOT calling redistribute because NOT changed Gravity ... defining average density in Gravity::set_mass_offset to be 1.004882812 Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 7.669883337e-19, 5.172613001e-13 MLMG: Timers: Solve = 0.673753534 Iter = 0.607290462 Bottom = 0.004429084 Average gas density 1 Average dm density 0.0048828125 Average total density 1.004882812 Average temperature 471.6564507 ... setting small_dens to 1e-06 ... setting small_temp to 0.0004716564507 ... setting small_pres to 6.666666667e-12 INITIAL GRIDS Level 0 2 grids 4096 cells 100 % of domain smallest grid: 16 x 16 x 8 biggest grid: 16 x 16 x 8 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 PLOTFILE: file = Part-2line_plt00000 Output file Part-2line_plt00000.temp at time 1.000000 and step 0 Write plotfile time = 0.270618976 seconds ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Re-integrating a from time 0 by dt = 0.003125 Old / new A time 0 0.003125 Old / new A 1 1 Old / new z 0 0 [Level 0 step 1] ADVANCE at time 0 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 7.669883337e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.05709168 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -1.387778781e-17 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.789252198e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.438269952e-21, 3.623260897e-14 MLMG: Timers: Solve = 0.09910053 Iter = 0.09219212 Bottom = 0.002889814 moveKick ... updating velocity only [Level 0 step 1] Advanced 4096 cells [Level 1 step 1] ADVANCE at time 0 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.573042079e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.613865564e-20, 2.987497242e-14 MLMG: Timers: Solve = 0.117493424 Iter = 0.107493497 Bottom = 0.002826198 moveKick ... updating velocity only [Level 1 step 1] Advanced 32768 cells [Level 2 step 1] ADVANCE at time 0 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 3.426355805e-19, 1.547933628e-13 MLMG: Timers: Solve = 0.182008271 Iter = 0.157120362 Bottom = 0.043910721 moveKick ... updating velocity only [Level 2 step 1] Advanced 53248 cells [Level 2 step 2] ADVANCE at time 0.00078125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 3.426355805e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.024863699 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.110122623e-19, 2.913709493e-13 MLMG: Timers: Solve = 0.18186709 Iter = 0.156970996 Bottom = 0.043834341 moveKick ... updating velocity only [Level 2 step 2] Advanced 53248 cells [Level 1 step 2] ADVANCE at time 0.0015625 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -9.540979118e-18 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 8.380401878e-10 MLMG: Final Iter. 6 resid, resid/bnorm = 9.773008656e-19, 6.590972693e-13 MLMG: Timers: Solve = 0.375299549 Iter = 0.328371132 Bottom = 0.002999992 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113485678e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 4.64459329e-20, 1.49176639e-13 MLMG: Timers: Solve = 0.11772144 Iter = 0.107667765 Bottom = 0.00294616 moveKick ... updating velocity only [Level 1 step 2] Advanced 32768 cells [Level 2 step 3] ADVANCE at time 0.0015625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.916804988e-19, 2.221277712e-13 MLMG: Timers: Solve = 0.182161439 Iter = 0.157230864 Bottom = 0.044079947 moveKick ... updating velocity only [Level 2 step 3] Advanced 53248 cells [Level 2 step 4] ADVANCE at time 0.00234375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 4.916804988e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.02489191 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 2.574297219e-19, 1.227594716e-13 MLMG: Timers: Solve = 0.183743704 Iter = 0.15862599 Bottom = 0.044494049 moveKick ... updating velocity only [Level 2 step 4] Advanced 53248 cells [STEP 1] Coarse TimeStep time: 6.417023526 [STEP 1] FAB kilobyte spread across MPI nodes: [62332 ... 68773] STEP = 1 TIME = 0.003125 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.003125 by dt = 0.003125 Old / new A time 0.003125 0.00625 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.024533462 new finest: 2 Setting the current time in the state data to 0.003125 Calling redistribute because BoxArray changed TIME = 0.003125 : REGRID with lbase = 1 Level 2 15 grids 11264 cells 4.296875 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 8 x 8 [Level 0 step 2] ADVANCE at time 0.003125 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -3.6429193e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.050217247e-08 MLMG: Final Iter. 8 resid, resid/bnorm = 9.807043003e-20, 6.61392565e-14 MLMG: Timers: Solve = 0.569019014 Iter = 0.528041678 Bottom = 0.004165198 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -1.789746736e-16 to ensure solvability MLMG: Initial rhs = 2.892150254e-08 MLMG: Initial residual (resid0) = 3.873110818e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 3.889816831e-21, 1.004313332e-13 MLMG: Timers: Solve = 0.100848248 Iter = 0.093865389 Bottom = 0.001807053 moveKick ... updating velocity only [Level 0 step 2] Advanced 4096 cells [Level 1 step 3] ADVANCE at time 0.003125 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.641046646e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 2.530888331e-20, 4.685038257e-14 MLMG: Timers: Solve = 0.117534639 Iter = 0.107454876 Bottom = 0.001820887 moveKick ... updating velocity only [Level 1 step 3] Advanced 32768 cells [Level 2 step 5] ADVANCE at time 0.003125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.974666662e-20, 4.054508381e-14 MLMG: Timers: Solve = 0.121296042 Iter = 0.108752773 Bottom = 0.014390372 moveKick ... updating velocity only [Level 2 step 5] Advanced 11264 cells [Level 2 step 6] ADVANCE at time 0.00390625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 8.974666662e-20 MLMG: No iterations needed MLMG: Timers: Solve = 0.012563728 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.898407423e-19, 9.052858793e-14 MLMG: Timers: Solve = 0.121207666 Iter = 0.108626328 Bottom = 0.01430476 moveKick ... updating velocity only [Level 2 step 6] Advanced 11264 cells [Level 1 step 4] ADVANCE at time 0.0046875 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -5.464378949e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 9.484814095e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 7.050490495e-19, 4.754890941e-13 MLMG: Timers: Solve = 0.340445363 Iter = 0.306583508 Bottom = 0.001855688 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 3.704988249e-07 MLMG: Initial residual (resid0) = 3.495865805e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.085633195e-20, 2.930193355e-14 MLMG: Timers: Solve = 0.116152508 Iter = 0.106013125 Bottom = 0.001874716 moveKick ... updating velocity only [Level 1 step 4] Advanced 32768 cells [Level 2 step 7] ADVANCE at time 0.0046875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.131615442e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.293896594e-19, 4.676264594e-14 MLMG: Timers: Solve = 0.120932464 Iter = 0.108363979 Bottom = 0.014030914 moveKick ... updating velocity only [Level 2 step 7] Advanced 11264 cells [Level 2 step 8] ADVANCE at time 0.00546875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.293896594e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.012485503 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.793151269e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 1.876353237e-18, 6.326553553e-13 MLMG: Timers: Solve = 0.108281987 Iter = 0.095775588 Bottom = 0.012821024 moveKick ... updating velocity only [Level 2 step 8] Advanced 11264 cells [STEP 2] Coarse TimeStep time: 4.21474142 [STEP 2] FAB kilobyte spread across MPI nodes: [62332 ... 68773] STEP = 2 TIME = 0.00625 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.00625 by dt = 0.003125 Old / new A time 0.00625 0.009375 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.040175387 new finest: 2 Setting the current time in the state data to 0.00625 Setting the current time in the state data to 0.00625 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -3.729655473e-17 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 7.247393028e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 3.388450771e-19, 1.142493579e-13 MLMG: Timers: Solve = 0.507143764 Iter = 0.458297459 Bottom = 0.001825141 STEP = 2 TIME = 0.00625 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 14 grids 7168 cells 2.734375 % of domain smallest grid: 8 x 8 x 8 biggest grid: 8 x 8 x 8 [Level 0 step 3] ADVANCE at time 0.00625 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -3.729655473e-17 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 3.388450771e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.046677924 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -5.486062993e-17 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.734865479e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 5.037840123e-21, 7.486213374e-14 MLMG: Timers: Solve = 0.100178806 Iter = 0.093217681 Bottom = 0.002221224 moveKick ... updating velocity only [Level 0 step 3] Advanced 4096 cells [Level 1 step 5] ADVANCE at time 0.00625 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.57065785e-07 MLMG: Final Iter. 6 resid, resid/bnorm = 4.290382661e-19, 7.942115287e-13 MLMG: Timers: Solve = 0.102584401 Iter = 0.092475278 Bottom = 0.00159391 moveKick ... updating velocity only [Level 1 step 5] Advanced 32768 cells [Level 2 step 9] ADVANCE at time 0.00625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 2.645371007e-18, 9.560620869e-13 MLMG: Timers: Solve = 0.103029805 Iter = 0.091408539 Bottom = 0.009062941 moveKick ... updating velocity only [Level 2 step 9] Advanced 7168 cells [Level 2 step 10] ADVANCE at time 0.00703125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.645371007e-18 MLMG: No iterations needed MLMG: Timers: Solve = 0.011709283 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.650467071e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.633470779e-19, 6.162954433e-14 MLMG: Timers: Solve = 0.116485744 Iter = 0.104792187 Bottom = 0.010988369 moveKick ... updating velocity only [Level 2 step 10] Advanced 7168 cells [Level 1 step 6] ADVANCE at time 0.0078125 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -2.949029909e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 9.957448238e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 5.798488531e-19, 3.910533686e-13 MLMG: Timers: Solve = 0.337207076 Iter = 0.304094055 Bottom = 0.001861077 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.444676299e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.456643023e-20, 1.003473977e-13 MLMG: Timers: Solve = 0.117721123 Iter = 0.107541127 Bottom = 0.001863011 moveKick ... updating velocity only [Level 1 step 6] Advanced 32768 cells [Level 2 step 11] ADVANCE at time 0.0078125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.690028643e-20, 3.925916727e-14 MLMG: Timers: Solve = 0.116273731 Iter = 0.104608778 Bottom = 0.010846935 moveKick ... updating velocity only [Level 2 step 11] Advanced 7168 cells [Level 2 step 12] ADVANCE at time 0.00859375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 8.690028643e-20 MLMG: No iterations needed MLMG: Timers: Solve = 0.01161583 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 7 resid, resid/resid0 = 1.168963318e-18, 5.574388155e-13 MLMG: Timers: Solve = 0.103732597 Iter = 0.092024435 Bottom = 0.009583101 moveKick ... updating velocity only [Level 2 step 12] Advanced 7168 cells [STEP 3] Coarse TimeStep time: 4.334659774 [STEP 3] FAB kilobyte spread across MPI nodes: [62332 ... 68773] STEP = 3 TIME = 0.009375 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.009375 by dt = 0.003125 Old / new A time 0.009375 0.0125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.018004352 new finest: 2 Setting the current time in the state data to 0.009375 Calling redistribute because BoxArray changed TIME = 0.009375 : REGRID with lbase = 1 Level 2 36 grids 46080 cells 17.578125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 4] ADVANCE at time 0.009375 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -3.295974604e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.380180577e-07 MLMG: Final Iter. 8 resid, resid/bnorm = 9.683798261e-20, 6.530808694e-14 MLMG: Timers: Solve = 0.670547333 Iter = 0.605380804 Bottom = 0.004307272 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -1.626303259e-17 to ensure solvability MLMG: Initial rhs = 1.432880048e-08 MLMG: Initial residual (resid0) = 4.198898866e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 2.648632321e-21, 6.30792121e-14 MLMG: Timers: Solve = 0.102281226 Iter = 0.095265617 Bottom = 0.003008515 moveKick ... updating velocity only [Level 0 step 4] Advanced 4096 cells [Level 1 step 7] ADVANCE at time 0.009375 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.593886225e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 3.715033567e-20, 6.877061375e-14 MLMG: Timers: Solve = 0.114884677 Iter = 0.104764728 Bottom = 0.002810854 moveKick ... updating velocity only [Level 1 step 7] Advanced 32768 cells [Level 2 step 13] ADVANCE at time 0.009375 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 6.046953425e-19, 2.731847796e-13 MLMG: Timers: Solve = 0.170678495 Iter = 0.149132013 Bottom = 0.038146571 moveKick ... updating velocity only [Level 2 step 13] Advanced 46080 cells [Level 2 step 14] ADVANCE at time 0.01015625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 6.046953425e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.021641687 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.034345124e-19, 2.877573784e-13 MLMG: Timers: Solve = 0.169810276 Iter = 0.148205951 Bottom = 0.037427351 moveKick ... updating velocity only [Level 2 step 14] Advanced 46080 cells [Level 1 step 8] ADVANCE at time 0.0109375 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -4.770489559e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 3.198732139e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.423701233e-19, 1.634557914e-13 MLMG: Timers: Solve = 0.430868044 Iter = 0.381162776 Bottom = 0.003647408 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113486436e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.300771177e-20, 1.06015274e-13 MLMG: Timers: Solve = 0.118924084 Iter = 0.108652931 Bottom = 0.003584136 moveKick ... updating velocity only [Level 1 step 8] Advanced 32768 cells [Level 2 step 15] ADVANCE at time 0.0109375 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.947588514e-19, 2.235184866e-13 MLMG: Timers: Solve = 0.169532228 Iter = 0.147935755 Bottom = 0.03724432 moveKick ... updating velocity only [Level 2 step 15] Advanced 46080 cells [Level 2 step 16] ADVANCE at time 0.01171875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 4.947588514e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.021709597 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.13258893e-18, 5.400931078e-13 MLMG: Timers: Solve = 0.169473751 Iter = 0.147837587 Bottom = 0.036901053 moveKick ... updating velocity only [Level 2 step 16] Advanced 46080 cells [STEP 4] Coarse TimeStep time: 6.724435984 [STEP 4] FAB kilobyte spread across MPI nodes: [63145 ... 68773] STEP = 4 TIME = 0.0125 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.0125 by dt = 0.003125 Old / new A time 0.0125 0.015625 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.05174186 new finest: 2 Setting the current time in the state data to 0.0125 Setting the current time in the state data to 0.0125 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -6.635317296e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 7.152210038e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.451223037e-18, 9.787130808e-13 MLMG: Timers: Solve = 0.615760809 Iter = 0.546796767 Bottom = 0.003967478 STEP = 4 TIME = 0.0125 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 5] ADVANCE at time 0.0125 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -6.635317296e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.451223037e-18 MLMG: No iterations needed MLMG: Timers: Solve = 0.068682817 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -1.604619215e-17 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.789252198e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.438425048e-21, 3.623491369e-14 MLMG: Timers: Solve = 0.102153304 Iter = 0.095083912 Bottom = 0.003016169 moveKick ... updating velocity only [Level 0 step 5] Advanced 4096 cells [Level 1 step 9] ADVANCE at time 0.0125 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.573042079e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.613891414e-20, 2.987545093e-14 MLMG: Timers: Solve = 0.118692699 Iter = 0.108488474 Bottom = 0.003051607 moveKick ... updating velocity only [Level 1 step 9] Advanced 32768 cells [Level 2 step 17] ADVANCE at time 0.0125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 3.426205879e-19, 1.547865895e-13 MLMG: Timers: Solve = 0.179789301 Iter = 0.156241938 Bottom = 0.041836901 moveKick ... updating velocity only [Level 2 step 17] Advanced 53248 cells [Level 2 step 18] ADVANCE at time 0.01328125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 3.426205879e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.023697092 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.110344411e-19, 2.913815257e-13 MLMG: Timers: Solve = 0.179647184 Iter = 0.156054437 Bottom = 0.042015488 moveKick ... updating velocity only [Level 2 step 18] Advanced 53248 cells [Level 1 step 10] ADVANCE at time 0.0140625 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -4.987329993e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 8.380401878e-10 MLMG: Final Iter. 6 resid, resid/bnorm = 9.773045879e-19, 6.590997796e-13 MLMG: Timers: Solve = 0.394600068 Iter = 0.340983303 Bottom = 0.003184791 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113485678e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 4.645741003e-20, 1.492135016e-13 MLMG: Timers: Solve = 0.118526543 Iter = 0.108206805 Bottom = 0.003124281 moveKick ... updating velocity only [Level 1 step 10] Advanced 32768 cells [Level 2 step 19] ADVANCE at time 0.0140625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.916757425e-19, 2.221256225e-13 MLMG: Timers: Solve = 0.179361702 Iter = 0.155824735 Bottom = 0.041913942 moveKick ... updating velocity only [Level 2 step 19] Advanced 53248 cells [Level 2 step 20] ADVANCE at time 0.01484375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 4.916757425e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.023702965 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 2.57416487e-19, 1.227531603e-13 MLMG: Timers: Solve = 0.180236908 Iter = 0.15662579 Bottom = 0.042377908 moveKick ... updating velocity only [Level 2 step 20] Advanced 53248 cells [STEP 5] Coarse TimeStep time: 7.583862991 [STEP 5] FAB kilobyte spread across MPI nodes: [68665 ... 68773] STEP = 5 TIME = 0.015625 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.015625 by dt = 0.003125 Old / new A time 0.015625 0.01875 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.024816852 new finest: 2 Setting the current time in the state data to 0.015625 Calling redistribute because BoxArray changed TIME = 0.015625 : REGRID with lbase = 1 Level 2 15 grids 11264 cells 4.296875 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 8 x 8 [Level 0 step 6] ADVANCE at time 0.015625 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -4.33680869e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.050217247e-08 MLMG: Final Iter. 8 resid, resid/bnorm = 9.805517888e-20, 6.612897104e-14 MLMG: Timers: Solve = 0.583266899 Iter = 0.532649353 Bottom = 0.004393312 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting 1.19262239e-18 to ensure solvability MLMG: Initial rhs = 2.892150254e-08 MLMG: Initial residual (resid0) = 3.873110818e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 3.890178722e-21, 1.004406769e-13 MLMG: Timers: Solve = 0.10123415 Iter = 0.094239364 Bottom = 0.001872494 moveKick ... updating velocity only [Level 0 step 6] Advanced 4096 cells [Level 1 step 11] ADVANCE at time 0.015625 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.641046646e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 2.529694089e-20, 4.682827543e-14 MLMG: Timers: Solve = 0.117605385 Iter = 0.107454526 Bottom = 0.00190512 moveKick ... updating velocity only [Level 1 step 11] Advanced 32768 cells [Level 2 step 21] ADVANCE at time 0.015625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.976724274e-20, 4.055437953e-14 MLMG: Timers: Solve = 0.119046726 Iter = 0.107265341 Bottom = 0.013229034 moveKick ... updating velocity only [Level 2 step 21] Advanced 11264 cells [Level 2 step 22] ADVANCE at time 0.01640625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 8.976724274e-20 MLMG: No iterations needed MLMG: Timers: Solve = 0.011805192 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.898534085e-19, 9.053462801e-14 MLMG: Timers: Solve = 0.118998467 Iter = 0.107196988 Bottom = 0.013222726 moveKick ... updating velocity only [Level 2 step 22] Advanced 11264 cells [Level 1 step 12] ADVANCE at time 0.0171875 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -4.683753385e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 9.484814095e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 7.050093448e-19, 4.75462317e-13 MLMG: Timers: Solve = 0.344567537 Iter = 0.309881716 Bottom = 0.001893259 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 3.704988249e-07 MLMG: Initial residual (resid0) = 3.495865805e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.085509118e-20, 2.929858463e-14 MLMG: Timers: Solve = 0.117773844 Iter = 0.107555036 Bottom = 0.001903995 moveKick ... updating velocity only [Level 1 step 12] Advanced 32768 cells [Level 2 step 23] ADVANCE at time 0.0171875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.131615442e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.294460627e-19, 4.678303065e-14 MLMG: Timers: Solve = 0.118630163 Iter = 0.106848586 Bottom = 0.012884623 moveKick ... updating velocity only [Level 2 step 23] Advanced 11264 cells [Level 2 step 24] ADVANCE at time 0.01796875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.294460627e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.01179411 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.793151269e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 1.876271294e-18, 6.326277265e-13 MLMG: Timers: Solve = 0.105873034 Iter = 0.094110523 Bottom = 0.011541593 moveKick ... updating velocity only [Level 2 step 24] Advanced 11264 cells [STEP 6] Coarse TimeStep time: 4.207627824 [STEP 6] FAB kilobyte spread across MPI nodes: [68665 ... 68773] STEP = 6 TIME = 0.01875 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.01875 by dt = 0.003125 Old / new A time 0.01875 0.021875 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.040301632 new finest: 2 Setting the current time in the state data to 0.01875 Setting the current time in the state data to 0.01875 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -5.724587471e-17 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 7.247393028e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 3.388801288e-19, 1.142611764e-13 MLMG: Timers: Solve = 0.511866071 Iter = 0.462381862 Bottom = 0.001860707 STEP = 6 TIME = 0.01875 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 14 grids 7168 cells 2.734375 % of domain smallest grid: 8 x 8 x 8 biggest grid: 8 x 8 x 8 [Level 0 step 7] ADVANCE at time 0.01875 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -5.724587471e-17 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 3.388801288e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.049420009 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -8.890457814e-18 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.734865479e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 5.037736726e-21, 7.486059725e-14 MLMG: Timers: Solve = 0.100949384 Iter = 0.093931989 Bottom = 0.001849147 moveKick ... updating velocity only [Level 0 step 7] Advanced 4096 cells [Level 1 step 13] ADVANCE at time 0.01875 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.57065785e-07 MLMG: Final Iter. 6 resid, resid/bnorm = 4.290317004e-19, 7.941993745e-13 MLMG: Timers: Solve = 0.102650302 Iter = 0.092508904 Bottom = 0.001608815 moveKick ... updating velocity only [Level 1 step 13] Advanced 32768 cells [Level 2 step 25] ADVANCE at time 0.01875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 2.645110652e-18, 9.559679921e-13 MLMG: Timers: Solve = 0.103617858 Iter = 0.091919647 Bottom = 0.009684237 moveKick ... updating velocity only [Level 2 step 25] Advanced 7168 cells [Level 2 step 26] ADVANCE at time 0.01953125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.645110652e-18 MLMG: No iterations needed MLMG: Timers: Solve = 0.011720268 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.650467071e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.632124025e-19, 6.15787324e-14 MLMG: Timers: Solve = 0.116440166 Iter = 0.104725926 Bottom = 0.010952188 moveKick ... updating velocity only [Level 2 step 26] Advanced 7168 cells [Level 1 step 14] ADVANCE at time 0.0203125 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -7.632783294e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 9.957448238e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 5.797530036e-19, 3.909887272e-13 MLMG: Timers: Solve = 0.340941719 Iter = 0.307150297 Bottom = 0.001866449 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.444676299e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.45636385e-20, 1.003392932e-13 MLMG: Timers: Solve = 0.117820799 Iter = 0.107625097 Bottom = 0.001869283 moveKick ... updating velocity only [Level 1 step 14] Advanced 32768 cells [Level 2 step 27] ADVANCE at time 0.0203125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.706572255e-20, 3.933390677e-14 MLMG: Timers: Solve = 0.116248577 Iter = 0.104578117 Bottom = 0.010876927 moveKick ... updating velocity only [Level 2 step 27] Advanced 7168 cells [Level 2 step 28] ADVANCE at time 0.02109375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 8.706572255e-20 MLMG: No iterations needed MLMG: Timers: Solve = 0.011709681 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 7 resid, resid/resid0 = 1.1690145e-18, 5.574632224e-13 MLMG: Timers: Solve = 0.103745659 Iter = 0.092055023 Bottom = 0.00962364 moveKick ... updating velocity only [Level 2 step 28] Advanced 7168 cells [STEP 7] Coarse TimeStep time: 4.364372506 [STEP 7] FAB kilobyte spread across MPI nodes: [68665 ... 68773] STEP = 7 TIME = 0.021875 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.021875 by dt = 0.003125 Old / new A time 0.021875 0.025 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.018099763 new finest: 2 Setting the current time in the state data to 0.021875 Calling redistribute because BoxArray changed TIME = 0.021875 : REGRID with lbase = 1 Level 2 36 grids 46080 cells 17.578125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 8] ADVANCE at time 0.021875 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -6.071532166e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.380180577e-07 MLMG: Final Iter. 8 resid, resid/bnorm = 9.683762072e-20, 6.530784288e-14 MLMG: Timers: Solve = 0.673328874 Iter = 0.607778702 Bottom = 0.004333772 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -1.940721889e-17 to ensure solvability MLMG: Initial rhs = 1.432880048e-08 MLMG: Initial residual (resid0) = 4.198898866e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 2.64697796e-21, 6.303981222e-14 MLMG: Timers: Solve = 0.102371907 Iter = 0.095345087 Bottom = 0.003043791 moveKick ... updating velocity only [Level 0 step 8] Advanced 4096 cells [Level 1 step 15] ADVANCE at time 0.021875 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.593886225e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 3.715074926e-20, 6.877137937e-14 MLMG: Timers: Solve = 0.118680987 Iter = 0.108538913 Bottom = 0.002828515 moveKick ... updating velocity only [Level 1 step 15] Advanced 32768 cells [Level 2 step 29] ADVANCE at time 0.021875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 6.047073366e-19, 2.731901982e-13 MLMG: Timers: Solve = 0.170483411 Iter = 0.148909506 Bottom = 0.038072536 moveKick ... updating velocity only [Level 2 step 29] Advanced 46080 cells [Level 2 step 30] ADVANCE at time 0.02265625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 6.047073366e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.021635931 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.034520383e-19, 2.877657359e-13 MLMG: Timers: Solve = 0.169830769 Iter = 0.148238772 Bottom = 0.037340673 moveKick ... updating velocity only [Level 2 step 30] Advanced 46080 cells [Level 1 step 16] ADVANCE at time 0.0234375 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -5.377642776e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 3.198732139e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.423271099e-19, 1.634267829e-13 MLMG: Timers: Solve = 0.431147331 Iter = 0.381470049 Bottom = 0.003675593 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113486436e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.301624207e-20, 1.060426719e-13 MLMG: Timers: Solve = 0.119608674 Iter = 0.109307773 Bottom = 0.003580263 moveKick ... updating velocity only [Level 1 step 16] Advanced 32768 cells [Level 2 step 31] ADVANCE at time 0.0234375 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.947655723e-19, 2.235215229e-13 MLMG: Timers: Solve = 0.169630132 Iter = 0.148061963 Bottom = 0.03725594 moveKick ... updating velocity only [Level 2 step 31] Advanced 46080 cells [Level 2 step 32] ADVANCE at time 0.02421875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 4.947655723e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.021744056 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.132430111e-18, 5.400173726e-13 MLMG: Timers: Solve = 0.169471366 Iter = 0.147818036 Bottom = 0.036926538 moveKick ... updating velocity only [Level 2 step 32] Advanced 46080 cells [STEP 8] Coarse TimeStep time: 6.738417225 [STEP 8] FAB kilobyte spread across MPI nodes: [68665 ... 68773] STEP = 8 TIME = 0.025 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.025 by dt = 0.003125 Old / new A time 0.025 0.028125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.051779963 new finest: 2 Setting the current time in the state data to 0.025 Setting the current time in the state data to 0.025 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -5.421010862e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 7.152210038e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.451142284e-18, 9.786586202e-13 MLMG: Timers: Solve = 0.621530875 Iter = 0.551511978 Bottom = 0.004008241 STEP = 8 TIME = 0.025 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 9] ADVANCE at time 0.025 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -5.421010862e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.451142284e-18 MLMG: No iterations needed MLMG: Timers: Solve = 0.069106689 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -5.984795992e-17 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.789252198e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.438631843e-21, 3.623798666e-14 MLMG: Timers: Solve = 0.102388255 Iter = 0.095346116 Bottom = 0.00301231 moveKick ... updating velocity only [Level 0 step 9] Advanced 4096 cells [Level 1 step 17] ADVANCE at time 0.025 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.573042079e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.613922433e-20, 2.987602514e-14 MLMG: Timers: Solve = 0.119077803 Iter = 0.108618555 Bottom = 0.003034672 moveKick ... updating velocity only [Level 1 step 17] Advanced 32768 cells [Level 2 step 33] ADVANCE at time 0.025 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 3.426114889e-19, 1.547824789e-13 MLMG: Timers: Solve = 0.179600343 Iter = 0.156041615 Bottom = 0.041760334 moveKick ... updating velocity only [Level 2 step 33] Advanced 53248 cells [Level 2 step 34] ADVANCE at time 0.02578125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 3.426114889e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.023729422 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.110209994e-19, 2.913751158e-13 MLMG: Timers: Solve = 0.179856984 Iter = 0.15622049 Bottom = 0.042030078 moveKick ... updating velocity only [Level 2 step 34] Advanced 53248 cells [Level 1 step 18] ADVANCE at time 0.0265625 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -6.505213035e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 8.380401878e-10 MLMG: Final Iter. 6 resid, resid/bnorm = 9.773000385e-19, 6.590967114e-13 MLMG: Timers: Solve = 0.395274117 Iter = 0.341671597 Bottom = 0.003217928 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113485678e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 4.646242481e-20, 1.492296083e-13 MLMG: Timers: Solve = 0.119100454 Iter = 0.108762413 Bottom = 0.003134664 moveKick ... updating velocity only [Level 1 step 18] Advanced 32768 cells [Level 2 step 35] ADVANCE at time 0.0265625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.916912004e-19, 2.221326059e-13 MLMG: Timers: Solve = 0.179743032 Iter = 0.156167148 Bottom = 0.041987938 moveKick ... updating velocity only [Level 2 step 35] Advanced 53248 cells [Level 2 step 36] ADVANCE at time 0.02734375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 4.916912004e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.023712528 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 2.574146775e-19, 1.227522974e-13 MLMG: Timers: Solve = 0.180266095 Iter = 0.156635804 Bottom = 0.042349833 moveKick ... updating velocity only [Level 2 step 36] Advanced 53248 cells [STEP 9] Coarse TimeStep time: 7.563423921 [STEP 9] FAB kilobyte spread across MPI nodes: [68665 ... 68773] STEP = 9 TIME = 0.028125 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.028125 by dt = 0.003125 Old / new A time 0.028125 0.03125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.024839074 new finest: 2 Setting the current time in the state data to 0.028125 Calling redistribute because BoxArray changed TIME = 0.028125 : REGRID with lbase = 1 Level 2 15 grids 11264 cells 4.296875 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 8 x 8 [Level 0 step 10] ADVANCE at time 0.028125 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -8.239936511e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.050217247e-08 MLMG: Final Iter. 8 resid, resid/bnorm = 9.765714991e-20, 6.586053804e-14 MLMG: Timers: Solve = 0.583265566 Iter = 0.532832016 Bottom = 0.004405015 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -1.198585502e-16 to ensure solvability MLMG: Initial rhs = 2.892150254e-08 MLMG: Initial residual (resid0) = 3.873110818e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 3.890023626e-21, 1.004366724e-13 MLMG: Timers: Solve = 0.101246088 Iter = 0.094220172 Bottom = 0.001907366 moveKick ... updating velocity only [Level 0 step 10] Advanced 4096 cells [Level 1 step 19] ADVANCE at time 0.028125 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.641046646e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 2.529632051e-20, 4.682712701e-14 MLMG: Timers: Solve = 0.11748943 Iter = 0.107328394 Bottom = 0.001904184 moveKick ... updating velocity only [Level 1 step 19] Advanced 32768 cells [Level 2 step 37] ADVANCE at time 0.028125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.972055873e-20, 4.053328898e-14 MLMG: Timers: Solve = 0.119178515 Iter = 0.107383363 Bottom = 0.013276471 moveKick ... updating velocity only [Level 2 step 37] Advanced 11264 cells [Level 2 step 38] ADVANCE at time 0.02890625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 8.972055873e-20 MLMG: No iterations needed MLMG: Timers: Solve = 0.011813689 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.89831178e-19, 9.052402705e-14 MLMG: Timers: Solve = 0.119202416 Iter = 0.107395501 Bottom = 0.013299666 moveKick ... updating velocity only [Level 2 step 38] Advanced 11264 cells [Level 1 step 20] ADVANCE at time 0.0296875 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -6.678685383e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 9.484814095e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 7.04982875e-19, 4.754444656e-13 MLMG: Timers: Solve = 0.34638985 Iter = 0.311466577 Bottom = 0.001903191 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 3.704988249e-07 MLMG: Initial residual (resid0) = 3.495865805e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.085323002e-20, 2.929356125e-14 MLMG: Timers: Solve = 0.118443229 Iter = 0.108132755 Bottom = 0.002034567 moveKick ... updating velocity only [Level 1 step 20] Advanced 32768 cells [Level 2 step 39] ADVANCE at time 0.0296875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.131615442e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.294914543e-19, 4.679943558e-14 MLMG: Timers: Solve = 0.119408791 Iter = 0.107553401 Bottom = 0.012943421 moveKick ... updating velocity only [Level 2 step 39] Advanced 11264 cells [Level 2 step 40] ADVANCE at time 0.03046875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.294914543e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.011890943 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.793151269e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 1.876273466e-18, 6.326284586e-13 MLMG: Timers: Solve = 0.106809715 Iter = 0.094928393 Bottom = 0.011673412 moveKick ... updating velocity only [Level 2 step 40] Advanced 11264 cells [STEP 10] Coarse TimeStep time: 4.216800797 [STEP 10] FAB kilobyte spread across MPI nodes: [68665 ... 68773] STEP = 10 TIME = 0.03125 DT = 0.003125 PLOTFILE: file = Part-2line_plt00010 Output file Part-2line_plt00010.temp at time 1.000000 and step 10 Write plotfile time = 0.141925172 seconds Time w/o init: 56.5069316 Run time = 58.28860091 Unused ParmParse Variables: [TOP]::amr.probin_file(nvals = 1) :: [] [TOP]::particles.particle_output_file(nvals = 1) :: [final_particles] Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [7511 ... 7521] [The Arena] max space (MB) allocated spread across MPI: [81 ... 81] [The Arena] max space (MB) used spread across MPI: [77 ... 77] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [16 ... 16] [The Pinned Arena] max space (MB) used spread across MPI: [8 ... 8] AMReX (26.06-1-g65060875b0e4) finalized