Initializing AMReX (26.09-7-g55dda725ff4d)... MPI initialized with 2 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.09-7-g55dda725ff4d) initialized Successfully read inputs file ... AMReX git describe: 26.09-7-g55dda725ff Nyx git describe: 26.09 Nyx::hydro_tile_size unset, using fabarray.mfiter_tile_size default: (1024000,1024000,1024000) Suggested default for currently compiled CPU / GPU: nyx.hydro_tile_size=(1048576,1048576,1048576) Nyx::sundials_tile_size unset, using fabarray.mfiter_tile_size default: (1024000,1024000,1024000) Suggested default for currently compiled CPU / GPU: nyx.sundials_tile_size=(1048576,1048576,1048576) Nyx::setting init_sb_vels to 0 since do_santa_barbara = 0 2 Species: H He Successfully read inputs file ... Getting Gconst from nyx_constants: 4.300927161e-09 Using -5.404704468e-08 for 4 pi G in Gravity.cpp Initializing the data at level 0 ... setting particle_initrandom_mass to 2.123188769e+11 by dividing 8.696581196e+14 by 4096 Initializing DM particles from "particle_file.2line" ... Redistributing from processor 0 to 0 Redistributing from processor 1 to 1 Total number of particles: 16 Average gas density 1 Average dm density 0.0048828125 Average total density 1.004882812 Done initializing the level 0 data ...estdt from hydro at level 0: 0.54 ...estdt from particles at level 0: 0.003125 Nyx::est_time_step at level 0: estdt = 0.003125 Integrating a from time 0 by dt = 0.003125 Old / new A time 0 0.003125 Old / new A 1 1 Old / new z 0 0 grid_places() time: 0.005649254 new finest: 1 Initializing the data at level 1 BA SIZE 0 FLEV 1 Calling redistribute because the size of BoxArray changed Done initializing the level 1 data grid_places() time: 0.01203071 new finest: 2 Initializing the data at level 2 BA SIZE 2 FLEV 2 Calling redistribute because the size of BoxArray changed Done initializing the level 2 data Now regridding at level lbase = 0 grid_places() time: 0.044880543 new finest: 2 Initializing the data at level 1 Calling redistribute because BoxArray changed Done initializing the level 1 data Initializing the data at level 2 Calling redistribute because BoxArray changed Done initializing the level 2 data NOT calling redistribute because NOT changed STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 Now regridding at level lbase = 0 grid_places() time: 0.052125191 new finest: 2 Regridding at level lbase = 0 but grids unchanged Setting the current time in the state data to 0 Setting the current time in the state data to 0 Setting the current time in the state data to 0 NOT calling redistribute because NOT changed Gravity ... defining average density in Gravity::set_mass_offset to be 1.004882812 Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 7.676236084e-19, 5.17689733e-13 MLMG: Timers: Solve = 0.68287298 Iter = 0.615923558 Bottom = 0.004440061 Average gas density 1 Average dm density 0.0048828125 Average total density 1.004882812 Average temperature 471.6564507 ... setting small_dens to 1e-06 ... setting small_temp to 0.0004716564507 ... setting small_pres to 6.666666667e-12 INITIAL GRIDS Level 0 2 grids 4096 cells 100 % of domain smallest grid: 16 x 16 x 8 biggest grid: 16 x 16 x 8 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 CHECKPOINT: file = Part-2line_restart_chk00000 checkPoint() time = 0.063204258 secs. PLOTFILE: file = Part-2line_restart_plt00000 Output file Part-2line_restart_plt00000.temp at time 1.000000 and step 0 Write plotfile time = 0.252479409 seconds ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Re-integrating a from time 0 by dt = 0.003125 Old / new A time 0 0.003125 Old / new A 1 1 Old / new z 0 0 [Level 0 step 1] ADVANCE at time 0 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 7.676236084e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.058410288 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -1.387778781e-17 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.789252198e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.438476747e-21, 3.623568194e-14 MLMG: Timers: Solve = 0.101648776 Iter = 0.094630475 Bottom = 0.002814699 moveKick ... updating velocity only [Level 0 step 1] Advanced 4096 cells [Level 1 step 1] ADVANCE at time 0 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.573042079e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.614031e-20, 2.987803488e-14 MLMG: Timers: Solve = 0.118382447 Iter = 0.108181228 Bottom = 0.002843256 moveKick ... updating velocity only [Level 1 step 1] Advanced 32768 cells [Level 2 step 1] ADVANCE at time 0 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 3.426091107e-19, 1.547814045e-13 MLMG: Timers: Solve = 0.184258967 Iter = 0.159013085 Bottom = 0.044305518 moveKick ... updating velocity only [Level 2 step 1] Advanced 53248 cells [Level 2 step 2] ADVANCE at time 0.00078125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 3.426091107e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.025232165 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.110254972e-19, 2.913772606e-13 MLMG: Timers: Solve = 0.18438164 Iter = 0.15911635 Bottom = 0.044285894 moveKick ... updating velocity only [Level 2 step 2] Advanced 53248 cells [Level 1 step 2] ADVANCE at time 0.0015625 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -9.540979118e-18 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 8.380401878e-10 MLMG: Final Iter. 6 resid, resid/bnorm = 9.772967297e-19, 6.5909448e-13 MLMG: Timers: Solve = 0.380883452 Iter = 0.332900381 Bottom = 0.003003593 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113485678e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 4.646909396e-20, 1.492510285e-13 MLMG: Timers: Solve = 0.118432262 Iter = 0.108259215 Bottom = 0.002974271 moveKick ... updating velocity only [Level 1 step 2] Advanced 32768 cells [Level 2 step 3] ADVANCE at time 0.0015625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.916804988e-19, 2.221277712e-13 MLMG: Timers: Solve = 0.184628966 Iter = 0.159330384 Bottom = 0.044444639 moveKick ... updating velocity only [Level 2 step 3] Advanced 53248 cells [Level 2 step 4] ADVANCE at time 0.00234375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 4.916804988e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.025312817 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 2.574462655e-19, 1.227673607e-13 MLMG: Timers: Solve = 0.185055983 Iter = 0.159724615 Bottom = 0.044646855 moveKick ... updating velocity only [Level 2 step 4] Advanced 53248 cells [STEP 1] Coarse TimeStep time: 6.500402088 [STEP 1] FAB kilobyte spread across MPI nodes: [62332 ... 68773] STEP = 1 TIME = 0.003125 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.003125 by dt = 0.003125 Old / new A time 0.003125 0.00625 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.02468928 new finest: 2 Setting the current time in the state data to 0.003125 Calling redistribute because BoxArray changed TIME = 0.003125 : REGRID with lbase = 1 Level 2 15 grids 11264 cells 4.296875 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 8 x 8 [Level 0 step 2] ADVANCE at time 0.003125 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -3.6429193e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.050217247e-08 MLMG: Final Iter. 8 resid, resid/bnorm = 9.796455091e-20, 6.606785102e-14 MLMG: Timers: Solve = 0.568630449 Iter = 0.527378813 Bottom = 0.004158085 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -1.789746736e-16 to ensure solvability MLMG: Initial rhs = 2.892150254e-08 MLMG: Initial residual (resid0) = 3.873110818e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 3.890075324e-21, 1.004380073e-13 MLMG: Timers: Solve = 0.100691121 Iter = 0.093652689 Bottom = 0.001814965 moveKick ... updating velocity only [Level 0 step 2] Advanced 4096 cells [Level 1 step 3] ADVANCE at time 0.003125 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.641046646e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 2.530226587e-20, 4.683813273e-14 MLMG: Timers: Solve = 0.117272661 Iter = 0.107131785 Bottom = 0.001831723 moveKick ... updating velocity only [Level 1 step 3] Advanced 32768 cells [Level 2 step 5] ADVANCE at time 0.003125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.975990151e-20, 4.055106297e-14 MLMG: Timers: Solve = 0.122117177 Iter = 0.109463549 Bottom = 0.014375455 moveKick ... updating velocity only [Level 2 step 5] Advanced 11264 cells [Level 2 step 6] ADVANCE at time 0.00390625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 8.975990151e-20 MLMG: No iterations needed MLMG: Timers: Solve = 0.012677865 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.898010376e-19, 9.050965412e-14 MLMG: Timers: Solve = 0.121822615 Iter = 0.109180376 Bottom = 0.014337099 moveKick ... updating velocity only [Level 2 step 6] Advanced 11264 cells [Level 1 step 4] ADVANCE at time 0.0046875 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -5.464378949e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 9.484814095e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 7.049299355e-19, 4.754087629e-13 MLMG: Timers: Solve = 0.340484311 Iter = 0.306150857 Bottom = 0.001841531 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 3.704988249e-07 MLMG: Initial residual (resid0) = 3.495865805e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.085074848e-20, 2.928686341e-14 MLMG: Timers: Solve = 0.117409655 Iter = 0.107206466 Bottom = 0.001931744 moveKick ... updating velocity only [Level 1 step 4] Advanced 32768 cells [Level 2 step 7] ADVANCE at time 0.0046875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.131615442e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.294425989e-19, 4.678177879e-14 MLMG: Timers: Solve = 0.12162766 Iter = 0.108965484 Bottom = 0.014039747 moveKick ... updating velocity only [Level 2 step 7] Advanced 11264 cells [Level 2 step 8] ADVANCE at time 0.00546875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.294425989e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.012668923 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.793151269e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 1.876300298e-18, 6.326375055e-13 MLMG: Timers: Solve = 0.108605801 Iter = 0.09603031 Bottom = 0.012522935 moveKick ... updating velocity only [Level 2 step 8] Advanced 11264 cells [STEP 2] Coarse TimeStep time: 4.228933686 [STEP 2] FAB kilobyte spread across MPI nodes: [62332 ... 68773] STEP = 2 TIME = 0.00625 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.00625 by dt = 0.003125 Old / new A time 0.00625 0.009375 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.040224151 new finest: 2 Setting the current time in the state data to 0.00625 Setting the current time in the state data to 0.00625 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -3.729655473e-17 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 7.247393028e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 3.388715468e-19, 1.142582828e-13 MLMG: Timers: Solve = 0.510324009 Iter = 0.461445451 Bottom = 0.001823153 STEP = 2 TIME = 0.00625 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 14 grids 7168 cells 2.734375 % of domain smallest grid: 8 x 8 x 8 biggest grid: 8 x 8 x 8 [Level 0 step 3] ADVANCE at time 0.00625 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -3.729655473e-17 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 3.388715468e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.044743599 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -5.486062993e-17 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.734865479e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 5.037788424e-21, 7.486136549e-14 MLMG: Timers: Solve = 0.100732342 Iter = 0.093677915 Bottom = 0.001857299 moveKick ... updating velocity only [Level 0 step 3] Advanced 4096 cells [Level 1 step 5] ADVANCE at time 0.00625 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.57065785e-07 MLMG: Final Iter. 6 resid, resid/bnorm = 4.290316487e-19, 7.941992788e-13 MLMG: Timers: Solve = 0.102256848 Iter = 0.092117331 Bottom = 0.001591567 moveKick ... updating velocity only [Level 1 step 5] Advanced 32768 cells [Level 2 step 9] ADVANCE at time 0.00625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 2.645318067e-18, 9.560429541e-13 MLMG: Timers: Solve = 0.104083045 Iter = 0.092343269 Bottom = 0.009514368 moveKick ... updating velocity only [Level 2 step 9] Advanced 7168 cells [Level 2 step 10] ADVANCE at time 0.00703125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.645318067e-18 MLMG: No iterations needed MLMG: Timers: Solve = 0.011751062 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.650467071e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.633470779e-19, 6.162954433e-14 MLMG: Timers: Solve = 0.116967131 Iter = 0.10521893 Bottom = 0.010980109 moveKick ... updating velocity only [Level 2 step 10] Advanced 7168 cells [Level 1 step 6] ADVANCE at time 0.0078125 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -2.949029909e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 9.957448238e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 5.796900344e-19, 3.909462604e-13 MLMG: Timers: Solve = 0.338459215 Iter = 0.30502805 Bottom = 0.001851614 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.444676299e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.455981279e-20, 1.00328187e-13 MLMG: Timers: Solve = 0.117382719 Iter = 0.107156837 Bottom = 0.001879119 moveKick ... updating velocity only [Level 1 step 6] Advanced 32768 cells [Level 2 step 11] ADVANCE at time 0.0078125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.709219233e-20, 3.934586509e-14 MLMG: Timers: Solve = 0.116763562 Iter = 0.105108646 Bottom = 0.010851265 moveKick ... updating velocity only [Level 2 step 11] Advanced 7168 cells [Level 2 step 12] ADVANCE at time 0.00859375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 8.709219233e-20 MLMG: No iterations needed MLMG: Timers: Solve = 0.011668083 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 7 resid, resid/resid0 = 1.168883909e-18, 5.574009479e-13 MLMG: Timers: Solve = 0.104158355 Iter = 0.09241748 Bottom = 0.009548027 moveKick ... updating velocity only [Level 2 step 12] Advanced 7168 cells [STEP 3] Coarse TimeStep time: 4.360137543 [STEP 3] FAB kilobyte spread across MPI nodes: [62332 ... 68773] STEP = 3 TIME = 0.009375 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.009375 by dt = 0.003125 Old / new A time 0.009375 0.0125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.018192762 new finest: 2 Setting the current time in the state data to 0.009375 Calling redistribute because BoxArray changed TIME = 0.009375 : REGRID with lbase = 1 Level 2 36 grids 46080 cells 17.578125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 4] ADVANCE at time 0.009375 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -3.295974604e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.380180577e-07 MLMG: Final Iter. 8 resid, resid/bnorm = 9.689092217e-20, 6.534378968e-14 MLMG: Timers: Solve = 0.675653128 Iter = 0.609638324 Bottom = 0.004298196 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -1.626303259e-17 to ensure solvability MLMG: Initial rhs = 1.432880048e-08 MLMG: Initial residual (resid0) = 4.198898866e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 2.643669238e-21, 6.296101245e-14 MLMG: Timers: Solve = 0.101903163 Iter = 0.094836679 Bottom = 0.003044044 moveKick ... updating velocity only [Level 0 step 4] Advanced 4096 cells [Level 1 step 7] ADVANCE at time 0.009375 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.593886225e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 3.715116285e-20, 6.877214498e-14 MLMG: Timers: Solve = 0.118216996 Iter = 0.108056199 Bottom = 0.002795016 moveKick ... updating velocity only [Level 1 step 7] Advanced 32768 cells [Level 2 step 13] ADVANCE at time 0.009375 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 6.046953425e-19, 2.731847796e-13 MLMG: Timers: Solve = 0.170488598 Iter = 0.148809707 Bottom = 0.038193104 moveKick ... updating velocity only [Level 2 step 13] Advanced 46080 cells [Level 2 step 14] ADVANCE at time 0.01015625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 6.046953425e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.022032732 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.034477473e-19, 2.877636896e-13 MLMG: Timers: Solve = 0.169783105 Iter = 0.148027926 Bottom = 0.03751165 moveKick ... updating velocity only [Level 2 step 14] Advanced 46080 cells [Level 1 step 8] ADVANCE at time 0.0109375 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -4.770489559e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 3.198732139e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.42350271e-19, 1.634424029e-13 MLMG: Timers: Solve = 0.432575573 Iter = 0.382704127 Bottom = 0.003650028 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113486436e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.300771177e-20, 1.06015274e-13 MLMG: Timers: Solve = 0.119229239 Iter = 0.108895754 Bottom = 0.00359484 moveKick ... updating velocity only [Level 1 step 8] Advanced 32768 cells [Level 2 step 15] ADVANCE at time 0.0109375 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.947853212e-19, 2.235304449e-13 MLMG: Timers: Solve = 0.169367432 Iter = 0.147634169 Bottom = 0.037256336 moveKick ... updating velocity only [Level 2 step 15] Advanced 46080 cells [Level 2 step 16] ADVANCE at time 0.01171875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 4.947853212e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.021822091 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.132694809e-18, 5.401435979e-13 MLMG: Timers: Solve = 0.169194875 Iter = 0.147459737 Bottom = 0.037042477 moveKick ... updating velocity only [Level 2 step 16] Advanced 46080 cells [STEP 4] Coarse TimeStep time: 6.752783873 [STEP 4] FAB kilobyte spread across MPI nodes: [63145 ... 68773] STEP = 4 TIME = 0.0125 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.0125 by dt = 0.003125 Old / new A time 0.0125 0.015625 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.052028364 new finest: 2 Setting the current time in the state data to 0.0125 Setting the current time in the state data to 0.0125 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -6.635317296e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 7.152210038e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.451209803e-18, 9.787041552e-13 MLMG: Timers: Solve = 0.618384947 Iter = 0.549068954 Bottom = 0.003998848 STEP = 4 TIME = 0.0125 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 5] ADVANCE at time 0.0125 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -6.635317296e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.451209803e-18 MLMG: No iterations needed MLMG: Timers: Solve = 0.069340098 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -1.604619215e-17 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.789252198e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.438580145e-21, 3.623721842e-14 MLMG: Timers: Solve = 0.102096786 Iter = 0.094968896 Bottom = 0.002988593 moveKick ... updating velocity only [Level 0 step 5] Advanced 4096 cells [Level 1 step 9] ADVANCE at time 0.0125 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.573042079e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.614139568e-20, 2.988004462e-14 MLMG: Timers: Solve = 0.119041994 Iter = 0.108635526 Bottom = 0.003030091 moveKick ... updating velocity only [Level 1 step 9] Advanced 32768 cells [Level 2 step 17] ADVANCE at time 0.0125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 3.426272053e-19, 1.547895791e-13 MLMG: Timers: Solve = 0.179487004 Iter = 0.155784582 Bottom = 0.041905557 moveKick ... updating velocity only [Level 2 step 17] Advanced 53248 cells [Level 2 step 18] ADVANCE at time 0.01328125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 3.426272053e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.023868158 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.110410585e-19, 2.913846813e-13 MLMG: Timers: Solve = 0.179879432 Iter = 0.156101085 Bottom = 0.042091019 moveKick ... updating velocity only [Level 2 step 18] Advanced 53248 cells [Level 1 step 10] ADVANCE at time 0.0140625 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -4.987329993e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 8.380401878e-10 MLMG: Final Iter. 6 resid, resid/bnorm = 9.773054151e-19, 6.591003375e-13 MLMG: Timers: Solve = 0.39739859 Iter = 0.343458334 Bottom = 0.003194719 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113485678e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 4.646237312e-20, 1.492294422e-13 MLMG: Timers: Solve = 0.118892599 Iter = 0.108514856 Bottom = 0.003118076 moveKick ... updating velocity only [Level 1 step 10] Advanced 32768 cells [Level 2 step 19] ADVANCE at time 0.0140625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.916757425e-19, 2.221256225e-13 MLMG: Timers: Solve = 0.179427738 Iter = 0.155744802 Bottom = 0.042066097 moveKick ... updating velocity only [Level 2 step 19] Advanced 53248 cells [Level 2 step 20] ADVANCE at time 0.01484375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 4.916757425e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.023884233 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 2.57416487e-19, 1.227531603e-13 MLMG: Timers: Solve = 0.181511392 Iter = 0.157565874 Bottom = 0.042752919 moveKick ... updating velocity only [Level 2 step 20] Advanced 53248 cells [STEP 5] Coarse TimeStep time: 7.631641996 [STEP 5] FAB kilobyte spread across MPI nodes: [68665 ... 68773] STEP = 5 TIME = 0.015625 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.015625 by dt = 0.003125 Old / new A time 0.015625 0.01875 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.024951699 new finest: 2 Setting the current time in the state data to 0.015625 Calling redistribute because BoxArray changed TIME = 0.015625 : REGRID with lbase = 1 Level 2 15 grids 11264 cells 4.296875 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 8 x 8 [Level 0 step 6] ADVANCE at time 0.015625 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -4.33680869e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.050217247e-08 MLMG: Final Iter. 8 resid, resid/bnorm = 9.779048109e-20, 6.595045734e-14 MLMG: Timers: Solve = 0.591799235 Iter = 0.540446269 Bottom = 0.00439627 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting 1.19262239e-18 to ensure solvability MLMG: Initial rhs = 2.892150254e-08 MLMG: Initial residual (resid0) = 3.873110818e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 3.890230421e-21, 1.004420117e-13 MLMG: Timers: Solve = 0.101547594 Iter = 0.094438154 Bottom = 0.001874567 moveKick ... updating velocity only [Level 0 step 6] Advanced 4096 cells [Level 1 step 11] ADVANCE at time 0.015625 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.641046646e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 2.530474741e-20, 4.684272642e-14 MLMG: Timers: Solve = 0.118390445 Iter = 0.108131324 Bottom = 0.001905222 moveKick ... updating velocity only [Level 1 step 11] Advanced 32768 cells [Level 2 step 21] ADVANCE at time 0.015625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.975400785e-20, 4.054840037e-14 MLMG: Timers: Solve = 0.119468619 Iter = 0.107544131 Bottom = 0.013363175 moveKick ... updating velocity only [Level 2 step 21] Advanced 11264 cells [Level 2 step 22] ADVANCE at time 0.01640625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 8.975400785e-20 MLMG: No iterations needed MLMG: Timers: Solve = 0.011956099 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.898269387e-19, 9.052200547e-14 MLMG: Timers: Solve = 0.120036034 Iter = 0.108104658 Bottom = 0.013365319 moveKick ... updating velocity only [Level 2 step 22] Advanced 11264 cells [Level 1 step 12] ADVANCE at time 0.0171875 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -4.683753385e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 9.484814095e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 7.050093448e-19, 4.75462317e-13 MLMG: Timers: Solve = 0.348447201 Iter = 0.313057244 Bottom = 0.001913379 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 3.704988249e-07 MLMG: Initial residual (resid0) = 3.495865805e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.085509118e-20, 2.929858463e-14 MLMG: Timers: Solve = 0.118298793 Iter = 0.107927644 Bottom = 0.001897592 moveKick ... updating velocity only [Level 1 step 12] Advanced 32768 cells [Level 2 step 23] ADVANCE at time 0.0171875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.131615442e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.294460627e-19, 4.678303065e-14 MLMG: Timers: Solve = 0.119121192 Iter = 0.10720345 Bottom = 0.013001821 moveKick ... updating velocity only [Level 2 step 23] Advanced 11264 cells [Level 2 step 24] ADVANCE at time 0.01796875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.294460627e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.011947265 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.793151269e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 1.876297764e-18, 6.326366514e-13 MLMG: Timers: Solve = 0.106525516 Iter = 0.094603072 Bottom = 0.011638116 moveKick ... updating velocity only [Level 2 step 24] Advanced 11264 cells [STEP 6] Coarse TimeStep time: 4.255051376 [STEP 6] FAB kilobyte spread across MPI nodes: [68665 ... 68773] STEP = 6 TIME = 0.01875 DT = 0.003125 CHECKPOINT: file = Part-2line_restart_chk00006 checkPoint() time = 0.030440151 secs. ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.01875 by dt = 0.003125 Old / new A time 0.01875 0.021875 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.041281637 new finest: 2 Setting the current time in the state data to 0.01875 Setting the current time in the state data to 0.01875 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -5.724587471e-17 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 7.247393028e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 3.389198335e-19, 1.142745638e-13 MLMG: Timers: Solve = 0.517740889 Iter = 0.467694628 Bottom = 0.001880636 STEP = 6 TIME = 0.01875 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 14 grids 7168 cells 2.734375 % of domain smallest grid: 8 x 8 x 8 biggest grid: 8 x 8 x 8 [Level 0 step 7] ADVANCE at time 0.01875 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -5.724587471e-17 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 3.389198335e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.049864587 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -8.890457814e-18 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.734865479e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 5.037685027e-21, 7.485982901e-14 MLMG: Timers: Solve = 0.101491352 Iter = 0.094392117 Bottom = 0.001841585 moveKick ... updating velocity only [Level 0 step 7] Advanced 4096 cells [Level 1 step 13] ADVANCE at time 0.01875 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.57065785e-07 MLMG: Final Iter. 6 resid, resid/bnorm = 4.290383178e-19, 7.942116244e-13 MLMG: Timers: Solve = 0.103210838 Iter = 0.092942902 Bottom = 0.001612028 moveKick ... updating velocity only [Level 1 step 13] Advanced 32768 cells [Level 2 step 25] ADVANCE at time 0.01875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 2.64526947e-18, 9.560253907e-13 MLMG: Timers: Solve = 0.104904662 Iter = 0.093082749 Bottom = 0.00956779 moveKick ... updating velocity only [Level 2 step 25] Advanced 7168 cells [Level 2 step 26] ADVANCE at time 0.01953125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.64526947e-18 MLMG: No iterations needed MLMG: Timers: Solve = 0.01184723 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.650467071e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.632653421e-19, 6.159870608e-14 MLMG: Timers: Solve = 0.117982764 Iter = 0.106127746 Bottom = 0.011063417 moveKick ... updating velocity only [Level 2 step 26] Advanced 7168 cells [Level 1 step 14] ADVANCE at time 0.0203125 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -7.632783294e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 9.957448238e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 5.796471244e-19, 3.909173217e-13 MLMG: Timers: Solve = 0.344542608 Iter = 0.310145276 Bottom = 0.001858758 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.444676299e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.456694722e-20, 1.003488985e-13 MLMG: Timers: Solve = 0.11833036 Iter = 0.108029296 Bottom = 0.00189146 moveKick ... updating velocity only [Level 1 step 14] Advanced 32768 cells [Level 2 step 27] ADVANCE at time 0.0203125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.695984344e-20, 3.928607349e-14 MLMG: Timers: Solve = 0.117695122 Iter = 0.105848664 Bottom = 0.010975078 moveKick ... updating velocity only [Level 2 step 27] Advanced 7168 cells [Level 2 step 28] ADVANCE at time 0.02109375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 8.695984344e-20 MLMG: No iterations needed MLMG: Timers: Solve = 0.011855163 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 7 resid, resid/resid0 = 1.168908621e-18, 5.574127322e-13 MLMG: Timers: Solve = 0.105130383 Iter = 0.093232434 Bottom = 0.009700303 moveKick ... updating velocity only [Level 2 step 28] Advanced 7168 cells [STEP 7] Coarse TimeStep time: 4.420573146 [STEP 7] FAB kilobyte spread across MPI nodes: [68665 ... 68773] STEP = 7 TIME = 0.021875 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.021875 by dt = 0.003125 Old / new A time 0.021875 0.025 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.0185812 new finest: 2 Setting the current time in the state data to 0.021875 Calling redistribute because BoxArray changed TIME = 0.021875 : REGRID with lbase = 1 Level 2 36 grids 46080 cells 17.578125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 8] ADVANCE at time 0.021875 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -6.071532166e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.380180577e-07 MLMG: Final Iter. 8 resid, resid/bnorm = 9.678855857e-20, 6.527475509e-14 MLMG: Timers: Solve = 0.681237527 Iter = 0.614513357 Bottom = 0.00434176 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -1.940721889e-17 to ensure solvability MLMG: Initial rhs = 1.432880048e-08 MLMG: Initial residual (resid0) = 4.198898866e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 2.643669238e-21, 6.296101245e-14 MLMG: Timers: Solve = 0.102691271 Iter = 0.095565648 Bottom = 0.003077702 moveKick ... updating velocity only [Level 0 step 8] Advanced 4096 cells [Level 1 step 15] ADVANCE at time 0.021875 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.593886225e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 3.715033567e-20, 6.877061375e-14 MLMG: Timers: Solve = 0.118616592 Iter = 0.108357529 Bottom = 0.00287937 moveKick ... updating velocity only [Level 1 step 15] Advanced 32768 cells [Level 2 step 29] ADVANCE at time 0.021875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 6.047338064e-19, 2.732021565e-13 MLMG: Timers: Solve = 0.171621194 Iter = 0.149760434 Bottom = 0.038534789 moveKick ... updating velocity only [Level 2 step 29] Advanced 46080 cells [Level 2 step 30] ADVANCE at time 0.02265625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 6.047338064e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.021970744 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.034652732e-19, 2.877720471e-13 MLMG: Timers: Solve = 0.171007187 Iter = 0.149134488 Bottom = 0.037785427 moveKick ... updating velocity only [Level 2 step 30] Advanced 46080 cells [Level 1 step 16] ADVANCE at time 0.0234375 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -5.377642776e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 3.198732139e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.423403448e-19, 1.634357086e-13 MLMG: Timers: Solve = 0.43687976 Iter = 0.386274196 Bottom = 0.003708995 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113486436e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.301624207e-20, 1.060426719e-13 MLMG: Timers: Solve = 0.12034678 Iter = 0.109937106 Bottom = 0.003592751 moveKick ... updating velocity only [Level 1 step 16] Advanced 32768 cells [Level 2 step 31] ADVANCE at time 0.0234375 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.947721897e-19, 2.235245124e-13 MLMG: Timers: Solve = 0.170469101 Iter = 0.148628955 Bottom = 0.037465034 moveKick ... updating velocity only [Level 2 step 31] Advanced 46080 cells [Level 2 step 32] ADVANCE at time 0.02421875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 4.947721897e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.022011911 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.13258893e-18, 5.400931078e-13 MLMG: Timers: Solve = 0.170390147 Iter = 0.148504683 Bottom = 0.037351865 moveKick ... updating velocity only [Level 2 step 32] Advanced 46080 cells [STEP 8] Coarse TimeStep time: 6.810768325 [STEP 8] FAB kilobyte spread across MPI nodes: [68665 ... 68773] STEP = 8 TIME = 0.025 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.025 by dt = 0.003125 Old / new A time 0.025 0.028125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.052486214 new finest: 2 Setting the current time in the state data to 0.025 Setting the current time in the state data to 0.025 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -5.421010862e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 7.152210038e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.451195224e-18, 9.78694323e-13 MLMG: Timers: Solve = 0.62288627 Iter = 0.552626262 Bottom = 0.004004015 STEP = 8 TIME = 0.025 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 9] ADVANCE at time 0.025 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -5.421010862e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.451195224e-18 MLMG: No iterations needed MLMG: Timers: Solve = 0.069676223 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -5.984795992e-17 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.789252198e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.438528446e-21, 3.623645018e-14 MLMG: Timers: Solve = 0.103045741 Iter = 0.095871866 Bottom = 0.003022233 moveKick ... updating velocity only [Level 0 step 9] Advanced 4096 cells [Level 1 step 17] ADVANCE at time 0.025 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.573042079e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.613674279e-20, 2.987143145e-14 MLMG: Timers: Solve = 0.119530957 Iter = 0.109243763 Bottom = 0.003070573 moveKick ... updating velocity only [Level 1 step 17] Advanced 32768 cells [Level 2 step 33] ADVANCE at time 0.025 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 3.426379587e-19, 1.547944372e-13 MLMG: Timers: Solve = 0.181083058 Iter = 0.157187787 Bottom = 0.042143195 moveKick ... updating velocity only [Level 2 step 33] Advanced 53248 cells [Level 2 step 34] ADVANCE at time 0.02578125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 3.426379587e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.024001974 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.110209994e-19, 2.913751158e-13 MLMG: Timers: Solve = 0.181102619 Iter = 0.157161972 Bottom = 0.042354131 moveKick ... updating velocity only [Level 2 step 34] Advanced 53248 cells [Level 1 step 18] ADVANCE at time 0.0265625 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -6.505213035e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 8.380401878e-10 MLMG: Final Iter. 6 resid, resid/bnorm = 9.772992113e-19, 6.590961536e-13 MLMG: Timers: Solve = 0.400991923 Iter = 0.346728653 Bottom = 0.003193172 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113485678e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 4.646242481e-20, 1.492296083e-13 MLMG: Timers: Solve = 0.119746949 Iter = 0.109300186 Bottom = 0.003158241 moveKick ... updating velocity only [Level 1 step 18] Advanced 32768 cells [Level 2 step 35] ADVANCE at time 0.0265625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.917044353e-19, 2.221385851e-13 MLMG: Timers: Solve = 0.181253766 Iter = 0.157351591 Bottom = 0.042386985 moveKick ... updating velocity only [Level 2 step 35] Advanced 53248 cells [Level 2 step 36] ADVANCE at time 0.02734375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 4.917044353e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.024045996 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 2.574146775e-19, 1.227522974e-13 MLMG: Timers: Solve = 0.181167023 Iter = 0.157226992 Bottom = 0.042733741 moveKick ... updating velocity only [Level 2 step 36] Advanced 53248 cells [STEP 9] Coarse TimeStep time: 7.674170281 [STEP 9] FAB kilobyte spread across MPI nodes: [68665 ... 68773] STEP = 9 TIME = 0.028125 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.028125 by dt = 0.003125 Old / new A time 0.028125 0.03125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.025156262 new finest: 2 Setting the current time in the state data to 0.028125 Calling redistribute because BoxArray changed TIME = 0.028125 : REGRID with lbase = 1 Level 2 15 grids 11264 cells 4.296875 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 8 x 8 [Level 0 step 10] ADVANCE at time 0.028125 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -8.239936511e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.050217247e-08 MLMG: Final Iter. 8 resid, resid/bnorm = 9.794831749e-20, 6.605690311e-14 MLMG: Timers: Solve = 0.591764503 Iter = 0.54040152 Bottom = 0.004446526 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -1.198585502e-16 to ensure solvability MLMG: Initial rhs = 2.892150254e-08 MLMG: Initial residual (resid0) = 3.873110818e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 3.890075324e-21, 1.004380073e-13 MLMG: Timers: Solve = 0.101320037 Iter = 0.094357126 Bottom = 0.0018721 moveKick ... updating velocity only [Level 0 step 10] Advanced 4096 cells [Level 1 step 19] ADVANCE at time 0.028125 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.641046646e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 2.530293795e-20, 4.683937685e-14 MLMG: Timers: Solve = 0.118234306 Iter = 0.107970396 Bottom = 0.001916057 moveKick ... updating velocity only [Level 1 step 19] Advanced 32768 cells [Level 2 step 37] ADVANCE at time 0.028125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.972655579e-20, 4.053599829e-14 MLMG: Timers: Solve = 0.119746387 Iter = 0.107811453 Bottom = 0.013322869 moveKick ... updating velocity only [Level 2 step 37] Advanced 11264 cells [Level 2 step 38] ADVANCE at time 0.02890625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 8.972655579e-20 MLMG: No iterations needed MLMG: Timers: Solve = 0.011968841 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.89831178e-19, 9.052402705e-14 MLMG: Timers: Solve = 0.119533645 Iter = 0.10758816 Bottom = 0.013307646 moveKick ... updating velocity only [Level 2 step 38] Advanced 11264 cells [Level 1 step 20] ADVANCE at time 0.0296875 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -6.678685383e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 9.484814095e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 7.04982875e-19, 4.754444656e-13 MLMG: Timers: Solve = 0.348249726 Iter = 0.313019718 Bottom = 0.001906469 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 3.704988249e-07 MLMG: Initial residual (resid0) = 3.495865805e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.085157566e-20, 2.928909602e-14 MLMG: Timers: Solve = 0.118509456 Iter = 0.108132891 Bottom = 0.002033891 moveKick ... updating velocity only [Level 1 step 20] Advanced 32768 cells [Level 2 step 39] ADVANCE at time 0.0296875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.131615442e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.294914543e-19, 4.679943558e-14 MLMG: Timers: Solve = 0.119738856 Iter = 0.107795289 Bottom = 0.013020881 moveKick ... updating velocity only [Level 2 step 39] Advanced 11264 cells [Level 2 step 40] ADVANCE at time 0.03046875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.294914543e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.011962521 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.793151269e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 1.87633964e-18, 6.326507708e-13 MLMG: Timers: Solve = 0.106824895 Iter = 0.094859124 Bottom = 0.011716881 moveKick ... updating velocity only [Level 2 step 40] Advanced 11264 cells [STEP 10] Coarse TimeStep time: 4.258599899 [STEP 10] FAB kilobyte spread across MPI nodes: [68665 ... 68773] STEP = 10 TIME = 0.03125 DT = 0.003125 PLOTFILE: file = Part-2line_restart_plt00010 Output file Part-2line_restart_plt00010.temp at time 1.000000 and step 10 Write plotfile time = 0.135668667 seconds Time w/o init: 57.05892525 CHECKPOINT: file = Part-2line_restart_chk00010 checkPoint() time = 0.030991748 secs. Run time = 58.93621093 Unused ParmParse Variables: [TOP]::amr.probin_file(nvals = 1) :: [] [TOP]::particles.particle_output_file(nvals = 1) :: [final_particles] Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [7511 ... 7521] [The Arena] max space (MB) allocated spread across MPI: [81 ... 81] [The Arena] max space (MB) used spread across MPI: [77 ... 77] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [16 ... 16] [The Pinned Arena] max space (MB) used spread across MPI: [8 ... 8] AMReX (26.09-7-g55dda725ff4d) finalized Initializing AMReX (26.09-7-g55dda725ff4d)... MPI initialized with 2 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.09-7-g55dda725ff4d) initialized Successfully read inputs file ... AMReX git describe: 26.09-7-g55dda725ff Nyx git describe: 26.09 Nyx::hydro_tile_size unset, using fabarray.mfiter_tile_size default: (1024000,1024000,1024000) Suggested default for currently compiled CPU / GPU: nyx.hydro_tile_size=(1048576,1048576,1048576) Nyx::sundials_tile_size unset, using fabarray.mfiter_tile_size default: (1024000,1024000,1024000) Suggested default for currently compiled CPU / GPU: nyx.sundials_tile_size=(1048576,1048576,1048576) Nyx::setting init_sb_vels to 0 since do_santa_barbara = 0 2 Species: H He restarting calculation from file: Part-2line_restart_chk00006 Successfully read inputs file ... read CPU time: 71.1727494 Getting Gconst from nyx_constants: 4.300927161e-09 Using -5.404704468e-08 for 4 pi G in Gravity.cpp ...setting old_a_time to 0.01875 Gravity ... defining average density in Gravity::set_mass_offset to be 1.004882812 Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -5.724587471e-17 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 7.247393028e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 4.500076048e-19, 1.517303435e-13 MLMG: Timers: Solve = 0.515882901 Iter = 0.466479051 Bottom = 0.001928033 Average gas density 1 Average dm density 0.0048828125 Average total density 1.004882812 Average temperature 471.6564507 ... setting small_dens to 1e-06 ... setting small_temp to 0.0004716564507 ... setting small_pres to 6.666666667e-12 Restart time = 0.88509904 seconds. ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.01875 by dt = 0.003125 Old / new A time 0.01875 0.021875 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.041013061 new finest: 2 Setting the current time in the state data to 0.01875 Setting the current time in the state data to 0.01875 BA SIZE 0 FLEV 2 Calling redistribute because the size of BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -5.724587471e-17 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 5.094599016e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 5.516331537e-19, 1.859957187e-13 MLMG: Timers: Solve = 0.510725516 Iter = 0.463923712 Bottom = 0.001799724 STEP = 6 TIME = 0.01875 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 14 grids 7168 cells 2.734375 % of domain smallest grid: 8 x 8 x 8 biggest grid: 8 x 8 x 8 [Level 0 step 7] ADVANCE at time 0.01875 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -5.724587471e-17 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 5.516331537e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.048734601 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -8.890457814e-18 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.734865479e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 5.037840123e-21, 7.486213374e-14 MLMG: Timers: Solve = 0.101764074 Iter = 0.094676201 Bottom = 0.001804779 moveKick ... updating velocity only [Level 0 step 7] Advanced 4096 cells [Level 1 step 13] ADVANCE at time 0.01875 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.57065785e-07 MLMG: Final Iter. 6 resid, resid/bnorm = 4.290470032e-19, 7.942277023e-13 MLMG: Timers: Solve = 0.10308927 Iter = 0.092879827 Bottom = 0.001547461 moveKick ... updating velocity only [Level 1 step 13] Advanced 32768 cells [Level 2 step 25] ADVANCE at time 0.01875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 2.645481229e-18, 9.561019221e-13 MLMG: Timers: Solve = 0.105126196 Iter = 0.093276435 Bottom = 0.009646181 moveKick ... updating velocity only [Level 2 step 25] Advanced 7168 cells [Level 2 step 26] ADVANCE at time 0.01953125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.645481229e-18 MLMG: No iterations needed MLMG: Timers: Solve = 0.011833777 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.650467071e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.63397691e-19, 6.164864025e-14 MLMG: Timers: Solve = 0.117869488 Iter = 0.106058518 Bottom = 0.010954147 moveKick ... updating velocity only [Level 2 step 26] Advanced 7168 cells [Level 1 step 14] ADVANCE at time 0.0203125 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -7.632783294e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 9.957448238e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 5.797530036e-19, 3.909887272e-13 MLMG: Timers: Solve = 0.340046057 Iter = 0.306472028 Bottom = 0.001923429 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.444676299e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.456332831e-20, 1.003383927e-13 MLMG: Timers: Solve = 0.118494622 Iter = 0.108284313 Bottom = 0.001847117 moveKick ... updating velocity only [Level 1 step 14] Advanced 32768 cells [Level 2 step 27] ADVANCE at time 0.0203125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.697969577e-20, 3.929504223e-14 MLMG: Timers: Solve = 0.117802374 Iter = 0.10598497 Bottom = 0.010976584 moveKick ... updating velocity only [Level 2 step 27] Advanced 7168 cells [Level 2 step 28] ADVANCE at time 0.02109375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 8.697969577e-20 MLMG: No iterations needed MLMG: Timers: Solve = 0.011843826 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 7 resid, resid/resid0 = 1.168855681e-18, 5.573874871e-13 MLMG: Timers: Solve = 0.10495872 Iter = 0.093109473 Bottom = 0.009598503 moveKick ... updating velocity only [Level 2 step 28] Advanced 7168 cells [STEP 7] Coarse TimeStep time: 4.396596347 [STEP 7] FAB kilobyte spread across MPI nodes: [42865 ... 42889] STEP = 7 TIME = 0.021875 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.021875 by dt = 0.003125 Old / new A time 0.021875 0.025 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.018535171 new finest: 2 Setting the current time in the state data to 0.021875 Calling redistribute because BoxArray changed TIME = 0.021875 : REGRID with lbase = 1 Level 2 36 grids 46080 cells 17.578125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 8] ADVANCE at time 0.021875 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -6.071532166e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.380180577e-07 MLMG: Final Iter. 8 resid, resid/bnorm = 9.68640905e-20, 6.532569425e-14 MLMG: Timers: Solve = 0.679099561 Iter = 0.612952803 Bottom = 0.004408169 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -1.940721889e-17 to ensure solvability MLMG: Initial rhs = 1.432880048e-08 MLMG: Initial residual (resid0) = 4.198898866e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 2.648632321e-21, 6.30792121e-14 MLMG: Timers: Solve = 0.10267088 Iter = 0.095551863 Bottom = 0.003016592 moveKick ... updating velocity only [Level 0 step 8] Advanced 4096 cells [Level 1 step 15] ADVANCE at time 0.021875 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.593886225e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 3.71490949e-20, 6.876831691e-14 MLMG: Timers: Solve = 0.119354885 Iter = 0.109133444 Bottom = 0.002782241 moveKick ... updating velocity only [Level 1 step 15] Advanced 32768 cells [Level 2 step 29] ADVANCE at time 0.021875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 6.046014575e-19, 2.731423649e-13 MLMG: Timers: Solve = 0.171625111 Iter = 0.149814864 Bottom = 0.038405868 moveKick ... updating velocity only [Level 2 step 29] Advanced 46080 cells [Level 2 step 30] ADVANCE at time 0.02265625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 6.046014575e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.021888418 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.033858639e-19, 2.877341795e-13 MLMG: Timers: Solve = 0.170622377 Iter = 0.148751781 Bottom = 0.037621335 moveKick ... updating velocity only [Level 2 step 30] Advanced 46080 cells [Level 1 step 16] ADVANCE at time 0.0234375 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -5.377642776e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 3.198732139e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.423568884e-19, 1.634468657e-13 MLMG: Timers: Solve = 0.434731079 Iter = 0.384568582 Bottom = 0.003615698 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113486436e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.30063159e-20, 1.060107907e-13 MLMG: Timers: Solve = 0.12027014 Iter = 0.10991844 Bottom = 0.003647595 moveKick ... updating velocity only [Level 1 step 16] Advanced 32768 cells [Level 2 step 31] ADVANCE at time 0.0234375 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.947788072e-19, 2.23527502e-13 MLMG: Timers: Solve = 0.170351134 Iter = 0.148525846 Bottom = 0.037438083 moveKick ... updating velocity only [Level 2 step 31] Advanced 46080 cells [Level 2 step 32] ADVANCE at time 0.02421875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 4.947788072e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.021949213 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.13253599e-18, 5.400678627e-13 MLMG: Timers: Solve = 0.170424209 Iter = 0.148581466 Bottom = 0.037218755 moveKick ... updating velocity only [Level 2 step 32] Advanced 46080 cells [STEP 8] Coarse TimeStep time: 6.812761814 [STEP 8] FAB kilobyte spread across MPI nodes: [56680 ... 63145] STEP = 8 TIME = 0.025 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.025 by dt = 0.003125 Old / new A time 0.025 0.028125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.052315381 new finest: 2 Setting the current time in the state data to 0.025 Setting the current time in the state data to 0.025 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -5.421010862e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 7.152210038e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.451248163e-18, 9.787300257e-13 MLMG: Timers: Solve = 0.618294863 Iter = 0.548910936 Bottom = 0.003961005 STEP = 8 TIME = 0.025 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 9] ADVANCE at time 0.025 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -5.421010862e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.451248163e-18 MLMG: No iterations needed MLMG: Timers: Solve = 0.068683209 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -5.984795992e-17 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.789252198e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.438528446e-21, 3.623645018e-14 MLMG: Timers: Solve = 0.102722781 Iter = 0.095557828 Bottom = 0.002998537 moveKick ... updating velocity only [Level 0 step 9] Advanced 4096 cells [Level 1 step 17] ADVANCE at time 0.025 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.573042079e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.614087869e-20, 2.98790876e-14 MLMG: Timers: Solve = 0.11930158 Iter = 0.109050723 Bottom = 0.003002544 moveKick ... updating velocity only [Level 1 step 17] Advanced 32768 cells [Level 2 step 33] ADVANCE at time 0.025 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 3.426445761e-19, 1.547974268e-13 MLMG: Timers: Solve = 0.180418795 Iter = 0.156598641 Bottom = 0.042134667 moveKick ... updating velocity only [Level 2 step 33] Advanced 53248 cells [Level 2 step 34] ADVANCE at time 0.02578125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 3.426445761e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.023969954 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.110408517e-19, 2.913845827e-13 MLMG: Timers: Solve = 0.181138862 Iter = 0.157268106 Bottom = 0.042308523 moveKick ... updating velocity only [Level 2 step 34] Advanced 53248 cells [Level 1 step 18] ADVANCE at time 0.0265625 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -6.505213035e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 8.380401878e-10 MLMG: Final Iter. 6 resid, resid/bnorm = 9.773041744e-19, 6.590995007e-13 MLMG: Timers: Solve = 0.39657138 Iter = 0.342782739 Bottom = 0.003136665 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113485678e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 4.645911609e-20, 1.492189812e-13 MLMG: Timers: Solve = 0.11941621 Iter = 0.109040431 Bottom = 0.003087502 moveKick ... updating velocity only [Level 1 step 18] Advanced 32768 cells [Level 2 step 35] ADVANCE at time 0.0265625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.916779656e-19, 2.221266268e-13 MLMG: Timers: Solve = 0.181004147 Iter = 0.157159152 Bottom = 0.042218766 moveKick ... updating velocity only [Level 2 step 35] Advanced 53248 cells [Level 2 step 36] ADVANCE at time 0.02734375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 4.916779656e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.023962711 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 2.574146775e-19, 1.227522974e-13 MLMG: Timers: Solve = 0.181167259 Iter = 0.157302751 Bottom = 0.042565066 moveKick ... updating velocity only [Level 2 step 36] Advanced 53248 cells [STEP 9] Coarse TimeStep time: 7.650349471 [STEP 9] FAB kilobyte spread across MPI nodes: [62439 ... 68665] STEP = 9 TIME = 0.028125 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.028125 by dt = 0.003125 Old / new A time 0.028125 0.03125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.024916605 new finest: 2 Setting the current time in the state data to 0.028125 Calling redistribute because BoxArray changed TIME = 0.028125 : REGRID with lbase = 1 Level 2 15 grids 11264 cells 4.296875 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 8 x 8 [Level 0 step 10] ADVANCE at time 0.028125 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -8.239936511e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.050217247e-08 MLMG: Final Iter. 8 resid, resid/bnorm = 9.789537793e-20, 6.602120037e-14 MLMG: Timers: Solve = 0.589846267 Iter = 0.538752276 Bottom = 0.004390553 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -1.198585502e-16 to ensure solvability MLMG: Initial rhs = 2.892150254e-08 MLMG: Initial residual (resid0) = 3.873110818e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 3.890075324e-21, 1.004380073e-13 MLMG: Timers: Solve = 0.101490583 Iter = 0.094351142 Bottom = 0.001868955 moveKick ... updating velocity only [Level 0 step 10] Advanced 4096 cells [Level 1 step 19] ADVANCE at time 0.028125 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.641046646e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 2.530707385e-20, 4.6847033e-14 MLMG: Timers: Solve = 0.118200567 Iter = 0.107954321 Bottom = 0.001900878 moveKick ... updating velocity only [Level 1 step 19] Advanced 32768 cells [Level 2 step 37] ADVANCE at time 0.028125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.977349829e-20, 4.055720562e-14 MLMG: Timers: Solve = 0.119622226 Iter = 0.107711001 Bottom = 0.013365193 moveKick ... updating velocity only [Level 2 step 37] Advanced 11264 cells [Level 2 step 38] ADVANCE at time 0.02890625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 8.977349829e-20 MLMG: No iterations needed MLMG: Timers: Solve = 0.011945842 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.898444129e-19, 9.053033832e-14 MLMG: Timers: Solve = 0.119630744 Iter = 0.107710233 Bottom = 0.013349343 moveKick ... updating velocity only [Level 2 step 38] Advanced 11264 cells [Level 1 step 20] ADVANCE at time 0.0296875 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -6.678685383e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 9.484814095e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 7.049299355e-19, 4.754087629e-13 MLMG: Timers: Solve = 0.347949089 Iter = 0.312993178 Bottom = 0.001901165 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 3.704988249e-07 MLMG: Initial residual (resid0) = 3.495865805e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.085188585e-20, 2.928993325e-14 MLMG: Timers: Solve = 0.118362794 Iter = 0.108001407 Bottom = 0.001926732 moveKick ... updating velocity only [Level 1 step 20] Advanced 32768 cells [Level 2 step 39] ADVANCE at time 0.0296875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.131615442e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.294120449e-19, 4.67707363e-14 MLMG: Timers: Solve = 0.119433781 Iter = 0.107508066 Bottom = 0.013046977 moveKick ... updating velocity only [Level 2 step 39] Advanced 11264 cells [Level 2 step 40] ADVANCE at time 0.03046875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.294120449e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.011930817 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.793151269e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 1.87631436e-18, 6.326422468e-13 MLMG: Timers: Solve = 0.106779401 Iter = 0.094848212 Bottom = 0.011717631 moveKick ... updating velocity only [Level 2 step 40] Advanced 11264 cells [STEP 10] Coarse TimeStep time: 4.253701066 [STEP 10] FAB kilobyte spread across MPI nodes: [62439 ... 68665] STEP = 10 TIME = 0.03125 DT = 0.003125 PLOTFILE: file = Part-2line_restart_plt00010 Output file Part-2line_restart_plt00010.temp at time 1.000000 and step 10 Write plotfile time = 0.133737772 seconds Time w/o init: 23.24756087 Run time = 24.13425425 Unused ParmParse Variables: [TOP]::amr.probin_file(nvals = 1) :: [] [TOP]::particles.particle_output_file(nvals = 1) :: [final_particles] Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [7519 ... 7529] [The Arena] max space (MB) allocated spread across MPI: [73 ... 81] [The Arena] max space (MB) used spread across MPI: [71 ... 77] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [16 ... 16] [The Pinned Arena] max space (MB) used spread across MPI: [8 ... 8] AMReX (26.09-7-g55dda725ff4d) finalized