Initializing AMReX (26.09-122-ga846c6a9c672)... MPI initialized with 2 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.09-122-ga846c6a9c672) initialized Successfully read inputs file ... AMReX git describe: 26.09-122-ga846c6a9c6 Nyx git describe: 26.09 Nyx::hydro_tile_size unset, using fabarray.mfiter_tile_size default: (1024000,1024000,1024000) Suggested default for currently compiled CPU / GPU: nyx.hydro_tile_size=(1048576,1048576,1048576) Nyx::sundials_tile_size unset, using fabarray.mfiter_tile_size default: (1024000,1024000,1024000) Suggested default for currently compiled CPU / GPU: nyx.sundials_tile_size=(1048576,1048576,1048576) Nyx::setting init_sb_vels to 0 since do_santa_barbara = 0 2 Species: H He Successfully read inputs file ... Getting Gconst from nyx_constants: 4.300927161e-09 Using -5.404704468e-08 for 4 pi G in Gravity.cpp Initializing the data at level 0 ... setting particle_initrandom_mass to 2.123188769e+11 by dividing 8.696581196e+14 by 4096 Initializing DM particles from "particle_file.2line" ... Redistributing from processor 0 to 0 Redistributing from processor 1 to 1 Total number of particles: 16 Average gas density 1 Average dm density 0.0048828125 Average total density 1.004882812 Done initializing the level 0 data ...estdt from hydro at level 0: 0.54 ...estdt from particles at level 0: 0.003125 Nyx::est_time_step at level 0: estdt = 0.003125 Integrating a from time 0 by dt = 0.003125 Old / new A time 0 0.003125 Old / new A 1 1 Old / new z 0 0 grid_places() time: 0.005641768 new finest: 1 Initializing the data at level 1 BA SIZE 0 FLEV 1 Calling redistribute because the size of BoxArray changed Done initializing the level 1 data grid_places() time: 0.011865176 new finest: 2 Initializing the data at level 2 BA SIZE 2 FLEV 2 Calling redistribute because the size of BoxArray changed Done initializing the level 2 data Now regridding at level lbase = 0 grid_places() time: 0.046711646 new finest: 2 Initializing the data at level 1 Calling redistribute because BoxArray changed Done initializing the level 1 data Initializing the data at level 2 Calling redistribute because BoxArray changed Done initializing the level 2 data NOT calling redistribute because NOT changed STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 Now regridding at level lbase = 0 grid_places() time: 0.052290099 new finest: 2 Regridding at level lbase = 0 but grids unchanged Setting the current time in the state data to 0 Setting the current time in the state data to 0 Setting the current time in the state data to 0 NOT calling redistribute because NOT changed Gravity ... defining average density in Gravity::set_mass_offset to be 1.004882812 Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 7.676236084e-19, 5.17689733e-13 MLMG: Timers: Solve = 0.699308684 Iter = 0.63312203 Bottom = 0.00446276 Average gas density 1 Average dm density 0.0048828125 Average total density 1.004882812 Average temperature 471.6564507 ... setting small_dens to 1e-06 ... setting small_temp to 0.0004716564507 ... setting small_pres to 6.666666667e-12 INITIAL GRIDS Level 0 2 grids 4096 cells 100 % of domain smallest grid: 16 x 16 x 8 biggest grid: 16 x 16 x 8 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 PLOTFILE: file = Part-2line_plt00000 Output file Part-2line_plt00000.temp at time 1.000000 and step 0 Write plotfile time = 0.291444875 seconds ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Re-integrating a from time 0 by dt = 0.003125 Old / new A time 0 0.003125 Old / new A 1 1 Old / new z 0 0 [Level 0 step 1] ADVANCE at time 0 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 7.676236084e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.058214852 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -1.387778781e-17 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.789252198e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.438269952e-21, 3.623260897e-14 MLMG: Timers: Solve = 0.101788955 Iter = 0.09478669 Bottom = 0.002818658 moveKick ... updating velocity only [Level 0 step 1] Advanced 4096 cells [Level 1 step 1] ADVANCE at time 0 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.573042079e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.613782846e-20, 2.987344119e-14 MLMG: Timers: Solve = 0.127940411 Iter = 0.117773287 Bottom = 0.002840207 moveKick ... updating velocity only [Level 1 step 1] Advanced 32768 cells [Level 2 step 1] ADVANCE at time 0 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 3.426091107e-19, 1.547814045e-13 MLMG: Timers: Solve = 0.196043709 Iter = 0.170817514 Bottom = 0.039738103 moveKick ... updating velocity only [Level 2 step 1] Advanced 53248 cells [Level 2 step 2] ADVANCE at time 0.00078125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 3.426091107e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.025217835 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.110188797e-19, 2.91374105e-13 MLMG: Timers: Solve = 0.195968385 Iter = 0.170743459 Bottom = 0.039730186 moveKick ... updating velocity only [Level 2 step 2] Advanced 53248 cells [Level 1 step 2] ADVANCE at time 0.0015625 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -9.540979118e-18 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 8.380401878e-10 MLMG: Final Iter. 6 resid, resid/bnorm = 9.7730252e-19, 6.59098385e-13 MLMG: Timers: Solve = 0.397249312 Iter = 0.35010552 Bottom = 0.003017661 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113485678e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 4.645373942e-20, 1.492017122e-13 MLMG: Timers: Solve = 0.12802973 Iter = 0.117815395 Bottom = 0.0030112 moveKick ... updating velocity only [Level 1 step 2] Advanced 32768 cells [Level 2 step 3] ADVANCE at time 0.0015625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.916871162e-19, 2.221307608e-13 MLMG: Timers: Solve = 0.196006492 Iter = 0.170771185 Bottom = 0.039840511 moveKick ... updating velocity only [Level 2 step 3] Advanced 53248 cells [Level 2 step 4] ADVANCE at time 0.00234375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 4.916871162e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.025255941 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 2.574330306e-19, 1.227610494e-13 MLMG: Timers: Solve = 0.196299092 Iter = 0.1710578 Bottom = 0.040113902 moveKick ... updating velocity only [Level 2 step 4] Advanced 53248 cells [STEP 1] Coarse TimeStep time: 6.581951002 [STEP 1] FAB kilobyte spread across MPI nodes: [62332 ... 68773] STEP = 1 TIME = 0.003125 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.003125 by dt = 0.003125 Old / new A time 0.003125 0.00625 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.024522638 new finest: 2 Setting the current time in the state data to 0.003125 Calling redistribute because BoxArray changed TIME = 0.003125 : REGRID with lbase = 1 Level 2 15 grids 11264 cells 4.296875 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 8 x 8 [Level 0 step 2] ADVANCE at time 0.003125 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -3.6429193e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.050217247e-08 MLMG: Final Iter. 8 resid, resid/bnorm = 9.812336959e-20, 6.617495924e-14 MLMG: Timers: Solve = 0.589600237 Iter = 0.549263297 Bottom = 0.004177084 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -1.789746736e-16 to ensure solvability MLMG: Initial rhs = 2.892150254e-08 MLMG: Initial residual (resid0) = 3.873110818e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 3.889868529e-21, 1.00432668e-13 MLMG: Timers: Solve = 0.100708402 Iter = 0.093653335 Bottom = 0.001805657 moveKick ... updating velocity only [Level 0 step 2] Advanced 4096 cells [Level 1 step 3] ADVANCE at time 0.003125 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.641046646e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 2.530888331e-20, 4.685038257e-14 MLMG: Timers: Solve = 0.126700103 Iter = 0.116564812 Bottom = 0.001839238 moveKick ... updating velocity only [Level 1 step 3] Advanced 32768 cells [Level 2 step 5] ADVANCE at time 0.003125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.973343173e-20, 4.053910465e-14 MLMG: Timers: Solve = 0.133037471 Iter = 0.120412974 Bottom = 0.009679542 moveKick ... updating velocity only [Level 2 step 5] Advanced 11264 cells [Level 2 step 6] ADVANCE at time 0.00390625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 8.973343173e-20 MLMG: No iterations needed MLMG: Timers: Solve = 0.012645712 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.898467394e-19, 9.053144772e-14 MLMG: Timers: Solve = 0.132937896 Iter = 0.120312041 Bottom = 0.009619651 moveKick ... updating velocity only [Level 2 step 6] Advanced 11264 cells [Level 1 step 4] ADVANCE at time 0.0046875 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -5.464378949e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 9.484814095e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 7.050490495e-19, 4.754890941e-13 MLMG: Timers: Solve = 0.36002773 Iter = 0.32594819 Bottom = 0.001849983 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 3.704988249e-07 MLMG: Initial residual (resid0) = 3.495865805e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.08540572e-20, 2.929579386e-14 MLMG: Timers: Solve = 0.127173832 Iter = 0.116956656 Bottom = 0.001946712 moveKick ... updating velocity only [Level 1 step 4] Advanced 32768 cells [Level 2 step 7] ADVANCE at time 0.0046875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.131615442e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.293631896e-19, 4.675307951e-14 MLMG: Timers: Solve = 0.132631059 Iter = 0.120003717 Bottom = 0.009380154 moveKick ... updating velocity only [Level 2 step 7] Advanced 11264 cells [Level 2 step 8] ADVANCE at time 0.00546875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.293631896e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.012653296 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.793151269e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 1.876307484e-18, 6.326399285e-13 MLMG: Timers: Solve = 0.118363685 Iter = 0.105720726 Bottom = 0.00856191 moveKick ... updating velocity only [Level 2 step 8] Advanced 11264 cells [STEP 2] Coarse TimeStep time: 4.332818677 [STEP 2] FAB kilobyte spread across MPI nodes: [62332 ... 68773] STEP = 2 TIME = 0.00625 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.00625 by dt = 0.003125 Old / new A time 0.00625 0.009375 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.040512081 new finest: 2 Setting the current time in the state data to 0.00625 Setting the current time in the state data to 0.00625 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -3.729655473e-17 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 7.247393028e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 3.388715468e-19, 1.142582828e-13 MLMG: Timers: Solve = 0.529289484 Iter = 0.47983339 Bottom = 0.001840144 STEP = 2 TIME = 0.00625 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 14 grids 7168 cells 2.734375 % of domain smallest grid: 8 x 8 x 8 biggest grid: 8 x 8 x 8 [Level 0 step 3] ADVANCE at time 0.00625 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -3.729655473e-17 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 3.388715468e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.046105546 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -5.486062993e-17 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.734865479e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 5.037891822e-21, 7.486290198e-14 MLMG: Timers: Solve = 0.100747481 Iter = 0.093687932 Bottom = 0.001842986 moveKick ... updating velocity only [Level 0 step 3] Advanced 4096 cells [Level 1 step 5] ADVANCE at time 0.00625 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.57065785e-07 MLMG: Final Iter. 6 resid, resid/bnorm = 4.290382661e-19, 7.942115287e-13 MLMG: Timers: Solve = 0.110581751 Iter = 0.100393356 Bottom = 0.001609132 moveKick ... updating velocity only [Level 1 step 5] Advanced 32768 cells [Level 2 step 9] ADVANCE at time 0.00625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 2.645318067e-18, 9.560429541e-13 MLMG: Timers: Solve = 0.114040098 Iter = 0.10231025 Bottom = 0.006499744 moveKick ... updating velocity only [Level 2 step 9] Advanced 7168 cells [Level 2 step 10] ADVANCE at time 0.00703125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.645318067e-18 MLMG: No iterations needed MLMG: Timers: Solve = 0.011754872 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.650467071e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.632941383e-19, 6.160957066e-14 MLMG: Timers: Solve = 0.128359567 Iter = 0.116617711 Bottom = 0.007479244 moveKick ... updating velocity only [Level 2 step 10] Advanced 7168 cells [Level 1 step 6] ADVANCE at time 0.0078125 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -2.949029909e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 9.957448238e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 5.798488531e-19, 3.910533686e-13 MLMG: Timers: Solve = 0.358346062 Iter = 0.324769366 Bottom = 0.001871197 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.444676299e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.456643023e-20, 1.003473977e-13 MLMG: Timers: Solve = 0.126896918 Iter = 0.116687786 Bottom = 0.001876487 moveKick ... updating velocity only [Level 1 step 6] Advanced 32768 cells [Level 2 step 11] ADVANCE at time 0.0078125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.706572255e-20, 3.933390677e-14 MLMG: Timers: Solve = 0.1281805 Iter = 0.116441238 Bottom = 0.007371604 moveKick ... updating velocity only [Level 2 step 11] Advanced 7168 cells [Level 2 step 12] ADVANCE at time 0.00859375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 8.706572255e-20 MLMG: No iterations needed MLMG: Timers: Solve = 0.0116851 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 7 resid, resid/resid0 = 1.168910379e-18, 5.574135704e-13 MLMG: Timers: Solve = 0.114098744 Iter = 0.102367043 Bottom = 0.006574779 moveKick ... updating velocity only [Level 2 step 12] Advanced 7168 cells [STEP 3] Coarse TimeStep time: 4.461531459 [STEP 3] FAB kilobyte spread across MPI nodes: [62332 ... 68773] STEP = 3 TIME = 0.009375 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.009375 by dt = 0.003125 Old / new A time 0.009375 0.0125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.018065663 new finest: 2 Setting the current time in the state data to 0.009375 Calling redistribute because BoxArray changed TIME = 0.009375 : REGRID with lbase = 1 Level 2 36 grids 46080 cells 17.578125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 4] ADVANCE at time 0.009375 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -3.295974604e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.380180577e-07 MLMG: Final Iter. 8 resid, resid/bnorm = 9.688823384e-20, 6.534197665e-14 MLMG: Timers: Solve = 0.696655509 Iter = 0.631094567 Bottom = 0.004289642 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -1.626303259e-17 to ensure solvability MLMG: Initial rhs = 1.432880048e-08 MLMG: Initial residual (resid0) = 4.198898866e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 2.648632321e-21, 6.30792121e-14 MLMG: Timers: Solve = 0.101905204 Iter = 0.094835362 Bottom = 0.003041147 moveKick ... updating velocity only [Level 0 step 4] Advanced 4096 cells [Level 1 step 7] ADVANCE at time 0.009375 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.593886225e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 3.715405798e-20, 6.877750429e-14 MLMG: Timers: Solve = 0.127726142 Iter = 0.117530913 Bottom = 0.002820452 moveKick ... updating velocity only [Level 1 step 7] Advanced 32768 cells [Level 2 step 13] ADVANCE at time 0.009375 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 6.046688727e-19, 2.731728213e-13 MLMG: Timers: Solve = 0.181893403 Iter = 0.160210254 Bottom = 0.033677658 moveKick ... updating velocity only [Level 2 step 13] Advanced 46080 cells [Level 2 step 14] ADVANCE at time 0.01015625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 6.046688727e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.021757557 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.033815729e-19, 2.877321333e-13 MLMG: Timers: Solve = 0.181159241 Iter = 0.15944478 Bottom = 0.032945618 moveKick ... updating velocity only [Level 2 step 14] Advanced 46080 cells [Level 1 step 8] ADVANCE at time 0.0109375 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -4.770489559e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 3.198732139e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.423469623e-19, 1.634401715e-13 MLMG: Timers: Solve = 0.449035872 Iter = 0.399013237 Bottom = 0.003656676 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113486436e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.300936613e-20, 1.060205876e-13 MLMG: Timers: Solve = 0.128587059 Iter = 0.118258981 Bottom = 0.00357547 moveKick ... updating velocity only [Level 1 step 8] Advanced 32768 cells [Level 2 step 15] ADVANCE at time 0.0109375 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.947588514e-19, 2.235184866e-13 MLMG: Timers: Solve = 0.181380876 Iter = 0.159704202 Bottom = 0.032638117 moveKick ... updating velocity only [Level 2 step 15] Advanced 46080 cells [Level 2 step 16] ADVANCE at time 0.01171875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 4.947588514e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.021792182 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.132694809e-18, 5.401435979e-13 MLMG: Timers: Solve = 0.180783509 Iter = 0.159101826 Bottom = 0.032459799 moveKick ... updating velocity only [Level 2 step 16] Advanced 46080 cells [STEP 4] Coarse TimeStep time: 6.858426707 [STEP 4] FAB kilobyte spread across MPI nodes: [63145 ... 68773] STEP = 4 TIME = 0.0125 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.0125 by dt = 0.003125 Old / new A time 0.0125 0.015625 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.051923353 new finest: 2 Setting the current time in the state data to 0.0125 Setting the current time in the state data to 0.0125 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -6.635317296e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 7.152210038e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.451209803e-18, 9.787041552e-13 MLMG: Timers: Solve = 0.636098411 Iter = 0.566503981 Bottom = 0.003967186 STEP = 4 TIME = 0.0125 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 5] ADVANCE at time 0.0125 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -6.635317296e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.451209803e-18 MLMG: No iterations needed MLMG: Timers: Solve = 0.069026851 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -1.604619215e-17 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.789252198e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.438580145e-21, 3.623721842e-14 MLMG: Timers: Solve = 0.101951633 Iter = 0.094819113 Bottom = 0.002996086 moveKick ... updating velocity only [Level 0 step 5] Advanced 4096 cells [Level 1 step 9] ADVANCE at time 0.0125 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.573042079e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.614387722e-20, 2.988463831e-14 MLMG: Timers: Solve = 0.128081521 Iter = 0.117875228 Bottom = 0.003031153 moveKick ... updating velocity only [Level 1 step 9] Advanced 32768 cells [Level 2 step 17] ADVANCE at time 0.0125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 3.426205879e-19, 1.547865895e-13 MLMG: Timers: Solve = 0.191308059 Iter = 0.16765356 Bottom = 0.037372997 moveKick ... updating velocity only [Level 2 step 17] Advanced 53248 cells [Level 2 step 18] ADVANCE at time 0.01328125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 3.426205879e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.023799237 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.110145887e-19, 2.913720588e-13 MLMG: Timers: Solve = 0.191322946 Iter = 0.167594539 Bottom = 0.037582504 moveKick ... updating velocity only [Level 2 step 18] Advanced 53248 cells [Level 1 step 10] ADVANCE at time 0.0140625 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -4.987329993e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 8.380401878e-10 MLMG: Final Iter. 6 resid, resid/bnorm = 9.77295489e-19, 6.590936432e-13 MLMG: Timers: Solve = 0.413102373 Iter = 0.359381223 Bottom = 0.003206109 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113485678e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 4.645570397e-20, 1.492080221e-13 MLMG: Timers: Solve = 0.129218163 Iter = 0.118806119 Bottom = 0.003111212 moveKick ... updating velocity only [Level 1 step 10] Advanced 32768 cells [Level 2 step 19] ADVANCE at time 0.0140625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.916757425e-19, 2.221256225e-13 MLMG: Timers: Solve = 0.19240828 Iter = 0.168572871 Bottom = 0.037759443 moveKick ... updating velocity only [Level 2 step 19] Advanced 53248 cells [Level 2 step 20] ADVANCE at time 0.01484375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 4.916757425e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.024003787 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 2.574131783e-19, 1.227515825e-13 MLMG: Timers: Solve = 0.192794497 Iter = 0.168890219 Bottom = 0.038160296 moveKick ... updating velocity only [Level 2 step 20] Advanced 53248 cells [STEP 5] Coarse TimeStep time: 7.730845278 [STEP 5] FAB kilobyte spread across MPI nodes: [68665 ... 68773] STEP = 5 TIME = 0.015625 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.015625 by dt = 0.003125 Old / new A time 0.015625 0.01875 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.024950629 new finest: 2 Setting the current time in the state data to 0.015625 Calling redistribute because BoxArray changed TIME = 0.015625 : REGRID with lbase = 1 Level 2 15 grids 11264 cells 4.296875 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 8 x 8 [Level 0 step 6] ADVANCE at time 0.015625 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -4.33680869e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.050217247e-08 MLMG: Final Iter. 8 resid, resid/bnorm = 9.808164866e-20, 6.614682241e-14 MLMG: Timers: Solve = 0.611908177 Iter = 0.560714071 Bottom = 0.004346966 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting 1.19262239e-18 to ensure solvability MLMG: Initial rhs = 2.892150254e-08 MLMG: Initial residual (resid0) = 3.873110818e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 3.890075324e-21, 1.004380073e-13 MLMG: Timers: Solve = 0.101770006 Iter = 0.094546168 Bottom = 0.001884071 moveKick ... updating velocity only [Level 0 step 6] Advanced 4096 cells [Level 1 step 11] ADVANCE at time 0.015625 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.641046646e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 2.530355834e-20, 4.684052527e-14 MLMG: Timers: Solve = 0.127845623 Iter = 0.117567662 Bottom = 0.00190067 moveKick ... updating velocity only [Level 1 step 11] Advanced 32768 cells [Level 2 step 21] ADVANCE at time 0.015625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.974077296e-20, 4.054242121e-14 MLMG: Timers: Solve = 0.130992619 Iter = 0.119082338 Bottom = 0.009824765 moveKick ... updating velocity only [Level 2 step 21] Advanced 11264 cells [Level 2 step 22] ADVANCE at time 0.01640625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 8.974077296e-20 MLMG: No iterations needed MLMG: Timers: Solve = 0.011942873 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.898474115e-19, 9.053176822e-14 MLMG: Timers: Solve = 0.130790312 Iter = 0.118862755 Bottom = 0.009710986 moveKick ... updating velocity only [Level 2 step 22] Advanced 11264 cells [Level 1 step 12] ADVANCE at time 0.0171875 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -4.683753385e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 9.484814095e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 7.050093448e-19, 4.75462317e-13 MLMG: Timers: Solve = 0.367505841 Iter = 0.332296198 Bottom = 0.001910115 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 3.704988249e-07 MLMG: Initial residual (resid0) = 3.495865805e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.0854264e-20, 2.929635202e-14 MLMG: Timers: Solve = 0.127916128 Iter = 0.117555931 Bottom = 0.001912369 moveKick ... updating velocity only [Level 1 step 12] Advanced 32768 cells [Level 2 step 23] ADVANCE at time 0.0171875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.131615442e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.293666534e-19, 4.675433137e-14 MLMG: Timers: Solve = 0.130269791 Iter = 0.118362532 Bottom = 0.009502469 moveKick ... updating velocity only [Level 2 step 23] Advanced 11264 cells [Level 2 step 24] ADVANCE at time 0.01796875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.293666534e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.011949031 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.793151269e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 1.876337469e-18, 6.326500387e-13 MLMG: Timers: Solve = 0.116539804 Iter = 0.104615907 Bottom = 0.008608004 moveKick ... updating velocity only [Level 2 step 24] Advanced 11264 cells [STEP 6] Coarse TimeStep time: 4.353722095 [STEP 6] FAB kilobyte spread across MPI nodes: [68665 ... 68773] STEP = 6 TIME = 0.01875 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.01875 by dt = 0.003125 Old / new A time 0.01875 0.021875 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.040969817 new finest: 2 Setting the current time in the state data to 0.01875 Setting the current time in the state data to 0.01875 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -5.724587471e-17 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 7.247393028e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 3.38799944e-19, 1.142341403e-13 MLMG: Timers: Solve = 0.53641005 Iter = 0.486173108 Bottom = 0.001864132 STEP = 6 TIME = 0.01875 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 14 grids 7168 cells 2.734375 % of domain smallest grid: 8 x 8 x 8 biggest grid: 8 x 8 x 8 [Level 0 step 7] ADVANCE at time 0.01875 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -5.724587471e-17 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 3.38799944e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.049677048 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -8.890457814e-18 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.734865479e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 5.037633328e-21, 7.485906077e-14 MLMG: Timers: Solve = 0.101102656 Iter = 0.093992404 Bottom = 0.00185112 moveKick ... updating velocity only [Level 0 step 7] Advanced 4096 cells [Level 1 step 13] ADVANCE at time 0.01875 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.57065785e-07 MLMG: Final Iter. 6 resid, resid/bnorm = 4.290383178e-19, 7.942116244e-13 MLMG: Timers: Solve = 0.111456614 Iter = 0.101206507 Bottom = 0.001625948 moveKick ... updating velocity only [Level 1 step 13] Advanced 32768 cells [Level 2 step 25] ADVANCE at time 0.01875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 2.645375349e-18, 9.560636564e-13 MLMG: Timers: Solve = 0.114770183 Iter = 0.102938252 Bottom = 0.00655638 moveKick ... updating velocity only [Level 2 step 25] Advanced 7168 cells [Level 2 step 26] ADVANCE at time 0.01953125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.645375349e-18 MLMG: No iterations needed MLMG: Timers: Solve = 0.011849542 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.650467071e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.633182816e-19, 6.161867975e-14 MLMG: Timers: Solve = 0.129334245 Iter = 0.117502201 Bottom = 0.00752403 moveKick ... updating velocity only [Level 2 step 26] Advanced 7168 cells [Level 1 step 14] ADVANCE at time 0.0203125 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -7.632783294e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 9.957448238e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 5.798059431e-19, 3.910244299e-13 MLMG: Timers: Solve = 0.363909801 Iter = 0.329636084 Bottom = 0.001895379 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.444676299e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.456694722e-20, 1.003488985e-13 MLMG: Timers: Solve = 0.127811404 Iter = 0.11746692 Bottom = 0.001897704 moveKick ... updating velocity only [Level 1 step 14] Advanced 32768 cells [Level 2 step 27] ADVANCE at time 0.0203125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.68804341e-20, 3.925019853e-14 MLMG: Timers: Solve = 0.129266543 Iter = 0.117438616 Bottom = 0.00749138 moveKick ... updating velocity only [Level 2 step 27] Advanced 7168 cells [Level 2 step 28] ADVANCE at time 0.02109375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 8.68804341e-20 MLMG: No iterations needed MLMG: Timers: Solve = 0.01186329 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 7 resid, resid/resid0 = 1.168935091e-18, 5.574253548e-13 MLMG: Timers: Solve = 0.114990505 Iter = 0.103161343 Bottom = 0.006638917 moveKick ... updating velocity only [Level 2 step 28] Advanced 7168 cells [STEP 7] Coarse TimeStep time: 4.518305739 [STEP 7] FAB kilobyte spread across MPI nodes: [68665 ... 68773] STEP = 7 TIME = 0.021875 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.021875 by dt = 0.003125 Old / new A time 0.021875 0.025 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.018469186 new finest: 2 Setting the current time in the state data to 0.021875 Calling redistribute because BoxArray changed TIME = 0.021875 : REGRID with lbase = 1 Level 2 36 grids 46080 cells 17.578125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 8] ADVANCE at time 0.021875 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -6.071532166e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.380180577e-07 MLMG: Final Iter. 8 resid, resid/bnorm = 9.678855857e-20, 6.527475509e-14 MLMG: Timers: Solve = 0.703296841 Iter = 0.636707336 Bottom = 0.00434759 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -1.940721889e-17 to ensure solvability MLMG: Initial rhs = 1.432880048e-08 MLMG: Initial residual (resid0) = 4.198898866e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 2.643669238e-21, 6.296101245e-14 MLMG: Timers: Solve = 0.102856285 Iter = 0.095731257 Bottom = 0.003072601 moveKick ... updating velocity only [Level 0 step 8] Advanced 4096 cells [Level 1 step 15] ADVANCE at time 0.021875 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.593886225e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 3.714992208e-20, 6.876984814e-14 MLMG: Timers: Solve = 0.128936078 Iter = 0.118644514 Bottom = 0.002869579 moveKick ... updating velocity only [Level 1 step 15] Advanced 32768 cells [Level 2 step 29] ADVANCE at time 0.021875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 6.046014575e-19, 2.731423649e-13 MLMG: Timers: Solve = 0.183143021 Iter = 0.161312252 Bottom = 0.033805121 moveKick ... updating velocity only [Level 2 step 29] Advanced 46080 cells [Level 2 step 30] ADVANCE at time 0.02265625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 6.046014575e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.021972064 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.033858639e-19, 2.877341795e-13 MLMG: Timers: Solve = 0.182388455 Iter = 0.160549138 Bottom = 0.033015899 moveKick ... updating velocity only [Level 2 step 30] Advanced 46080 cells [Level 1 step 16] ADVANCE at time 0.0234375 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -5.377642776e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 3.198732139e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.423800495e-19, 1.634624857e-13 MLMG: Timers: Solve = 0.455385704 Iter = 0.404944799 Bottom = 0.003747188 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113486436e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.30145877e-20, 1.060373584e-13 MLMG: Timers: Solve = 0.129770935 Iter = 0.119352398 Bottom = 0.003630366 moveKick ... updating velocity only [Level 1 step 16] Advanced 32768 cells [Level 2 step 31] ADVANCE at time 0.0234375 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.947721897e-19, 2.235245124e-13 MLMG: Timers: Solve = 0.182514657 Iter = 0.160683157 Bottom = 0.032806225 moveKick ... updating velocity only [Level 2 step 31] Advanced 46080 cells [Level 2 step 32] ADVANCE at time 0.02421875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 4.947721897e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.021983051 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.13258893e-18, 5.400931078e-13 MLMG: Timers: Solve = 0.180916019 Iter = 0.159028574 Bottom = 0.032619773 moveKick ... updating velocity only [Level 2 step 32] Advanced 46080 cells [STEP 8] Coarse TimeStep time: 6.922323538 [STEP 8] FAB kilobyte spread across MPI nodes: [68665 ... 68773] STEP = 8 TIME = 0.025 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.025 by dt = 0.003125 Old / new A time 0.025 0.028125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.05245967 new finest: 2 Setting the current time in the state data to 0.025 Setting the current time in the state data to 0.025 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -5.421010862e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 7.152210038e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.451234928e-18, 9.787211e-13 MLMG: Timers: Solve = 0.642481534 Iter = 0.572195157 Bottom = 0.00402398 STEP = 8 TIME = 0.025 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 9] ADVANCE at time 0.025 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -5.421010862e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.451234928e-18 MLMG: No iterations needed MLMG: Timers: Solve = 0.069902614 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -5.984795992e-17 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.789252198e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.438528446e-21, 3.623645018e-14 MLMG: Timers: Solve = 0.102596664 Iter = 0.095462736 Bottom = 0.003013024 moveKick ... updating velocity only [Level 0 step 9] Advanced 4096 cells [Level 1 step 17] ADVANCE at time 0.025 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.573042079e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.613922433e-20, 2.987602514e-14 MLMG: Timers: Solve = 0.129022527 Iter = 0.118717823 Bottom = 0.003053458 moveKick ... updating velocity only [Level 1 step 17] Advanced 32768 cells [Level 2 step 33] ADVANCE at time 0.025 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 3.426379587e-19, 1.547944372e-13 MLMG: Timers: Solve = 0.192299685 Iter = 0.168502304 Bottom = 0.037559742 moveKick ... updating velocity only [Level 2 step 33] Advanced 53248 cells [Level 2 step 34] ADVANCE at time 0.02578125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 3.426379587e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.023972696 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.110209994e-19, 2.913751158e-13 MLMG: Timers: Solve = 0.193503979 Iter = 0.169617722 Bottom = 0.037854724 moveKick ... updating velocity only [Level 2 step 34] Advanced 53248 cells [Level 1 step 18] ADVANCE at time 0.0265625 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -6.505213035e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 8.380401878e-10 MLMG: Final Iter. 6 resid, resid/bnorm = 9.772967297e-19, 6.5909448e-13 MLMG: Timers: Solve = 0.416932143 Iter = 0.363033996 Bottom = 0.003213112 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113485678e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 4.645911609e-20, 1.492189812e-13 MLMG: Timers: Solve = 0.129154714 Iter = 0.118729429 Bottom = 0.003156845 moveKick ... updating velocity only [Level 1 step 18] Advanced 32768 cells [Level 2 step 35] ADVANCE at time 0.0265625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.916647307e-19, 2.221206476e-13 MLMG: Timers: Solve = 0.193035399 Iter = 0.169168113 Bottom = 0.037645197 moveKick ... updating velocity only [Level 2 step 35] Advanced 53248 cells [Level 2 step 36] ADVANCE at time 0.02734375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 4.916647307e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.023973917 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 2.57444456e-19, 1.227664978e-13 MLMG: Timers: Solve = 0.193049984 Iter = 0.169171292 Bottom = 0.038099914 moveKick ... updating velocity only [Level 2 step 36] Advanced 53248 cells [STEP 9] Coarse TimeStep time: 7.772620098 [STEP 9] FAB kilobyte spread across MPI nodes: [68665 ... 68773] STEP = 9 TIME = 0.028125 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.028125 by dt = 0.003125 Old / new A time 0.028125 0.03125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.025115393 new finest: 2 Setting the current time in the state data to 0.028125 Calling redistribute because BoxArray changed TIME = 0.028125 : REGRID with lbase = 1 Level 2 15 grids 11264 cells 4.296875 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 8 x 8 [Level 0 step 10] ADVANCE at time 0.028125 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -8.239936511e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.050217247e-08 MLMG: Final Iter. 8 resid, resid/bnorm = 9.768361969e-20, 6.587838941e-14 MLMG: Timers: Solve = 0.615003766 Iter = 0.563828019 Bottom = 0.004415774 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -1.198585502e-16 to ensure solvability MLMG: Initial rhs = 2.892150254e-08 MLMG: Initial residual (resid0) = 3.873110818e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 3.890023626e-21, 1.004366724e-13 MLMG: Timers: Solve = 0.101526403 Iter = 0.094379521 Bottom = 0.001900819 moveKick ... updating velocity only [Level 0 step 10] Advanced 4096 cells [Level 1 step 19] ADVANCE at time 0.028125 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.641046646e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 2.530707385e-20, 4.6847033e-14 MLMG: Timers: Solve = 0.127860808 Iter = 0.117579485 Bottom = 0.001942525 moveKick ... updating velocity only [Level 1 step 19] Advanced 32768 cells [Level 2 step 37] ADVANCE at time 0.028125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.974702851e-20, 4.05452473e-14 MLMG: Timers: Solve = 0.130835289 Iter = 0.118907598 Bottom = 0.009886014 moveKick ... updating velocity only [Level 2 step 37] Advanced 11264 cells [Level 2 step 38] ADVANCE at time 0.02890625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 8.974702851e-20 MLMG: No iterations needed MLMG: Timers: Solve = 0.011964384 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.898419314e-19, 9.052915496e-14 MLMG: Timers: Solve = 0.130908028 Iter = 0.118963404 Bottom = 0.009906051 moveKick ... updating velocity only [Level 2 step 38] Advanced 11264 cells [Level 1 step 20] ADVANCE at time 0.0296875 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -6.678685383e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 9.484814095e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 7.04982875e-19, 4.754444656e-13 MLMG: Timers: Solve = 0.367332914 Iter = 0.332135766 Bottom = 0.001936688 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 3.704988249e-07 MLMG: Initial residual (resid0) = 3.495865805e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.085684894e-20, 2.930332893e-14 MLMG: Timers: Solve = 0.127947247 Iter = 0.11754915 Bottom = 0.001936376 moveKick ... updating velocity only [Level 1 step 20] Advanced 32768 cells [Level 2 step 39] ADVANCE at time 0.0296875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.131615442e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.293591054e-19, 4.675160344e-14 MLMG: Timers: Solve = 0.130630652 Iter = 0.118694339 Bottom = 0.009503127 moveKick ... updating velocity only [Level 2 step 39] Advanced 11264 cells [Level 2 step 40] ADVANCE at time 0.03046875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.293591054e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.011969924 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.793151269e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 1.87631436e-18, 6.326422468e-13 MLMG: Timers: Solve = 0.116442089 Iter = 0.104512088 Bottom = 0.008669598 moveKick ... updating velocity only [Level 2 step 40] Advanced 11264 cells [STEP 10] Coarse TimeStep time: 4.355491822 [STEP 10] FAB kilobyte spread across MPI nodes: [68665 ... 68773] STEP = 10 TIME = 0.03125 DT = 0.003125 PLOTFILE: file = Part-2line_plt00010 Output file Part-2line_plt00010.temp at time 1.000000 and step 10 Write plotfile time = 0.14334678 seconds Time w/o init: 58.03140644 Run time = 59.87675563 Unused ParmParse Variables: [TOP]::amr.probin_file(nvals = 1) :: [] [TOP]::particles.particle_output_file(nvals = 1) :: [final_particles] Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [7511 ... 7521] [The Arena] max space (MB) allocated spread across MPI: [81 ... 81] [The Arena] max space (MB) used spread across MPI: [77 ... 77] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [16 ... 16] [The Pinned Arena] max space (MB) used spread across MPI: [8 ... 8] AMReX (26.09-122-ga846c6a9c672) finalized