Initializing AMReX (26.09-155-g14ffe112f87b)... MPI initialized with 2 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.09-155-g14ffe112f87b) initialized Successfully read inputs file ... AMReX git describe: 26.09-155-g14ffe112f8 Nyx git describe: 26.09 Nyx::hydro_tile_size unset, using fabarray.mfiter_tile_size default: (1024000,1024000,1024000) Suggested default for currently compiled CPU / GPU: nyx.hydro_tile_size=(1048576,1048576,1048576) Nyx::sundials_tile_size unset, using fabarray.mfiter_tile_size default: (1024000,1024000,1024000) Suggested default for currently compiled CPU / GPU: nyx.sundials_tile_size=(1048576,1048576,1048576) Nyx::setting init_sb_vels to 0 since do_santa_barbara = 0 2 Species: H He Successfully read inputs file ... Getting Gconst from nyx_constants: 4.300927161e-09 Using -5.404704468e-08 for 4 pi G in Gravity.cpp Initializing the data at level 0 ... setting particle_initrandom_mass to 2.123188769e+11 by dividing 8.696581196e+14 by 4096 Initializing DM particles from "particle_file.2line" ... Redistributing from processor 0 to 0 Redistributing from processor 1 to 1 Total number of particles: 16 Average gas density 1 Average dm density 0.0048828125 Average total density 1.004882812 Done initializing the level 0 data ...estdt from hydro at level 0: 0.54 ...estdt from particles at level 0: 0.003125 Nyx::est_time_step at level 0: estdt = 0.003125 Integrating a from time 0 by dt = 0.003125 Old / new A time 0 0.003125 Old / new A 1 1 Old / new z 0 0 grid_places() time: 0.005616896 new finest: 1 Initializing the data at level 1 BA SIZE 0 FLEV 1 Calling redistribute because the size of BoxArray changed Done initializing the level 1 data grid_places() time: 0.010869262 new finest: 2 Initializing the data at level 2 BA SIZE 2 FLEV 2 Calling redistribute because the size of BoxArray changed Done initializing the level 2 data Now regridding at level lbase = 0 grid_places() time: 0.039363903 new finest: 2 Initializing the data at level 1 Calling redistribute because BoxArray changed Done initializing the level 1 data Initializing the data at level 2 Calling redistribute because BoxArray changed Done initializing the level 2 data NOT calling redistribute because NOT changed STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 Now regridding at level lbase = 0 grid_places() time: 0.051941609 new finest: 2 Regridding at level lbase = 0 but grids unchanged Setting the current time in the state data to 0 Setting the current time in the state data to 0 Setting the current time in the state data to 0 NOT calling redistribute because NOT changed Gravity ... defining average density in Gravity::set_mass_offset to be 1.004882812 Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 7.676236084e-19, 5.17689733e-13 MLMG: Timers: Solve = 0.691012861 Iter = 0.625395005 Bottom = 0.004469624 Average gas density 1 Average dm density 0.0048828125 Average total density 1.004882812 Average temperature 471.6564507 ... setting small_dens to 1e-06 ... setting small_temp to 0.0004716564507 ... setting small_pres to 6.666666667e-12 INITIAL GRIDS Level 0 2 grids 4096 cells 100 % of domain smallest grid: 16 x 16 x 8 biggest grid: 16 x 16 x 8 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 CHECKPOINT: file = Part-2line_restart_chk00000 checkPoint() time = 0.061489746 secs. PLOTFILE: file = Part-2line_restart_plt00000 Output file Part-2line_restart_plt00000.temp at time 1.000000 and step 0 Write plotfile time = 0.263691774 seconds ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Re-integrating a from time 0 by dt = 0.003125 Old / new A time 0 0.003125 Old / new A 1 1 Old / new z 0 0 [Level 0 step 1] ADVANCE at time 0 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 7.676236084e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.056884833 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -1.387778781e-17 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.789252198e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.438476747e-21, 3.623568194e-14 MLMG: Timers: Solve = 0.101022021 Iter = 0.094044288 Bottom = 0.00285149 moveKick ... updating velocity only [Level 0 step 1] Advanced 4096 cells [Level 1 step 1] ADVANCE at time 0 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.573042079e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.613782846e-20, 2.987344119e-14 MLMG: Timers: Solve = 0.12683699 Iter = 0.116754189 Bottom = 0.002804911 moveKick ... updating velocity only [Level 1 step 1] Advanced 32768 cells [Level 2 step 1] ADVANCE at time 0 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 3.42642198e-19, 1.547963524e-13 MLMG: Timers: Solve = 0.194877283 Iter = 0.169772274 Bottom = 0.039557927 moveKick ... updating velocity only [Level 2 step 1] Advanced 53248 cells [Level 2 step 2] ADVANCE at time 0.00078125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 3.42642198e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.025047359 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.110387321e-19, 2.913835719e-13 MLMG: Timers: Solve = 0.194678876 Iter = 0.169570412 Bottom = 0.039490407 moveKick ... updating velocity only [Level 2 step 2] Advanced 53248 cells [Level 1 step 2] ADVANCE at time 0.0015625 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -9.540979118e-18 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 8.380401878e-10 MLMG: Final Iter. 6 resid, resid/bnorm = 9.773033472e-19, 6.590989429e-13 MLMG: Timers: Solve = 0.393206771 Iter = 0.345857592 Bottom = 0.003004797 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113485678e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 4.646909396e-20, 1.492510285e-13 MLMG: Timers: Solve = 0.12706516 Iter = 0.11694046 Bottom = 0.003022679 moveKick ... updating velocity only [Level 1 step 2] Advanced 32768 cells [Level 2 step 3] ADVANCE at time 0.0015625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.917003511e-19, 2.2213674e-13 MLMG: Timers: Solve = 0.194920553 Iter = 0.16982782 Bottom = 0.039646336 moveKick ... updating velocity only [Level 2 step 3] Advanced 53248 cells [Level 2 step 4] ADVANCE at time 0.00234375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 4.917003511e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.025160868 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 2.574131783e-19, 1.227515825e-13 MLMG: Timers: Solve = 0.195099848 Iter = 0.169998179 Bottom = 0.039905246 moveKick ... updating velocity only [Level 2 step 4] Advanced 53248 cells [STEP 1] Coarse TimeStep time: 6.520382013 [STEP 1] FAB kilobyte spread across MPI nodes: [62332 ... 68773] STEP = 1 TIME = 0.003125 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.003125 by dt = 0.003125 Old / new A time 0.003125 0.00625 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.024475406 new finest: 2 Setting the current time in the state data to 0.003125 Calling redistribute because BoxArray changed TIME = 0.003125 : REGRID with lbase = 1 Level 2 15 grids 11264 cells 4.296875 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 8 x 8 [Level 0 step 2] ADVANCE at time 0.003125 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -3.6429193e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.050217247e-08 MLMG: Final Iter. 8 resid, resid/bnorm = 9.793808113e-20, 6.604999965e-14 MLMG: Timers: Solve = 0.586310549 Iter = 0.545959911 Bottom = 0.004221165 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -1.789746736e-16 to ensure solvability MLMG: Initial rhs = 2.892150254e-08 MLMG: Initial residual (resid0) = 3.873110818e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 3.890023626e-21, 1.004366724e-13 MLMG: Timers: Solve = 0.100104245 Iter = 0.093052755 Bottom = 0.001824413 moveKick ... updating velocity only [Level 0 step 2] Advanced 4096 cells [Level 1 step 3] ADVANCE at time 0.003125 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.641046646e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 2.529564842e-20, 4.682588288e-14 MLMG: Timers: Solve = 0.12606819 Iter = 0.115980658 Bottom = 0.001856515 moveKick ... updating velocity only [Level 1 step 3] Advanced 32768 cells [Level 2 step 5] ADVANCE at time 0.003125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.973942879e-20, 4.054181396e-14 MLMG: Timers: Solve = 0.132249432 Iter = 0.119707125 Bottom = 0.009649334 moveKick ... updating velocity only [Level 2 step 5] Advanced 11264 cells [Level 2 step 6] ADVANCE at time 0.00390625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 8.973942879e-20 MLMG: No iterations needed MLMG: Timers: Solve = 0.012597008 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.898275074e-19, 9.052227666e-14 MLMG: Timers: Solve = 0.132183093 Iter = 0.119630279 Bottom = 0.009677871 moveKick ... updating velocity only [Level 2 step 6] Advanced 11264 cells [Level 1 step 4] ADVANCE at time 0.0046875 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -5.464378949e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 9.484814095e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 7.050490495e-19, 4.754890941e-13 MLMG: Timers: Solve = 0.35739923 Iter = 0.323498374 Bottom = 0.001865009 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 3.704988249e-07 MLMG: Initial residual (resid0) = 3.495865805e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.084909412e-20, 2.928239818e-14 MLMG: Timers: Solve = 0.126087364 Iter = 0.115948029 Bottom = 0.001921065 moveKick ... updating velocity only [Level 1 step 4] Advanced 32768 cells [Level 2 step 7] ADVANCE at time 0.0046875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.131615442e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.294425989e-19, 4.678177879e-14 MLMG: Timers: Solve = 0.131759402 Iter = 0.119213431 Bottom = 0.009316012 moveKick ... updating velocity only [Level 2 step 7] Advanced 11264 cells [Level 2 step 8] ADVANCE at time 0.00546875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.294425989e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.012568181 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.793151269e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 1.876326767e-18, 6.326464304e-13 MLMG: Timers: Solve = 0.117638363 Iter = 0.105074321 Bottom = 0.008543814 moveKick ... updating velocity only [Level 2 step 8] Advanced 11264 cells [STEP 2] Coarse TimeStep time: 4.309398306 [STEP 2] FAB kilobyte spread across MPI nodes: [62332 ... 68773] STEP = 2 TIME = 0.00625 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.00625 by dt = 0.003125 Old / new A time 0.00625 0.009375 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.040086817 new finest: 2 Setting the current time in the state data to 0.00625 Setting the current time in the state data to 0.00625 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -3.729655473e-17 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 7.247393028e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 3.387656677e-19, 1.142225833e-13 MLMG: Timers: Solve = 0.525670622 Iter = 0.476730166 Bottom = 0.001853948 STEP = 2 TIME = 0.00625 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 14 grids 7168 cells 2.734375 % of domain smallest grid: 8 x 8 x 8 biggest grid: 8 x 8 x 8 [Level 0 step 3] ADVANCE at time 0.00625 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -3.729655473e-17 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 3.387656677e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.045834739 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -5.486062993e-17 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.734865479e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 5.038046918e-21, 7.48652067e-14 MLMG: Timers: Solve = 0.100070476 Iter = 0.093073867 Bottom = 0.001833446 moveKick ... updating velocity only [Level 0 step 3] Advanced 4096 cells [Level 1 step 5] ADVANCE at time 0.00625 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.57065785e-07 MLMG: Final Iter. 6 resid, resid/bnorm = 4.290316487e-19, 7.941992788e-13 MLMG: Timers: Solve = 0.11012679 Iter = 0.100007039 Bottom = 0.001791696 moveKick ... updating velocity only [Level 1 step 5] Advanced 32768 cells [Level 2 step 9] ADVANCE at time 0.00625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 2.645318067e-18, 9.560429541e-13 MLMG: Timers: Solve = 0.113368007 Iter = 0.101695554 Bottom = 0.006512565 moveKick ... updating velocity only [Level 2 step 9] Advanced 7168 cells [Level 2 step 10] ADVANCE at time 0.00703125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.645318067e-18 MLMG: No iterations needed MLMG: Timers: Solve = 0.011684311 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.650467071e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.632941383e-19, 6.160957066e-14 MLMG: Timers: Solve = 0.127570821 Iter = 0.11587972 Bottom = 0.007486357 moveKick ... updating velocity only [Level 2 step 10] Advanced 7168 cells [Level 1 step 6] ADVANCE at time 0.0078125 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -2.949029909e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 9.957448238e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 5.79742974e-19, 3.909819632e-13 MLMG: Timers: Solve = 0.355245549 Iter = 0.322027287 Bottom = 0.001899597 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.444676299e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.456312151e-20, 1.003377923e-13 MLMG: Timers: Solve = 0.126250124 Iter = 0.116102414 Bottom = 0.001881714 moveKick ... updating velocity only [Level 1 step 6] Advanced 32768 cells [Level 2 step 11] ADVANCE at time 0.0078125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.709219233e-20, 3.934586509e-14 MLMG: Timers: Solve = 0.127433199 Iter = 0.115761613 Bottom = 0.007427567 moveKick ... updating velocity only [Level 2 step 11] Advanced 7168 cells [Level 2 step 12] ADVANCE at time 0.00859375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 8.709219233e-20 MLMG: No iterations needed MLMG: Timers: Solve = 0.01169355 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 7 resid, resid/resid0 = 1.168910379e-18, 5.574135704e-13 MLMG: Timers: Solve = 0.113481984 Iter = 0.101808272 Bottom = 0.006591386 moveKick ... updating velocity only [Level 2 step 12] Advanced 7168 cells [STEP 3] Coarse TimeStep time: 4.432768461 [STEP 3] FAB kilobyte spread across MPI nodes: [62332 ... 68773] STEP = 3 TIME = 0.009375 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.009375 by dt = 0.003125 Old / new A time 0.009375 0.0125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.018274099 new finest: 2 Setting the current time in the state data to 0.009375 Calling redistribute because BoxArray changed TIME = 0.009375 : REGRID with lbase = 1 Level 2 36 grids 46080 cells 17.578125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 4] ADVANCE at time 0.009375 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -3.295974604e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.380180577e-07 MLMG: Final Iter. 8 resid, resid/bnorm = 9.688823384e-20, 6.534197665e-14 MLMG: Timers: Solve = 0.691943415 Iter = 0.626922786 Bottom = 0.004322269 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -1.626303259e-17 to ensure solvability MLMG: Initial rhs = 1.432880048e-08 MLMG: Initial residual (resid0) = 4.198898866e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 2.645323599e-21, 6.300041233e-14 MLMG: Timers: Solve = 0.101403608 Iter = 0.094364184 Bottom = 0.003048529 moveKick ... updating velocity only [Level 0 step 4] Advanced 4096 cells [Level 1 step 7] ADVANCE at time 0.009375 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.593886225e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 3.714868131e-20, 6.876755129e-14 MLMG: Timers: Solve = 0.127086129 Iter = 0.116862345 Bottom = 0.002806028 moveKick ... updating velocity only [Level 1 step 7] Advanced 32768 cells [Level 2 step 13] ADVANCE at time 0.009375 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 6.047218122e-19, 2.731967379e-13 MLMG: Timers: Solve = 0.181022399 Iter = 0.159491862 Bottom = 0.03345199 moveKick ... updating velocity only [Level 2 step 13] Advanced 46080 cells [Level 2 step 14] ADVANCE at time 0.01015625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 6.047218122e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.021623775 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.034345124e-19, 2.877573784e-13 MLMG: Timers: Solve = 0.180351919 Iter = 0.158762351 Bottom = 0.032753317 moveKick ... updating velocity only [Level 2 step 14] Advanced 46080 cells [Level 1 step 8] ADVANCE at time 0.0109375 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -4.770489559e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 3.198732139e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.42350271e-19, 1.634424029e-13 MLMG: Timers: Solve = 0.448572812 Iter = 0.399135411 Bottom = 0.003660487 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113486436e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.300936613e-20, 1.060205876e-13 MLMG: Timers: Solve = 0.127876277 Iter = 0.117602193 Bottom = 0.00359458 moveKick ... updating velocity only [Level 1 step 8] Advanced 32768 cells [Level 2 step 15] ADVANCE at time 0.0109375 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.947588514e-19, 2.235184866e-13 MLMG: Timers: Solve = 0.179762198 Iter = 0.158192044 Bottom = 0.032509111 moveKick ... updating velocity only [Level 2 step 15] Advanced 46080 cells [Level 2 step 16] ADVANCE at time 0.01171875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 4.947588514e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.02166409 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.132694809e-18, 5.401435979e-13 MLMG: Timers: Solve = 0.179656038 Iter = 0.158102807 Bottom = 0.032224062 moveKick ... updating velocity only [Level 2 step 16] Advanced 46080 cells [STEP 4] Coarse TimeStep time: 6.820469531 [STEP 4] FAB kilobyte spread across MPI nodes: [63145 ... 68773] STEP = 4 TIME = 0.0125 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.0125 by dt = 0.003125 Old / new A time 0.0125 0.015625 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.051621501 new finest: 2 Setting the current time in the state data to 0.0125 Setting the current time in the state data to 0.0125 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -6.635317296e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 7.152210038e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.451130393e-18, 9.78650601e-13 MLMG: Timers: Solve = 0.6311354 Iter = 0.562714789 Bottom = 0.003991415 STEP = 4 TIME = 0.0125 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 5] ADVANCE at time 0.0125 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -6.635317296e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.451130393e-18 MLMG: No iterations needed MLMG: Timers: Solve = 0.068522124 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -1.604619215e-17 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.789252198e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.438580145e-21, 3.623721842e-14 MLMG: Timers: Solve = 0.101353068 Iter = 0.094265561 Bottom = 0.0030151 moveKick ... updating velocity only [Level 0 step 5] Advanced 4096 cells [Level 1 step 9] ADVANCE at time 0.0125 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.573042079e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.613725978e-20, 2.987238847e-14 MLMG: Timers: Solve = 0.127232337 Iter = 0.117065168 Bottom = 0.003055636 moveKick ... updating velocity only [Level 1 step 9] Advanced 32768 cells [Level 2 step 17] ADVANCE at time 0.0125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 3.426338228e-19, 1.547925687e-13 MLMG: Timers: Solve = 0.189562589 Iter = 0.16606318 Bottom = 0.037047223 moveKick ... updating velocity only [Level 2 step 17] Advanced 53248 cells [Level 2 step 18] ADVANCE at time 0.01328125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 3.426338228e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.02364925 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.110344411e-19, 2.913815257e-13 MLMG: Timers: Solve = 0.189904295 Iter = 0.166333946 Bottom = 0.037246412 moveKick ... updating velocity only [Level 2 step 18] Advanced 53248 cells [Level 1 step 10] ADVANCE at time 0.0140625 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -4.987329993e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 8.380401878e-10 MLMG: Final Iter. 6 resid, resid/bnorm = 9.772987977e-19, 6.590958747e-13 MLMG: Timers: Solve = 0.409777094 Iter = 0.356384283 Bottom = 0.003159972 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113485678e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 4.645239525e-20, 1.49197395e-13 MLMG: Timers: Solve = 0.127988174 Iter = 0.11768916 Bottom = 0.003363852 moveKick ... updating velocity only [Level 1 step 10] Advanced 32768 cells [Level 2 step 19] ADVANCE at time 0.0140625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.916889774e-19, 2.221316016e-13 MLMG: Timers: Solve = 0.191778421 Iter = 0.16806705 Bottom = 0.037584074 moveKick ... updating velocity only [Level 2 step 19] Advanced 53248 cells [Level 2 step 20] ADVANCE at time 0.01484375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 4.916889774e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.023872509 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 2.57439648e-19, 1.22764205e-13 MLMG: Timers: Solve = 0.191855238 Iter = 0.16811746 Bottom = 0.03788769 moveKick ... updating velocity only [Level 2 step 20] Advanced 53248 cells [STEP 5] Coarse TimeStep time: 7.675215544 [STEP 5] FAB kilobyte spread across MPI nodes: [68665 ... 68773] STEP = 5 TIME = 0.015625 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.015625 by dt = 0.003125 Old / new A time 0.015625 0.01875 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.024767764 new finest: 2 Setting the current time in the state data to 0.015625 Calling redistribute because BoxArray changed TIME = 0.015625 : REGRID with lbase = 1 Level 2 15 grids 11264 cells 4.296875 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 8 x 8 [Level 0 step 6] ADVANCE at time 0.015625 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -4.33680869e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.050217247e-08 MLMG: Final Iter. 8 resid, resid/bnorm = 9.789636021e-20, 6.602186282e-14 MLMG: Timers: Solve = 0.608484806 Iter = 0.557480518 Bottom = 0.004380192 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting 1.19262239e-18 to ensure solvability MLMG: Initial rhs = 2.892150254e-08 MLMG: Initial residual (resid0) = 3.873110818e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 3.889868529e-21, 1.00432668e-13 MLMG: Timers: Solve = 0.100888336 Iter = 0.093794137 Bottom = 0.001875304 moveKick ... updating velocity only [Level 0 step 6] Advanced 4096 cells [Level 1 step 11] ADVANCE at time 0.015625 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.641046646e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 2.530474741e-20, 4.684272642e-14 MLMG: Timers: Solve = 0.127006936 Iter = 0.116793642 Bottom = 0.001938008 moveKick ... updating velocity only [Level 1 step 11] Advanced 32768 cells [Level 2 step 21] ADVANCE at time 0.015625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.970106829e-20, 4.052448373e-14 MLMG: Timers: Solve = 0.129870985 Iter = 0.118041786 Bottom = 0.009771332 moveKick ... updating velocity only [Level 2 step 21] Advanced 11264 cells [Level 2 step 22] ADVANCE at time 0.01640625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 8.970106829e-20 MLMG: No iterations needed MLMG: Timers: Solve = 0.011851271 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.898534085e-19, 9.053462801e-14 MLMG: Timers: Solve = 0.129867805 Iter = 0.118011018 Bottom = 0.009695766 moveKick ... updating velocity only [Level 2 step 22] Advanced 11264 cells [Level 1 step 12] ADVANCE at time 0.0171875 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -4.683753385e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 9.484814095e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 7.050093448e-19, 4.75462317e-13 MLMG: Timers: Solve = 0.365382136 Iter = 0.330583345 Bottom = 0.001914895 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 3.704988249e-07 MLMG: Initial residual (resid0) = 3.495865805e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.0854264e-20, 2.929635202e-14 MLMG: Timers: Solve = 0.12695113 Iter = 0.116674961 Bottom = 0.001921782 moveKick ... updating velocity only [Level 1 step 12] Advanced 32768 cells [Level 2 step 23] ADVANCE at time 0.0171875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.131615442e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.293931232e-19, 4.676389779e-14 MLMG: Timers: Solve = 0.129501644 Iter = 0.117735563 Bottom = 0.009409362 moveKick ... updating velocity only [Level 2 step 23] Advanced 11264 cells [Level 2 step 24] ADVANCE at time 0.01796875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.293931232e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.01186306 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.793151269e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 1.876297764e-18, 6.326366514e-13 MLMG: Timers: Solve = 0.115656243 Iter = 0.10382341 Bottom = 0.008632115 moveKick ... updating velocity only [Level 2 step 24] Advanced 11264 cells [STEP 6] Coarse TimeStep time: 4.327676851 [STEP 6] FAB kilobyte spread across MPI nodes: [68665 ... 68773] STEP = 6 TIME = 0.01875 DT = 0.003125 CHECKPOINT: file = Part-2line_restart_chk00006 checkPoint() time = 0.031665176 secs. ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.01875 by dt = 0.003125 Old / new A time 0.01875 0.021875 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.040542717 new finest: 2 Setting the current time in the state data to 0.01875 Setting the current time in the state data to 0.01875 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -5.724587471e-17 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 7.247393028e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 3.389330684e-19, 1.142790262e-13 MLMG: Timers: Solve = 0.532563684 Iter = 0.482852784 Bottom = 0.001896583 STEP = 6 TIME = 0.01875 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 14 grids 7168 cells 2.734375 % of domain smallest grid: 8 x 8 x 8 biggest grid: 8 x 8 x 8 [Level 0 step 7] ADVANCE at time 0.01875 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -5.724587471e-17 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 3.389330684e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.049534823 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -8.890457814e-18 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.734865479e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 5.037943521e-21, 7.486367022e-14 MLMG: Timers: Solve = 0.101099094 Iter = 0.094045145 Bottom = 0.001836136 moveKick ... updating velocity only [Level 0 step 7] Advanced 4096 cells [Level 1 step 13] ADVANCE at time 0.01875 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.57065785e-07 MLMG: Final Iter. 6 resid, resid/bnorm = 4.290217742e-19, 7.941809998e-13 MLMG: Timers: Solve = 0.110578876 Iter = 0.100412735 Bottom = 0.001627665 moveKick ... updating velocity only [Level 1 step 13] Advanced 32768 cells [Level 2 step 25] ADVANCE at time 0.01875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 2.645375349e-18, 9.560636564e-13 MLMG: Timers: Solve = 0.113942115 Iter = 0.102206427 Bottom = 0.006472814 moveKick ... updating velocity only [Level 2 step 25] Advanced 7168 cells [Level 2 step 26] ADVANCE at time 0.01953125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.645375349e-18 MLMG: No iterations needed MLMG: Timers: Solve = 0.011765151 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.650467071e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.633182816e-19, 6.161867975e-14 MLMG: Timers: Solve = 0.12830372 Iter = 0.116557209 Bottom = 0.007453276 moveKick ... updating velocity only [Level 2 step 26] Advanced 7168 cells [Level 1 step 14] ADVANCE at time 0.0203125 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -7.632783294e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 9.957448238e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 5.794883058e-19, 3.908102135e-13 MLMG: Timers: Solve = 0.361551819 Iter = 0.327424841 Bottom = 0.001891203 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.444676299e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.456663703e-20, 1.00347998e-13 MLMG: Timers: Solve = 0.127124064 Iter = 0.116888616 Bottom = 0.001894081 moveKick ... updating velocity only [Level 1 step 14] Advanced 32768 cells [Level 2 step 27] ADVANCE at time 0.0203125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.706572255e-20, 3.933390677e-14 MLMG: Timers: Solve = 0.128483402 Iter = 0.116741323 Bottom = 0.007434365 moveKick ... updating velocity only [Level 2 step 27] Advanced 7168 cells [Level 2 step 28] ADVANCE at time 0.02109375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 8.706572255e-20 MLMG: No iterations needed MLMG: Timers: Solve = 0.011755493 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 7 resid, resid/resid0 = 1.168855681e-18, 5.573874871e-13 MLMG: Timers: Solve = 0.114234254 Iter = 0.102479932 Bottom = 0.006591189 moveKick ... updating velocity only [Level 2 step 28] Advanced 7168 cells [STEP 7] Coarse TimeStep time: 4.484626445 [STEP 7] FAB kilobyte spread across MPI nodes: [68665 ... 68773] STEP = 7 TIME = 0.021875 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.021875 by dt = 0.003125 Old / new A time 0.021875 0.025 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.018491879 new finest: 2 Setting the current time in the state data to 0.021875 Calling redistribute because BoxArray changed TIME = 0.021875 : REGRID with lbase = 1 Level 2 36 grids 46080 cells 17.578125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 8] ADVANCE at time 0.021875 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -6.071532166e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.380180577e-07 MLMG: Final Iter. 8 resid, resid/bnorm = 9.677144627e-20, 6.526321446e-14 MLMG: Timers: Solve = 0.697243717 Iter = 0.631391514 Bottom = 0.00434449 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -1.940721889e-17 to ensure solvability MLMG: Initial rhs = 1.432880048e-08 MLMG: Initial residual (resid0) = 4.198898866e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 2.64697796e-21, 6.303981222e-14 MLMG: Timers: Solve = 0.102045196 Iter = 0.094945214 Bottom = 0.003092927 moveKick ... updating velocity only [Level 0 step 8] Advanced 4096 cells [Level 1 step 15] ADVANCE at time 0.021875 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.593886225e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 3.715033567e-20, 6.877061375e-14 MLMG: Timers: Solve = 0.127965816 Iter = 0.117770122 Bottom = 0.002855155 moveKick ... updating velocity only [Level 1 step 15] Advanced 32768 cells [Level 2 step 29] ADVANCE at time 0.021875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 6.046808668e-19, 2.731782399e-13 MLMG: Timers: Solve = 0.182381979 Iter = 0.160654518 Bottom = 0.033752654 moveKick ... updating velocity only [Level 2 step 29] Advanced 46080 cells [Level 2 step 30] ADVANCE at time 0.02265625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 6.046808668e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.021805458 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.033990987e-19, 2.877404908e-13 MLMG: Timers: Solve = 0.18192307 Iter = 0.160207975 Bottom = 0.032799812 moveKick ... updating velocity only [Level 2 step 30] Advanced 46080 cells [Level 1 step 16] ADVANCE at time 0.0234375 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -5.377642776e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 3.198732139e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.42350271e-19, 1.634424029e-13 MLMG: Timers: Solve = 0.45154069 Iter = 0.401449639 Bottom = 0.003725477 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113486436e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.30145877e-20, 1.060373584e-13 MLMG: Timers: Solve = 0.128929434 Iter = 0.118611333 Bottom = 0.003657728 moveKick ... updating velocity only [Level 1 step 16] Advanced 32768 cells [Level 2 step 31] ADVANCE at time 0.0234375 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.947523374e-19, 2.235155437e-13 MLMG: Timers: Solve = 0.18152048 Iter = 0.159807985 Bottom = 0.032611368 moveKick ... updating velocity only [Level 2 step 31] Advanced 46080 cells [Level 2 step 32] ADVANCE at time 0.02421875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 4.947523374e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.021858897 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.132377171e-18, 5.399921275e-13 MLMG: Timers: Solve = 0.180985715 Iter = 0.15924238 Bottom = 0.032429493 moveKick ... updating velocity only [Level 2 step 32] Advanced 46080 cells [STEP 8] Coarse TimeStep time: 6.867418698 [STEP 8] FAB kilobyte spread across MPI nodes: [68665 ... 68773] STEP = 8 TIME = 0.025 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.025 by dt = 0.003125 Old / new A time 0.025 0.028125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.052033533 new finest: 2 Setting the current time in the state data to 0.025 Setting the current time in the state data to 0.025 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -5.421010862e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 7.152210038e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.451208458e-18, 9.787032486e-13 MLMG: Timers: Solve = 0.637563601 Iter = 0.568064807 Bottom = 0.004020802 STEP = 8 TIME = 0.025 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 9] ADVANCE at time 0.025 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -5.421010862e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.451208458e-18 MLMG: No iterations needed MLMG: Timers: Solve = 0.069335519 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -5.984795992e-17 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.789252198e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.438476747e-21, 3.623568194e-14 MLMG: Timers: Solve = 0.101792524 Iter = 0.094880224 Bottom = 0.003039151 moveKick ... updating velocity only [Level 0 step 9] Advanced 4096 cells [Level 1 step 17] ADVANCE at time 0.025 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.573042079e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.614087869e-20, 2.98790876e-14 MLMG: Timers: Solve = 0.128010035 Iter = 0.117783506 Bottom = 0.00305232 moveKick ... updating velocity only [Level 1 step 17] Advanced 32768 cells [Level 2 step 33] ADVANCE at time 0.025 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 3.426247238e-19, 1.54788458e-13 MLMG: Timers: Solve = 0.190808145 Iter = 0.167151533 Bottom = 0.037283969 moveKick ... updating velocity only [Level 2 step 33] Advanced 53248 cells [Level 2 step 34] ADVANCE at time 0.02578125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 3.426247238e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.023843789 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.11014382e-19, 2.913719601e-13 MLMG: Timers: Solve = 0.191221477 Iter = 0.167461167 Bottom = 0.037525799 moveKick ... updating velocity only [Level 2 step 34] Advanced 53248 cells [Level 1 step 18] ADVANCE at time 0.0265625 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -6.505213035e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 8.380401878e-10 MLMG: Final Iter. 6 resid, resid/bnorm = 9.772992113e-19, 6.590961536e-13 MLMG: Timers: Solve = 0.414068119 Iter = 0.360252477 Bottom = 0.003218254 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113485678e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 4.646242481e-20, 1.492296083e-13 MLMG: Timers: Solve = 0.128449591 Iter = 0.118073748 Bottom = 0.003159869 moveKick ... updating velocity only [Level 1 step 18] Advanced 32768 cells [Level 2 step 35] ADVANCE at time 0.0265625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.916978179e-19, 2.221355955e-13 MLMG: Timers: Solve = 0.1910485 Iter = 0.167347695 Bottom = 0.037492138 moveKick ... updating velocity only [Level 2 step 35] Advanced 53248 cells [Level 2 step 36] ADVANCE at time 0.02734375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 4.916978179e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.023883778 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 2.574146775e-19, 1.227522974e-13 MLMG: Timers: Solve = 0.191735539 Iter = 0.167938021 Bottom = 0.03790758 moveKick ... updating velocity only [Level 2 step 36] Advanced 53248 cells [STEP 9] Coarse TimeStep time: 7.708790301 [STEP 9] FAB kilobyte spread across MPI nodes: [68665 ... 68773] STEP = 9 TIME = 0.028125 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.028125 by dt = 0.003125 Old / new A time 0.028125 0.03125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.025016584 new finest: 2 Setting the current time in the state data to 0.028125 Calling redistribute because BoxArray changed TIME = 0.028125 : REGRID with lbase = 1 Level 2 15 grids 11264 cells 4.296875 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 8 x 8 [Level 0 step 10] ADVANCE at time 0.028125 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -8.239936511e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.050217247e-08 MLMG: Final Iter. 8 resid, resid/bnorm = 9.778949881e-20, 6.594979489e-14 MLMG: Timers: Solve = 0.609548198 Iter = 0.558454532 Bottom = 0.004412805 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -1.198585502e-16 to ensure solvability MLMG: Initial rhs = 2.892150254e-08 MLMG: Initial residual (resid0) = 3.873110818e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 3.889713433e-21, 1.004286636e-13 MLMG: Timers: Solve = 0.100890671 Iter = 0.093786788 Bottom = 0.001918269 moveKick ... updating velocity only [Level 0 step 10] Advanced 4096 cells [Level 1 step 19] ADVANCE at time 0.028125 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.641046646e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 2.529053024e-20, 4.68164084e-14 MLMG: Timers: Solve = 0.12694211 Iter = 0.116728046 Bottom = 0.001938528 moveKick ... updating velocity only [Level 1 step 19] Advanced 32768 cells [Level 2 step 37] ADVANCE at time 0.028125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.974702851e-20, 4.05452473e-14 MLMG: Timers: Solve = 0.13015172 Iter = 0.11831654 Bottom = 0.009782942 moveKick ... updating velocity only [Level 2 step 37] Advanced 11264 cells [Level 2 step 38] ADVANCE at time 0.02890625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 8.974702851e-20 MLMG: No iterations needed MLMG: Timers: Solve = 0.011882752 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.898154616e-19, 9.051653242e-14 MLMG: Timers: Solve = 0.129943452 Iter = 0.118092887 Bottom = 0.009766642 moveKick ... updating velocity only [Level 2 step 38] Advanced 11264 cells [Level 1 step 20] ADVANCE at time 0.0296875 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -6.678685383e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 9.484814095e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 7.052608077e-19, 4.75631905e-13 MLMG: Timers: Solve = 0.365438179 Iter = 0.330683746 Bottom = 0.001934461 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 3.704988249e-07 MLMG: Initial residual (resid0) = 3.495865805e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.085157566e-20, 2.928909602e-14 MLMG: Timers: Solve = 0.127252357 Iter = 0.116909282 Bottom = 0.002042797 moveKick ... updating velocity only [Level 1 step 20] Advanced 32768 cells [Level 2 step 39] ADVANCE at time 0.0296875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.131615442e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.293591054e-19, 4.675160344e-14 MLMG: Timers: Solve = 0.129985831 Iter = 0.118139352 Bottom = 0.009459126 moveKick ... updating velocity only [Level 2 step 39] Advanced 11264 cells [Level 2 step 40] ADVANCE at time 0.03046875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.293591054e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.011904201 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.793151269e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 1.876301125e-18, 6.326377844e-13 MLMG: Timers: Solve = 0.115677057 Iter = 0.103804324 Bottom = 0.008692386 moveKick ... updating velocity only [Level 2 step 40] Advanced 11264 cells [STEP 10] Coarse TimeStep time: 4.327976764 [STEP 10] FAB kilobyte spread across MPI nodes: [68665 ... 68773] STEP = 10 TIME = 0.03125 DT = 0.003125 PLOTFILE: file = Part-2line_restart_plt00010 Output file Part-2line_restart_plt00010.temp at time 1.000000 and step 10 Write plotfile time = 0.135514488 seconds Time w/o init: 57.64199766 CHECKPOINT: file = Part-2line_restart_chk00010 checkPoint() time = 0.031070344 secs. Run time = 59.5128686 Unused ParmParse Variables: [TOP]::amr.probin_file(nvals = 1) :: [] [TOP]::particles.particle_output_file(nvals = 1) :: [final_particles] Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [7511 ... 7521] [The Arena] max space (MB) allocated spread across MPI: [81 ... 81] [The Arena] max space (MB) used spread across MPI: [77 ... 77] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [16 ... 16] [The Pinned Arena] max space (MB) used spread across MPI: [8 ... 8] AMReX (26.09-155-g14ffe112f87b) finalized Initializing AMReX (26.09-155-g14ffe112f87b)... MPI initialized with 2 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.09-155-g14ffe112f87b) initialized Successfully read inputs file ... AMReX git describe: 26.09-155-g14ffe112f8 Nyx git describe: 26.09 Nyx::hydro_tile_size unset, using fabarray.mfiter_tile_size default: (1024000,1024000,1024000) Suggested default for currently compiled CPU / GPU: nyx.hydro_tile_size=(1048576,1048576,1048576) Nyx::sundials_tile_size unset, using fabarray.mfiter_tile_size default: (1024000,1024000,1024000) Suggested default for currently compiled CPU / GPU: nyx.sundials_tile_size=(1048576,1048576,1048576) Nyx::setting init_sb_vels to 0 since do_santa_barbara = 0 2 Species: H He restarting calculation from file: Part-2line_restart_chk00006 Successfully read inputs file ... read CPU time: 71.87633533 Getting Gconst from nyx_constants: 4.300927161e-09 Using -5.404704468e-08 for 4 pi G in Gravity.cpp ...setting old_a_time to 0.01875 Gravity ... defining average density in Gravity::set_mass_offset to be 1.004882812 Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -5.724587471e-17 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 7.247393028e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 4.500340746e-19, 1.517392683e-13 MLMG: Timers: Solve = 0.533598122 Iter = 0.484582174 Bottom = 0.001919296 Average gas density 1 Average dm density 0.0048828125 Average total density 1.004882812 Average temperature 471.6564507 ... setting small_dens to 1e-06 ... setting small_temp to 0.0004716564507 ... setting small_pres to 6.666666667e-12 Restart time = 0.89986129 seconds. ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.01875 by dt = 0.003125 Old / new A time 0.01875 0.021875 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.040666753 new finest: 2 Setting the current time in the state data to 0.01875 Setting the current time in the state data to 0.01875 BA SIZE 0 FLEV 2 Calling redistribute because the size of BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -5.724587471e-17 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 5.094599016e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 5.517390328e-19, 1.860314183e-13 MLMG: Timers: Solve = 0.52611577 Iter = 0.480284648 Bottom = 0.001800974 STEP = 6 TIME = 0.01875 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 14 grids 7168 cells 2.734375 % of domain smallest grid: 8 x 8 x 8 biggest grid: 8 x 8 x 8 [Level 0 step 7] ADVANCE at time 0.01875 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -5.724587471e-17 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 5.517390328e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.046577615 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -8.890457814e-18 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.734865479e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 5.037788424e-21, 7.486136549e-14 MLMG: Timers: Solve = 0.10147983 Iter = 0.094463148 Bottom = 0.001817245 moveKick ... updating velocity only [Level 0 step 7] Advanced 4096 cells [Level 1 step 13] ADVANCE at time 0.01875 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.57065785e-07 MLMG: Final Iter. 6 resid, resid/bnorm = 4.290238421e-19, 7.941848278e-13 MLMG: Timers: Solve = 0.111188486 Iter = 0.101056004 Bottom = 0.001542663 moveKick ... updating velocity only [Level 1 step 13] Advanced 32768 cells [Level 2 step 25] ADVANCE at time 0.01875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 2.645375349e-18, 9.560636564e-13 MLMG: Timers: Solve = 0.114348329 Iter = 0.102635363 Bottom = 0.006596885 moveKick ... updating velocity only [Level 2 step 25] Advanced 7168 cells [Level 2 step 26] ADVANCE at time 0.01953125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.645375349e-18 MLMG: No iterations needed MLMG: Timers: Solve = 0.011721107 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.650467071e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.632388723e-19, 6.158871924e-14 MLMG: Timers: Solve = 0.128373312 Iter = 0.116714288 Bottom = 0.007350133 moveKick ... updating velocity only [Level 2 step 26] Advanced 7168 cells [Level 1 step 14] ADVANCE at time 0.0203125 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -7.632783294e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 9.957448238e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 5.798588827e-19, 3.910601326e-13 MLMG: Timers: Solve = 0.357815607 Iter = 0.324695346 Bottom = 0.001846315 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.444676299e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.456001958e-20, 1.003287873e-13 MLMG: Timers: Solve = 0.127452642 Iter = 0.117296575 Bottom = 0.001865051 moveKick ... updating velocity only [Level 1 step 14] Advanced 32768 cells [Level 2 step 27] ADVANCE at time 0.0203125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.7012783e-20, 3.930999013e-14 MLMG: Timers: Solve = 0.128304485 Iter = 0.116656132 Bottom = 0.00737307 moveKick ... updating velocity only [Level 2 step 27] Advanced 7168 cells [Level 2 step 28] ADVANCE at time 0.02109375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 8.7012783e-20 MLMG: No iterations needed MLMG: Timers: Solve = 0.011743054 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 7 resid, resid/resid0 = 1.168829211e-18, 5.573748646e-13 MLMG: Timers: Solve = 0.114137087 Iter = 0.102381228 Bottom = 0.006555405 moveKick ... updating velocity only [Level 2 step 28] Advanced 7168 cells [STEP 7] Coarse TimeStep time: 4.459498164 [STEP 7] FAB kilobyte spread across MPI nodes: [42865 ... 42889] STEP = 7 TIME = 0.021875 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.021875 by dt = 0.003125 Old / new A time 0.021875 0.025 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.018285677 new finest: 2 Setting the current time in the state data to 0.021875 Calling redistribute because BoxArray changed TIME = 0.021875 : REGRID with lbase = 1 Level 2 36 grids 46080 cells 17.578125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 8] ADVANCE at time 0.021875 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -6.071532166e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.380180577e-07 MLMG: Final Iter. 8 resid, resid/bnorm = 9.679791605e-20, 6.528106583e-14 MLMG: Timers: Solve = 0.694552147 Iter = 0.628804641 Bottom = 0.004419632 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -1.940721889e-17 to ensure solvability MLMG: Initial rhs = 1.432880048e-08 MLMG: Initial residual (resid0) = 4.198898866e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 2.643669238e-21, 6.296101245e-14 MLMG: Timers: Solve = 0.102994412 Iter = 0.095930764 Bottom = 0.003024137 moveKick ... updating velocity only [Level 0 step 8] Advanced 4096 cells [Level 1 step 15] ADVANCE at time 0.021875 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.593886225e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 3.714702695e-20, 6.876448883e-14 MLMG: Timers: Solve = 0.128952597 Iter = 0.118802422 Bottom = 0.002799488 moveKick ... updating velocity only [Level 1 step 15] Advanced 32768 cells [Level 2 step 29] ADVANCE at time 0.021875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 6.04654397e-19, 2.731662816e-13 MLMG: Timers: Solve = 0.182693282 Iter = 0.161059503 Bottom = 0.033479591 moveKick ... updating velocity only [Level 2 step 29] Advanced 46080 cells [Level 2 step 30] ADVANCE at time 0.02265625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 6.04654397e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.02171842 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.033990987e-19, 2.877404908e-13 MLMG: Timers: Solve = 0.182150802 Iter = 0.160479265 Bottom = 0.03269522 moveKick ... updating velocity only [Level 2 step 30] Advanced 46080 cells [Level 1 step 16] ADVANCE at time 0.0234375 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -5.377642776e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 3.198732139e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.423403448e-19, 1.634357086e-13 MLMG: Timers: Solve = 0.450230932 Iter = 0.400390642 Bottom = 0.003720573 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113486436e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.301293334e-20, 1.060320449e-13 MLMG: Timers: Solve = 0.129871256 Iter = 0.119535294 Bottom = 0.003583974 moveKick ... updating velocity only [Level 1 step 16] Advanced 32768 cells [Level 2 step 31] ADVANCE at time 0.0234375 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.947854246e-19, 2.235304916e-13 MLMG: Timers: Solve = 0.1818398 Iter = 0.160190018 Bottom = 0.032433358 moveKick ... updating velocity only [Level 2 step 31] Advanced 46080 cells [Level 2 step 32] ADVANCE at time 0.02421875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 4.947854246e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.021774164 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.13248305e-18, 5.400426176e-13 MLMG: Timers: Solve = 0.18291413 Iter = 0.161206377 Bottom = 0.033433254 moveKick ... updating velocity only [Level 2 step 32] Advanced 46080 cells [STEP 8] Coarse TimeStep time: 6.872183053 [STEP 8] FAB kilobyte spread across MPI nodes: [56680 ... 63145] STEP = 8 TIME = 0.025 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.025 by dt = 0.003125 Old / new A time 0.025 0.028125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.052160512 new finest: 2 Setting the current time in the state data to 0.025 Setting the current time in the state data to 0.025 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -5.421010862e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 7.152210038e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.451234928e-18, 9.787211e-13 MLMG: Timers: Solve = 0.635558596 Iter = 0.566146658 Bottom = 0.004007825 STEP = 8 TIME = 0.025 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 9] ADVANCE at time 0.025 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -5.421010862e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.451234928e-18 MLMG: No iterations needed MLMG: Timers: Solve = 0.068330919 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -5.984795992e-17 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.789252198e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.438425048e-21, 3.623491369e-14 MLMG: Timers: Solve = 0.102262078 Iter = 0.095151806 Bottom = 0.003000564 moveKick ... updating velocity only [Level 0 step 9] Advanced 4096 cells [Level 1 step 17] ADVANCE at time 0.025 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.573042079e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.614253305e-20, 2.988215007e-14 MLMG: Timers: Solve = 0.128934245 Iter = 0.11874063 Bottom = 0.003014076 moveKick ... updating velocity only [Level 1 step 17] Advanced 32768 cells [Level 2 step 33] ADVANCE at time 0.025 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 3.426313412e-19, 1.547914476e-13 MLMG: Timers: Solve = 0.191747785 Iter = 0.168058776 Bottom = 0.037127396 moveKick ... updating velocity only [Level 2 step 33] Advanced 53248 cells [Level 2 step 34] ADVANCE at time 0.02578125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 3.426313412e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.023814984 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.110342343e-19, 2.91381427e-13 MLMG: Timers: Solve = 0.191544321 Iter = 0.167830949 Bottom = 0.037337221 moveKick ... updating velocity only [Level 2 step 34] Advanced 53248 cells [Level 1 step 18] ADVANCE at time 0.0265625 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -6.505213035e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 8.380401878e-10 MLMG: Final Iter. 6 resid, resid/bnorm = 9.772992113e-19, 6.590961536e-13 MLMG: Timers: Solve = 0.412137862 Iter = 0.358495062 Bottom = 0.003148706 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113485678e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 4.646573354e-20, 1.492402354e-13 MLMG: Timers: Solve = 0.129059588 Iter = 0.118699715 Bottom = 0.003113396 moveKick ... updating velocity only [Level 1 step 18] Advanced 32768 cells [Level 2 step 35] ADVANCE at time 0.0265625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.916779656e-19, 2.221266268e-13 MLMG: Timers: Solve = 0.191983489 Iter = 0.168335776 Bottom = 0.037320393 moveKick ... updating velocity only [Level 2 step 35] Advanced 53248 cells [Level 2 step 36] ADVANCE at time 0.02734375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 4.916779656e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.02392487 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 2.574113688e-19, 1.227507196e-13 MLMG: Timers: Solve = 0.192384688 Iter = 0.16869451 Bottom = 0.037643577 moveKick ... updating velocity only [Level 2 step 36] Advanced 53248 cells [STEP 9] Coarse TimeStep time: 7.704429764 [STEP 9] FAB kilobyte spread across MPI nodes: [62439 ... 68665] STEP = 9 TIME = 0.028125 DT = 0.003125 ...estdt from hydro at level 0: 0.54 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 0.54 ...estdt from hydro at level 1: 0.27 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 0.27 ...estdt from hydro at level 2: 0.135 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.54 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 0.27 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.028125 by dt = 0.003125 Old / new A time 0.028125 0.03125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.024952625 new finest: 2 Setting the current time in the state data to 0.028125 Calling redistribute because BoxArray changed TIME = 0.028125 : REGRID with lbase = 1 Level 2 15 grids 11264 cells 4.296875 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 8 x 8 [Level 0 step 10] ADVANCE at time 0.028125 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -8.239936511e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.050217247e-08 MLMG: Final Iter. 8 resid, resid/bnorm = 9.768361969e-20, 6.587838941e-14 MLMG: Timers: Solve = 0.605383088 Iter = 0.554566233 Bottom = 0.004338852 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 1.004882812 ... subtracting -1.198585502e-16 to ensure solvability MLMG: Initial rhs = 2.892150254e-08 MLMG: Initial residual (resid0) = 3.873110818e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 3.889868529e-21, 1.00432668e-13 MLMG: Timers: Solve = 0.101432897 Iter = 0.09436488 Bottom = 0.001861957 moveKick ... updating velocity only [Level 0 step 10] Advanced 4096 cells [Level 1 step 19] ADVANCE at time 0.028125 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.641046646e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 2.53095554e-20, 4.685162669e-14 MLMG: Timers: Solve = 0.127975025 Iter = 0.11780685 Bottom = 0.001895548 moveKick ... updating velocity only [Level 1 step 19] Advanced 32768 cells [Level 2 step 37] ADVANCE at time 0.028125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.972655579e-20, 4.053599829e-14 MLMG: Timers: Solve = 0.130793991 Iter = 0.118959264 Bottom = 0.009770158 moveKick ... updating velocity only [Level 2 step 37] Advanced 11264 cells [Level 2 step 38] ADVANCE at time 0.02890625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 8.972655579e-20 MLMG: No iterations needed MLMG: Timers: Solve = 0.011868416 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.897914734e-19, 9.050509324e-14 MLMG: Timers: Solve = 0.13114892 Iter = 0.119306517 Bottom = 0.009728449 moveKick ... updating velocity only [Level 2 step 38] Advanced 11264 cells [Level 1 step 20] ADVANCE at time 0.0296875 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level ... subtracting -6.678685383e-17 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 9.484814095e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 7.049961099e-19, 4.754533913e-13 MLMG: Timers: Solve = 0.364681765 Iter = 0.330053611 Bottom = 0.001905586 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 3.704988249e-07 MLMG: Initial residual (resid0) = 3.495865805e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.084857713e-20, 2.92810028e-14 MLMG: Timers: Solve = 0.127483363 Iter = 0.117214045 Bottom = 0.00191146 moveKick ... updating velocity only [Level 1 step 20] Advanced 32768 cells [Level 2 step 39] ADVANCE at time 0.0296875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.131615442e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.294385147e-19, 4.678030272e-14 MLMG: Timers: Solve = 0.130778571 Iter = 0.118928492 Bottom = 0.009340181 moveKick ... updating velocity only [Level 2 step 39] Advanced 11264 cells [Level 2 step 40] ADVANCE at time 0.03046875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 1.004882812 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.294385147e-19 MLMG: No iterations needed MLMG: Timers: Solve = 0.011880281 Iter = 0 Bottom = 0 moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 1.004882812 MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.793151269e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 1.876326405e-18, 6.326463084e-13 MLMG: Timers: Solve = 0.116521216 Iter = 0.104684599 Bottom = 0.008574676 moveKick ... updating velocity only [Level 2 step 40] Advanced 11264 cells [STEP 10] Coarse TimeStep time: 4.333229034 [STEP 10] FAB kilobyte spread across MPI nodes: [62439 ... 68665] STEP = 10 TIME = 0.03125 DT = 0.003125 PLOTFILE: file = Part-2line_restart_plt00010 Output file Part-2line_restart_plt00010.temp at time 1.000000 and step 10 Write plotfile time = 0.133486868 seconds Time w/o init: 23.5028724 Run time = 24.40441802 Unused ParmParse Variables: [TOP]::amr.probin_file(nvals = 1) :: [] [TOP]::particles.particle_output_file(nvals = 1) :: [final_particles] Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [7519 ... 7529] [The Arena] max space (MB) allocated spread across MPI: [73 ... 81] [The Arena] max space (MB) used spread across MPI: [71 ... 77] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [16 ... 16] [The Pinned Arena] max space (MB) used spread across MPI: [8 ... 8] AMReX (26.09-155-g14ffe112f87b) finalized