Initializing AMReX (26.04-124-g666ca0230a91)... MPI initialized with 2 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.04-124-g666ca0230a91) initialized Successfully read inputs file ... AMReX git describe: 26.04-124-g666ca0230a Nyx git describe: 21.02.1-263-gf4b50a67 Nyx::hydro_tile_size unset, using fabarray.mfiter_tile_size default: (1024000,1024000,1024000) Suggested default for currently compiled CPU / GPU: nyx.hydro_tile_size=(1048576,1048576,1048576) Nyx::sundials_tile_size unset, using fabarray.mfiter_tile_size default: (1024000,1024000,1024000) Suggested default for currently compiled CPU / GPU: nyx.sundials_tile_size=(1048576,1048576,1048576) Nyx::setting init_sb_vels to 0 since do_santa_barbara = 0 Successfully read inputs file ... Getting Gconst from nyx_constants: 4.300927161e-09 Using -5.404704468e-08 for 4 pi G in Gravity.cpp Initializing the data at level 0 ... setting particle_initrandom_mass to 2.123188769e+11 by dividing 8.696581196e+14 by 4096 Initializing DM particles from "particle_file.2line" ... Redistributing from processor 0 to 0 Redistributing from processor 1 to 1 Total number of particles: 16 Average dm density 0.0048828125 Average total density 0.0048828125 Done initializing the level 0 data ...estdt from particles at level 0: 0.003125 Nyx::est_time_step at level 0: estdt = 0.003125 Integrating a from time 0 by dt = 0.003125 Old / new A time 0 0.003125 Old / new A 1 1 Old / new z 0 0 grid_places() time: 0.005656762 new finest: 1 Initializing the data at level 1 BA SIZE 0 FLEV 1 Calling redistribute because the size of BoxArray changed Done initializing the level 1 data grid_places() time: 0.011907962 new finest: 2 Initializing the data at level 2 BA SIZE 2 FLEV 2 Calling redistribute because the size of BoxArray changed Done initializing the level 2 data Now regridding at level lbase = 0 grid_places() time: 0.042894128 new finest: 2 Initializing the data at level 1 Calling redistribute because BoxArray changed Done initializing the level 1 data Initializing the data at level 2 Calling redistribute because BoxArray changed Done initializing the level 2 data NOT calling redistribute because NOT changed STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 Now regridding at level lbase = 0 grid_places() time: 0.055345953 new finest: 2 Regridding at level lbase = 0 but grids unchanged Setting the current time in the state data to 0 Setting the current time in the state data to 0 Setting the current time in the state data to 0 NOT calling redistribute because NOT changed Gravity ... defining average density in Gravity::set_mass_offset to be 0.0048828125 Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 7.669883337e-19, 5.172613001e-13 MLMG: Timers: Solve = 0.682713896 Iter = 0.614962806 Bottom = 0.004463778 Average dm density 0.0048828125 Average total density 0.0048828125 INITIAL GRIDS Level 0 2 grids 4096 cells 100 % of domain smallest grid: 16 x 16 x 8 biggest grid: 16 x 16 x 8 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 CHECKPOINT: file = Part-2line_restart-nbody_chk00000 checkPoint() time = 0.014611342 secs. PLOTFILE: file = Part-2line_restart-nbody_plt00000 Output file Part-2line_restart-nbody_plt00000.temp at time 1.000000 and step 0 Write plotfile time = 0.242765847 seconds ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Re-integrating a from time 0 by dt = 0.003125 Old / new A time 0 0.003125 Old / new A 1 1 Old / new z 0 0 [Level 0 step 1] ADVANCE at time 0 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 7.669883337e-19, 5.172613001e-13 MLMG: Timers: Solve = 0.672503305 Iter = 0.614530537 Bottom = 0.004231903 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 0 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.789252198e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.438580145e-21, 3.623721842e-14 MLMG: Timers: Solve = 0.101599039 Iter = 0.094604505 Bottom = 0.002796674 moveKick ... updating velocity only [Level 0 step 1] Advanced 4096 cells [Level 1 step 1] ADVANCE at time 0 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.573042079e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.613922433e-20, 2.987602514e-14 MLMG: Timers: Solve = 0.118273232 Iter = 0.108130962 Bottom = 0.002823933 moveKick ... updating velocity only [Level 1 step 1] Advanced 32768 cells [Level 2 step 1] ADVANCE at time 0 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 3.425964962e-19, 1.547757056e-13 MLMG: Timers: Solve = 0.185495637 Iter = 0.160139849 Bottom = 0.044249519 moveKick ... updating velocity only [Level 2 step 1] Advanced 53248 cells [Level 2 step 2] ADVANCE at time 0.00078125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 1.926981343e-19, 8.705573478e-14 MLMG: Timers: Solve = 0.207158554 Iter = 0.181761793 Bottom = 0.052063514 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.110368709e-19, 2.913826844e-13 MLMG: Timers: Solve = 0.185366372 Iter = 0.159949518 Bottom = 0.044261907 moveKick ... updating velocity only [Level 2 step 2] Advanced 53248 cells [Level 1 step 2] ADVANCE at time 0.0015625 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.728296179e-19, 1.165572786e-13 MLMG: Timers: Solve = 0.488525974 Iter = 0.440077197 Bottom = 0.00382406 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113485678e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 4.644970691e-20, 1.491887605e-13 MLMG: Timers: Solve = 0.119516665 Iter = 0.109307644 Bottom = 0.002929329 moveKick ... updating velocity only [Level 1 step 2] Advanced 32768 cells [Level 2 step 3] ADVANCE at time 0.0015625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.916846347e-19, 2.221296397e-13 MLMG: Timers: Solve = 0.189034663 Iter = 0.162956089 Bottom = 0.046975416 moveKick ... updating velocity only [Level 2 step 3] Advanced 53248 cells [Level 2 step 4] ADVANCE at time 0.00234375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 2.134901462e-19, 9.644899579e-14 MLMG: Timers: Solve = 0.207488512 Iter = 0.181953981 Bottom = 0.052279503 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 2.574237765e-19, 1.227566364e-13 MLMG: Timers: Solve = 0.183256465 Iter = 0.157806384 Bottom = 0.044753196 moveKick ... updating velocity only [Level 2 step 4] Advanced 53248 cells [STEP 1] Coarse TimeStep time: 5.203254471 [STEP 1] FAB kilobyte spread across MPI nodes: [19864 ... 20326] STEP = 1 TIME = 0.003125 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.003125 by dt = 0.003125 Old / new A time 0.003125 0.00625 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.024693505 new finest: 2 Setting the current time in the state data to 0.003125 Calling redistribute because BoxArray changed TIME = 0.003125 : REGRID with lbase = 1 Level 2 15 grids 11264 cells 4.296875 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 8 x 8 [Level 0 step 2] ADVANCE at time 0.003125 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 3.14747393e-19, 2.122674342e-13 MLMG: Timers: Solve = 0.633752258 Iter = 0.592462088 Bottom = 0.002308515 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 1.084202172e-19 to ensure solvability MLMG: Initial rhs = 2.892150254e-08 MLMG: Initial residual (resid0) = 3.873110818e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 3.890127023e-21, 1.004393421e-13 MLMG: Timers: Solve = 0.101205545 Iter = 0.094156331 Bottom = 0.001775714 moveKick ... updating velocity only [Level 0 step 2] Advanced 4096 cells [Level 1 step 3] ADVANCE at time 0.003125 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.641046646e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 2.52967341e-20, 4.682789262e-14 MLMG: Timers: Solve = 0.117977046 Iter = 0.107814656 Bottom = 0.001799115 moveKick ... updating velocity only [Level 1 step 3] Advanced 32768 cells [Level 2 step 5] ADVANCE at time 0.003125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.977701381e-20, 4.055879384e-14 MLMG: Timers: Solve = 0.122480186 Iter = 0.109765227 Bottom = 0.014343498 moveKick ... updating velocity only [Level 2 step 5] Advanced 11264 cells [Level 2 step 6] ADVANCE at time 0.00390625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.61440986e-19, 3.891754233e-13 MLMG: Timers: Solve = 0.122432652 Iter = 0.109729892 Bottom = 0.014258078 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.898195458e-19, 9.051848004e-14 MLMG: Timers: Solve = 0.122519954 Iter = 0.109752062 Bottom = 0.014319044 moveKick ... updating velocity only [Level 2 step 6] Advanced 11264 cells [Level 1 step 4] ADVANCE at time 0.0046875 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 9.8361701e-20, 6.63356913e-14 MLMG: Timers: Solve = 0.427478572 Iter = 0.393252297 Bottom = 0.002449329 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 3.704988249e-07 MLMG: Initial residual (resid0) = 3.495865805e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.085074848e-20, 2.928686341e-14 MLMG: Timers: Solve = 0.117874012 Iter = 0.107645534 Bottom = 0.001813328 moveKick ... updating velocity only [Level 1 step 4] Advanced 32768 cells [Level 2 step 7] ADVANCE at time 0.0046875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.131615442e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.294419785e-19, 4.678155458e-14 MLMG: Timers: Solve = 0.122190374 Iter = 0.109486259 Bottom = 0.014018222 moveKick ... updating velocity only [Level 2 step 7] Advanced 11264 cells [Level 2 step 8] ADVANCE at time 0.00546875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.766944786e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 5.942645432e-19, 2.147728231e-13 MLMG: Timers: Solve = 0.122494224 Iter = 0.109773157 Bottom = 0.014277025 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.793151269e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 1.876315083e-18, 6.326424909e-13 MLMG: Timers: Solve = 0.109256127 Iter = 0.096521032 Bottom = 0.012529711 moveKick ... updating velocity only [Level 2 step 8] Advanced 11264 cells [STEP 2] Coarse TimeStep time: 3.44591722 [STEP 2] FAB kilobyte spread across MPI nodes: [19864 ... 20326] STEP = 2 TIME = 0.00625 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.00625 by dt = 0.003125 Old / new A time 0.00625 0.009375 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.040302277 new finest: 2 Setting the current time in the state data to 0.00625 Setting the current time in the state data to 0.00625 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 7.247393028e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 3.38887832e-19, 1.142637737e-13 MLMG: Timers: Solve = 0.51185969 Iter = 0.463557099 Bottom = 0.001817023 STEP = 2 TIME = 0.00625 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 14 grids 7168 cells 2.734375 % of domain smallest grid: 8 x 8 x 8 biggest grid: 8 x 8 x 8 [Level 0 step 3] ADVANCE at time 0.00625 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.965837911e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 4.679857034e-19, 1.5779207e-13 MLMG: Timers: Solve = 0.635118581 Iter = 0.588606285 Bottom = 0.002323613 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 0 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.734865479e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 5.038046918e-21, 7.48652067e-14 MLMG: Timers: Solve = 0.1013715 Iter = 0.094317866 Bottom = 0.001780747 moveKick ... updating velocity only [Level 0 step 3] Advanced 4096 cells [Level 1 step 5] ADVANCE at time 0.00625 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.57065785e-07 MLMG: Final Iter. 6 resid, resid/bnorm = 4.290437979e-19, 7.942217688e-13 MLMG: Timers: Solve = 0.10288504 Iter = 0.092702514 Bottom = 0.001577109 moveKick ... updating velocity only [Level 1 step 5] Advanced 32768 cells [Level 2 step 9] ADVANCE at time 0.00625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 2.645473939e-18, 9.560992876e-13 MLMG: Timers: Solve = 0.104607167 Iter = 0.092807678 Bottom = 0.009440222 moveKick ... updating velocity only [Level 2 step 9] Advanced 7168 cells [Level 2 step 10] ADVANCE at time 0.00703125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.766944786e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.83925267e-19, 1.748951657e-13 MLMG: Timers: Solve = 0.117578129 Iter = 0.105757481 Bottom = 0.010864241 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.650467071e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.632079047e-19, 6.157703542e-14 MLMG: Timers: Solve = 0.117623411 Iter = 0.105798054 Bottom = 0.010947126 moveKick ... updating velocity only [Level 2 step 10] Advanced 7168 cells [Level 1 step 6] ADVANCE at time 0.0078125 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 1.527835679e-19, 1.030381082e-13 MLMG: Timers: Solve = 0.424510084 Iter = 0.391003981 Bottom = 0.002454504 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.444676299e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.455774484e-20, 1.003221837e-13 MLMG: Timers: Solve = 0.118312904 Iter = 0.108083426 Bottom = 0.001826034 moveKick ... updating velocity only [Level 1 step 6] Advanced 32768 cells [Level 2 step 11] ADVANCE at time 0.0078125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.711866211e-20, 3.935782341e-14 MLMG: Timers: Solve = 0.117605116 Iter = 0.105791469 Bottom = 0.010876277 moveKick ... updating velocity only [Level 2 step 11] Advanced 7168 cells [Level 2 step 12] ADVANCE at time 0.00859375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.289115524e-19, 1.937704819e-13 MLMG: Timers: Solve = 0.117647014 Iter = 0.105809462 Bottom = 0.01096422 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 7 resid, resid/resid0 = 1.168910223e-18, 5.574134965e-13 MLMG: Timers: Solve = 0.104802938 Iter = 0.092992752 Bottom = 0.009584729 moveKick ... updating velocity only [Level 2 step 12] Advanced 7168 cells [STEP 3] Coarse TimeStep time: 4.10190039 [STEP 3] FAB kilobyte spread across MPI nodes: [19864 ... 20326] STEP = 3 TIME = 0.009375 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.009375 by dt = 0.003125 Old / new A time 0.009375 0.0125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.018503809 new finest: 2 Setting the current time in the state data to 0.009375 Calling redistribute because BoxArray changed TIME = 0.009375 : REGRID with lbase = 1 Level 2 36 grids 46080 cells 17.578125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 4] ADVANCE at time 0.009375 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 8.581502547e-20, 5.787414187e-14 MLMG: Timers: Solve = 0.751998604 Iter = 0.685647508 Bottom = 0.004762934 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 1.355252716e-19 to ensure solvability MLMG: Initial rhs = 1.432880048e-08 MLMG: Initial residual (resid0) = 4.198898866e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 2.650286683e-21, 6.311861198e-14 MLMG: Timers: Solve = 0.102534602 Iter = 0.095431532 Bottom = 0.002992432 moveKick ... updating velocity only [Level 0 step 4] Advanced 4096 cells [Level 1 step 7] ADVANCE at time 0.009375 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.593886225e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 3.715126625e-20, 6.877233639e-14 MLMG: Timers: Solve = 0.119228255 Iter = 0.109030278 Bottom = 0.002740887 moveKick ... updating velocity only [Level 1 step 7] Advanced 32768 cells [Level 2 step 13] ADVANCE at time 0.009375 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 6.046444192e-19, 2.731617738e-13 MLMG: Timers: Solve = 0.171873179 Iter = 0.150070353 Bottom = 0.038253267 moveKick ... updating velocity only [Level 2 step 13] Advanced 46080 cells [Level 2 step 14] ADVANCE at time 0.01015625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 9.264999819e-19, 4.185672943e-13 MLMG: Timers: Solve = 0.190922493 Iter = 0.169053862 Bottom = 0.043415601 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.034098521e-19, 2.877456187e-13 MLMG: Timers: Solve = 0.170873054 Iter = 0.149032118 Bottom = 0.03753156 moveKick ... updating velocity only [Level 2 step 14] Advanced 46080 cells [Level 1 step 8] ADVANCE at time 0.0109375 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 2.431730572e-19, 1.639972946e-13 MLMG: Timers: Solve = 0.486599847 Iter = 0.436619757 Bottom = 0.0039325 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113486436e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.300595401e-20, 1.060096284e-13 MLMG: Timers: Solve = 0.119741473 Iter = 0.109418311 Bottom = 0.003496127 moveKick ... updating velocity only [Level 1 step 8] Advanced 32768 cells [Level 2 step 15] ADVANCE at time 0.0109375 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.947580243e-19, 2.235181129e-13 MLMG: Timers: Solve = 0.170395556 Iter = 0.148563392 Bottom = 0.037305012 moveKick ... updating velocity only [Level 2 step 15] Advanced 46080 cells [Level 2 step 16] ADVANCE at time 0.01171875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.290546235e-06 MLMG: Final Iter. 9 resid, resid/resid0 = 9.266540443e-19, 4.045559221e-13 MLMG: Timers: Solve = 0.190617165 Iter = 0.168728408 Bottom = 0.043481569 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.132377171e-18, 5.399921275e-13 MLMG: Timers: Solve = 0.170529553 Iter = 0.148694204 Bottom = 0.037111385 moveKick ... updating velocity only [Level 2 step 16] Advanced 46080 cells [STEP 4] Coarse TimeStep time: 5.01962113 [STEP 4] FAB kilobyte spread across MPI nodes: [19864 ... 20326] STEP = 4 TIME = 0.0125 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.0125 by dt = 0.003125 Old / new A time 0.0125 0.015625 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.052326425 new finest: 2 Setting the current time in the state data to 0.0125 Setting the current time in the state data to 0.0125 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 7.152210038e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.45122738e-18, 9.787160096e-13 MLMG: Timers: Solve = 0.620487976 Iter = 0.550855797 Bottom = 0.003907537 STEP = 4 TIME = 0.0125 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 5] ADVANCE at time 0.0125 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 7.676236084e-19, 5.17689733e-13 MLMG: Timers: Solve = 0.694934944 Iter = 0.625524717 Bottom = 0.004389239 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 0 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.789252198e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.438528446e-21, 3.623645018e-14 MLMG: Timers: Solve = 0.102390286 Iter = 0.095421332 Bottom = 0.002936305 moveKick ... updating velocity only [Level 0 step 5] Advanced 4096 cells [Level 1 step 9] ADVANCE at time 0.0125 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.573042079e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.613839715e-20, 2.987449391e-14 MLMG: Timers: Solve = 0.119116119 Iter = 0.108896984 Bottom = 0.00294781 moveKick ... updating velocity only [Level 1 step 9] Advanced 32768 cells [Level 2 step 17] ADVANCE at time 0.0125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 3.426163486e-19, 1.547846743e-13 MLMG: Timers: Solve = 0.180001698 Iter = 0.156228837 Bottom = 0.041799517 moveKick ... updating velocity only [Level 2 step 17] Advanced 53248 cells [Level 2 step 18] ADVANCE at time 0.01328125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 1.92678282e-19, 8.704676604e-14 MLMG: Timers: Solve = 0.201981818 Iter = 0.17809011 Bottom = 0.049496441 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.110434884e-19, 2.9138584e-13 MLMG: Timers: Solve = 0.180784469 Iter = 0.156925704 Bottom = 0.04209362 moveKick ... updating velocity only [Level 2 step 18] Advanced 53248 cells [Level 1 step 10] ADVANCE at time 0.0140625 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.727965307e-19, 1.165349643e-13 MLMG: Timers: Solve = 0.502554712 Iter = 0.449151887 Bottom = 0.003993608 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113485678e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 4.645632436e-20, 1.492100146e-13 MLMG: Timers: Solve = 0.119423906 Iter = 0.109071211 Bottom = 0.003045566 moveKick ... updating velocity only [Level 1 step 10] Advanced 32768 cells [Level 2 step 19] ADVANCE at time 0.0140625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.916978696e-19, 2.221356189e-13 MLMG: Timers: Solve = 0.180762643 Iter = 0.15694902 Bottom = 0.042376468 moveKick ... updating velocity only [Level 2 step 19] Advanced 53248 cells [Level 2 step 20] ADVANCE at time 0.01484375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 2.134769113e-19, 9.644301663e-14 MLMG: Timers: Solve = 0.202978377 Iter = 0.179083665 Bottom = 0.049795004 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 2.574171591e-19, 1.227534808e-13 MLMG: Timers: Solve = 0.180771436 Iter = 0.15691081 Bottom = 0.042387513 moveKick ... updating velocity only [Level 2 step 20] Advanced 53248 cells [STEP 5] Coarse TimeStep time: 6.282598379 [STEP 5] FAB kilobyte spread across MPI nodes: [20326 ... 20434] STEP = 5 TIME = 0.015625 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.015625 by dt = 0.003125 Old / new A time 0.015625 0.01875 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.025152521 new finest: 2 Setting the current time in the state data to 0.015625 Calling redistribute because BoxArray changed TIME = 0.015625 : REGRID with lbase = 1 Level 2 15 grids 11264 cells 4.296875 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 8 x 8 [Level 0 step 6] ADVANCE at time 0.015625 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 3.152503188e-19, 2.126066103e-13 MLMG: Timers: Solve = 0.649329614 Iter = 0.59830287 Bottom = 0.002365805 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting -2.710505431e-20 to ensure solvability MLMG: Initial rhs = 2.892150254e-08 MLMG: Initial residual (resid0) = 3.873110818e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 3.889816831e-21, 1.004313332e-13 MLMG: Timers: Solve = 0.102071917 Iter = 0.094981889 Bottom = 0.001803902 moveKick ... updating velocity only [Level 0 step 6] Advanced 4096 cells [Level 1 step 11] ADVANCE at time 0.015625 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.641046646e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 2.530004282e-20, 4.683401754e-14 MLMG: Timers: Solve = 0.117881081 Iter = 0.10767755 Bottom = 0.001824286 moveKick ... updating velocity only [Level 1 step 11] Advanced 32768 cells [Level 2 step 21] ADVANCE at time 0.015625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.977701381e-20, 4.055879384e-14 MLMG: Timers: Solve = 0.119379497 Iter = 0.107468382 Bottom = 0.013219713 moveKick ... updating velocity only [Level 2 step 21] Advanced 11264 cells [Level 2 step 22] ADVANCE at time 0.01640625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.614674557e-19, 3.891873816e-13 MLMG: Timers: Solve = 0.119488647 Iter = 0.107566826 Bottom = 0.013157946 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.898327807e-19, 9.052479131e-14 MLMG: Timers: Solve = 0.119559479 Iter = 0.107635616 Bottom = 0.013159686 moveKick ... updating velocity only [Level 2 step 22] Advanced 11264 cells [Level 1 step 12] ADVANCE at time 0.0171875 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 9.846758012e-20, 6.640709678e-14 MLMG: Timers: Solve = 0.432146637 Iter = 0.397199276 Bottom = 0.002393748 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 3.704988249e-07 MLMG: Initial residual (resid0) = 3.495865805e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.084909412e-20, 2.928239818e-14 MLMG: Timers: Solve = 0.118066628 Iter = 0.107761175 Bottom = 0.001863738 moveKick ... updating velocity only [Level 1 step 12] Advanced 32768 cells [Level 2 step 23] ADVANCE at time 0.0171875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.131615442e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.29389039e-19, 4.676242172e-14 MLMG: Timers: Solve = 0.119243757 Iter = 0.107339302 Bottom = 0.012924184 moveKick ... updating velocity only [Level 2 step 23] Advanced 11264 cells [Level 2 step 24] ADVANCE at time 0.01796875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.766944786e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 5.943174828e-19, 2.14791956e-13 MLMG: Timers: Solve = 0.119785598 Iter = 0.107872766 Bottom = 0.013201672 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.793151269e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 1.876301848e-18, 6.326380284e-13 MLMG: Timers: Solve = 0.106489317 Iter = 0.094576657 Bottom = 0.011567125 moveKick ... updating velocity only [Level 2 step 24] Advanced 11264 cells [STEP 6] Coarse TimeStep time: 3.422242295 [STEP 6] FAB kilobyte spread across MPI nodes: [20326 ... 20434] STEP = 6 TIME = 0.01875 DT = 0.003125 CHECKPOINT: file = Part-2line_restart-nbody_chk00006 checkPoint() time = 0.014349738 secs. ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.01875 by dt = 0.003125 Old / new A time 0.01875 0.021875 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.04128217 new finest: 2 Setting the current time in the state data to 0.01875 Setting the current time in the state data to 0.01875 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 7.247393028e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 3.390201809e-19, 1.143083982e-13 MLMG: Timers: Solve = 0.516742704 Iter = 0.466955474 Bottom = 0.001842812 STEP = 6 TIME = 0.01875 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 14 grids 7168 cells 2.734375 % of domain smallest grid: 8 x 8 x 8 biggest grid: 8 x 8 x 8 [Level 0 step 7] ADVANCE at time 0.01875 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.965837911e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 4.688327363e-19, 1.580776666e-13 MLMG: Timers: Solve = 0.642566796 Iter = 0.592987625 Bottom = 0.002366451 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 0 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.734865479e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 5.03752993e-21, 7.485752428e-14 MLMG: Timers: Solve = 0.101242713 Iter = 0.094195721 Bottom = 0.001805842 moveKick ... updating velocity only [Level 0 step 7] Advanced 4096 cells [Level 1 step 13] ADVANCE at time 0.01875 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.57065785e-07 MLMG: Final Iter. 6 resid, resid/bnorm = 4.29030563e-19, 7.941972691e-13 MLMG: Timers: Solve = 0.102937923 Iter = 0.092732667 Bottom = 0.001577889 moveKick ... updating velocity only [Level 1 step 13] Advanced 32768 cells [Level 2 step 25] ADVANCE at time 0.01875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 2.64536806e-18, 9.560610219e-13 MLMG: Timers: Solve = 0.104856857 Iter = 0.093032616 Bottom = 0.009522843 moveKick ... updating velocity only [Level 2 step 25] Advanced 7168 cells [Level 2 step 26] ADVANCE at time 0.01953125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.766944786e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.839517367e-19, 1.749047322e-13 MLMG: Timers: Solve = 0.117564077 Iter = 0.105748198 Bottom = 0.010852432 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.650467071e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.632873141e-19, 6.160699593e-14 MLMG: Timers: Solve = 0.117759651 Iter = 0.105944495 Bottom = 0.011045194 moveKick ... updating velocity only [Level 2 step 26] Advanced 7168 cells [Level 1 step 14] ADVANCE at time 0.0203125 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 1.524659305e-19, 1.028238918e-13 MLMG: Timers: Solve = 0.428179024 Iter = 0.394159924 Bottom = 0.002352747 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.444676299e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.456105356e-20, 1.00331789e-13 MLMG: Timers: Solve = 0.118067175 Iter = 0.107748884 Bottom = 0.001907156 moveKick ... updating velocity only [Level 1 step 14] Advanced 32768 cells [Level 2 step 27] ADVANCE at time 0.0203125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.701940044e-20, 3.931297971e-14 MLMG: Timers: Solve = 0.117679133 Iter = 0.105856288 Bottom = 0.010921799 moveKick ... updating velocity only [Level 2 step 27] Advanced 7168 cells [Level 2 step 28] ADVANCE at time 0.02109375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.289115524e-19, 1.937704819e-13 MLMG: Timers: Solve = 0.117765426 Iter = 0.10594084 Bottom = 0.011035996 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 7 resid, resid/resid0 = 1.168936693e-18, 5.57426119e-13 MLMG: Timers: Solve = 0.104803313 Iter = 0.092985254 Bottom = 0.00956393 moveKick ... updating velocity only [Level 2 step 28] Advanced 7168 cells [STEP 7] Coarse TimeStep time: 4.126473152 [STEP 7] FAB kilobyte spread across MPI nodes: [20326 ... 20434] STEP = 7 TIME = 0.021875 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.021875 by dt = 0.003125 Old / new A time 0.021875 0.025 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.018697414 new finest: 2 Setting the current time in the state data to 0.021875 Calling redistribute because BoxArray changed TIME = 0.021875 : REGRID with lbase = 1 Level 2 36 grids 46080 cells 17.578125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 8] ADVANCE at time 0.021875 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 8.570914635e-20, 5.780273639e-14 MLMG: Timers: Solve = 0.752299318 Iter = 0.685977496 Bottom = 0.00477221 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 1.084202172e-19 to ensure solvability MLMG: Initial rhs = 1.432880048e-08 MLMG: Initial residual (resid0) = 4.198898866e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 2.645323599e-21, 6.300041233e-14 MLMG: Timers: Solve = 0.102570588 Iter = 0.095470365 Bottom = 0.003025489 moveKick ... updating velocity only [Level 0 step 8] Advanced 4096 cells [Level 1 step 15] ADVANCE at time 0.021875 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.593886225e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 3.715209343e-20, 6.877386762e-14 MLMG: Timers: Solve = 0.118890564 Iter = 0.1086748 Bottom = 0.002756456 moveKick ... updating velocity only [Level 1 step 15] Advanced 32768 cells [Level 2 step 29] ADVANCE at time 0.021875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 6.047238285e-19, 2.731976488e-13 MLMG: Timers: Solve = 0.171736571 Iter = 0.149938299 Bottom = 0.038264439 moveKick ... updating velocity only [Level 2 step 29] Advanced 46080 cells [Level 2 step 30] ADVANCE at time 0.02265625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 9.265529215e-19, 4.185912109e-13 MLMG: Timers: Solve = 0.190528747 Iter = 0.168679151 Bottom = 0.04313885 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.033966172e-19, 2.877393074e-13 MLMG: Timers: Solve = 0.170990061 Iter = 0.14917249 Bottom = 0.037494096 moveKick ... updating velocity only [Level 2 step 30] Advanced 46080 cells [Level 1 step 16] ADVANCE at time 0.0234375 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 2.434112852e-19, 1.641579569e-13 MLMG: Timers: Solve = 0.487852763 Iter = 0.437557411 Bottom = 0.003941149 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113486436e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.301588017e-20, 1.060415096e-13 MLMG: Timers: Solve = 0.119672916 Iter = 0.109360074 Bottom = 0.003507399 moveKick ... updating velocity only [Level 1 step 16] Advanced 32768 cells [Level 2 step 31] ADVANCE at time 0.0234375 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.94784494e-19, 2.235300712e-13 MLMG: Timers: Solve = 0.170481456 Iter = 0.148675095 Bottom = 0.037309813 moveKick ... updating velocity only [Level 2 step 31] Advanced 46080 cells [Level 2 step 32] ADVANCE at time 0.02421875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.290546235e-06 MLMG: Final Iter. 9 resid, resid/resid0 = 9.266540443e-19, 4.045559221e-13 MLMG: Timers: Solve = 0.19100618 Iter = 0.169106867 Bottom = 0.043529093 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.13258893e-18, 5.400931078e-13 MLMG: Timers: Solve = 0.170313729 Iter = 0.148458373 Bottom = 0.037098886 moveKick ... updating velocity only [Level 2 step 32] Advanced 46080 cells [STEP 8] Coarse TimeStep time: 5.022433169 [STEP 8] FAB kilobyte spread across MPI nodes: [20326 ... 20434] STEP = 8 TIME = 0.025 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.025 by dt = 0.003125 Old / new A time 0.025 0.028125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.052275211 new finest: 2 Setting the current time in the state data to 0.025 Setting the current time in the state data to 0.025 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 7.152210038e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.451253798e-18, 9.787338261e-13 MLMG: Timers: Solve = 0.620269403 Iter = 0.551518124 Bottom = 0.003943773 STEP = 8 TIME = 0.025 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 9] ADVANCE at time 0.025 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 7.674118502e-19, 5.17546922e-13 MLMG: Timers: Solve = 0.695394749 Iter = 0.626398807 Bottom = 0.004401323 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 0 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.789252198e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.438528446e-21, 3.623645018e-14 MLMG: Timers: Solve = 0.102509312 Iter = 0.095372515 Bottom = 0.002929346 moveKick ... updating velocity only [Level 0 step 9] Advanced 4096 cells [Level 1 step 17] ADVANCE at time 0.025 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.573042079e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.614170587e-20, 2.988061883e-14 MLMG: Timers: Solve = 0.119150207 Iter = 0.108924162 Bottom = 0.00294796 moveKick ... updating velocity only [Level 1 step 17] Advanced 32768 cells [Level 2 step 33] ADVANCE at time 0.025 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 3.426295835e-19, 1.547906535e-13 MLMG: Timers: Solve = 0.180511009 Iter = 0.156745555 Bottom = 0.04192314 moveKick ... updating velocity only [Level 2 step 33] Advanced 53248 cells [Level 2 step 34] ADVANCE at time 0.02578125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 1.927047518e-19, 8.705872436e-14 MLMG: Timers: Solve = 0.202400446 Iter = 0.178495958 Bottom = 0.049538937 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.110302535e-19, 2.913795287e-13 MLMG: Timers: Solve = 0.180570308 Iter = 0.156739108 Bottom = 0.042100548 moveKick ... updating velocity only [Level 2 step 34] Advanced 53248 cells [Level 1 step 18] ADVANCE at time 0.0265625 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.727634435e-19, 1.165126501e-13 MLMG: Timers: Solve = 0.503688463 Iter = 0.44988586 Bottom = 0.004014887 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113485678e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 4.645963308e-20, 1.492206417e-13 MLMG: Timers: Solve = 0.119352374 Iter = 0.108988033 Bottom = 0.003066447 moveKick ... updating velocity only [Level 1 step 18] Advanced 32768 cells [Level 2 step 35] ADVANCE at time 0.0265625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.916780173e-19, 2.221266501e-13 MLMG: Timers: Solve = 0.181089462 Iter = 0.157271294 Bottom = 0.042279155 moveKick ... updating velocity only [Level 2 step 35] Advanced 53248 cells [Level 2 step 36] ADVANCE at time 0.02734375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 2.134967637e-19, 9.645198537e-14 MLMG: Timers: Solve = 0.203369039 Iter = 0.179462712 Bottom = 0.049874176 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 2.574237765e-19, 1.227566364e-13 MLMG: Timers: Solve = 0.181135714 Iter = 0.157239191 Bottom = 0.042615483 moveKick ... updating velocity only [Level 2 step 36] Advanced 53248 cells [STEP 9] Coarse TimeStep time: 6.271764404 [STEP 9] FAB kilobyte spread across MPI nodes: [20326 ... 20434] STEP = 9 TIME = 0.028125 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.028125 by dt = 0.003125 Old / new A time 0.028125 0.03125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.024977906 new finest: 2 Setting the current time in the state data to 0.028125 Calling redistribute because BoxArray changed TIME = 0.028125 : REGRID with lbase = 1 Level 2 15 grids 11264 cells 4.296875 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 8 x 8 [Level 0 step 10] ADVANCE at time 0.028125 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 3.150385605e-19, 2.124637993e-13 MLMG: Timers: Solve = 0.651405139 Iter = 0.600205364 Bottom = 0.002392059 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting -2.710505431e-20 to ensure solvability MLMG: Initial rhs = 2.892150254e-08 MLMG: Initial residual (resid0) = 3.873110818e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 3.890075324e-21, 1.004380073e-13 MLMG: Timers: Solve = 0.101653177 Iter = 0.094559875 Bottom = 0.001823714 moveKick ... updating velocity only [Level 0 step 10] Advanced 4096 cells [Level 1 step 19] ADVANCE at time 0.028125 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.641046646e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 2.52967341e-20, 4.682789262e-14 MLMG: Timers: Solve = 0.118108944 Iter = 0.107904051 Bottom = 0.001843907 moveKick ... updating velocity only [Level 1 step 19] Advanced 32768 cells [Level 2 step 37] ADVANCE at time 0.028125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.969760447e-20, 4.052291887e-14 MLMG: Timers: Solve = 0.119752456 Iter = 0.107861568 Bottom = 0.013223779 moveKick ... updating velocity only [Level 2 step 37] Advanced 11264 cells [Level 2 step 38] ADVANCE at time 0.02890625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.614806906e-19, 3.891933608e-13 MLMG: Timers: Solve = 0.119536616 Iter = 0.107611013 Bottom = 0.01321693 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.897798411e-19, 9.049954623e-14 MLMG: Timers: Solve = 0.119951824 Iter = 0.108026261 Bottom = 0.013228388 moveKick ... updating velocity only [Level 2 step 38] Advanced 11264 cells [Level 1 step 20] ADVANCE at time 0.0296875 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 9.867933836e-20, 6.654990774e-14 MLMG: Timers: Solve = 0.434220795 Iter = 0.399253334 Bottom = 0.002483051 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 3.704988249e-07 MLMG: Initial residual (resid0) = 3.495865805e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.085736593e-20, 2.930472432e-14 MLMG: Timers: Solve = 0.118222499 Iter = 0.107953709 Bottom = 0.001853331 moveKick ... updating velocity only [Level 1 step 20] Advanced 32768 cells [Level 2 step 39] ADVANCE at time 0.0296875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.131615442e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.294155088e-19, 4.677198815e-14 MLMG: Timers: Solve = 0.118931012 Iter = 0.107036792 Bottom = 0.012979907 moveKick ... updating velocity only [Level 2 step 39] Advanced 11264 cells [Level 2 step 40] ADVANCE at time 0.03046875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.766944786e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 5.942777781e-19, 2.147776064e-13 MLMG: Timers: Solve = 0.119596581 Iter = 0.107684249 Bottom = 0.013173409 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.793151269e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 1.876328318e-18, 6.326469533e-13 MLMG: Timers: Solve = 0.106903741 Iter = 0.094992904 Bottom = 0.011582595 moveKick ... updating velocity only [Level 2 step 40] Advanced 11264 cells [STEP 10] Coarse TimeStep time: 3.429065827 [STEP 10] FAB kilobyte spread across MPI nodes: [20326 ... 20434] STEP = 10 TIME = 0.03125 DT = 0.003125 PLOTFILE: file = Part-2line_restart-nbody_plt00010 Output file Part-2line_restart-nbody_plt00010.temp at time 1.000000 and step 10 Write plotfile time = 0.140701281 seconds Time w/o init: 46.48044309 CHECKPOINT: file = Part-2line_restart-nbody_chk00010 checkPoint() time = 0.014169895 secs. Run time = 48.17379033 Unused ParmParse Variables: [TOP]::amr.probin_file(nvals = 1) :: [] [TOP]::particles.particle_output_file(nvals = 1) :: [final_particles] Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [7611 ... 7621] [The Arena] max space (MB) allocated spread across MPI: [33 ... 33] [The Arena] max space (MB) used spread across MPI: [29 ... 30] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Pinned Arena] max space (MB) used spread across MPI: [3 ... 3] AMReX (26.04-124-g666ca0230a91) finalized Initializing AMReX (26.04-124-g666ca0230a91)... MPI initialized with 2 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.04-124-g666ca0230a91) initialized Successfully read inputs file ... AMReX git describe: 26.04-124-g666ca0230a Nyx git describe: 21.02.1-263-gf4b50a67 Nyx::hydro_tile_size unset, using fabarray.mfiter_tile_size default: (1024000,1024000,1024000) Suggested default for currently compiled CPU / GPU: nyx.hydro_tile_size=(1048576,1048576,1048576) Nyx::sundials_tile_size unset, using fabarray.mfiter_tile_size default: (1024000,1024000,1024000) Suggested default for currently compiled CPU / GPU: nyx.sundials_tile_size=(1048576,1048576,1048576) Nyx::setting init_sb_vels to 0 since do_santa_barbara = 0 restarting calculation from file: Part-2line_restart-nbody_chk00006 Successfully read inputs file ... read CPU time: 58.32861405 Getting Gconst from nyx_constants: 4.300927161e-09 Using -5.404704468e-08 for 4 pi G in Gravity.cpp ...setting old_a_time to 0.01875 Gravity ... defining average density in Gravity::set_mass_offset to be 0.0048828125 Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 7.247393028e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 4.499020876e-19, 1.516947659e-13 MLMG: Timers: Solve = 0.51966519 Iter = 0.469289557 Bottom = 0.001919154 Average dm density 0.0048828125 Average total density 0.0048828125 Restart time = 0.839882264 seconds. ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.01875 by dt = 0.003125 Old / new A time 0.01875 0.021875 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.04102341 new finest: 2 Setting the current time in the state data to 0.01875 Setting the current time in the state data to 0.01875 BA SIZE 0 FLEV 2 Calling redistribute because the size of BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 5.094599016e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 5.518202516e-19, 1.86058803e-13 MLMG: Timers: Solve = 0.511114376 Iter = 0.464621899 Bottom = 0.001824867 STEP = 6 TIME = 0.01875 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 14 grids 7168 cells 2.734375 % of domain smallest grid: 8 x 8 x 8 biggest grid: 8 x 8 x 8 [Level 0 step 7] ADVANCE at time 0.01875 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.965837911e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 4.688327363e-19, 1.580776666e-13 MLMG: Timers: Solve = 0.636349133 Iter = 0.590809145 Bottom = 0.002317661 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 0 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.734865479e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 5.03752993e-21, 7.485752428e-14 MLMG: Timers: Solve = 0.102266144 Iter = 0.095207736 Bottom = 0.001780989 moveKick ... updating velocity only [Level 0 step 7] Advanced 4096 cells [Level 1 step 13] ADVANCE at time 0.01875 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.57065785e-07 MLMG: Final Iter. 6 resid, resid/bnorm = 4.29030563e-19, 7.941972691e-13 MLMG: Timers: Solve = 0.103800461 Iter = 0.093610779 Bottom = 0.001561326 moveKick ... updating velocity only [Level 1 step 13] Advanced 32768 cells [Level 2 step 25] ADVANCE at time 0.01875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 2.64536806e-18, 9.560610219e-13 MLMG: Timers: Solve = 0.104832121 Iter = 0.093035504 Bottom = 0.009634202 moveKick ... updating velocity only [Level 2 step 25] Advanced 7168 cells [Level 2 step 26] ADVANCE at time 0.01953125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.766944786e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.839517367e-19, 1.749047322e-13 MLMG: Timers: Solve = 0.117359375 Iter = 0.105635669 Bottom = 0.010807736 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.650467071e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.632873141e-19, 6.160699593e-14 MLMG: Timers: Solve = 0.117655667 Iter = 0.105848885 Bottom = 0.010952993 moveKick ... updating velocity only [Level 2 step 26] Advanced 7168 cells [Level 1 step 14] ADVANCE at time 0.0203125 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 1.524659305e-19, 1.028238918e-13 MLMG: Timers: Solve = 0.425581478 Iter = 0.392320676 Bottom = 0.00232063 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.444676299e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.456105356e-20, 1.00331789e-13 MLMG: Timers: Solve = 0.11889947 Iter = 0.108726966 Bottom = 0.001812022 moveKick ... updating velocity only [Level 1 step 14] Advanced 32768 cells [Level 2 step 27] ADVANCE at time 0.0203125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.701940044e-20, 3.931297971e-14 MLMG: Timers: Solve = 0.11753729 Iter = 0.10573931 Bottom = 0.010885626 moveKick ... updating velocity only [Level 2 step 27] Advanced 7168 cells [Level 2 step 28] ADVANCE at time 0.02109375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.289115524e-19, 1.937704819e-13 MLMG: Timers: Solve = 0.11769818 Iter = 0.105951917 Bottom = 0.010998457 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 7 resid, resid/resid0 = 1.168936693e-18, 5.57426119e-13 MLMG: Timers: Solve = 0.104758193 Iter = 0.09293835 Bottom = 0.009607735 moveKick ... updating velocity only [Level 2 step 28] Advanced 7168 cells [STEP 7] Coarse TimeStep time: 4.107362615 [STEP 7] FAB kilobyte spread across MPI nodes: [9023 ... 9047] STEP = 7 TIME = 0.021875 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.021875 by dt = 0.003125 Old / new A time 0.021875 0.025 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.018316709 new finest: 2 Setting the current time in the state data to 0.021875 Calling redistribute because BoxArray changed TIME = 0.021875 : REGRID with lbase = 1 Level 2 36 grids 46080 cells 17.578125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 8] ADVANCE at time 0.021875 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 8.581502547e-20, 5.787414187e-14 MLMG: Timers: Solve = 0.752086906 Iter = 0.685993803 Bottom = 0.004936096 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 1.084202172e-19 to ensure solvability MLMG: Initial rhs = 1.432880048e-08 MLMG: Initial residual (resid0) = 4.198898866e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 2.648632321e-21, 6.30792121e-14 MLMG: Timers: Solve = 0.103377429 Iter = 0.096272848 Bottom = 0.002984396 moveKick ... updating velocity only [Level 0 step 8] Advanced 4096 cells [Level 1 step 15] ADVANCE at time 0.021875 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.593886225e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 3.715126625e-20, 6.877233639e-14 MLMG: Timers: Solve = 0.119697297 Iter = 0.109496324 Bottom = 0.002751921 moveKick ... updating velocity only [Level 1 step 15] Advanced 32768 cells [Level 2 step 29] ADVANCE at time 0.021875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 6.046444192e-19, 2.731617738e-13 MLMG: Timers: Solve = 0.172600318 Iter = 0.150765864 Bottom = 0.038441784 moveKick ... updating velocity only [Level 2 step 29] Advanced 46080 cells [Level 2 step 30] ADVANCE at time 0.02265625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 9.265793912e-19, 4.186031692e-13 MLMG: Timers: Solve = 0.190854201 Iter = 0.169046691 Bottom = 0.04338471 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.033966172e-19, 2.877393074e-13 MLMG: Timers: Solve = 0.17167345 Iter = 0.149823245 Bottom = 0.037699395 moveKick ... updating velocity only [Level 2 step 30] Advanced 46080 cells [Level 1 step 16] ADVANCE at time 0.0234375 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 2.432789363e-19, 1.640687001e-13 MLMG: Timers: Solve = 0.486311277 Iter = 0.436574112 Bottom = 0.003924331 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113486436e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.301257145e-20, 1.060308825e-13 MLMG: Timers: Solve = 0.12072767 Iter = 0.110418167 Bottom = 0.003497713 moveKick ... updating velocity only [Level 1 step 16] Advanced 32768 cells [Level 2 step 31] ADVANCE at time 0.0234375 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.947646417e-19, 2.235211024e-13 MLMG: Timers: Solve = 0.171546475 Iter = 0.149707205 Bottom = 0.037357444 moveKick ... updating velocity only [Level 2 step 31] Advanced 46080 cells [Level 2 step 32] ADVANCE at time 0.02421875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.290546235e-06 MLMG: Final Iter. 9 resid, resid/resid0 = 9.270775608e-19, 4.047408197e-13 MLMG: Timers: Solve = 0.191420955 Iter = 0.169561475 Bottom = 0.043505005 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.13258893e-18, 5.400931078e-13 MLMG: Timers: Solve = 0.171286007 Iter = 0.149454915 Bottom = 0.037185002 moveKick ... updating velocity only [Level 2 step 32] Advanced 46080 cells [STEP 8] Coarse TimeStep time: 5.022626716 [STEP 8] FAB kilobyte spread across MPI nodes: [17778 ... 18368] STEP = 8 TIME = 0.025 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.025 by dt = 0.003125 Old / new A time 0.025 0.028125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.05202082 new finest: 2 Setting the current time in the state data to 0.025 Setting the current time in the state data to 0.025 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 7.152210038e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.451280268e-18, 9.787516775e-13 MLMG: Timers: Solve = 0.618104642 Iter = 0.549226994 Bottom = 0.003883443 STEP = 8 TIME = 0.025 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 9] ADVANCE at time 0.025 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 7.674118502e-19, 5.17546922e-13 MLMG: Timers: Solve = 0.693250605 Iter = 0.62428943 Bottom = 0.004430807 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 0 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.789252198e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.438321651e-21, 3.623337721e-14 MLMG: Timers: Solve = 0.103504685 Iter = 0.096384167 Bottom = 0.0028957 moveKick ... updating velocity only [Level 0 step 9] Advanced 4096 cells [Level 1 step 17] ADVANCE at time 0.025 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.573042079e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.614087869e-20, 2.98790876e-14 MLMG: Timers: Solve = 0.120123201 Iter = 0.10991418 Bottom = 0.002920923 moveKick ... updating velocity only [Level 1 step 17] Advanced 32768 cells [Level 2 step 33] ADVANCE at time 0.025 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 3.426428183e-19, 1.547966327e-13 MLMG: Timers: Solve = 0.181353402 Iter = 0.157550608 Bottom = 0.042013179 moveKick ... updating velocity only [Level 2 step 33] Advanced 53248 cells [Level 2 step 34] ADVANCE at time 0.02578125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 1.926716646e-19, 8.704377646e-14 MLMG: Timers: Solve = 0.203010466 Iter = 0.179015655 Bottom = 0.049682863 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.11023636e-19, 2.913763731e-13 MLMG: Timers: Solve = 0.181804249 Iter = 0.157980518 Bottom = 0.042190395 moveKick ... updating velocity only [Level 2 step 34] Advanced 53248 cells [Level 1 step 18] ADVANCE at time 0.0265625 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.727832958e-19, 1.165260387e-13 MLMG: Timers: Solve = 0.498183454 Iter = 0.445167787 Bottom = 0.003967619 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113485678e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 4.64629418e-20, 1.492312688e-13 MLMG: Timers: Solve = 0.120371961 Iter = 0.110023244 Bottom = 0.003050819 moveKick ... updating velocity only [Level 1 step 18] Advanced 32768 cells [Level 2 step 35] ADVANCE at time 0.0265625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.916647824e-19, 2.22120671e-13 MLMG: Timers: Solve = 0.181719557 Iter = 0.157865571 Bottom = 0.042331953 moveKick ... updating velocity only [Level 2 step 35] Advanced 53248 cells [Level 2 step 36] ADVANCE at time 0.02734375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 2.134769113e-19, 9.644301663e-14 MLMG: Timers: Solve = 0.20404961 Iter = 0.180137223 Bottom = 0.05021682 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 2.574337027e-19, 1.227613699e-13 MLMG: Timers: Solve = 0.182138486 Iter = 0.158286976 Bottom = 0.042607975 moveKick ... updating velocity only [Level 2 step 36] Advanced 53248 cells [STEP 9] Coarse TimeStep time: 6.279555749 [STEP 9] FAB kilobyte spread across MPI nodes: [19756 ... 20434] STEP = 9 TIME = 0.028125 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.028125 by dt = 0.003125 Old / new A time 0.028125 0.03125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.024993839 new finest: 2 Setting the current time in the state data to 0.028125 Calling redistribute because BoxArray changed TIME = 0.028125 : REGRID with lbase = 1 Level 2 15 grids 11264 cells 4.296875 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 8 x 8 [Level 0 step 10] ADVANCE at time 0.028125 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 3.150385605e-19, 2.124637993e-13 MLMG: Timers: Solve = 0.648333727 Iter = 0.597690096 Bottom = 0.002413557 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting -2.710505431e-20 to ensure solvability MLMG: Initial rhs = 2.892150254e-08 MLMG: Initial residual (resid0) = 3.873110818e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 3.890075324e-21, 1.004380073e-13 MLMG: Timers: Solve = 0.102073413 Iter = 0.094972365 Bottom = 0.001850199 moveKick ... updating velocity only [Level 0 step 10] Advanced 4096 cells [Level 1 step 19] ADVANCE at time 0.028125 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.641046646e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 2.52967341e-20, 4.682789262e-14 MLMG: Timers: Solve = 0.118663002 Iter = 0.108465435 Bottom = 0.001862575 moveKick ... updating velocity only [Level 1 step 19] Advanced 32768 cells [Level 2 step 37] ADVANCE at time 0.028125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.969760447e-20, 4.052291887e-14 MLMG: Timers: Solve = 0.120214813 Iter = 0.108311256 Bottom = 0.013371137 moveKick ... updating velocity only [Level 2 step 37] Advanced 11264 cells [Level 2 step 38] ADVANCE at time 0.02890625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.614806906e-19, 3.891933608e-13 MLMG: Timers: Solve = 0.120448891 Iter = 0.108530628 Bottom = 0.013307766 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.897798411e-19, 9.049954623e-14 MLMG: Timers: Solve = 0.120527544 Iter = 0.108605756 Bottom = 0.0133025 moveKick ... updating velocity only [Level 2 step 38] Advanced 11264 cells [Level 1 step 20] ADVANCE at time 0.0296875 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 9.867933836e-20, 6.654990774e-14 MLMG: Timers: Solve = 0.432469018 Iter = 0.397716792 Bottom = 0.002484789 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 3.704988249e-07 MLMG: Initial residual (resid0) = 3.495865805e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.085736593e-20, 2.930472432e-14 MLMG: Timers: Solve = 0.118952088 Iter = 0.108676211 Bottom = 0.001870348 moveKick ... updating velocity only [Level 1 step 20] Advanced 32768 cells [Level 2 step 39] ADVANCE at time 0.0296875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.131615442e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.294155088e-19, 4.677198815e-14 MLMG: Timers: Solve = 0.120150016 Iter = 0.108229943 Bottom = 0.012973828 moveKick ... updating velocity only [Level 2 step 39] Advanced 11264 cells [Level 2 step 40] ADVANCE at time 0.03046875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.766944786e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 5.942777781e-19, 2.147776064e-13 MLMG: Timers: Solve = 0.120549232 Iter = 0.108617643 Bottom = 0.013302549 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.793151269e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 1.876328318e-18, 6.326469533e-13 MLMG: Timers: Solve = 0.107096658 Iter = 0.095185156 Bottom = 0.011589371 moveKick ... updating velocity only [Level 2 step 40] Advanced 11264 cells [STEP 10] Coarse TimeStep time: 3.428024318 [STEP 10] FAB kilobyte spread across MPI nodes: [19756 ... 20434] STEP = 10 TIME = 0.03125 DT = 0.003125 PLOTFILE: file = Part-2line_restart-nbody_plt00010 Output file Part-2line_restart-nbody_plt00010.temp at time 1.000000 and step 10 Write plotfile time = 0.132899121 seconds Time w/o init: 18.97073777 Run time = 19.8120261 Unused ParmParse Variables: [TOP]::amr.probin_file(nvals = 1) :: [] [TOP]::particles.particle_output_file(nvals = 1) :: [final_particles] Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [7611 ... 7621] [The Arena] max space (MB) allocated spread across MPI: [33 ... 33] [The Arena] max space (MB) used spread across MPI: [29 ... 30] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Pinned Arena] max space (MB) used spread across MPI: [3 ... 3] AMReX (26.04-124-g666ca0230a91) finalized