Initializing AMReX (26.09-7-g55dda725ff4d)... MPI initialized with 2 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.09-7-g55dda725ff4d) initialized Successfully read inputs file ... AMReX git describe: 26.09-7-g55dda725ff Nyx git describe: 26.09 Nyx::setting init_sb_vels to 0 since do_santa_barbara = 0 Successfully read inputs file ... Getting Gconst from nyx_constants: 4.300927161e-09 Using -5.404704468e-08 for 4 pi G in Gravity.cpp Initializing the data at level 0 ... setting particle_initrandom_mass to 2.123188769e+11 by dividing 8.696581196e+14 by 4096 Initializing DM particles from "particle_file.2line" ... Redistributing from processor 0 to 0 Redistributing from processor 1 to 1 Total number of particles: 16 Done initializing the level 0 data ...estdt from particles at level 0: 0.003125 Nyx::est_time_step at level 0: estdt = 0.003125 Integrating a from time 0 by dt = 0.003125 Old / new A time 0 0.003125 Old / new A 1 1 Old / new z 0 0 grid_places() time: 0.005632123 new finest: 1 Initializing the data at level 1 BA SIZE 0 FLEV 1 Calling redistribute because the size of BoxArray changed Done initializing the level 1 data grid_places() time: 0.012061882 new finest: 2 Initializing the data at level 2 BA SIZE 2 FLEV 2 Calling redistribute because the size of BoxArray changed Done initializing the level 2 data Now regridding at level lbase = 0 grid_places() time: 0.047107736 new finest: 2 Initializing the data at level 1 Calling redistribute because BoxArray changed Done initializing the level 1 data Initializing the data at level 2 Calling redistribute because BoxArray changed Done initializing the level 2 data NOT calling redistribute because NOT changed STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 Now regridding at level lbase = 0 grid_places() time: 0.05263656 new finest: 2 Regridding at level lbase = 0 but grids unchanged Setting the current time in the state data to 0 Setting the current time in the state data to 0 Setting the current time in the state data to 0 NOT calling redistribute because NOT changed Gravity ... defining average density in Gravity::set_mass_offset to be 0.0048828125 Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 7.669883337e-19, 5.172613001e-13 MLMG: Timers: Solve = 0.684333456 Iter = 0.616268403 Bottom = 0.004463542 INITIAL GRIDS Level 0 2 grids 4096 cells 100 % of domain smallest grid: 16 x 16 x 8 biggest grid: 16 x 16 x 8 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 CHECKPOINT: file = Part-2line_restart-nomesh_chk00000 checkPoint() time = 0.01467758 secs. PLOTFILE: file = Part-2line_restart-nomesh_plt00000 Output file Part-2line_restart-nomesh_plt00000.temp at time 1.000000 and step 0 Write plotfile time = 0.246825393 seconds ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Re-integrating a from time 0 by dt = 0.003125 Old / new A time 0 0.003125 Old / new A 1 1 Old / new z 0 0 [Level 0 step 1] ADVANCE at time 0 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 7.676236084e-19, 5.17689733e-13 MLMG: Timers: Solve = 0.672781709 Iter = 0.615003286 Bottom = 0.004267233 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 0 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.789252198e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.438580145e-21, 3.623721842e-14 MLMG: Timers: Solve = 0.101632229 Iter = 0.094605989 Bottom = 0.002783419 moveKick ... updating velocity only [Level 0 step 1] Advanced 4096 cells [Level 1 step 1] ADVANCE at time 0 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.573042079e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.614005151e-20, 2.987755637e-14 MLMG: Timers: Solve = 0.11840376 Iter = 0.10825311 Bottom = 0.002816356 moveKick ... updating velocity only [Level 1 step 1] Advanced 32768 cells [Level 2 step 1] ADVANCE at time 0 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 3.42622966e-19, 1.547876639e-13 MLMG: Timers: Solve = 0.18452364 Iter = 0.159267684 Bottom = 0.044261485 moveKick ... updating velocity only [Level 2 step 1] Advanced 53248 cells [Level 2 step 2] ADVANCE at time 0.00078125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 1.926981343e-19, 8.705573478e-14 MLMG: Timers: Solve = 0.205959249 Iter = 0.180677267 Bottom = 0.051902254 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.110368709e-19, 2.913826844e-13 MLMG: Timers: Solve = 0.184346164 Iter = 0.159088031 Bottom = 0.044162645 moveKick ... updating velocity only [Level 2 step 2] Advanced 53248 cells [Level 1 step 2] ADVANCE at time 0.0015625 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.727766784e-19, 1.165215758e-13 MLMG: Timers: Solve = 0.484543845 Iter = 0.436501819 Bottom = 0.003812141 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113485678e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 4.645136127e-20, 1.49194074e-13 MLMG: Timers: Solve = 0.118341542 Iter = 0.108184208 Bottom = 0.002931304 moveKick ... updating velocity only [Level 1 step 2] Advanced 32768 cells [Level 2 step 3] ADVANCE at time 0.0015625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.916912521e-19, 2.221326293e-13 MLMG: Timers: Solve = 0.184465638 Iter = 0.159251503 Bottom = 0.044384569 moveKick ... updating velocity only [Level 2 step 3] Advanced 53248 cells [Level 2 step 4] ADVANCE at time 0.00234375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 2.134967637e-19, 9.645198537e-14 MLMG: Timers: Solve = 0.206494295 Iter = 0.181229013 Bottom = 0.052235476 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 2.574237765e-19, 1.227566364e-13 MLMG: Timers: Solve = 0.184671558 Iter = 0.159418767 Bottom = 0.04456458 moveKick ... updating velocity only [Level 2 step 4] Advanced 53248 cells [STEP 1] Coarse TimeStep time: 5.159205054 [STEP 1] FAB kilobyte spread across MPI nodes: [17669 ... 18099] STEP = 1 TIME = 0.003125 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.003125 by dt = 0.003125 Old / new A time 0.003125 0.00625 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.024522955 new finest: 2 Setting the current time in the state data to 0.003125 Calling redistribute because BoxArray changed TIME = 0.003125 : REGRID with lbase = 1 Level 2 15 grids 11264 cells 4.296875 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 8 x 8 [Level 0 step 2] ADVANCE at time 0.003125 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 3.14747393e-19, 2.122674342e-13 MLMG: Timers: Solve = 0.63361683 Iter = 0.592548738 Bottom = 0.002309542 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 1.084202172e-19 to ensure solvability MLMG: Initial rhs = 2.892150254e-08 MLMG: Initial residual (resid0) = 3.873110818e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 3.890127023e-21, 1.004393421e-13 MLMG: Timers: Solve = 0.101525981 Iter = 0.094380731 Bottom = 0.0017786 moveKick ... updating velocity only [Level 0 step 2] Advanced 4096 cells [Level 1 step 3] ADVANCE at time 0.003125 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.641046646e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 2.52967341e-20, 4.682789262e-14 MLMG: Timers: Solve = 0.117991428 Iter = 0.107819069 Bottom = 0.001797122 moveKick ... updating velocity only [Level 1 step 3] Advanced 32768 cells [Level 2 step 5] ADVANCE at time 0.003125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.977701381e-20, 4.055879384e-14 MLMG: Timers: Solve = 0.122628784 Iter = 0.109908545 Bottom = 0.014398847 moveKick ... updating velocity only [Level 2 step 5] Advanced 11264 cells [Level 2 step 6] ADVANCE at time 0.00390625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.61440986e-19, 3.891754233e-13 MLMG: Timers: Solve = 0.12259159 Iter = 0.1098647 Bottom = 0.014329815 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.898195458e-19, 9.051848004e-14 MLMG: Timers: Solve = 0.122752378 Iter = 0.110024015 Bottom = 0.014383958 moveKick ... updating velocity only [Level 2 step 6] Advanced 11264 cells [Level 1 step 4] ADVANCE at time 0.0046875 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 9.8361701e-20, 6.63356913e-14 MLMG: Timers: Solve = 0.428381299 Iter = 0.394359031 Bottom = 0.002453762 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 3.704988249e-07 MLMG: Initial residual (resid0) = 3.495865805e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.085074848e-20, 2.928686341e-14 MLMG: Timers: Solve = 0.118112916 Iter = 0.107869734 Bottom = 0.001829358 moveKick ... updating velocity only [Level 1 step 4] Advanced 32768 cells [Level 2 step 7] ADVANCE at time 0.0046875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.131615442e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.294419785e-19, 4.678155458e-14 MLMG: Timers: Solve = 0.122430538 Iter = 0.109705877 Bottom = 0.014049463 moveKick ... updating velocity only [Level 2 step 7] Advanced 11264 cells [Level 2 step 8] ADVANCE at time 0.00546875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.766944786e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 5.942645432e-19, 2.147728231e-13 MLMG: Timers: Solve = 0.122601661 Iter = 0.109857209 Bottom = 0.014310041 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.793151269e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 1.876315083e-18, 6.326424909e-13 MLMG: Timers: Solve = 0.10965638 Iter = 0.096904073 Bottom = 0.012577271 moveKick ... updating velocity only [Level 2 step 8] Advanced 11264 cells [STEP 2] Coarse TimeStep time: 3.436067653 [STEP 2] FAB kilobyte spread across MPI nodes: [17669 ... 18099] STEP = 2 TIME = 0.00625 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.00625 by dt = 0.003125 Old / new A time 0.00625 0.009375 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.040882224 new finest: 2 Setting the current time in the state data to 0.00625 Setting the current time in the state data to 0.00625 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 7.247393028e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 3.38887832e-19, 1.142637737e-13 MLMG: Timers: Solve = 0.51326241 Iter = 0.463864778 Bottom = 0.001825351 STEP = 2 TIME = 0.00625 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 14 grids 7168 cells 2.734375 % of domain smallest grid: 8 x 8 x 8 biggest grid: 8 x 8 x 8 [Level 0 step 3] ADVANCE at time 0.00625 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.965837911e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 4.679857034e-19, 1.5779207e-13 MLMG: Timers: Solve = 0.636575038 Iter = 0.590072935 Bottom = 0.002341441 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 0 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.734865479e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 5.038046918e-21, 7.48652067e-14 MLMG: Timers: Solve = 0.101449713 Iter = 0.094348905 Bottom = 0.001802212 moveKick ... updating velocity only [Level 0 step 3] Advanced 4096 cells [Level 1 step 5] ADVANCE at time 0.00625 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.57065785e-07 MLMG: Final Iter. 6 resid, resid/bnorm = 4.290437979e-19, 7.942217688e-13 MLMG: Timers: Solve = 0.103061478 Iter = 0.092863262 Bottom = 0.001566124 moveKick ... updating velocity only [Level 1 step 5] Advanced 32768 cells [Level 2 step 9] ADVANCE at time 0.00625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 2.645473939e-18, 9.560992876e-13 MLMG: Timers: Solve = 0.104773996 Iter = 0.09296105 Bottom = 0.009530322 moveKick ... updating velocity only [Level 2 step 9] Advanced 7168 cells [Level 2 step 10] ADVANCE at time 0.00703125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.766944786e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.83925267e-19, 1.748951657e-13 MLMG: Timers: Solve = 0.117716438 Iter = 0.105883855 Bottom = 0.010919128 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.650467071e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.632079047e-19, 6.157703542e-14 MLMG: Timers: Solve = 0.117792169 Iter = 0.10595887 Bottom = 0.011012054 moveKick ... updating velocity only [Level 2 step 10] Advanced 7168 cells [Level 1 step 6] ADVANCE at time 0.0078125 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 1.527835679e-19, 1.030381082e-13 MLMG: Timers: Solve = 0.42568072 Iter = 0.392080573 Bottom = 0.002963663 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.444676299e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.455774484e-20, 1.003221837e-13 MLMG: Timers: Solve = 0.118225266 Iter = 0.107985776 Bottom = 0.001840627 moveKick ... updating velocity only [Level 1 step 6] Advanced 32768 cells [Level 2 step 11] ADVANCE at time 0.0078125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.711866211e-20, 3.935782341e-14 MLMG: Timers: Solve = 0.117640176 Iter = 0.105821438 Bottom = 0.01090937 moveKick ... updating velocity only [Level 2 step 11] Advanced 7168 cells [Level 2 step 12] ADVANCE at time 0.00859375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.289115524e-19, 1.937704819e-13 MLMG: Timers: Solve = 0.117856422 Iter = 0.106025696 Bottom = 0.011050932 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 7 resid, resid/resid0 = 1.168910223e-18, 5.574134965e-13 MLMG: Timers: Solve = 0.104880161 Iter = 0.093060058 Bottom = 0.00960857 moveKick ... updating velocity only [Level 2 step 12] Advanced 7168 cells [STEP 3] Coarse TimeStep time: 4.09350899 [STEP 3] FAB kilobyte spread across MPI nodes: [17669 ... 18099] STEP = 3 TIME = 0.009375 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.009375 by dt = 0.003125 Old / new A time 0.009375 0.0125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.018516725 new finest: 2 Setting the current time in the state data to 0.009375 Calling redistribute because BoxArray changed TIME = 0.009375 : REGRID with lbase = 1 Level 2 36 grids 46080 cells 17.578125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 4] ADVANCE at time 0.009375 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 8.581502547e-20, 5.787414187e-14 MLMG: Timers: Solve = 0.752361894 Iter = 0.686078935 Bottom = 0.004770287 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 1.355252716e-19 to ensure solvability MLMG: Initial rhs = 1.432880048e-08 MLMG: Initial residual (resid0) = 4.198898866e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 2.650286683e-21, 6.311861198e-14 MLMG: Timers: Solve = 0.102618349 Iter = 0.095492281 Bottom = 0.002994583 moveKick ... updating velocity only [Level 0 step 4] Advanced 4096 cells [Level 1 step 7] ADVANCE at time 0.009375 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.593886225e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 3.714961189e-20, 6.876927393e-14 MLMG: Timers: Solve = 0.119073867 Iter = 0.108852745 Bottom = 0.00276221 moveKick ... updating velocity only [Level 1 step 7] Advanced 32768 cells [Level 2 step 13] ADVANCE at time 0.009375 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 6.046708889e-19, 2.731737321e-13 MLMG: Timers: Solve = 0.171477264 Iter = 0.149641402 Bottom = 0.038436127 moveKick ... updating velocity only [Level 2 step 13] Advanced 46080 cells [Level 2 step 14] ADVANCE at time 0.01015625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 9.266852704e-19, 4.186510025e-13 MLMG: Timers: Solve = 0.190333937 Iter = 0.168449514 Bottom = 0.0432945 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.03423087e-19, 2.8775193e-13 MLMG: Timers: Solve = 0.170719613 Iter = 0.148839956 Bottom = 0.037647443 moveKick ... updating velocity only [Level 2 step 14] Advanced 46080 cells [Level 1 step 8] ADVANCE at time 0.0109375 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 2.433054061e-19, 1.640865515e-13 MLMG: Timers: Solve = 0.486606717 Iter = 0.436490083 Bottom = 0.003892697 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113486436e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.301091709e-20, 1.06025569e-13 MLMG: Timers: Solve = 0.119792439 Iter = 0.109491078 Bottom = 0.003511221 moveKick ... updating velocity only [Level 1 step 8] Advanced 32768 cells [Level 2 step 15] ADVANCE at time 0.0109375 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.94784494e-19, 2.235300712e-13 MLMG: Timers: Solve = 0.169578942 Iter = 0.147766255 Bottom = 0.035851155 moveKick ... updating velocity only [Level 2 step 15] Advanced 46080 cells [Level 2 step 16] ADVANCE at time 0.01171875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.290546235e-06 MLMG: Final Iter. 9 resid, resid/resid0 = 9.270775608e-19, 4.047408197e-13 MLMG: Timers: Solve = 0.190514691 Iter = 0.168620891 Bottom = 0.043540298 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.13253599e-18, 5.400678627e-13 MLMG: Timers: Solve = 0.17052192 Iter = 0.148586769 Bottom = 0.03715359 moveKick ... updating velocity only [Level 2 step 16] Advanced 46080 cells [STEP 4] Coarse TimeStep time: 4.990697137 [STEP 4] FAB kilobyte spread across MPI nodes: [17669 ... 18099] STEP = 4 TIME = 0.0125 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.0125 by dt = 0.003125 Old / new A time 0.0125 0.015625 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.052140656 new finest: 2 Setting the current time in the state data to 0.0125 Setting the current time in the state data to 0.0125 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 7.152210038e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.451174441e-18, 9.786803068e-13 MLMG: Timers: Solve = 0.620260807 Iter = 0.550423695 Bottom = 0.00390834 STEP = 4 TIME = 0.0125 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 5] ADVANCE at time 0.0125 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 7.676236084e-19, 5.17689733e-13 MLMG: Timers: Solve = 0.694641258 Iter = 0.625610686 Bottom = 0.004432665 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 0 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.789252198e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.438425048e-21, 3.623491369e-14 MLMG: Timers: Solve = 0.102680598 Iter = 0.095521821 Bottom = 0.002936728 moveKick ... updating velocity only [Level 0 step 5] Advanced 4096 cells [Level 1 step 9] ADVANCE at time 0.0125 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.573042079e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.614170587e-20, 2.988061883e-14 MLMG: Timers: Solve = 0.119624291 Iter = 0.109392185 Bottom = 0.002969474 moveKick ... updating velocity only [Level 1 step 9] Advanced 32768 cells [Level 2 step 17] ADVANCE at time 0.0125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 3.426163486e-19, 1.547846743e-13 MLMG: Timers: Solve = 0.180364281 Iter = 0.156519029 Bottom = 0.04202632 moveKick ... updating velocity only [Level 2 step 17] Advanced 53248 cells [Level 2 step 18] ADVANCE at time 0.01328125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 1.927113692e-19, 8.706171394e-14 MLMG: Timers: Solve = 0.202575691 Iter = 0.178679446 Bottom = 0.049713984 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.110434884e-19, 2.9138584e-13 MLMG: Timers: Solve = 0.18113655 Iter = 0.157255157 Bottom = 0.042260123 moveKick ... updating velocity only [Level 2 step 18] Advanced 53248 cells [Level 1 step 10] ADVANCE at time 0.0140625 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.727899133e-19, 1.165305015e-13 MLMG: Timers: Solve = 0.503291691 Iter = 0.449692491 Bottom = 0.0040237 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113485678e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 4.646790489e-20, 1.492472094e-13 MLMG: Timers: Solve = 0.119536111 Iter = 0.109162243 Bottom = 0.003055729 moveKick ... updating velocity only [Level 1 step 10] Advanced 32768 cells [Level 2 step 19] ADVANCE at time 0.0140625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.916713998e-19, 2.221236605e-13 MLMG: Timers: Solve = 0.180796369 Iter = 0.157029989 Bottom = 0.042202654 moveKick ... updating velocity only [Level 2 step 19] Advanced 53248 cells [Level 2 step 20] ADVANCE at time 0.01484375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 2.134702939e-19, 9.644002705e-14 MLMG: Timers: Solve = 0.202798095 Iter = 0.17886141 Bottom = 0.049982584 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 2.574469376e-19, 1.227676812e-13 MLMG: Timers: Solve = 0.18177073 Iter = 0.15788078 Bottom = 0.042599288 moveKick ... updating velocity only [Level 2 step 20] Advanced 53248 cells [STEP 5] Coarse TimeStep time: 6.249530695 [STEP 5] FAB kilobyte spread across MPI nodes: [18099 ... 18207] STEP = 5 TIME = 0.015625 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.015625 by dt = 0.003125 Old / new A time 0.015625 0.01875 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.024828181 new finest: 2 Setting the current time in the state data to 0.015625 Calling redistribute because BoxArray changed TIME = 0.015625 : REGRID with lbase = 1 Level 2 15 grids 11264 cells 4.296875 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 8 x 8 [Level 0 step 6] ADVANCE at time 0.015625 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 3.152503188e-19, 2.126066103e-13 MLMG: Timers: Solve = 0.648587205 Iter = 0.597679611 Bottom = 0.002407422 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting -2.710505431e-20 to ensure solvability MLMG: Initial rhs = 2.892150254e-08 MLMG: Initial residual (resid0) = 3.873110818e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 3.889816831e-21, 1.004313332e-13 MLMG: Timers: Solve = 0.101531549 Iter = 0.094416547 Bottom = 0.001819708 moveKick ... updating velocity only [Level 0 step 6] Advanced 4096 cells [Level 1 step 11] ADVANCE at time 0.015625 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.641046646e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 2.530004282e-20, 4.683401754e-14 MLMG: Timers: Solve = 0.118384773 Iter = 0.108171056 Bottom = 0.001861857 moveKick ... updating velocity only [Level 1 step 11] Advanced 32768 cells [Level 2 step 21] ADVANCE at time 0.015625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.977701381e-20, 4.055879384e-14 MLMG: Timers: Solve = 0.119505178 Iter = 0.107602905 Bottom = 0.013217923 moveKick ... updating velocity only [Level 2 step 21] Advanced 11264 cells [Level 2 step 22] ADVANCE at time 0.01640625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.614674557e-19, 3.891873816e-13 MLMG: Timers: Solve = 0.119476037 Iter = 0.10753925 Bottom = 0.013226142 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.898327807e-19, 9.052479131e-14 MLMG: Timers: Solve = 0.119529503 Iter = 0.107611934 Bottom = 0.013159717 moveKick ... updating velocity only [Level 2 step 22] Advanced 11264 cells [Level 1 step 12] ADVANCE at time 0.0171875 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 9.846758012e-20, 6.640709678e-14 MLMG: Timers: Solve = 0.432328636 Iter = 0.39756908 Bottom = 0.00236682 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 3.704988249e-07 MLMG: Initial residual (resid0) = 3.495865805e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.084909412e-20, 2.928239818e-14 MLMG: Timers: Solve = 0.118246055 Iter = 0.107945307 Bottom = 0.001884092 moveKick ... updating velocity only [Level 1 step 12] Advanced 32768 cells [Level 2 step 23] ADVANCE at time 0.0171875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.131615442e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.29389039e-19, 4.676242172e-14 MLMG: Timers: Solve = 0.118072889 Iter = 0.106163184 Bottom = 0.012861642 moveKick ... updating velocity only [Level 2 step 23] Advanced 11264 cells [Level 2 step 24] ADVANCE at time 0.01796875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.766944786e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 5.943174828e-19, 2.14791956e-13 MLMG: Timers: Solve = 0.120033133 Iter = 0.108100681 Bottom = 0.013209518 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.793151269e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 1.876301848e-18, 6.326380284e-13 MLMG: Timers: Solve = 0.106288703 Iter = 0.094378962 Bottom = 0.011531074 moveKick ... updating velocity only [Level 2 step 24] Advanced 11264 cells [STEP 6] Coarse TimeStep time: 3.407305272 [STEP 6] FAB kilobyte spread across MPI nodes: [18099 ... 18207] STEP = 6 TIME = 0.01875 DT = 0.003125 CHECKPOINT: file = Part-2line_restart-nomesh_chk00006 checkPoint() time = 0.014081084 secs. ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.01875 by dt = 0.003125 Old / new A time 0.01875 0.021875 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.041291841 new finest: 2 Setting the current time in the state data to 0.01875 Setting the current time in the state data to 0.01875 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 7.247393028e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 3.390201809e-19, 1.143083982e-13 MLMG: Timers: Solve = 0.516746584 Iter = 0.467065816 Bottom = 0.001855183 STEP = 6 TIME = 0.01875 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 14 grids 7168 cells 2.734375 % of domain smallest grid: 8 x 8 x 8 biggest grid: 8 x 8 x 8 [Level 0 step 7] ADVANCE at time 0.01875 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.965837911e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 4.688327363e-19, 1.580776666e-13 MLMG: Timers: Solve = 0.642394905 Iter = 0.593117614 Bottom = 0.002375769 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 0 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.734865479e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 5.03752993e-21, 7.485752428e-14 MLMG: Timers: Solve = 0.10139482 Iter = 0.094263867 Bottom = 0.001811854 moveKick ... updating velocity only [Level 0 step 7] Advanced 4096 cells [Level 1 step 13] ADVANCE at time 0.01875 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.57065785e-07 MLMG: Final Iter. 6 resid, resid/bnorm = 4.29030563e-19, 7.941972691e-13 MLMG: Timers: Solve = 0.103070674 Iter = 0.0928403 Bottom = 0.001573974 moveKick ... updating velocity only [Level 1 step 13] Advanced 32768 cells [Level 2 step 25] ADVANCE at time 0.01875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 2.64536806e-18, 9.560610219e-13 MLMG: Timers: Solve = 0.104834895 Iter = 0.093009018 Bottom = 0.009500154 moveKick ... updating velocity only [Level 2 step 25] Advanced 7168 cells [Level 2 step 26] ADVANCE at time 0.01953125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.766944786e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.839517367e-19, 1.749047322e-13 MLMG: Timers: Solve = 0.11767477 Iter = 0.105828555 Bottom = 0.010872634 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.650467071e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.632873141e-19, 6.160699593e-14 MLMG: Timers: Solve = 0.117747721 Iter = 0.105921773 Bottom = 0.010982448 moveKick ... updating velocity only [Level 2 step 26] Advanced 7168 cells [Level 1 step 14] ADVANCE at time 0.0203125 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 1.524659305e-19, 1.028238918e-13 MLMG: Timers: Solve = 0.428663924 Iter = 0.394571026 Bottom = 0.002367636 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.444676299e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.456105356e-20, 1.00331789e-13 MLMG: Timers: Solve = 0.118154642 Iter = 0.107894643 Bottom = 0.001840275 moveKick ... updating velocity only [Level 1 step 14] Advanced 32768 cells [Level 2 step 27] ADVANCE at time 0.0203125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.701940044e-20, 3.931297971e-14 MLMG: Timers: Solve = 0.117537957 Iter = 0.105710072 Bottom = 0.010858189 moveKick ... updating velocity only [Level 2 step 27] Advanced 7168 cells [Level 2 step 28] ADVANCE at time 0.02109375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.289115524e-19, 1.937704819e-13 MLMG: Timers: Solve = 0.117829752 Iter = 0.105992982 Bottom = 0.01102505 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 7 resid, resid/resid0 = 1.168936693e-18, 5.57426119e-13 MLMG: Timers: Solve = 0.104947004 Iter = 0.093123668 Bottom = 0.009621651 moveKick ... updating velocity only [Level 2 step 28] Advanced 7168 cells [STEP 7] Coarse TimeStep time: 4.110253404 [STEP 7] FAB kilobyte spread across MPI nodes: [18099 ... 18207] STEP = 7 TIME = 0.021875 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.021875 by dt = 0.003125 Old / new A time 0.021875 0.025 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.018602835 new finest: 2 Setting the current time in the state data to 0.021875 Calling redistribute because BoxArray changed TIME = 0.021875 : REGRID with lbase = 1 Level 2 36 grids 46080 cells 17.578125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 8] ADVANCE at time 0.021875 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 8.560326723e-20, 5.773133091e-14 MLMG: Timers: Solve = 0.753122441 Iter = 0.687046644 Bottom = 0.004819304 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 1.084202172e-19 to ensure solvability MLMG: Initial rhs = 1.432880048e-08 MLMG: Initial residual (resid0) = 4.198898866e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 2.64697796e-21, 6.303981222e-14 MLMG: Timers: Solve = 0.102768032 Iter = 0.095647277 Bottom = 0.003032265 moveKick ... updating velocity only [Level 0 step 8] Advanced 4096 cells [Level 1 step 15] ADVANCE at time 0.021875 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.593886225e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 3.715209343e-20, 6.877386762e-14 MLMG: Timers: Solve = 0.119087012 Iter = 0.108842025 Bottom = 0.002782258 moveKick ... updating velocity only [Level 1 step 15] Advanced 32768 cells [Level 2 step 29] ADVANCE at time 0.021875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 6.046444192e-19, 2.731617738e-13 MLMG: Timers: Solve = 0.171367576 Iter = 0.149493621 Bottom = 0.038378215 moveKick ... updating velocity only [Level 2 step 29] Advanced 46080 cells [Level 2 step 30] ADVANCE at time 0.02265625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 9.264999819e-19, 4.185672942e-13 MLMG: Timers: Solve = 0.189877775 Iter = 0.168023938 Bottom = 0.043269079 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.034098521e-19, 2.877456187e-13 MLMG: Timers: Solve = 0.170561612 Iter = 0.148719672 Bottom = 0.037594743 moveKick ... updating velocity only [Level 2 step 30] Advanced 46080 cells [Level 1 step 16] ADVANCE at time 0.0234375 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 2.431465874e-19, 1.639794432e-13 MLMG: Timers: Solve = 0.487465963 Iter = 0.43712661 Bottom = 0.003944669 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113486436e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.301257145e-20, 1.060308825e-13 MLMG: Timers: Solve = 0.119955433 Iter = 0.109616492 Bottom = 0.003526083 moveKick ... updating velocity only [Level 1 step 16] Advanced 32768 cells [Level 2 step 31] ADVANCE at time 0.0234375 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.94784494e-19, 2.235300712e-13 MLMG: Timers: Solve = 0.170499569 Iter = 0.148677273 Bottom = 0.037335333 moveKick ... updating velocity only [Level 2 step 31] Advanced 46080 cells [Level 2 step 32] ADVANCE at time 0.02421875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.290546235e-06 MLMG: Final Iter. 9 resid, resid/resid0 = 9.270775608e-19, 4.047408197e-13 MLMG: Timers: Solve = 0.190787388 Iter = 0.168860469 Bottom = 0.043644198 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.132271292e-18, 5.399416373e-13 MLMG: Timers: Solve = 0.170189227 Iter = 0.148336205 Bottom = 0.037181706 moveKick ... updating velocity only [Level 2 step 32] Advanced 46080 cells [STEP 8] Coarse TimeStep time: 4.989748997 [STEP 8] FAB kilobyte spread across MPI nodes: [18099 ... 18207] STEP = 8 TIME = 0.025 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.025 by dt = 0.003125 Old / new A time 0.025 0.028125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.052037562 new finest: 2 Setting the current time in the state data to 0.025 Setting the current time in the state data to 0.025 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 7.152210038e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.451214094e-18, 9.78707049e-13 MLMG: Timers: Solve = 0.621223343 Iter = 0.55117242 Bottom = 0.003960097 STEP = 8 TIME = 0.025 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 9] ADVANCE at time 0.025 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 7.67200092e-19, 5.174041111e-13 MLMG: Timers: Solve = 0.696297272 Iter = 0.627024685 Bottom = 0.004443033 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 0 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.789252198e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.438373349e-21, 3.623414545e-14 MLMG: Timers: Solve = 0.102833982 Iter = 0.095679644 Bottom = 0.002937154 moveKick ... updating velocity only [Level 0 step 9] Advanced 4096 cells [Level 1 step 17] ADVANCE at time 0.025 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.573042079e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.613839715e-20, 2.987449391e-14 MLMG: Timers: Solve = 0.119398819 Iter = 0.109159906 Bottom = 0.002972075 moveKick ... updating velocity only [Level 1 step 17] Advanced 32768 cells [Level 2 step 33] ADVANCE at time 0.025 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 3.426362009e-19, 1.547936431e-13 MLMG: Timers: Solve = 0.180330881 Iter = 0.156481872 Bottom = 0.041889868 moveKick ... updating velocity only [Level 2 step 33] Advanced 53248 cells [Level 2 step 34] ADVANCE at time 0.02578125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 1.926716646e-19, 8.704377646e-14 MLMG: Timers: Solve = 0.202410104 Iter = 0.178511874 Bottom = 0.049631758 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.110368709e-19, 2.913826844e-13 MLMG: Timers: Solve = 0.180803944 Iter = 0.156902822 Bottom = 0.042269526 moveKick ... updating velocity only [Level 2 step 34] Advanced 53248 cells [Level 1 step 18] ADVANCE at time 0.0265625 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.728097656e-19, 1.1654389e-13 MLMG: Timers: Solve = 0.502218625 Iter = 0.448416229 Bottom = 0.004052421 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113485678e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 4.647121361e-20, 1.492578364e-13 MLMG: Timers: Solve = 0.119453456 Iter = 0.109094102 Bottom = 0.003101575 moveKick ... updating velocity only [Level 1 step 18] Advanced 32768 cells [Level 2 step 35] ADVANCE at time 0.0265625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.91704487e-19, 2.221386084e-13 MLMG: Timers: Solve = 0.181078413 Iter = 0.157271401 Bottom = 0.042495893 moveKick ... updating velocity only [Level 2 step 35] Advanced 53248 cells [Level 2 step 36] ADVANCE at time 0.02734375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 2.134901462e-19, 9.644899579e-14 MLMG: Timers: Solve = 0.202910825 Iter = 0.17900473 Bottom = 0.050100259 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 2.574237765e-19, 1.227566364e-13 MLMG: Timers: Solve = 0.181777178 Iter = 0.157891181 Bottom = 0.042553698 moveKick ... updating velocity only [Level 2 step 36] Advanced 53248 cells [STEP 9] Coarse TimeStep time: 6.250940568 [STEP 9] FAB kilobyte spread across MPI nodes: [18099 ... 18207] STEP = 9 TIME = 0.028125 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.028125 by dt = 0.003125 Old / new A time 0.028125 0.03125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.025146916 new finest: 2 Setting the current time in the state data to 0.028125 Calling redistribute because BoxArray changed TIME = 0.028125 : REGRID with lbase = 1 Level 2 15 grids 11264 cells 4.296875 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 8 x 8 [Level 0 step 10] ADVANCE at time 0.028125 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 3.150385605e-19, 2.124637993e-13 MLMG: Timers: Solve = 0.650199284 Iter = 0.599083937 Bottom = 0.002407582 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting -2.710505431e-20 to ensure solvability MLMG: Initial rhs = 2.892150254e-08 MLMG: Initial residual (resid0) = 3.873110818e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 3.890075324e-21, 1.004380073e-13 MLMG: Timers: Solve = 0.101468118 Iter = 0.094353428 Bottom = 0.00184705 moveKick ... updating velocity only [Level 0 step 10] Advanced 4096 cells [Level 1 step 19] ADVANCE at time 0.028125 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.641046646e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 2.52967341e-20, 4.682789262e-14 MLMG: Timers: Solve = 0.11817711 Iter = 0.107950854 Bottom = 0.001899459 moveKick ... updating velocity only [Level 1 step 19] Advanced 32768 cells [Level 2 step 37] ADVANCE at time 0.028125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.969760447e-20, 4.052291887e-14 MLMG: Timers: Solve = 0.119212198 Iter = 0.107292785 Bottom = 0.013282767 moveKick ... updating velocity only [Level 2 step 37] Advanced 11264 cells [Level 2 step 38] ADVANCE at time 0.02890625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.614806906e-19, 3.891933608e-13 MLMG: Timers: Solve = 0.119815307 Iter = 0.107872666 Bottom = 0.013273639 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.897798411e-19, 9.049954623e-14 MLMG: Timers: Solve = 0.119722597 Iter = 0.107803636 Bottom = 0.01326472 moveKick ... updating velocity only [Level 2 step 38] Advanced 11264 cells [Level 1 step 20] ADVANCE at time 0.0296875 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 9.867933836e-20, 6.654990774e-14 MLMG: Timers: Solve = 0.432634029 Iter = 0.397842949 Bottom = 0.002486408 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 3.704988249e-07 MLMG: Initial residual (resid0) = 3.495865805e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.085736593e-20, 2.930472432e-14 MLMG: Timers: Solve = 0.118232213 Iter = 0.107918638 Bottom = 0.001862458 moveKick ... updating velocity only [Level 1 step 20] Advanced 32768 cells [Level 2 step 39] ADVANCE at time 0.0296875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.131615442e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.294155088e-19, 4.677198815e-14 MLMG: Timers: Solve = 0.119041273 Iter = 0.107122032 Bottom = 0.012889343 moveKick ... updating velocity only [Level 2 step 39] Advanced 11264 cells [Level 2 step 40] ADVANCE at time 0.03046875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.766944786e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 5.942777781e-19, 2.147776064e-13 MLMG: Timers: Solve = 0.119517484 Iter = 0.10758065 Bottom = 0.013164134 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.793151269e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 1.876328318e-18, 6.326469533e-13 MLMG: Timers: Solve = 0.106557496 Iter = 0.094640706 Bottom = 0.011543886 moveKick ... updating velocity only [Level 2 step 40] Advanced 11264 cells [STEP 10] Coarse TimeStep time: 3.407146657 [STEP 10] FAB kilobyte spread across MPI nodes: [18099 ... 18207] STEP = 10 TIME = 0.03125 DT = 0.003125 PLOTFILE: file = Part-2line_restart-nomesh_plt00010 Output file Part-2line_restart-nomesh_plt00010.temp at time 1.000000 and step 10 Write plotfile time = 0.145685479 seconds Time w/o init: 46.25430803 CHECKPOINT: file = Part-2line_restart-nomesh_chk00010 checkPoint() time = 0.013883807 secs. Run time = 47.87528349 Unused ParmParse Variables: [TOP]::amr.probin_file(nvals = 1) :: [] [TOP]::nyx.do_hydro(nvals = 1) :: [0] [TOP]::nyx.do_hydro(nvals = 1) :: [0] [TOP]::particles.particle_output_file(nvals = 1) :: [final_particles] Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [7611 ... 7621] [The Arena] max space (MB) allocated spread across MPI: [33 ... 33] [The Arena] max space (MB) used spread across MPI: [27 ... 28] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Pinned Arena] max space (MB) used spread across MPI: [3 ... 3] AMReX (26.09-7-g55dda725ff4d) finalized Initializing AMReX (26.09-7-g55dda725ff4d)... MPI initialized with 2 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.09-7-g55dda725ff4d) initialized Successfully read inputs file ... AMReX git describe: 26.09-7-g55dda725ff Nyx git describe: 26.09 Nyx::setting init_sb_vels to 0 since do_santa_barbara = 0 restarting calculation from file: Part-2line_restart-nomesh_chk00006 Successfully read inputs file ... read CPU time: 57.90568589 Getting Gconst from nyx_constants: 4.300927161e-09 Using -5.404704468e-08 for 4 pi G in Gravity.cpp ...setting old_a_time to 0.01875 Gravity ... defining average density in Gravity::set_mass_offset to be 0.0048828125 Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 7.247393028e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 4.499020876e-19, 1.516947659e-13 MLMG: Timers: Solve = 0.51780046 Iter = 0.467791817 Bottom = 0.00188496 Restart time = 0.802027982 seconds. ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.01875 by dt = 0.003125 Old / new A time 0.01875 0.021875 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.041128311 new finest: 2 Setting the current time in the state data to 0.01875 Setting the current time in the state data to 0.01875 BA SIZE 0 FLEV 2 Calling redistribute because the size of BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 5.094599016e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 5.518202516e-19, 1.86058803e-13 MLMG: Timers: Solve = 0.510700072 Iter = 0.463766384 Bottom = 0.001807514 STEP = 6 TIME = 0.01875 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 14 grids 7168 cells 2.734375 % of domain smallest grid: 8 x 8 x 8 biggest grid: 8 x 8 x 8 [Level 0 step 7] ADVANCE at time 0.01875 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.965837911e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 4.688327363e-19, 1.580776666e-13 MLMG: Timers: Solve = 0.636702198 Iter = 0.589411876 Bottom = 0.002299936 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 0 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.734865479e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 5.03752993e-21, 7.485752428e-14 MLMG: Timers: Solve = 0.10126223 Iter = 0.094182866 Bottom = 0.001777906 moveKick ... updating velocity only [Level 0 step 7] Advanced 4096 cells [Level 1 step 13] ADVANCE at time 0.01875 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.57065785e-07 MLMG: Final Iter. 6 resid, resid/bnorm = 4.29030563e-19, 7.941972691e-13 MLMG: Timers: Solve = 0.102950527 Iter = 0.092772632 Bottom = 0.001577651 moveKick ... updating velocity only [Level 1 step 13] Advanced 32768 cells [Level 2 step 25] ADVANCE at time 0.01875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 2.64536806e-18, 9.560610219e-13 MLMG: Timers: Solve = 0.104832249 Iter = 0.093031277 Bottom = 0.009546443 moveKick ... updating velocity only [Level 2 step 25] Advanced 7168 cells [Level 2 step 26] ADVANCE at time 0.01953125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.766944786e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.839517367e-19, 1.749047322e-13 MLMG: Timers: Solve = 0.117513128 Iter = 0.105723414 Bottom = 0.010713007 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.650467071e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.632873141e-19, 6.160699593e-14 MLMG: Timers: Solve = 0.117658187 Iter = 0.105855253 Bottom = 0.010851572 moveKick ... updating velocity only [Level 2 step 26] Advanced 7168 cells [Level 1 step 14] ADVANCE at time 0.0203125 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 1.524659305e-19, 1.028238918e-13 MLMG: Timers: Solve = 0.422918643 Iter = 0.389429875 Bottom = 0.002293266 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.444676299e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.456105356e-20, 1.00331789e-13 MLMG: Timers: Solve = 0.117996045 Iter = 0.107793091 Bottom = 0.001808403 moveKick ... updating velocity only [Level 1 step 14] Advanced 32768 cells [Level 2 step 27] ADVANCE at time 0.0203125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.701940044e-20, 3.931297971e-14 MLMG: Timers: Solve = 0.117533842 Iter = 0.10573534 Bottom = 0.010782226 moveKick ... updating velocity only [Level 2 step 27] Advanced 7168 cells [Level 2 step 28] ADVANCE at time 0.02109375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.289115524e-19, 1.937704819e-13 MLMG: Timers: Solve = 0.117553635 Iter = 0.105826307 Bottom = 0.01090354 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 7 resid, resid/resid0 = 1.168936693e-18, 5.57426119e-13 MLMG: Timers: Solve = 0.104871127 Iter = 0.093054671 Bottom = 0.009537101 moveKick ... updating velocity only [Level 2 step 28] Advanced 7168 cells [STEP 7] Coarse TimeStep time: 4.082568975 [STEP 7] FAB kilobyte spread across MPI nodes: [7974 ... 7998] STEP = 7 TIME = 0.021875 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.021875 by dt = 0.003125 Old / new A time 0.021875 0.025 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.018363891 new finest: 2 Setting the current time in the state data to 0.021875 Calling redistribute because BoxArray changed TIME = 0.021875 : REGRID with lbase = 1 Level 2 36 grids 46080 cells 17.578125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 8] ADVANCE at time 0.021875 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 8.592090459e-20, 5.794554735e-14 MLMG: Timers: Solve = 0.752400746 Iter = 0.686245649 Bottom = 0.004875048 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 1.084202172e-19 to ensure solvability MLMG: Initial rhs = 1.432880048e-08 MLMG: Initial residual (resid0) = 4.198898866e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 2.642014876e-21, 6.292161257e-14 MLMG: Timers: Solve = 0.103047419 Iter = 0.095949406 Bottom = 0.002950967 moveKick ... updating velocity only [Level 0 step 8] Advanced 4096 cells [Level 1 step 15] ADVANCE at time 0.021875 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.593886225e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 3.71491983e-20, 6.876850831e-14 MLMG: Timers: Solve = 0.118712166 Iter = 0.108553707 Bottom = 0.002698527 moveKick ... updating velocity only [Level 1 step 15] Advanced 32768 cells [Level 2 step 29] ADVANCE at time 0.021875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 6.045650098e-19, 2.731258989e-13 MLMG: Timers: Solve = 0.171264758 Iter = 0.149455792 Bottom = 0.03810677 moveKick ... updating velocity only [Level 2 step 29] Advanced 46080 cells [Level 2 step 30] ADVANCE at time 0.02265625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 9.265793912e-19, 4.186031692e-13 MLMG: Timers: Solve = 0.190091398 Iter = 0.168287693 Bottom = 0.043033273 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.034627916e-19, 2.877708638e-13 MLMG: Timers: Solve = 0.170502332 Iter = 0.148658235 Bottom = 0.037324093 moveKick ... updating velocity only [Level 2 step 30] Advanced 46080 cells [Level 1 step 16] ADVANCE at time 0.0234375 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 2.432259968e-19, 1.640329973e-13 MLMG: Timers: Solve = 0.486422238 Iter = 0.436351239 Bottom = 0.003879932 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113486436e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.301588017e-20, 1.060415096e-13 MLMG: Timers: Solve = 0.119698786 Iter = 0.109395461 Bottom = 0.003455857 moveKick ... updating velocity only [Level 1 step 16] Advanced 32768 cells [Level 2 step 31] ADVANCE at time 0.0234375 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.947778766e-19, 2.235270816e-13 MLMG: Timers: Solve = 0.170417775 Iter = 0.148586194 Bottom = 0.037133184 moveKick ... updating velocity only [Level 2 step 31] Advanced 46080 cells [Level 2 step 32] ADVANCE at time 0.02421875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.290546235e-06 MLMG: Final Iter. 9 resid, resid/resid0 = 9.270775608e-19, 4.047408197e-13 MLMG: Timers: Solve = 0.190330729 Iter = 0.168465597 Bottom = 0.043305289 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.13258893e-18, 5.400931078e-13 MLMG: Timers: Solve = 0.170368483 Iter = 0.148567711 Bottom = 0.036806443 moveKick ... updating velocity only [Level 2 step 32] Advanced 46080 cells [STEP 8] Coarse TimeStep time: 4.986337992 [STEP 8] FAB kilobyte spread across MPI nodes: [15766 ... 16329] STEP = 8 TIME = 0.025 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.025 by dt = 0.003125 Old / new A time 0.025 0.028125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.05216408 new finest: 2 Setting the current time in the state data to 0.025 Setting the current time in the state data to 0.025 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 7.152210038e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.451253798e-18, 9.787338261e-13 MLMG: Timers: Solve = 0.619250271 Iter = 0.549688696 Bottom = 0.003893297 STEP = 8 TIME = 0.025 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 9] ADVANCE at time 0.025 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 7.67200092e-19, 5.174041111e-13 MLMG: Timers: Solve = 0.693998331 Iter = 0.625101391 Bottom = 0.004361216 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 0 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.789252198e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.438321651e-21, 3.623337721e-14 MLMG: Timers: Solve = 0.102368741 Iter = 0.095240468 Bottom = 0.002873967 moveKick ... updating velocity only [Level 0 step 9] Advanced 4096 cells [Level 1 step 17] ADVANCE at time 0.025 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.573042079e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.613591561e-20, 2.986990022e-14 MLMG: Timers: Solve = 0.119263736 Iter = 0.109076384 Bottom = 0.002936869 moveKick ... updating velocity only [Level 1 step 17] Advanced 32768 cells [Level 2 step 33] ADVANCE at time 0.025 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 3.42622966e-19, 1.547876639e-13 MLMG: Timers: Solve = 0.18044216 Iter = 0.156639568 Bottom = 0.041685513 moveKick ... updating velocity only [Level 2 step 33] Advanced 53248 cells [Level 2 step 34] ADVANCE at time 0.02578125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 1.926716646e-19, 8.704377646e-14 MLMG: Timers: Solve = 0.202296823 Iter = 0.178412649 Bottom = 0.049364399 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.110302535e-19, 2.913795287e-13 MLMG: Timers: Solve = 0.180756347 Iter = 0.15694248 Bottom = 0.041901183 moveKick ... updating velocity only [Level 2 step 34] Advanced 53248 cells [Level 1 step 18] ADVANCE at time 0.0265625 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.727965307e-19, 1.165349643e-13 MLMG: Timers: Solve = 0.502135438 Iter = 0.448621973 Bottom = 0.003949225 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113485678e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 4.645797872e-20, 1.492153282e-13 MLMG: Timers: Solve = 0.119303538 Iter = 0.108961271 Bottom = 0.003056491 moveKick ... updating velocity only [Level 1 step 18] Advanced 32768 cells [Level 2 step 35] ADVANCE at time 0.0265625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.916912521e-19, 2.221326293e-13 MLMG: Timers: Solve = 0.181062393 Iter = 0.157295059 Bottom = 0.041948963 moveKick ... updating velocity only [Level 2 step 35] Advanced 53248 cells [Level 2 step 36] ADVANCE at time 0.02734375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 2.134702939e-19, 9.644002705e-14 MLMG: Timers: Solve = 0.20288228 Iter = 0.178971742 Bottom = 0.049627314 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 2.574237765e-19, 1.227566364e-13 MLMG: Timers: Solve = 0.181256744 Iter = 0.157433462 Bottom = 0.042324391 moveKick ... updating velocity only [Level 2 step 36] Advanced 53248 cells [STEP 9] Coarse TimeStep time: 6.241367149 [STEP 9] FAB kilobyte spread across MPI nodes: [17561 ... 18207] STEP = 9 TIME = 0.028125 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.028125 by dt = 0.003125 Old / new A time 0.028125 0.03125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.024888657 new finest: 2 Setting the current time in the state data to 0.028125 Calling redistribute because BoxArray changed TIME = 0.028125 : REGRID with lbase = 1 Level 2 15 grids 11264 cells 4.296875 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 8 x 8 [Level 0 step 10] ADVANCE at time 0.028125 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 3.150385605e-19, 2.124637993e-13 MLMG: Timers: Solve = 0.650780348 Iter = 0.599566452 Bottom = 0.002365912 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting -2.710505431e-20 to ensure solvability MLMG: Initial rhs = 2.892150254e-08 MLMG: Initial residual (resid0) = 3.873110818e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 3.890075324e-21, 1.004380073e-13 MLMG: Timers: Solve = 0.101188276 Iter = 0.094151022 Bottom = 0.001797562 moveKick ... updating velocity only [Level 0 step 10] Advanced 4096 cells [Level 1 step 19] ADVANCE at time 0.028125 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.641046646e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 2.52967341e-20, 4.682789262e-14 MLMG: Timers: Solve = 0.118208661 Iter = 0.108030405 Bottom = 0.001835642 moveKick ... updating velocity only [Level 1 step 19] Advanced 32768 cells [Level 2 step 37] ADVANCE at time 0.028125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.969760447e-20, 4.052291887e-14 MLMG: Timers: Solve = 0.119315158 Iter = 0.107429124 Bottom = 0.013152844 moveKick ... updating velocity only [Level 2 step 37] Advanced 11264 cells [Level 2 step 38] ADVANCE at time 0.02890625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.614806906e-19, 3.891933608e-13 MLMG: Timers: Solve = 0.119262596 Iter = 0.107337056 Bottom = 0.013085905 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.897798411e-19, 9.049954623e-14 MLMG: Timers: Solve = 0.120088153 Iter = 0.108188206 Bottom = 0.013154842 moveKick ... updating velocity only [Level 2 step 38] Advanced 11264 cells [Level 1 step 20] ADVANCE at time 0.0296875 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 9.867933836e-20, 6.654990774e-14 MLMG: Timers: Solve = 0.432303357 Iter = 0.397607653 Bottom = 0.002442397 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 3.704988249e-07 MLMG: Initial residual (resid0) = 3.495865805e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.085736593e-20, 2.930472432e-14 MLMG: Timers: Solve = 0.118033434 Iter = 0.107729107 Bottom = 0.001822523 moveKick ... updating velocity only [Level 1 step 20] Advanced 32768 cells [Level 2 step 39] ADVANCE at time 0.0296875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.131615442e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.294155088e-19, 4.677198815e-14 MLMG: Timers: Solve = 0.118823386 Iter = 0.106945981 Bottom = 0.012758149 moveKick ... updating velocity only [Level 2 step 39] Advanced 11264 cells [Level 2 step 40] ADVANCE at time 0.03046875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.766944786e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 5.942777781e-19, 2.147776064e-13 MLMG: Timers: Solve = 0.119487685 Iter = 0.107567447 Bottom = 0.013013727 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.793151269e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 1.876328318e-18, 6.326469533e-13 MLMG: Timers: Solve = 0.106109162 Iter = 0.094224473 Bottom = 0.011458929 moveKick ... updating velocity only [Level 2 step 40] Advanced 11264 cells [STEP 10] Coarse TimeStep time: 3.409422968 [STEP 10] FAB kilobyte spread across MPI nodes: [17561 ... 18207] STEP = 10 TIME = 0.03125 DT = 0.003125 PLOTFILE: file = Part-2line_restart-nomesh_plt00010 Output file Part-2line_restart-nomesh_plt00010.temp at time 1.000000 and step 10 Write plotfile time = 0.132595838 seconds Time w/o init: 18.85266994 Run time = 19.65603079 Unused ParmParse Variables: [TOP]::amr.probin_file(nvals = 1) :: [] [TOP]::nyx.do_hydro(nvals = 1) :: [0] [TOP]::nyx.do_hydro(nvals = 1) :: [0] [TOP]::particles.particle_output_file(nvals = 1) :: [final_particles] Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [7611 ... 7611] [The Arena] max space (MB) allocated spread across MPI: [33 ... 33] [The Arena] max space (MB) used spread across MPI: [27 ... 27] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Pinned Arena] max space (MB) used spread across MPI: [3 ... 3] AMReX (26.09-7-g55dda725ff4d) finalized