Initializing AMReX (26.05-3-g4ceb814db7d7)... MPI initialized with 2 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.05-3-g4ceb814db7d7) initialized Successfully read inputs file ... AMReX git describe: 26.05-3-g4ceb814db7 Nyx git describe: 21.02.1-263-gf4b50a67 Nyx::setting init_sb_vels to 0 since do_santa_barbara = 0 Successfully read inputs file ... Getting Gconst from nyx_constants: 4.300927161e-09 Using -5.404704468e-08 for 4 pi G in Gravity.cpp Initializing the data at level 0 ... setting particle_initrandom_mass to 2.123188769e+11 by dividing 8.696581196e+14 by 4096 Initializing DM particles from "particle_file.2line" ... Redistributing from processor 0 to 0 Redistributing from processor 1 to 1 Total number of particles: 16 Done initializing the level 0 data ...estdt from particles at level 0: 0.003125 Nyx::est_time_step at level 0: estdt = 0.003125 Integrating a from time 0 by dt = 0.003125 Old / new A time 0 0.003125 Old / new A 1 1 Old / new z 0 0 grid_places() time: 0.005636463 new finest: 1 Initializing the data at level 1 BA SIZE 0 FLEV 1 Calling redistribute because the size of BoxArray changed Done initializing the level 1 data grid_places() time: 0.011969422 new finest: 2 Initializing the data at level 2 BA SIZE 2 FLEV 2 Calling redistribute because the size of BoxArray changed Done initializing the level 2 data Now regridding at level lbase = 0 grid_places() time: 0.042638453 new finest: 2 Initializing the data at level 1 Calling redistribute because BoxArray changed Done initializing the level 1 data Initializing the data at level 2 Calling redistribute because BoxArray changed Done initializing the level 2 data NOT calling redistribute because NOT changed STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 Now regridding at level lbase = 0 grid_places() time: 0.052186587 new finest: 2 Regridding at level lbase = 0 but grids unchanged Setting the current time in the state data to 0 Setting the current time in the state data to 0 Setting the current time in the state data to 0 NOT calling redistribute because NOT changed Gravity ... defining average density in Gravity::set_mass_offset to be 0.0048828125 Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 7.676236084e-19, 5.17689733e-13 MLMG: Timers: Solve = 0.68513739 Iter = 0.617031103 Bottom = 0.004456065 INITIAL GRIDS Level 0 2 grids 4096 cells 100 % of domain smallest grid: 16 x 16 x 8 biggest grid: 16 x 16 x 8 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 CHECKPOINT: file = Part-2line_restart-nomesh_chk00000 checkPoint() time = 0.014445139 secs. PLOTFILE: file = Part-2line_restart-nomesh_plt00000 Output file Part-2line_restart-nomesh_plt00000.temp at time 1.000000 and step 0 Write plotfile time = 0.242810807 seconds ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Re-integrating a from time 0 by dt = 0.003125 Old / new A time 0 0.003125 Old / new A 1 1 Old / new z 0 0 [Level 0 step 1] ADVANCE at time 0 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 7.676236084e-19, 5.17689733e-13 MLMG: Timers: Solve = 0.678310131 Iter = 0.619589177 Bottom = 0.004278764 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 0 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.789252198e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.438425048e-21, 3.623491369e-14 MLMG: Timers: Solve = 0.102372848 Iter = 0.095311952 Bottom = 0.002820591 moveKick ... updating velocity only [Level 0 step 1] Advanced 4096 cells [Level 1 step 1] ADVANCE at time 0 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.573042079e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.613591561e-20, 2.986990022e-14 MLMG: Timers: Solve = 0.119203188 Iter = 0.108996096 Bottom = 0.00284726 moveKick ... updating velocity only [Level 1 step 1] Advanced 32768 cells [Level 2 step 1] ADVANCE at time 0 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 3.426362009e-19, 1.547936431e-13 MLMG: Timers: Solve = 0.185611182 Iter = 0.160182015 Bottom = 0.044390511 moveKick ... updating velocity only [Level 2 step 1] Advanced 53248 cells [Level 2 step 2] ADVANCE at time 0.00078125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 1.926981343e-19, 8.705573478e-14 MLMG: Timers: Solve = 0.205946831 Iter = 0.182151138 Bottom = 0.052368166 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.110368709e-19, 2.913826844e-13 MLMG: Timers: Solve = 0.185695844 Iter = 0.160207999 Bottom = 0.044422931 moveKick ... updating velocity only [Level 2 step 2] Advanced 53248 cells [Level 1 step 2] ADVANCE at time 0.0015625 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.728097656e-19, 1.1654389e-13 MLMG: Timers: Solve = 0.48948204 Iter = 0.440711024 Bottom = 0.003819522 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113485678e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 4.64629418e-20, 1.492312688e-13 MLMG: Timers: Solve = 0.120186589 Iter = 0.10982561 Bottom = 0.003903009 moveKick ... updating velocity only [Level 1 step 2] Advanced 32768 cells [Level 2 step 3] ADVANCE at time 0.0015625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.916713998e-19, 2.221236606e-13 MLMG: Timers: Solve = 0.183547468 Iter = 0.158119842 Bottom = 0.044529159 moveKick ... updating velocity only [Level 2 step 3] Advanced 53248 cells [Level 2 step 4] ADVANCE at time 0.00234375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 2.134967637e-19, 9.645198537e-14 MLMG: Timers: Solve = 0.207519518 Iter = 0.18210922 Bottom = 0.052413957 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 2.57430394e-19, 1.227597921e-13 MLMG: Timers: Solve = 0.186086267 Iter = 0.16062208 Bottom = 0.044827847 moveKick ... updating velocity only [Level 2 step 4] Advanced 53248 cells [STEP 1] Coarse TimeStep time: 5.186828376 [STEP 1] FAB kilobyte spread across MPI nodes: [17669 ... 18099] STEP = 1 TIME = 0.003125 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.003125 by dt = 0.003125 Old / new A time 0.003125 0.00625 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.024984792 new finest: 2 Setting the current time in the state data to 0.003125 Calling redistribute because BoxArray changed TIME = 0.003125 : REGRID with lbase = 1 Level 2 15 grids 11264 cells 4.296875 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 8 x 8 [Level 0 step 2] ADVANCE at time 0.003125 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 3.14747393e-19, 2.122674342e-13 MLMG: Timers: Solve = 0.635372833 Iter = 0.593861839 Bottom = 0.002336263 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 1.084202172e-19 to ensure solvability MLMG: Initial rhs = 2.892150254e-08 MLMG: Initial residual (resid0) = 3.873110818e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 3.890127023e-21, 1.004393421e-13 MLMG: Timers: Solve = 0.101387086 Iter = 0.094296893 Bottom = 0.001807297 moveKick ... updating velocity only [Level 0 step 2] Advanced 4096 cells [Level 1 step 3] ADVANCE at time 0.003125 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.641046646e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 2.52967341e-20, 4.682789262e-14 MLMG: Timers: Solve = 0.118115413 Iter = 0.107934322 Bottom = 0.001843235 moveKick ... updating velocity only [Level 1 step 3] Advanced 32768 cells [Level 2 step 5] ADVANCE at time 0.003125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.977701381e-20, 4.055879384e-14 MLMG: Timers: Solve = 0.12267735 Iter = 0.10996993 Bottom = 0.01442267 moveKick ... updating velocity only [Level 2 step 5] Advanced 11264 cells [Level 2 step 6] ADVANCE at time 0.00390625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.61440986e-19, 3.891754233e-13 MLMG: Timers: Solve = 0.122690721 Iter = 0.109967103 Bottom = 0.01435911 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.898195458e-19, 9.051848004e-14 MLMG: Timers: Solve = 0.122677011 Iter = 0.109954551 Bottom = 0.01437618 moveKick ... updating velocity only [Level 2 step 6] Advanced 11264 cells [Level 1 step 4] ADVANCE at time 0.0046875 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 9.8361701e-20, 6.63356913e-14 MLMG: Timers: Solve = 0.428000685 Iter = 0.393691294 Bottom = 0.002440997 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 3.704988249e-07 MLMG: Initial residual (resid0) = 3.495865805e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.085074848e-20, 2.928686341e-14 MLMG: Timers: Solve = 0.118037979 Iter = 0.107800086 Bottom = 0.001815536 moveKick ... updating velocity only [Level 1 step 4] Advanced 32768 cells [Level 2 step 7] ADVANCE at time 0.0046875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.131615442e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.294419785e-19, 4.678155458e-14 MLMG: Timers: Solve = 0.12244227 Iter = 0.109646267 Bottom = 0.014062629 moveKick ... updating velocity only [Level 2 step 7] Advanced 11264 cells [Level 2 step 8] ADVANCE at time 0.00546875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.766944786e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 5.942645432e-19, 2.147728231e-13 MLMG: Timers: Solve = 0.122590282 Iter = 0.109867578 Bottom = 0.014300575 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.793151269e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 1.876315083e-18, 6.326424909e-13 MLMG: Timers: Solve = 0.109538254 Iter = 0.096816891 Bottom = 0.012565376 moveKick ... updating velocity only [Level 2 step 8] Advanced 11264 cells [STEP 2] Coarse TimeStep time: 3.436555034 [STEP 2] FAB kilobyte spread across MPI nodes: [17669 ... 18099] STEP = 2 TIME = 0.00625 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.00625 by dt = 0.003125 Old / new A time 0.00625 0.009375 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.040850132 new finest: 2 Setting the current time in the state data to 0.00625 Setting the current time in the state data to 0.00625 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 7.247393028e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 3.38887832e-19, 1.142637737e-13 MLMG: Timers: Solve = 0.513564431 Iter = 0.464220324 Bottom = 0.001833764 STEP = 2 TIME = 0.00625 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 14 grids 7168 cells 2.734375 % of domain smallest grid: 8 x 8 x 8 biggest grid: 8 x 8 x 8 [Level 0 step 3] ADVANCE at time 0.00625 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.965837911e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 4.679857034e-19, 1.5779207e-13 MLMG: Timers: Solve = 0.637189364 Iter = 0.590555532 Bottom = 0.002353968 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 0 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.734865479e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 5.038046918e-21, 7.48652067e-14 MLMG: Timers: Solve = 0.101389376 Iter = 0.09429906 Bottom = 0.001791663 moveKick ... updating velocity only [Level 0 step 3] Advanced 4096 cells [Level 1 step 5] ADVANCE at time 0.00625 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.57065785e-07 MLMG: Final Iter. 6 resid, resid/bnorm = 4.290437979e-19, 7.942217688e-13 MLMG: Timers: Solve = 0.103062275 Iter = 0.092873301 Bottom = 0.001590871 moveKick ... updating velocity only [Level 1 step 5] Advanced 32768 cells [Level 2 step 9] ADVANCE at time 0.00625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 2.645473939e-18, 9.560992876e-13 MLMG: Timers: Solve = 0.104854895 Iter = 0.093041631 Bottom = 0.009505871 moveKick ... updating velocity only [Level 2 step 9] Advanced 7168 cells [Level 2 step 10] ADVANCE at time 0.00703125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.766944786e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.83925267e-19, 1.748951657e-13 MLMG: Timers: Solve = 0.117606943 Iter = 0.105791988 Bottom = 0.010878473 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.650467071e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.632079047e-19, 6.157703542e-14 MLMG: Timers: Solve = 0.117739619 Iter = 0.10591673 Bottom = 0.0109468 moveKick ... updating velocity only [Level 2 step 10] Advanced 7168 cells [Level 1 step 6] ADVANCE at time 0.0078125 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 1.527835679e-19, 1.030381082e-13 MLMG: Timers: Solve = 0.424733591 Iter = 0.39127632 Bottom = 0.002417043 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.444676299e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.455774484e-20, 1.003221837e-13 MLMG: Timers: Solve = 0.118749563 Iter = 0.108515151 Bottom = 0.001822915 moveKick ... updating velocity only [Level 1 step 6] Advanced 32768 cells [Level 2 step 11] ADVANCE at time 0.0078125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.711866211e-20, 3.935782341e-14 MLMG: Timers: Solve = 0.117567766 Iter = 0.105760745 Bottom = 0.010857594 moveKick ... updating velocity only [Level 2 step 11] Advanced 7168 cells [Level 2 step 12] ADVANCE at time 0.00859375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.289115524e-19, 1.937704819e-13 MLMG: Timers: Solve = 0.117777909 Iter = 0.105958334 Bottom = 0.010983876 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 7 resid, resid/resid0 = 1.168910223e-18, 5.574134965e-13 MLMG: Timers: Solve = 0.104807149 Iter = 0.092995961 Bottom = 0.009559513 moveKick ... updating velocity only [Level 2 step 12] Advanced 7168 cells [STEP 3] Coarse TimeStep time: 4.089250248 [STEP 3] FAB kilobyte spread across MPI nodes: [17669 ... 18099] STEP = 3 TIME = 0.009375 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.009375 by dt = 0.003125 Old / new A time 0.009375 0.0125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.018364824 new finest: 2 Setting the current time in the state data to 0.009375 Calling redistribute because BoxArray changed TIME = 0.009375 : REGRID with lbase = 1 Level 2 36 grids 46080 cells 17.578125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 4] ADVANCE at time 0.009375 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 8.602678371e-20, 5.801695283e-14 MLMG: Timers: Solve = 0.752740031 Iter = 0.686403008 Bottom = 0.004739307 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 1.355252716e-19 to ensure solvability MLMG: Initial rhs = 1.432880048e-08 MLMG: Initial residual (resid0) = 4.198898866e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 2.650286683e-21, 6.311861198e-14 MLMG: Timers: Solve = 0.102697581 Iter = 0.095596962 Bottom = 0.002977233 moveKick ... updating velocity only [Level 0 step 4] Advanced 4096 cells [Level 1 step 7] ADVANCE at time 0.009375 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.593886225e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 3.715043907e-20, 6.877080516e-14 MLMG: Timers: Solve = 0.119115052 Iter = 0.108904796 Bottom = 0.00278581 moveKick ... updating velocity only [Level 1 step 7] Advanced 32768 cells [Level 2 step 13] ADVANCE at time 0.009375 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 6.046973587e-19, 2.731856905e-13 MLMG: Timers: Solve = 0.171411545 Iter = 0.149578664 Bottom = 0.038380724 moveKick ... updating velocity only [Level 2 step 13] Advanced 46080 cells [Level 2 step 14] ADVANCE at time 0.01015625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 9.265264517e-19, 4.185792526e-13 MLMG: Timers: Solve = 0.189892458 Iter = 0.168049084 Bottom = 0.043173202 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.03423087e-19, 2.8775193e-13 MLMG: Timers: Solve = 0.170985675 Iter = 0.149107125 Bottom = 0.037587481 moveKick ... updating velocity only [Level 2 step 14] Advanced 46080 cells [Level 1 step 8] ADVANCE at time 0.0109375 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 2.430407083e-19, 1.639080377e-13 MLMG: Timers: Solve = 0.486430008 Iter = 0.436292801 Bottom = 0.003874175 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113486436e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.300595401e-20, 1.060096284e-13 MLMG: Timers: Solve = 0.119840919 Iter = 0.109548025 Bottom = 0.00348342 moveKick ... updating velocity only [Level 1 step 8] Advanced 32768 cells [Level 2 step 15] ADVANCE at time 0.0109375 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.94784494e-19, 2.235300712e-13 MLMG: Timers: Solve = 0.170281749 Iter = 0.14846473 Bottom = 0.037295669 moveKick ... updating velocity only [Level 2 step 15] Advanced 46080 cells [Level 2 step 16] ADVANCE at time 0.01171875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.290546235e-06 MLMG: Final Iter. 9 resid, resid/resid0 = 9.266540443e-19, 4.045559221e-13 MLMG: Timers: Solve = 0.190517095 Iter = 0.168648648 Bottom = 0.04346097 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.13253599e-18, 5.400678627e-13 MLMG: Timers: Solve = 0.170042111 Iter = 0.148177434 Bottom = 0.03707993 moveKick ... updating velocity only [Level 2 step 16] Advanced 46080 cells [STEP 4] Coarse TimeStep time: 4.990403772 [STEP 4] FAB kilobyte spread across MPI nodes: [17669 ... 18099] STEP = 4 TIME = 0.0125 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.0125 by dt = 0.003125 Old / new A time 0.0125 0.015625 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.051994835 new finest: 2 Setting the current time in the state data to 0.0125 Setting the current time in the state data to 0.0125 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 7.152210038e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.451240615e-18, 9.787249353e-13 MLMG: Timers: Solve = 0.621755179 Iter = 0.551654897 Bottom = 0.003888705 STEP = 4 TIME = 0.0125 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 5] ADVANCE at time 0.0125 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 7.676236084e-19, 5.17689733e-13 MLMG: Timers: Solve = 0.69797664 Iter = 0.628979088 Bottom = 0.004411035 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 0 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.789252198e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.438476747e-21, 3.623568194e-14 MLMG: Timers: Solve = 0.102527116 Iter = 0.09538066 Bottom = 0.002915457 moveKick ... updating velocity only [Level 0 step 5] Advanced 4096 cells [Level 1 step 9] ADVANCE at time 0.0125 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.573042079e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.614005151e-20, 2.987755637e-14 MLMG: Timers: Solve = 0.119185465 Iter = 0.108966177 Bottom = 0.002933076 moveKick ... updating velocity only [Level 1 step 9] Advanced 32768 cells [Level 2 step 17] ADVANCE at time 0.0125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 3.42622966e-19, 1.547876639e-13 MLMG: Timers: Solve = 0.180249049 Iter = 0.156476321 Bottom = 0.041871146 moveKick ... updating velocity only [Level 2 step 17] Advanced 53248 cells [Level 2 step 18] ADVANCE at time 0.01328125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 1.92678282e-19, 8.704676604e-14 MLMG: Timers: Solve = 0.202861033 Iter = 0.179004032 Bottom = 0.049575544 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.110037837e-19, 2.913669062e-13 MLMG: Timers: Solve = 0.1811419 Iter = 0.157265596 Bottom = 0.042247745 moveKick ... updating velocity only [Level 2 step 18] Advanced 53248 cells [Level 1 step 10] ADVANCE at time 0.0140625 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.727899133e-19, 1.165305015e-13 MLMG: Timers: Solve = 0.504316995 Iter = 0.450420702 Bottom = 0.004016677 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113485678e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 4.645136127e-20, 1.49194074e-13 MLMG: Timers: Solve = 0.119368034 Iter = 0.109004762 Bottom = 0.003041207 moveKick ... updating velocity only [Level 1 step 10] Advanced 32768 cells [Level 2 step 19] ADVANCE at time 0.0140625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.916846347e-19, 2.221296397e-13 MLMG: Timers: Solve = 0.180457454 Iter = 0.156698616 Bottom = 0.042192255 moveKick ... updating velocity only [Level 2 step 19] Advanced 53248 cells [Level 2 step 20] ADVANCE at time 0.01484375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 2.134769113e-19, 9.644301663e-14 MLMG: Timers: Solve = 0.202826026 Iter = 0.178915387 Bottom = 0.04998387 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 2.574138503e-19, 1.22751903e-13 MLMG: Timers: Solve = 0.181144317 Iter = 0.157300466 Bottom = 0.042620925 moveKick ... updating velocity only [Level 2 step 20] Advanced 53248 cells [STEP 5] Coarse TimeStep time: 6.248782694 [STEP 5] FAB kilobyte spread across MPI nodes: [18099 ... 18207] STEP = 5 TIME = 0.015625 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.015625 by dt = 0.003125 Old / new A time 0.015625 0.01875 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.024901494 new finest: 2 Setting the current time in the state data to 0.015625 Calling redistribute because BoxArray changed TIME = 0.015625 : REGRID with lbase = 1 Level 2 15 grids 11264 cells 4.296875 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 8 x 8 [Level 0 step 6] ADVANCE at time 0.015625 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 3.152503188e-19, 2.126066103e-13 MLMG: Timers: Solve = 0.65057639 Iter = 0.599366318 Bottom = 0.002440154 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting -2.710505431e-20 to ensure solvability MLMG: Initial rhs = 2.892150254e-08 MLMG: Initial residual (resid0) = 3.873110818e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 3.889816831e-21, 1.004313332e-13 MLMG: Timers: Solve = 0.101416749 Iter = 0.094313215 Bottom = 0.001814482 moveKick ... updating velocity only [Level 0 step 6] Advanced 4096 cells [Level 1 step 11] ADVANCE at time 0.015625 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.641046646e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 2.530004282e-20, 4.683401754e-14 MLMG: Timers: Solve = 0.118094874 Iter = 0.107898839 Bottom = 0.001847008 moveKick ... updating velocity only [Level 1 step 11] Advanced 32768 cells [Level 2 step 21] ADVANCE at time 0.015625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.977701381e-20, 4.055879384e-14 MLMG: Timers: Solve = 0.119675534 Iter = 0.107782425 Bottom = 0.013252205 moveKick ... updating velocity only [Level 2 step 21] Advanced 11264 cells [Level 2 step 22] ADVANCE at time 0.01640625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.614674557e-19, 3.891873816e-13 MLMG: Timers: Solve = 0.11953126 Iter = 0.107616753 Bottom = 0.01326343 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.898327807e-19, 9.052479131e-14 MLMG: Timers: Solve = 0.119720325 Iter = 0.107819429 Bottom = 0.013213397 moveKick ... updating velocity only [Level 2 step 22] Advanced 11264 cells [Level 1 step 12] ADVANCE at time 0.0171875 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 9.846758012e-20, 6.640709678e-14 MLMG: Timers: Solve = 0.431963979 Iter = 0.39801161 Bottom = 0.002369813 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 3.704988249e-07 MLMG: Initial residual (resid0) = 3.495865805e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.084909412e-20, 2.928239818e-14 MLMG: Timers: Solve = 0.11814145 Iter = 0.107874579 Bottom = 0.001865682 moveKick ... updating velocity only [Level 1 step 12] Advanced 32768 cells [Level 2 step 23] ADVANCE at time 0.0171875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.131615442e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.29389039e-19, 4.676242172e-14 MLMG: Timers: Solve = 0.119174186 Iter = 0.107281836 Bottom = 0.012881118 moveKick ... updating velocity only [Level 2 step 23] Advanced 11264 cells [Level 2 step 24] ADVANCE at time 0.01796875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.766944786e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 5.943174828e-19, 2.14791956e-13 MLMG: Timers: Solve = 0.119530566 Iter = 0.107603317 Bottom = 0.013207169 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.793151269e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 1.876301848e-18, 6.326380284e-13 MLMG: Timers: Solve = 0.106410257 Iter = 0.094507054 Bottom = 0.011581269 moveKick ... updating velocity only [Level 2 step 24] Advanced 11264 cells [STEP 6] Coarse TimeStep time: 3.409786358 [STEP 6] FAB kilobyte spread across MPI nodes: [18099 ... 18207] STEP = 6 TIME = 0.01875 DT = 0.003125 CHECKPOINT: file = Part-2line_restart-nomesh_chk00006 checkPoint() time = 0.014077451 secs. ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.01875 by dt = 0.003125 Old / new A time 0.01875 0.021875 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.041296383 new finest: 2 Setting the current time in the state data to 0.01875 Setting the current time in the state data to 0.01875 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 7.247393028e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 3.390201809e-19, 1.143083982e-13 MLMG: Timers: Solve = 0.516805751 Iter = 0.467043903 Bottom = 0.001854788 STEP = 6 TIME = 0.01875 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 14 grids 7168 cells 2.734375 % of domain smallest grid: 8 x 8 x 8 biggest grid: 8 x 8 x 8 [Level 0 step 7] ADVANCE at time 0.01875 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.965837911e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 4.688327363e-19, 1.580776666e-13 MLMG: Timers: Solve = 0.644074314 Iter = 0.594291986 Bottom = 0.002391843 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 0 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.734865479e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 5.03752993e-21, 7.485752428e-14 MLMG: Timers: Solve = 0.101586381 Iter = 0.094491988 Bottom = 0.001803916 moveKick ... updating velocity only [Level 0 step 7] Advanced 4096 cells [Level 1 step 13] ADVANCE at time 0.01875 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.57065785e-07 MLMG: Final Iter. 6 resid, resid/bnorm = 4.29030563e-19, 7.941972691e-13 MLMG: Timers: Solve = 0.103185291 Iter = 0.092986467 Bottom = 0.001574364 moveKick ... updating velocity only [Level 1 step 13] Advanced 32768 cells [Level 2 step 25] ADVANCE at time 0.01875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 2.64536806e-18, 9.560610219e-13 MLMG: Timers: Solve = 0.104779557 Iter = 0.092976072 Bottom = 0.009488037 moveKick ... updating velocity only [Level 2 step 25] Advanced 7168 cells [Level 2 step 26] ADVANCE at time 0.01953125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.766944786e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.839517367e-19, 1.749047322e-13 MLMG: Timers: Solve = 0.117573599 Iter = 0.105750464 Bottom = 0.010860939 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.650467071e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.632873141e-19, 6.160699593e-14 MLMG: Timers: Solve = 0.117682423 Iter = 0.105866206 Bottom = 0.010997509 moveKick ... updating velocity only [Level 2 step 26] Advanced 7168 cells [Level 1 step 14] ADVANCE at time 0.0203125 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 1.524659305e-19, 1.028238918e-13 MLMG: Timers: Solve = 0.429234828 Iter = 0.395025352 Bottom = 0.002371309 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.444676299e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.456105356e-20, 1.00331789e-13 MLMG: Timers: Solve = 0.11813923 Iter = 0.10787148 Bottom = 0.001841516 moveKick ... updating velocity only [Level 1 step 14] Advanced 32768 cells [Level 2 step 27] ADVANCE at time 0.0203125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.701940044e-20, 3.931297971e-14 MLMG: Timers: Solve = 0.117647065 Iter = 0.105838841 Bottom = 0.010938826 moveKick ... updating velocity only [Level 2 step 27] Advanced 7168 cells [Level 2 step 28] ADVANCE at time 0.02109375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.289115524e-19, 1.937704819e-13 MLMG: Timers: Solve = 0.117872191 Iter = 0.106018322 Bottom = 0.011103129 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 7 resid, resid/resid0 = 1.168936693e-18, 5.57426119e-13 MLMG: Timers: Solve = 0.104926303 Iter = 0.093111225 Bottom = 0.009637305 moveKick ... updating velocity only [Level 2 step 28] Advanced 7168 cells [STEP 7] Coarse TimeStep time: 4.111906586 [STEP 7] FAB kilobyte spread across MPI nodes: [18099 ... 18207] STEP = 7 TIME = 0.021875 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.021875 by dt = 0.003125 Old / new A time 0.021875 0.025 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.01849137 new finest: 2 Setting the current time in the state data to 0.021875 Calling redistribute because BoxArray changed TIME = 0.021875 : REGRID with lbase = 1 Level 2 36 grids 46080 cells 17.578125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 8] ADVANCE at time 0.021875 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 8.560326723e-20, 5.773133091e-14 MLMG: Timers: Solve = 0.753377599 Iter = 0.687014343 Bottom = 0.004795235 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 1.084202172e-19 to ensure solvability MLMG: Initial rhs = 1.432880048e-08 MLMG: Initial residual (resid0) = 4.198898866e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 2.648632321e-21, 6.30792121e-14 MLMG: Timers: Solve = 0.102557228 Iter = 0.095393555 Bottom = 0.002970805 moveKick ... updating velocity only [Level 0 step 8] Advanced 4096 cells [Level 1 step 15] ADVANCE at time 0.021875 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.593886225e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 3.715374779e-20, 6.877693008e-14 MLMG: Timers: Solve = 0.119016969 Iter = 0.108818649 Bottom = 0.002782471 moveKick ... updating velocity only [Level 1 step 15] Advanced 32768 cells [Level 2 step 29] ADVANCE at time 0.021875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 6.045914796e-19, 2.731378572e-13 MLMG: Timers: Solve = 0.171704265 Iter = 0.149891742 Bottom = 0.038353142 moveKick ... updating velocity only [Level 2 step 29] Advanced 46080 cells [Level 2 step 30] ADVANCE at time 0.02265625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 9.266588006e-19, 4.186390442e-13 MLMG: Timers: Solve = 0.190410621 Iter = 0.1685412 Bottom = 0.043331035 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.033966172e-19, 2.877393074e-13 MLMG: Timers: Solve = 0.170842397 Iter = 0.149019808 Bottom = 0.037702624 moveKick ... updating velocity only [Level 2 step 30] Advanced 46080 cells [Level 1 step 16] ADVANCE at time 0.0234375 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 2.433054061e-19, 1.640865515e-13 MLMG: Timers: Solve = 0.488023895 Iter = 0.437646787 Bottom = 0.003962756 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113486436e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.300760837e-20, 1.060149419e-13 MLMG: Timers: Solve = 0.119925495 Iter = 0.10956843 Bottom = 0.003558798 moveKick ... updating velocity only [Level 1 step 16] Advanced 32768 cells [Level 2 step 31] ADVANCE at time 0.0234375 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.94784494e-19, 2.235300712e-13 MLMG: Timers: Solve = 0.170717636 Iter = 0.148905671 Bottom = 0.037448812 moveKick ... updating velocity only [Level 2 step 31] Advanced 46080 cells [Level 2 step 32] ADVANCE at time 0.02421875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.290546235e-06 MLMG: Final Iter. 9 resid, resid/resid0 = 9.275010772e-19, 4.049257173e-13 MLMG: Timers: Solve = 0.193424357 Iter = 0.171541428 Bottom = 0.04505882 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.13258893e-18, 5.400931078e-13 MLMG: Timers: Solve = 0.170614454 Iter = 0.14875467 Bottom = 0.037162631 moveKick ... updating velocity only [Level 2 step 32] Advanced 46080 cells [STEP 8] Coarse TimeStep time: 4.990840494 [STEP 8] FAB kilobyte spread across MPI nodes: [18099 ... 18207] STEP = 8 TIME = 0.025 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.025 by dt = 0.003125 Old / new A time 0.025 0.028125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.052411933 new finest: 2 Setting the current time in the state data to 0.025 Setting the current time in the state data to 0.025 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 7.152210038e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.451253798e-18, 9.787338261e-13 MLMG: Timers: Solve = 0.624577083 Iter = 0.553724863 Bottom = 0.003963233 STEP = 8 TIME = 0.025 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 9] ADVANCE at time 0.025 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 7.674118502e-19, 5.17546922e-13 MLMG: Timers: Solve = 0.699596296 Iter = 0.630510405 Bottom = 0.00443726 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 0 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.789252198e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.438476747e-21, 3.623568194e-14 MLMG: Timers: Solve = 0.102719618 Iter = 0.095582777 Bottom = 0.002923528 moveKick ... updating velocity only [Level 0 step 9] Advanced 4096 cells [Level 1 step 17] ADVANCE at time 0.025 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.573042079e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.613839715e-20, 2.987449391e-14 MLMG: Timers: Solve = 0.11939051 Iter = 0.109178864 Bottom = 0.002954454 moveKick ... updating velocity only [Level 1 step 17] Advanced 32768 cells [Level 2 step 33] ADVANCE at time 0.025 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 3.426163486e-19, 1.547846743e-13 MLMG: Timers: Solve = 0.180490035 Iter = 0.156705626 Bottom = 0.042029697 moveKick ... updating velocity only [Level 2 step 33] Advanced 53248 cells [Level 2 step 34] ADVANCE at time 0.02578125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 1.927047518e-19, 8.705872436e-14 MLMG: Timers: Solve = 0.201959181 Iter = 0.178063765 Bottom = 0.049722518 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.110302535e-19, 2.913795287e-13 MLMG: Timers: Solve = 0.180874486 Iter = 0.157005376 Bottom = 0.042219031 moveKick ... updating velocity only [Level 2 step 34] Advanced 53248 cells [Level 1 step 18] ADVANCE at time 0.0265625 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.72816383e-19, 1.165483529e-13 MLMG: Timers: Solve = 0.504933931 Iter = 0.451012582 Bottom = 0.003987352 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113485678e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 4.645963308e-20, 1.492206417e-13 MLMG: Timers: Solve = 0.119426083 Iter = 0.109063126 Bottom = 0.003071814 moveKick ... updating velocity only [Level 1 step 18] Advanced 32768 cells [Level 2 step 35] ADVANCE at time 0.0265625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.916780173e-19, 2.221266501e-13 MLMG: Timers: Solve = 0.180692631 Iter = 0.156908468 Bottom = 0.042292184 moveKick ... updating velocity only [Level 2 step 35] Advanced 53248 cells [Level 2 step 36] ADVANCE at time 0.02734375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 2.134835288e-19, 9.644600621e-14 MLMG: Timers: Solve = 0.203815854 Iter = 0.179898402 Bottom = 0.050278249 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 2.574270852e-19, 1.227582143e-13 MLMG: Timers: Solve = 0.18130524 Iter = 0.157401244 Bottom = 0.042758594 moveKick ... updating velocity only [Level 2 step 36] Advanced 53248 cells [STEP 9] Coarse TimeStep time: 6.259004478 [STEP 9] FAB kilobyte spread across MPI nodes: [18099 ... 18207] STEP = 9 TIME = 0.028125 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.028125 by dt = 0.003125 Old / new A time 0.028125 0.03125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.024932913 new finest: 2 Setting the current time in the state data to 0.028125 Calling redistribute because BoxArray changed TIME = 0.028125 : REGRID with lbase = 1 Level 2 15 grids 11264 cells 4.296875 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 8 x 8 [Level 0 step 10] ADVANCE at time 0.028125 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 3.150385605e-19, 2.124637993e-13 MLMG: Timers: Solve = 0.651478858 Iter = 0.600502469 Bottom = 0.002416582 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting -2.710505431e-20 to ensure solvability MLMG: Initial rhs = 2.892150254e-08 MLMG: Initial residual (resid0) = 3.873110818e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 3.890075324e-21, 1.004380073e-13 MLMG: Timers: Solve = 0.102133553 Iter = 0.094971793 Bottom = 0.0018273 moveKick ... updating velocity only [Level 0 step 10] Advanced 4096 cells [Level 1 step 19] ADVANCE at time 0.028125 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.641046646e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 2.52967341e-20, 4.682789262e-14 MLMG: Timers: Solve = 0.118078806 Iter = 0.107863335 Bottom = 0.0018577 moveKick ... updating velocity only [Level 1 step 19] Advanced 32768 cells [Level 2 step 37] ADVANCE at time 0.028125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.969760447e-20, 4.052291887e-14 MLMG: Timers: Solve = 0.119914876 Iter = 0.108020926 Bottom = 0.013245235 moveKick ... updating velocity only [Level 2 step 37] Advanced 11264 cells [Level 2 step 38] ADVANCE at time 0.02890625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.614806906e-19, 3.891933608e-13 MLMG: Timers: Solve = 0.119282708 Iter = 0.107360951 Bottom = 0.013183194 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.897798411e-19, 9.049954623e-14 MLMG: Timers: Solve = 0.119554898 Iter = 0.107652653 Bottom = 0.013186045 moveKick ... updating velocity only [Level 2 step 38] Advanced 11264 cells [Level 1 step 20] ADVANCE at time 0.0296875 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 9.867933836e-20, 6.654990774e-14 MLMG: Timers: Solve = 0.434648595 Iter = 0.399693454 Bottom = 0.002478221 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 3.704988249e-07 MLMG: Initial residual (resid0) = 3.495865805e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.085736593e-20, 2.930472432e-14 MLMG: Timers: Solve = 0.118355202 Iter = 0.108060915 Bottom = 0.001854414 moveKick ... updating velocity only [Level 1 step 20] Advanced 32768 cells [Level 2 step 39] ADVANCE at time 0.0296875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.131615442e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.294155088e-19, 4.677198815e-14 MLMG: Timers: Solve = 0.118908003 Iter = 0.107005669 Bottom = 0.012938981 moveKick ... updating velocity only [Level 2 step 39] Advanced 11264 cells [Level 2 step 40] ADVANCE at time 0.03046875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.766944786e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 5.942777781e-19, 2.147776064e-13 MLMG: Timers: Solve = 0.119656908 Iter = 0.10773541 Bottom = 0.013217475 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.793151269e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 1.876328318e-18, 6.326469533e-13 MLMG: Timers: Solve = 0.106660466 Iter = 0.094651766 Bottom = 0.011593195 moveKick ... updating velocity only [Level 2 step 40] Advanced 11264 cells [STEP 10] Coarse TimeStep time: 3.415633872 [STEP 10] FAB kilobyte spread across MPI nodes: [18099 ... 18207] STEP = 10 TIME = 0.03125 DT = 0.003125 PLOTFILE: file = Part-2line_restart-nomesh_plt00010 Output file Part-2line_restart-nomesh_plt00010.temp at time 1.000000 and step 10 Write plotfile time = 0.13779386 seconds Time w/o init: 46.29110055 CHECKPOINT: file = Part-2line_restart-nomesh_chk00010 checkPoint() time = 0.01393879 secs. Run time = 47.89070773 Unused ParmParse Variables: [TOP]::amr.probin_file(nvals = 1) :: [] [TOP]::nyx.do_hydro(nvals = 1) :: [0] [TOP]::nyx.do_hydro(nvals = 1) :: [0] [TOP]::particles.particle_output_file(nvals = 1) :: [final_particles] Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [7611 ... 7621] [The Arena] max space (MB) allocated spread across MPI: [33 ... 33] [The Arena] max space (MB) used spread across MPI: [27 ... 28] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Pinned Arena] max space (MB) used spread across MPI: [3 ... 3] AMReX (26.05-3-g4ceb814db7d7) finalized Initializing AMReX (26.05-3-g4ceb814db7d7)... MPI initialized with 2 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.05-3-g4ceb814db7d7) initialized Successfully read inputs file ... AMReX git describe: 26.05-3-g4ceb814db7 Nyx git describe: 21.02.1-263-gf4b50a67 Nyx::setting init_sb_vels to 0 since do_santa_barbara = 0 restarting calculation from file: Part-2line_restart-nomesh_chk00006 Successfully read inputs file ... read CPU time: 57.91353042 Getting Gconst from nyx_constants: 4.300927161e-09 Using -5.404704468e-08 for 4 pi G in Gravity.cpp ...setting old_a_time to 0.01875 Gravity ... defining average density in Gravity::set_mass_offset to be 0.0048828125 Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 7.247393028e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 4.499020876e-19, 1.516947659e-13 MLMG: Timers: Solve = 0.519288823 Iter = 0.469265516 Bottom = 0.001900412 Restart time = 0.80349927 seconds. ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.01875 by dt = 0.003125 Old / new A time 0.01875 0.021875 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.041145105 new finest: 2 Setting the current time in the state data to 0.01875 Setting the current time in the state data to 0.01875 BA SIZE 0 FLEV 2 Calling redistribute because the size of BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 5.094599016e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 5.518202516e-19, 1.86058803e-13 MLMG: Timers: Solve = 0.514292399 Iter = 0.4650921 Bottom = 0.001903739 STEP = 6 TIME = 0.01875 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 14 grids 7168 cells 2.734375 % of domain smallest grid: 8 x 8 x 8 biggest grid: 8 x 8 x 8 [Level 0 step 7] ADVANCE at time 0.01875 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.965837911e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 4.688327363e-19, 1.580776666e-13 MLMG: Timers: Solve = 0.637257208 Iter = 0.590489139 Bottom = 0.002318478 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 0 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.734865479e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 5.03752993e-21, 7.485752428e-14 MLMG: Timers: Solve = 0.102282886 Iter = 0.095194386 Bottom = 0.001793999 moveKick ... updating velocity only [Level 0 step 7] Advanced 4096 cells [Level 1 step 13] ADVANCE at time 0.01875 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.57065785e-07 MLMG: Final Iter. 6 resid, resid/bnorm = 4.29030563e-19, 7.941972691e-13 MLMG: Timers: Solve = 0.104217368 Iter = 0.093987606 Bottom = 0.001673462 moveKick ... updating velocity only [Level 1 step 13] Advanced 32768 cells [Level 2 step 25] ADVANCE at time 0.01875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 2.64536806e-18, 9.560610219e-13 MLMG: Timers: Solve = 0.10528988 Iter = 0.093472658 Bottom = 0.009879749 moveKick ... updating velocity only [Level 2 step 25] Advanced 7168 cells [Level 2 step 26] ADVANCE at time 0.01953125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.766944786e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.839517367e-19, 1.749047322e-13 MLMG: Timers: Solve = 0.117655227 Iter = 0.10584606 Bottom = 0.010890842 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.650467071e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.632873141e-19, 6.160699593e-14 MLMG: Timers: Solve = 0.117912149 Iter = 0.106087472 Bottom = 0.01108928 moveKick ... updating velocity only [Level 2 step 26] Advanced 7168 cells [Level 1 step 14] ADVANCE at time 0.0203125 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 1.524659305e-19, 1.028238918e-13 MLMG: Timers: Solve = 0.425596386 Iter = 0.392073708 Bottom = 0.00232479 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.444676299e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.456105356e-20, 1.00331789e-13 MLMG: Timers: Solve = 0.118947091 Iter = 0.108748032 Bottom = 0.001820773 moveKick ... updating velocity only [Level 1 step 14] Advanced 32768 cells [Level 2 step 27] ADVANCE at time 0.0203125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.701940044e-20, 3.931297971e-14 MLMG: Timers: Solve = 0.1174423 Iter = 0.105621664 Bottom = 0.01090206 moveKick ... updating velocity only [Level 2 step 27] Advanced 7168 cells [Level 2 step 28] ADVANCE at time 0.02109375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.289115524e-19, 1.937704819e-13 MLMG: Timers: Solve = 0.117769234 Iter = 0.106027883 Bottom = 0.011010675 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 7 resid, resid/resid0 = 1.168936693e-18, 5.57426119e-13 MLMG: Timers: Solve = 0.104871238 Iter = 0.093050932 Bottom = 0.009591711 moveKick ... updating velocity only [Level 2 step 28] Advanced 7168 cells [STEP 7] Coarse TimeStep time: 4.094192551 [STEP 7] FAB kilobyte spread across MPI nodes: [7974 ... 7998] STEP = 7 TIME = 0.021875 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.021875 by dt = 0.003125 Old / new A time 0.021875 0.025 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.018514343 new finest: 2 Setting the current time in the state data to 0.021875 Calling redistribute because BoxArray changed TIME = 0.021875 : REGRID with lbase = 1 Level 2 36 grids 46080 cells 17.578125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 8] ADVANCE at time 0.021875 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 8.602678371e-20, 5.801695283e-14 MLMG: Timers: Solve = 0.752989864 Iter = 0.686581404 Bottom = 0.004943073 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 1.084202172e-19 to ensure solvability MLMG: Initial rhs = 1.432880048e-08 MLMG: Initial residual (resid0) = 4.198898866e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 2.64697796e-21, 6.303981222e-14 MLMG: Timers: Solve = 0.103441841 Iter = 0.096337897 Bottom = 0.002995058 moveKick ... updating velocity only [Level 0 step 8] Advanced 4096 cells [Level 1 step 15] ADVANCE at time 0.021875 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.593886225e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 3.714878471e-20, 6.87677427e-14 MLMG: Timers: Solve = 0.119923982 Iter = 0.109747029 Bottom = 0.00272188 moveKick ... updating velocity only [Level 1 step 15] Advanced 32768 cells [Level 2 step 29] ADVANCE at time 0.021875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 6.046444192e-19, 2.731617738e-13 MLMG: Timers: Solve = 0.172712482 Iter = 0.150889257 Bottom = 0.038418248 moveKick ... updating velocity only [Level 2 step 29] Advanced 46080 cells [Level 2 step 30] ADVANCE at time 0.02265625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 9.266323308e-19, 4.186270859e-13 MLMG: Timers: Solve = 0.19111289 Iter = 0.169201958 Bottom = 0.04327513 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.034495568e-19, 2.877645525e-13 MLMG: Timers: Solve = 0.17180658 Iter = 0.149966577 Bottom = 0.037638486 moveKick ... updating velocity only [Level 2 step 30] Advanced 46080 cells [Level 1 step 16] ADVANCE at time 0.0234375 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 2.433054061e-19, 1.640865515e-13 MLMG: Timers: Solve = 0.486765267 Iter = 0.436611125 Bottom = 0.003918487 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113486436e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.301588017e-20, 1.060415096e-13 MLMG: Timers: Solve = 0.120859795 Iter = 0.110550896 Bottom = 0.003515002 moveKick ... updating velocity only [Level 1 step 16] Advanced 32768 cells [Level 2 step 31] ADVANCE at time 0.0234375 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.947646417e-19, 2.235211024e-13 MLMG: Timers: Solve = 0.171672429 Iter = 0.149818408 Bottom = 0.037448833 moveKick ... updating velocity only [Level 2 step 31] Advanced 46080 cells [Level 2 step 32] ADVANCE at time 0.02421875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.290546235e-06 MLMG: Final Iter. 9 resid, resid/resid0 = 9.275010772e-19, 4.049257173e-13 MLMG: Timers: Solve = 0.191492288 Iter = 0.169581899 Bottom = 0.043577708 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.132377171e-18, 5.399921275e-13 MLMG: Timers: Solve = 0.171314352 Iter = 0.149439669 Bottom = 0.03716633 moveKick ... updating velocity only [Level 2 step 32] Advanced 46080 cells [STEP 8] Coarse TimeStep time: 5.000496053 [STEP 8] FAB kilobyte spread across MPI nodes: [15766 ... 16329] STEP = 8 TIME = 0.025 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.025 by dt = 0.003125 Old / new A time 0.025 0.028125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.052162938 new finest: 2 Setting the current time in the state data to 0.025 Setting the current time in the state data to 0.025 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 7.152210038e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.451280268e-18, 9.787516775e-13 MLMG: Timers: Solve = 0.618874885 Iter = 0.549935574 Bottom = 0.003903815 STEP = 8 TIME = 0.025 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 9] ADVANCE at time 0.025 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 7.674118502e-19, 5.17546922e-13 MLMG: Timers: Solve = 0.693870911 Iter = 0.625093544 Bottom = 0.004380651 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 0 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.789252198e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.438321651e-21, 3.623337721e-14 MLMG: Timers: Solve = 0.103501364 Iter = 0.096390077 Bottom = 0.002894769 moveKick ... updating velocity only [Level 0 step 9] Advanced 4096 cells [Level 1 step 17] ADVANCE at time 0.025 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.573042079e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.613922433e-20, 2.987602514e-14 MLMG: Timers: Solve = 0.120099603 Iter = 0.109909303 Bottom = 0.002918783 moveKick ... updating velocity only [Level 1 step 17] Advanced 32768 cells [Level 2 step 33] ADVANCE at time 0.025 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 3.42622966e-19, 1.547876639e-13 MLMG: Timers: Solve = 0.181620188 Iter = 0.157839783 Bottom = 0.042012868 moveKick ... updating velocity only [Level 2 step 33] Advanced 53248 cells [Level 2 step 34] ADVANCE at time 0.02578125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 1.926848995e-19, 8.704975562e-14 MLMG: Timers: Solve = 0.203479732 Iter = 0.179589016 Bottom = 0.049793323 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.110434884e-19, 2.9138584e-13 MLMG: Timers: Solve = 0.181871078 Iter = 0.158025055 Bottom = 0.042428458 moveKick ... updating velocity only [Level 2 step 34] Advanced 53248 cells [Level 1 step 18] ADVANCE at time 0.0265625 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.727965307e-19, 1.165349643e-13 MLMG: Timers: Solve = 0.502805549 Iter = 0.449042184 Bottom = 0.003986737 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113485678e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 4.646790489e-20, 1.492472094e-13 MLMG: Timers: Solve = 0.120374088 Iter = 0.110037056 Bottom = 0.003055563 moveKick ... updating velocity only [Level 1 step 18] Advanced 32768 cells [Level 2 step 35] ADVANCE at time 0.0265625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.916713998e-19, 2.221236605e-13 MLMG: Timers: Solve = 0.182002852 Iter = 0.158138581 Bottom = 0.042343525 moveKick ... updating velocity only [Level 2 step 35] Advanced 53248 cells [Level 2 step 36] ADVANCE at time 0.02734375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 2.134835288e-19, 9.644600621e-14 MLMG: Timers: Solve = 0.204022893 Iter = 0.180076359 Bottom = 0.050129177 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 2.574204678e-19, 1.227550586e-13 MLMG: Timers: Solve = 0.18223207 Iter = 0.158332453 Bottom = 0.042750916 moveKick ... updating velocity only [Level 2 step 36] Advanced 53248 cells [STEP 9] Coarse TimeStep time: 6.260919713 [STEP 9] FAB kilobyte spread across MPI nodes: [17561 ... 18207] STEP = 9 TIME = 0.028125 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.028125 by dt = 0.003125 Old / new A time 0.028125 0.03125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.025080268 new finest: 2 Setting the current time in the state data to 0.028125 Calling redistribute because BoxArray changed TIME = 0.028125 : REGRID with lbase = 1 Level 2 15 grids 11264 cells 4.296875 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 8 x 8 [Level 0 step 10] ADVANCE at time 0.028125 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 3.150385605e-19, 2.124637993e-13 MLMG: Timers: Solve = 0.649888581 Iter = 0.59899075 Bottom = 0.002387741 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting -2.710505431e-20 to ensure solvability MLMG: Initial rhs = 2.892150254e-08 MLMG: Initial residual (resid0) = 3.873110818e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 3.890075324e-21, 1.004380073e-13 MLMG: Timers: Solve = 0.1022213 Iter = 0.09515652 Bottom = 0.001832082 moveKick ... updating velocity only [Level 0 step 10] Advanced 4096 cells [Level 1 step 19] ADVANCE at time 0.028125 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.641046646e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 2.52967341e-20, 4.682789262e-14 MLMG: Timers: Solve = 0.119085179 Iter = 0.108885173 Bottom = 0.001844969 moveKick ... updating velocity only [Level 1 step 19] Advanced 32768 cells [Level 2 step 37] ADVANCE at time 0.028125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.969760447e-20, 4.052291887e-14 MLMG: Timers: Solve = 0.120553587 Iter = 0.108626059 Bottom = 0.013344611 moveKick ... updating velocity only [Level 2 step 37] Advanced 11264 cells [Level 2 step 38] ADVANCE at time 0.02890625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.614806906e-19, 3.891933608e-13 MLMG: Timers: Solve = 0.120483143 Iter = 0.108562326 Bottom = 0.013223571 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.897798411e-19, 9.049954623e-14 MLMG: Timers: Solve = 0.120568006 Iter = 0.108637436 Bottom = 0.013316483 moveKick ... updating velocity only [Level 2 step 38] Advanced 11264 cells [Level 1 step 20] ADVANCE at time 0.0296875 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 9.867933836e-20, 6.654990774e-14 MLMG: Timers: Solve = 0.433435049 Iter = 0.398276692 Bottom = 0.002482703 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 3.704988249e-07 MLMG: Initial residual (resid0) = 3.495865805e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.085736593e-20, 2.930472432e-14 MLMG: Timers: Solve = 0.119074583 Iter = 0.108793246 Bottom = 0.001845944 moveKick ... updating velocity only [Level 1 step 20] Advanced 32768 cells [Level 2 step 39] ADVANCE at time 0.0296875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.131615442e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.294155088e-19, 4.677198815e-14 MLMG: Timers: Solve = 0.120207412 Iter = 0.108305294 Bottom = 0.012977915 moveKick ... updating velocity only [Level 2 step 39] Advanced 11264 cells [Level 2 step 40] ADVANCE at time 0.03046875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.766944786e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 5.942777781e-19, 2.147776064e-13 MLMG: Timers: Solve = 0.120587709 Iter = 0.10865246 Bottom = 0.01319092 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.793151269e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 1.876328318e-18, 6.326469533e-13 MLMG: Timers: Solve = 0.107338198 Iter = 0.095413985 Bottom = 0.011630734 moveKick ... updating velocity only [Level 2 step 40] Advanced 11264 cells [STEP 10] Coarse TimeStep time: 3.420041241 [STEP 10] FAB kilobyte spread across MPI nodes: [17561 ... 18207] STEP = 10 TIME = 0.03125 DT = 0.003125 PLOTFILE: file = Part-2line_restart-nomesh_plt00010 Output file Part-2line_restart-nomesh_plt00010.temp at time 1.000000 and step 10 Write plotfile time = 0.135147741 seconds Time w/o init: 18.90986985 Run time = 19.71587894 Unused ParmParse Variables: [TOP]::amr.probin_file(nvals = 1) :: [] [TOP]::nyx.do_hydro(nvals = 1) :: [0] [TOP]::nyx.do_hydro(nvals = 1) :: [0] [TOP]::particles.particle_output_file(nvals = 1) :: [final_particles] Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [7611 ... 7621] [The Arena] max space (MB) allocated spread across MPI: [33 ... 33] [The Arena] max space (MB) used spread across MPI: [27 ... 27] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Pinned Arena] max space (MB) used spread across MPI: [3 ... 3] AMReX (26.05-3-g4ceb814db7d7) finalized