Initializing AMReX (26.09-190-g541acefee8d0)... MPI initialized with 2 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.09-190-g541acefee8d0) initialized Successfully read inputs file ... AMReX git describe: 26.09-190-g541acefee8 Nyx git describe: 26.09 Nyx::hydro_tile_size unset, using fabarray.mfiter_tile_size default: (1024000,1024000,1024000) Suggested default for currently compiled CPU / GPU: nyx.hydro_tile_size=(1048576,1048576,1048576) Nyx::sundials_tile_size unset, using fabarray.mfiter_tile_size default: (1024000,1024000,1024000) Suggested default for currently compiled CPU / GPU: nyx.sundials_tile_size=(1048576,1048576,1048576) Nyx::setting init_sb_vels to 0 since do_santa_barbara = 0 Successfully read inputs file ... Getting Gconst from nyx_constants: 4.300927161e-09 Using -5.404704468e-08 for 4 pi G in Gravity.cpp Initializing the data at level 0 ... setting particle_initrandom_mass to 2.123188769e+11 by dividing 8.696581196e+14 by 4096 Initializing DM particles from "particle_file.2line" ... Redistributing from processor 0 to 0 Redistributing from processor 1 to 1 Total number of particles: 16 Average dm density 0.0048828125 Average total density 0.0048828125 Done initializing the level 0 data ...estdt from particles at level 0: 0.003125 Nyx::est_time_step at level 0: estdt = 0.003125 Integrating a from time 0 by dt = 0.003125 Old / new A time 0 0.003125 Old / new A 1 1 Old / new z 0 0 grid_places() time: 0.005644232 new finest: 1 Initializing the data at level 1 BA SIZE 0 FLEV 1 Calling redistribute because the size of BoxArray changed Done initializing the level 1 data grid_places() time: 0.011639933 new finest: 2 Initializing the data at level 2 BA SIZE 2 FLEV 2 Calling redistribute because the size of BoxArray changed Done initializing the level 2 data Now regridding at level lbase = 0 grid_places() time: 0.046510506 new finest: 2 Initializing the data at level 1 Calling redistribute because BoxArray changed Done initializing the level 1 data Initializing the data at level 2 Calling redistribute because BoxArray changed Done initializing the level 2 data NOT calling redistribute because NOT changed STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 Now regridding at level lbase = 0 grid_places() time: 0.052991465 new finest: 2 Regridding at level lbase = 0 but grids unchanged Setting the current time in the state data to 0 Setting the current time in the state data to 0 Setting the current time in the state data to 0 NOT calling redistribute because NOT changed Gravity ... defining average density in Gravity::set_mass_offset to be 0.0048828125 Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 7.676236084e-19, 5.17689733e-13 MLMG: Timers: Solve = 0.704869872 Iter = 0.636857638 Bottom = 0.004439066 Average dm density 0.0048828125 Average total density 0.0048828125 INITIAL GRIDS Level 0 2 grids 4096 cells 100 % of domain smallest grid: 16 x 16 x 8 biggest grid: 16 x 16 x 8 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 CHECKPOINT: file = Part-2line_restart-nbody_chk00000 checkPoint() time = 0.014840734 secs. PLOTFILE: file = Part-2line_restart-nbody_plt00000 Output file Part-2line_restart-nbody_plt00000.temp at time 1.000000 and step 0 Write plotfile time = 0.242520663 seconds ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Re-integrating a from time 0 by dt = 0.003125 Old / new A time 0 0.003125 Old / new A 1 1 Old / new z 0 0 [Level 0 step 1] ADVANCE at time 0 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 7.669883337e-19, 5.172613001e-13 MLMG: Timers: Solve = 0.694586064 Iter = 0.636475248 Bottom = 0.004262798 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 0 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.789252198e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.438218253e-21, 3.623184072e-14 MLMG: Timers: Solve = 0.102459642 Iter = 0.095444505 Bottom = 0.002779826 moveKick ... updating velocity only [Level 0 step 1] Advanced 4096 cells [Level 1 step 1] ADVANCE at time 0 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.573042079e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.614087869e-20, 2.98790876e-14 MLMG: Timers: Solve = 0.128032361 Iter = 0.117879361 Bottom = 0.002814261 moveKick ... updating velocity only [Level 1 step 1] Advanced 32768 cells [Level 2 step 1] ADVANCE at time 0 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 3.426295835e-19, 1.547906535e-13 MLMG: Timers: Solve = 0.195946555 Iter = 0.170692576 Bottom = 0.039545644 moveKick ... updating velocity only [Level 2 step 1] Advanced 53248 cells [Level 2 step 2] ADVANCE at time 0.00078125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 1.926981343e-19, 8.705573478e-14 MLMG: Timers: Solve = 0.218731728 Iter = 0.193509329 Bottom = 0.046486783 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.110104011e-19, 2.913700618e-13 MLMG: Timers: Solve = 0.19598217 Iter = 0.170733302 Bottom = 0.039525194 moveKick ... updating velocity only [Level 2 step 2] Advanced 53248 cells [Level 1 step 2] ADVANCE at time 0.0015625 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.727766784e-19, 1.165215758e-13 MLMG: Timers: Solve = 0.510609218 Iter = 0.462471881 Bottom = 0.003878289 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113485678e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 4.645963308e-20, 1.492206417e-13 MLMG: Timers: Solve = 0.128909857 Iter = 0.118425153 Bottom = 0.002950936 moveKick ... updating velocity only [Level 1 step 2] Advanced 32768 cells [Level 2 step 3] ADVANCE at time 0.0015625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.916846347e-19, 2.221296397e-13 MLMG: Timers: Solve = 0.197223223 Iter = 0.171818984 Bottom = 0.03988625 moveKick ... updating velocity only [Level 2 step 3] Advanced 53248 cells [Level 2 step 4] ADVANCE at time 0.00234375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 2.134769113e-19, 9.644301663e-14 MLMG: Timers: Solve = 0.220670075 Iter = 0.195217732 Bottom = 0.047686221 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 2.574469376e-19, 1.227676812e-13 MLMG: Timers: Solve = 0.197540181 Iter = 0.172100276 Bottom = 0.040017783 moveKick ... updating velocity only [Level 2 step 4] Advanced 53248 cells [STEP 1] Coarse TimeStep time: 5.329564994 [STEP 1] FAB kilobyte spread across MPI nodes: [19864 ... 20326] STEP = 1 TIME = 0.003125 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.003125 by dt = 0.003125 Old / new A time 0.003125 0.00625 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.024857405 new finest: 2 Setting the current time in the state data to 0.003125 Calling redistribute because BoxArray changed TIME = 0.003125 : REGRID with lbase = 1 Level 2 15 grids 11264 cells 4.296875 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 8 x 8 [Level 0 step 2] ADVANCE at time 0.003125 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 3.14747393e-19, 2.122674342e-13 MLMG: Timers: Solve = 0.659595512 Iter = 0.618759259 Bottom = 0.002327513 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 1.084202172e-19 to ensure solvability MLMG: Initial rhs = 2.892150254e-08 MLMG: Initial residual (resid0) = 3.873110818e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 3.890127023e-21, 1.004393421e-13 MLMG: Timers: Solve = 0.101288684 Iter = 0.09422621 Bottom = 0.001777392 moveKick ... updating velocity only [Level 0 step 2] Advanced 4096 cells [Level 1 step 3] ADVANCE at time 0.003125 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.641046646e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 2.52967341e-20, 4.682789262e-14 MLMG: Timers: Solve = 0.127776575 Iter = 0.117628181 Bottom = 0.00180258 moveKick ... updating velocity only [Level 1 step 3] Advanced 32768 cells [Level 2 step 5] ADVANCE at time 0.003125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.977701381e-20, 4.055879384e-14 MLMG: Timers: Solve = 0.133928619 Iter = 0.121221331 Bottom = 0.009661581 moveKick ... updating velocity only [Level 2 step 5] Advanced 11264 cells [Level 2 step 6] ADVANCE at time 0.00390625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.61440986e-19, 3.891754233e-13 MLMG: Timers: Solve = 0.134364173 Iter = 0.121643748 Bottom = 0.00993378 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.898195458e-19, 9.051848004e-14 MLMG: Timers: Solve = 0.133792459 Iter = 0.121072449 Bottom = 0.009596053 moveKick ... updating velocity only [Level 2 step 6] Advanced 11264 cells [Level 1 step 4] ADVANCE at time 0.0046875 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 9.8361701e-20, 6.63356913e-14 MLMG: Timers: Solve = 0.453441359 Iter = 0.419139203 Bottom = 0.002452609 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 3.704988249e-07 MLMG: Initial residual (resid0) = 3.495865805e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.085074848e-20, 2.928686341e-14 MLMG: Timers: Solve = 0.127892468 Iter = 0.117679803 Bottom = 0.00183446 moveKick ... updating velocity only [Level 1 step 4] Advanced 32768 cells [Level 2 step 7] ADVANCE at time 0.0046875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.131615442e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.294419785e-19, 4.678155458e-14 MLMG: Timers: Solve = 0.133547311 Iter = 0.120836579 Bottom = 0.009316979 moveKick ... updating velocity only [Level 2 step 7] Advanced 11264 cells [Level 2 step 8] ADVANCE at time 0.00546875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.766944786e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 5.942645432e-19, 2.147728231e-13 MLMG: Timers: Solve = 0.133767008 Iter = 0.121112174 Bottom = 0.009702837 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.793151269e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 1.876315083e-18, 6.326424909e-13 MLMG: Timers: Solve = 0.119165302 Iter = 0.106430593 Bottom = 0.008505765 moveKick ... updating velocity only [Level 2 step 8] Advanced 11264 cells [STEP 2] Coarse TimeStep time: 3.584312764 [STEP 2] FAB kilobyte spread across MPI nodes: [19864 ... 20326] STEP = 2 TIME = 0.00625 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.00625 by dt = 0.003125 Old / new A time 0.00625 0.009375 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.040520828 new finest: 2 Setting the current time in the state data to 0.00625 Setting the current time in the state data to 0.00625 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 7.247393028e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 3.38887832e-19, 1.142637737e-13 MLMG: Timers: Solve = 0.531126564 Iter = 0.481821567 Bottom = 0.001825135 STEP = 2 TIME = 0.00625 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 14 grids 7168 cells 2.734375 % of domain smallest grid: 8 x 8 x 8 biggest grid: 8 x 8 x 8 [Level 0 step 3] ADVANCE at time 0.00625 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.965837911e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 4.679857034e-19, 1.5779207e-13 MLMG: Timers: Solve = 0.661258396 Iter = 0.614725858 Bottom = 0.002326438 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 0 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.734865479e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 5.038046918e-21, 7.48652067e-14 MLMG: Timers: Solve = 0.101350717 Iter = 0.094281631 Bottom = 0.001801989 moveKick ... updating velocity only [Level 0 step 3] Advanced 4096 cells [Level 1 step 5] ADVANCE at time 0.00625 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.57065785e-07 MLMG: Final Iter. 6 resid, resid/bnorm = 4.290437979e-19, 7.942217688e-13 MLMG: Timers: Solve = 0.111187287 Iter = 0.100993559 Bottom = 0.001572831 moveKick ... updating velocity only [Level 1 step 5] Advanced 32768 cells [Level 2 step 9] ADVANCE at time 0.00625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 2.645473939e-18, 9.560992876e-13 MLMG: Timers: Solve = 0.114692582 Iter = 0.102889297 Bottom = 0.006487171 moveKick ... updating velocity only [Level 2 step 9] Advanced 7168 cells [Level 2 step 10] ADVANCE at time 0.00703125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.766944786e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.83925267e-19, 1.748951657e-13 MLMG: Timers: Solve = 0.129036261 Iter = 0.11720676 Bottom = 0.00731043 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.650467071e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.632079047e-19, 6.157703542e-14 MLMG: Timers: Solve = 0.129123344 Iter = 0.117295432 Bottom = 0.007423853 moveKick ... updating velocity only [Level 2 step 10] Advanced 7168 cells [Level 1 step 6] ADVANCE at time 0.0078125 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 1.527835679e-19, 1.030381082e-13 MLMG: Timers: Solve = 0.449242433 Iter = 0.415887883 Bottom = 0.002444348 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.444676299e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.455774484e-20, 1.003221837e-13 MLMG: Timers: Solve = 0.127698485 Iter = 0.117467606 Bottom = 0.001836389 moveKick ... updating velocity only [Level 1 step 6] Advanced 32768 cells [Level 2 step 11] ADVANCE at time 0.0078125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.711866211e-20, 3.935782341e-14 MLMG: Timers: Solve = 0.128964105 Iter = 0.117151255 Bottom = 0.007333335 moveKick ... updating velocity only [Level 2 step 11] Advanced 7168 cells [Level 2 step 12] ADVANCE at time 0.00859375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.289115524e-19, 1.937704819e-13 MLMG: Timers: Solve = 0.129276739 Iter = 0.117420645 Bottom = 0.007424861 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 7 resid, resid/resid0 = 1.168910223e-18, 5.574134965e-13 MLMG: Timers: Solve = 0.114818857 Iter = 0.102998163 Bottom = 0.006530247 moveKick ... updating velocity only [Level 2 step 12] Advanced 7168 cells [STEP 3] Coarse TimeStep time: 4.256070797 [STEP 3] FAB kilobyte spread across MPI nodes: [19864 ... 20326] STEP = 3 TIME = 0.009375 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.009375 by dt = 0.003125 Old / new A time 0.009375 0.0125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.018520948 new finest: 2 Setting the current time in the state data to 0.009375 Calling redistribute because BoxArray changed TIME = 0.009375 : REGRID with lbase = 1 Level 2 36 grids 46080 cells 17.578125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 4] ADVANCE at time 0.009375 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 8.597384415e-20, 5.798125009e-14 MLMG: Timers: Solve = 0.776935314 Iter = 0.710470443 Bottom = 0.004742735 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 1.355252716e-19 to ensure solvability MLMG: Initial rhs = 1.432880048e-08 MLMG: Initial residual (resid0) = 4.198898866e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 2.650286683e-21, 6.311861198e-14 MLMG: Timers: Solve = 0.102560946 Iter = 0.095463413 Bottom = 0.002994302 moveKick ... updating velocity only [Level 0 step 4] Advanced 4096 cells [Level 1 step 7] ADVANCE at time 0.009375 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.593886225e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 3.714837112e-20, 6.876697708e-14 MLMG: Timers: Solve = 0.128538435 Iter = 0.118321961 Bottom = 0.002762373 moveKick ... updating velocity only [Level 1 step 7] Advanced 32768 cells [Level 2 step 13] ADVANCE at time 0.009375 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 6.046973587e-19, 2.731856905e-13 MLMG: Timers: Solve = 0.183010358 Iter = 0.161147172 Bottom = 0.033595972 moveKick ... updating velocity only [Level 2 step 13] Advanced 46080 cells [Level 2 step 14] ADVANCE at time 0.01015625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 9.265529215e-19, 4.185912109e-13 MLMG: Timers: Solve = 0.202992594 Iter = 0.181126064 Bottom = 0.037926951 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.03423087e-19, 2.8775193e-13 MLMG: Timers: Solve = 0.182389213 Iter = 0.160532795 Bottom = 0.032789539 moveKick ... updating velocity only [Level 2 step 14] Advanced 46080 cells [Level 1 step 8] ADVANCE at time 0.0109375 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 2.431465874e-19, 1.639794432e-13 MLMG: Timers: Solve = 0.507438813 Iter = 0.457499482 Bottom = 0.00393305 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113486436e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.300926273e-20, 1.060202555e-13 MLMG: Timers: Solve = 0.129515134 Iter = 0.119141594 Bottom = 0.003523924 moveKick ... updating velocity only [Level 1 step 8] Advanced 32768 cells [Level 2 step 15] ADVANCE at time 0.0109375 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.947514068e-19, 2.235151233e-13 MLMG: Timers: Solve = 0.182270205 Iter = 0.160454308 Bottom = 0.032606193 moveKick ... updating velocity only [Level 2 step 15] Advanced 46080 cells [Level 2 step 16] ADVANCE at time 0.01171875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.290546235e-06 MLMG: Final Iter. 9 resid, resid/resid0 = 9.270775608e-19, 4.047408197e-13 MLMG: Timers: Solve = 0.203095346 Iter = 0.181974409 Bottom = 0.038168001 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.13258893e-18, 5.400931078e-13 MLMG: Timers: Solve = 0.182096298 Iter = 0.160260368 Bottom = 0.032364067 moveKick ... updating velocity only [Level 2 step 16] Advanced 46080 cells [STEP 4] Coarse TimeStep time: 5.153229154 [STEP 4] FAB kilobyte spread across MPI nodes: [19864 ... 20326] STEP = 4 TIME = 0.0125 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.0125 by dt = 0.003125 Old / new A time 0.0125 0.015625 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.052357077 new finest: 2 Setting the current time in the state data to 0.0125 Setting the current time in the state data to 0.0125 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 7.152210038e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.451187675e-18, 9.786892325e-13 MLMG: Timers: Solve = 0.639352301 Iter = 0.570280273 Bottom = 0.003919853 STEP = 4 TIME = 0.0125 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 5] ADVANCE at time 0.0125 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 7.676236084e-19, 5.17689733e-13 MLMG: Timers: Solve = 0.71634706 Iter = 0.647435655 Bottom = 0.004404546 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 0 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.789252198e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.438528446e-21, 3.623645018e-14 MLMG: Timers: Solve = 0.102528205 Iter = 0.095386872 Bottom = 0.002929066 moveKick ... updating velocity only [Level 0 step 5] Advanced 4096 cells [Level 1 step 9] ADVANCE at time 0.0125 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.573042079e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.613922433e-20, 2.987602514e-14 MLMG: Timers: Solve = 0.128778038 Iter = 0.118558145 Bottom = 0.002944578 moveKick ... updating velocity only [Level 1 step 9] Advanced 32768 cells [Level 2 step 17] ADVANCE at time 0.0125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 3.426295835e-19, 1.547906535e-13 MLMG: Timers: Solve = 0.192462471 Iter = 0.16858741 Bottom = 0.037176902 moveKick ... updating velocity only [Level 2 step 17] Advanced 53248 cells [Level 2 step 18] ADVANCE at time 0.01328125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 1.927047518e-19, 8.705872436e-14 MLMG: Timers: Solve = 0.215385822 Iter = 0.191433766 Bottom = 0.044294875 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.110434884e-19, 2.9138584e-13 MLMG: Timers: Solve = 0.192881755 Iter = 0.168966033 Bottom = 0.037403087 moveKick ... updating velocity only [Level 2 step 18] Advanced 53248 cells [Level 1 step 10] ADVANCE at time 0.0140625 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.72756826e-19, 1.165081873e-13 MLMG: Timers: Solve = 0.523096327 Iter = 0.469836357 Bottom = 0.004000027 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113485678e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 4.646128744e-20, 1.492259552e-13 MLMG: Timers: Solve = 0.128970402 Iter = 0.118611843 Bottom = 0.003058436 moveKick ... updating velocity only [Level 1 step 10] Advanced 32768 cells [Level 2 step 19] ADVANCE at time 0.0140625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.916912521e-19, 2.221326293e-13 MLMG: Timers: Solve = 0.190563911 Iter = 0.166746129 Bottom = 0.037421086 moveKick ... updating velocity only [Level 2 step 19] Advanced 53248 cells [Level 2 step 20] ADVANCE at time 0.01484375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 2.134967637e-19, 9.645198537e-14 MLMG: Timers: Solve = 0.216203204 Iter = 0.192256127 Bottom = 0.044632957 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 2.574072329e-19, 1.227487474e-13 MLMG: Timers: Solve = 0.193243315 Iter = 0.169328972 Bottom = 0.037865532 moveKick ... updating velocity only [Level 2 step 20] Advanced 53248 cells [STEP 5] Coarse TimeStep time: 6.427210974 [STEP 5] FAB kilobyte spread across MPI nodes: [20326 ... 20434] STEP = 5 TIME = 0.015625 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.015625 by dt = 0.003125 Old / new A time 0.015625 0.01875 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.025009374 new finest: 2 Setting the current time in the state data to 0.015625 Calling redistribute because BoxArray changed TIME = 0.015625 : REGRID with lbase = 1 Level 2 15 grids 11264 cells 4.296875 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 8 x 8 [Level 0 step 6] ADVANCE at time 0.015625 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 3.152503188e-19, 2.126066103e-13 MLMG: Timers: Solve = 0.674466936 Iter = 0.623335466 Bottom = 0.002428642 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting -2.710505431e-20 to ensure solvability MLMG: Initial rhs = 2.892150254e-08 MLMG: Initial residual (resid0) = 3.873110818e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 3.889816831e-21, 1.004313332e-13 MLMG: Timers: Solve = 0.101440743 Iter = 0.094326107 Bottom = 0.001838272 moveKick ... updating velocity only [Level 0 step 6] Advanced 4096 cells [Level 1 step 11] ADVANCE at time 0.015625 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.641046646e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 2.530004282e-20, 4.683401754e-14 MLMG: Timers: Solve = 0.12768975 Iter = 0.117464226 Bottom = 0.001866415 moveKick ... updating velocity only [Level 1 step 11] Advanced 32768 cells [Level 2 step 21] ADVANCE at time 0.015625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.977701381e-20, 4.055879384e-14 MLMG: Timers: Solve = 0.130658419 Iter = 0.118740062 Bottom = 0.009707109 moveKick ... updating velocity only [Level 2 step 21] Advanced 11264 cells [Level 2 step 22] ADVANCE at time 0.01640625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.614674557e-19, 3.891873816e-13 MLMG: Timers: Solve = 0.126907427 Iter = 0.114460095 Bottom = 0.010847565 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.898327807e-19, 9.052479131e-14 MLMG: Timers: Solve = 0.130842381 Iter = 0.118899864 Bottom = 0.009722162 moveKick ... updating velocity only [Level 2 step 22] Advanced 11264 cells [Level 1 step 12] ADVANCE at time 0.0171875 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 9.846758012e-20, 6.640709678e-14 MLMG: Timers: Solve = 0.457134747 Iter = 0.422354751 Bottom = 0.002399079 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 3.704988249e-07 MLMG: Initial residual (resid0) = 3.495865805e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.084909412e-20, 2.928239818e-14 MLMG: Timers: Solve = 0.127908988 Iter = 0.11761868 Bottom = 0.001860133 moveKick ... updating velocity only [Level 1 step 12] Advanced 32768 cells [Level 2 step 23] ADVANCE at time 0.0171875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.131615442e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.29389039e-19, 4.676242172e-14 MLMG: Timers: Solve = 0.130510818 Iter = 0.118595738 Bottom = 0.009355623 moveKick ... updating velocity only [Level 2 step 23] Advanced 11264 cells [Level 2 step 24] ADVANCE at time 0.01796875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.766944786e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 5.943174828e-19, 2.14791956e-13 MLMG: Timers: Solve = 0.130940019 Iter = 0.119000265 Bottom = 0.009656514 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.793151269e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 1.876301848e-18, 6.326380284e-13 MLMG: Timers: Solve = 0.116403049 Iter = 0.104479195 Bottom = 0.008548819 moveKick ... updating velocity only [Level 2 step 24] Advanced 11264 cells [STEP 6] Coarse TimeStep time: 3.552840058 [STEP 6] FAB kilobyte spread across MPI nodes: [20326 ... 20434] STEP = 6 TIME = 0.01875 DT = 0.003125 CHECKPOINT: file = Part-2line_restart-nbody_chk00006 checkPoint() time = 0.014304781 secs. ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.01875 by dt = 0.003125 Old / new A time 0.01875 0.021875 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.041302622 new finest: 2 Setting the current time in the state data to 0.01875 Setting the current time in the state data to 0.01875 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 7.247393028e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 3.390201809e-19, 1.143083982e-13 MLMG: Timers: Solve = 0.53590839 Iter = 0.486080005 Bottom = 0.001845893 STEP = 6 TIME = 0.01875 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 14 grids 7168 cells 2.734375 % of domain smallest grid: 8 x 8 x 8 biggest grid: 8 x 8 x 8 [Level 0 step 7] ADVANCE at time 0.01875 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.965837911e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 4.688327363e-19, 1.580776666e-13 MLMG: Timers: Solve = 0.667876276 Iter = 0.61823763 Bottom = 0.002414343 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 0 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.734865479e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 5.03752993e-21, 7.485752428e-14 MLMG: Timers: Solve = 0.101435565 Iter = 0.094350588 Bottom = 0.001819422 moveKick ... updating velocity only [Level 0 step 7] Advanced 4096 cells [Level 1 step 13] ADVANCE at time 0.01875 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.57065785e-07 MLMG: Final Iter. 6 resid, resid/bnorm = 4.29030563e-19, 7.941972691e-13 MLMG: Timers: Solve = 0.111160564 Iter = 0.100980103 Bottom = 0.001594986 moveKick ... updating velocity only [Level 1 step 13] Advanced 32768 cells [Level 2 step 25] ADVANCE at time 0.01875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 2.64536806e-18, 9.560610219e-13 MLMG: Timers: Solve = 0.114625566 Iter = 0.102810297 Bottom = 0.006435508 moveKick ... updating velocity only [Level 2 step 25] Advanced 7168 cells [Level 2 step 26] ADVANCE at time 0.01953125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.766944786e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.839517367e-19, 1.749047322e-13 MLMG: Timers: Solve = 0.129075653 Iter = 0.117241465 Bottom = 0.007301244 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.650467071e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.632873141e-19, 6.160699593e-14 MLMG: Timers: Solve = 0.129184676 Iter = 0.117361465 Bottom = 0.00744408 moveKick ... updating velocity only [Level 2 step 26] Advanced 7168 cells [Level 1 step 14] ADVANCE at time 0.0203125 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 1.524659305e-19, 1.028238918e-13 MLMG: Timers: Solve = 0.453297874 Iter = 0.419184843 Bottom = 0.002344415 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.444676299e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.456105356e-20, 1.00331789e-13 MLMG: Timers: Solve = 0.127644356 Iter = 0.117391321 Bottom = 0.001846092 moveKick ... updating velocity only [Level 1 step 14] Advanced 32768 cells [Level 2 step 27] ADVANCE at time 0.0203125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.701940044e-20, 3.931297971e-14 MLMG: Timers: Solve = 0.128977698 Iter = 0.117156705 Bottom = 0.007351707 moveKick ... updating velocity only [Level 2 step 27] Advanced 7168 cells [Level 2 step 28] ADVANCE at time 0.02109375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.289115524e-19, 1.937704819e-13 MLMG: Timers: Solve = 0.129217661 Iter = 0.117380434 Bottom = 0.007429616 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 7 resid, resid/resid0 = 1.168936693e-18, 5.57426119e-13 MLMG: Timers: Solve = 0.114799307 Iter = 0.102973089 Bottom = 0.006536373 moveKick ... updating velocity only [Level 2 step 28] Advanced 7168 cells [STEP 7] Coarse TimeStep time: 4.278105833 [STEP 7] FAB kilobyte spread across MPI nodes: [20326 ... 20434] STEP = 7 TIME = 0.021875 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.021875 by dt = 0.003125 Old / new A time 0.021875 0.025 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.018575873 new finest: 2 Setting the current time in the state data to 0.021875 Calling redistribute because BoxArray changed TIME = 0.021875 : REGRID with lbase = 1 Level 2 36 grids 46080 cells 17.578125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 8] ADVANCE at time 0.021875 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 8.592090459e-20, 5.794554735e-14 MLMG: Timers: Solve = 0.77732688 Iter = 0.710852332 Bottom = 0.004772066 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 1.084202172e-19 to ensure solvability MLMG: Initial rhs = 1.432880048e-08 MLMG: Initial residual (resid0) = 4.198898866e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 2.651941044e-21, 6.315801186e-14 MLMG: Timers: Solve = 0.102578857 Iter = 0.095468399 Bottom = 0.003009789 moveKick ... updating velocity only [Level 0 step 8] Advanced 4096 cells [Level 1 step 15] ADVANCE at time 0.021875 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.593886225e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 3.715292061e-20, 6.877539885e-14 MLMG: Timers: Solve = 0.128605857 Iter = 0.118399565 Bottom = 0.002748404 moveKick ... updating velocity only [Level 1 step 15] Advanced 32768 cells [Level 2 step 29] ADVANCE at time 0.021875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 6.045650098e-19, 2.731258989e-13 MLMG: Timers: Solve = 0.182809159 Iter = 0.160994775 Bottom = 0.033485873 moveKick ... updating velocity only [Level 2 step 29] Advanced 46080 cells [Level 2 step 30] ADVANCE at time 0.02265625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 9.264999819e-19, 4.185672942e-13 MLMG: Timers: Solve = 0.202974486 Iter = 0.181088157 Bottom = 0.037835946 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.034098521e-19, 2.877456187e-13 MLMG: Timers: Solve = 0.182845166 Iter = 0.160979115 Bottom = 0.032779289 moveKick ... updating velocity only [Level 2 step 30] Advanced 46080 cells [Level 1 step 16] ADVANCE at time 0.0234375 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 2.432789363e-19, 1.640687001e-13 MLMG: Timers: Solve = 0.509279751 Iter = 0.458968249 Bottom = 0.003941185 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113486436e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.300926273e-20, 1.060202555e-13 MLMG: Timers: Solve = 0.129675806 Iter = 0.119357591 Bottom = 0.003519352 moveKick ... updating velocity only [Level 1 step 16] Advanced 32768 cells [Level 2 step 31] ADVANCE at time 0.0234375 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.947580243e-19, 2.235181129e-13 MLMG: Timers: Solve = 0.182159879 Iter = 0.160323532 Bottom = 0.032612136 moveKick ... updating velocity only [Level 2 step 31] Advanced 46080 cells [Level 2 step 32] ADVANCE at time 0.02421875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.290546235e-06 MLMG: Final Iter. 9 resid, resid/resid0 = 9.270775608e-19, 4.047408197e-13 MLMG: Timers: Solve = 0.203736203 Iter = 0.181840414 Bottom = 0.038222604 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.13258893e-18, 5.400931078e-13 MLMG: Timers: Solve = 0.182231784 Iter = 0.160332747 Bottom = 0.032444778 moveKick ... updating velocity only [Level 2 step 32] Advanced 46080 cells [STEP 8] Coarse TimeStep time: 5.152194136 [STEP 8] FAB kilobyte spread across MPI nodes: [20326 ... 20434] STEP = 8 TIME = 0.025 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.025 by dt = 0.003125 Old / new A time 0.025 0.028125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.052314279 new finest: 2 Setting the current time in the state data to 0.025 Setting the current time in the state data to 0.025 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 7.152210038e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.451267033e-18, 9.787427518e-13 MLMG: Timers: Solve = 0.641892561 Iter = 0.571800909 Bottom = 0.003963726 STEP = 8 TIME = 0.025 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 9] ADVANCE at time 0.025 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 7.674118502e-19, 5.17546922e-13 MLMG: Timers: Solve = 0.716280717 Iter = 0.64733154 Bottom = 0.004425291 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 0 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.789252198e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.438528446e-21, 3.623645018e-14 MLMG: Timers: Solve = 0.102574377 Iter = 0.095414318 Bottom = 0.002969679 moveKick ... updating velocity only [Level 0 step 9] Advanced 4096 cells [Level 1 step 17] ADVANCE at time 0.025 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.573042079e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.614253305e-20, 2.988215007e-14 MLMG: Timers: Solve = 0.128725138 Iter = 0.118500085 Bottom = 0.002958706 moveKick ... updating velocity only [Level 1 step 17] Advanced 32768 cells [Level 2 step 33] ADVANCE at time 0.025 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 3.426097311e-19, 1.547816848e-13 MLMG: Timers: Solve = 0.19243937 Iter = 0.168612935 Bottom = 0.03719564 moveKick ... updating velocity only [Level 2 step 33] Advanced 53248 cells [Level 2 step 34] ADVANCE at time 0.02578125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 1.926915169e-19, 8.70527452e-14 MLMG: Timers: Solve = 0.215970649 Iter = 0.192062782 Bottom = 0.044239199 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.11023636e-19, 2.913763731e-13 MLMG: Timers: Solve = 0.193161286 Iter = 0.169294825 Bottom = 0.037351658 moveKick ... updating velocity only [Level 2 step 34] Advanced 53248 cells [Level 1 step 18] ADVANCE at time 0.0265625 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.728031481e-19, 1.165394272e-13 MLMG: Timers: Solve = 0.524821689 Iter = 0.471025608 Bottom = 0.004037653 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113485678e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 4.647121361e-20, 1.492578364e-13 MLMG: Timers: Solve = 0.129270651 Iter = 0.118921642 Bottom = 0.003058071 moveKick ... updating velocity only [Level 1 step 18] Advanced 32768 cells [Level 2 step 35] ADVANCE at time 0.0265625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.916912521e-19, 2.221326293e-13 MLMG: Timers: Solve = 0.193121354 Iter = 0.169310523 Bottom = 0.037447141 moveKick ... updating velocity only [Level 2 step 35] Advanced 53248 cells [Level 2 step 36] ADVANCE at time 0.02734375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 2.134835288e-19, 9.644600621e-14 MLMG: Timers: Solve = 0.216492802 Iter = 0.192528921 Bottom = 0.044584634 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 2.57430394e-19, 1.227597921e-13 MLMG: Timers: Solve = 0.192918852 Iter = 0.169041345 Bottom = 0.037785878 moveKick ... updating velocity only [Level 2 step 36] Advanced 53248 cells [STEP 9] Coarse TimeStep time: 6.437525246 [STEP 9] FAB kilobyte spread across MPI nodes: [20326 ... 20434] STEP = 9 TIME = 0.028125 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.028125 by dt = 0.003125 Old / new A time 0.028125 0.03125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.024851054 new finest: 2 Setting the current time in the state data to 0.028125 Calling redistribute because BoxArray changed TIME = 0.028125 : REGRID with lbase = 1 Level 2 15 grids 11264 cells 4.296875 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 8 x 8 [Level 0 step 10] ADVANCE at time 0.028125 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 3.150385605e-19, 2.124637993e-13 MLMG: Timers: Solve = 0.674903606 Iter = 0.623712771 Bottom = 0.002436552 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting -2.710505431e-20 to ensure solvability MLMG: Initial rhs = 2.892150254e-08 MLMG: Initial residual (resid0) = 3.873110818e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 3.890075324e-21, 1.004380073e-13 MLMG: Timers: Solve = 0.10136912 Iter = 0.094259913 Bottom = 0.001842591 moveKick ... updating velocity only [Level 0 step 10] Advanced 4096 cells [Level 1 step 19] ADVANCE at time 0.028125 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.641046646e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 2.52967341e-20, 4.682789262e-14 MLMG: Timers: Solve = 0.127583528 Iter = 0.11737057 Bottom = 0.001866383 moveKick ... updating velocity only [Level 1 step 19] Advanced 32768 cells [Level 2 step 37] ADVANCE at time 0.028125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.969760447e-20, 4.052291887e-14 MLMG: Timers: Solve = 0.130899755 Iter = 0.118997967 Bottom = 0.009744746 moveKick ... updating velocity only [Level 2 step 37] Advanced 11264 cells [Level 2 step 38] ADVANCE at time 0.02890625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.614806906e-19, 3.891933608e-13 MLMG: Timers: Solve = 0.130639457 Iter = 0.118704754 Bottom = 0.009714088 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.897798411e-19, 9.049954623e-14 MLMG: Timers: Solve = 0.130890752 Iter = 0.118979973 Bottom = 0.009685864 moveKick ... updating velocity only [Level 2 step 38] Advanced 11264 cells [Level 1 step 20] ADVANCE at time 0.0296875 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 9.867933836e-20, 6.654990774e-14 MLMG: Timers: Solve = 0.457969926 Iter = 0.423234417 Bottom = 0.00251106 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 3.704988249e-07 MLMG: Initial residual (resid0) = 3.495865805e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.085736593e-20, 2.930472432e-14 MLMG: Timers: Solve = 0.127678086 Iter = 0.11736503 Bottom = 0.001880708 moveKick ... updating velocity only [Level 1 step 20] Advanced 32768 cells [Level 2 step 39] ADVANCE at time 0.0296875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.131615442e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.294155088e-19, 4.677198815e-14 MLMG: Timers: Solve = 0.130383994 Iter = 0.118472081 Bottom = 0.009377044 moveKick ... updating velocity only [Level 2 step 39] Advanced 11264 cells [Level 2 step 40] ADVANCE at time 0.03046875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.766944786e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 5.942777781e-19, 2.147776064e-13 MLMG: Timers: Solve = 0.131306452 Iter = 0.1193731 Bottom = 0.00963486 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.793151269e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 1.876328318e-18, 6.326469533e-13 MLMG: Timers: Solve = 0.116670864 Iter = 0.104737375 Bottom = 0.008528714 moveKick ... updating velocity only [Level 2 step 40] Advanced 11264 cells [STEP 10] Coarse TimeStep time: 3.558324903 [STEP 10] FAB kilobyte spread across MPI nodes: [20326 ... 20434] STEP = 10 TIME = 0.03125 DT = 0.003125 PLOTFILE: file = Part-2line_restart-nbody_plt00010 Output file Part-2line_restart-nbody_plt00010.temp at time 1.000000 and step 10 Write plotfile time = 0.132815238 seconds Time w/o init: 47.87676128 CHECKPOINT: file = Part-2line_restart-nbody_chk00010 checkPoint() time = 0.014091969 secs. Run time = 49.59011893 Unused ParmParse Variables: [TOP]::amr.probin_file(nvals = 1) :: [] [TOP]::particles.particle_output_file(nvals = 1) :: [final_particles] Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [7611 ... 7621] [The Arena] max space (MB) allocated spread across MPI: [33 ... 33] [The Arena] max space (MB) used spread across MPI: [29 ... 30] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Pinned Arena] max space (MB) used spread across MPI: [3 ... 3] AMReX (26.09-190-g541acefee8d0) finalized Initializing AMReX (26.09-190-g541acefee8d0)... MPI initialized with 2 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.09-190-g541acefee8d0) initialized Successfully read inputs file ... AMReX git describe: 26.09-190-g541acefee8 Nyx git describe: 26.09 Nyx::hydro_tile_size unset, using fabarray.mfiter_tile_size default: (1024000,1024000,1024000) Suggested default for currently compiled CPU / GPU: nyx.hydro_tile_size=(1048576,1048576,1048576) Nyx::sundials_tile_size unset, using fabarray.mfiter_tile_size default: (1024000,1024000,1024000) Suggested default for currently compiled CPU / GPU: nyx.sundials_tile_size=(1048576,1048576,1048576) Nyx::setting init_sb_vels to 0 since do_santa_barbara = 0 restarting calculation from file: Part-2line_restart-nbody_chk00006 Successfully read inputs file ... read CPU time: 60.02435789 Getting Gconst from nyx_constants: 4.300927161e-09 Using -5.404704468e-08 for 4 pi G in Gravity.cpp ...setting old_a_time to 0.01875 Gravity ... defining average density in Gravity::set_mass_offset to be 0.0048828125 Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 7.247393028e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 4.499020876e-19, 1.516947659e-13 MLMG: Timers: Solve = 0.535899955 Iter = 0.485475625 Bottom = 0.001934389 Average dm density 0.0048828125 Average total density 0.0048828125 Restart time = 0.856292074 seconds. ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.01875 by dt = 0.003125 Old / new A time 0.01875 0.021875 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.041038838 new finest: 2 Setting the current time in the state data to 0.01875 Setting the current time in the state data to 0.01875 BA SIZE 0 FLEV 2 Calling redistribute because the size of BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 5.094599016e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 5.518202516e-19, 1.86058803e-13 MLMG: Timers: Solve = 0.52885225 Iter = 0.482122032 Bottom = 0.001815198 STEP = 6 TIME = 0.01875 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 14 grids 7168 cells 2.734375 % of domain smallest grid: 8 x 8 x 8 biggest grid: 8 x 8 x 8 [Level 0 step 7] ADVANCE at time 0.01875 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.965837911e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 4.688327363e-19, 1.580776666e-13 MLMG: Timers: Solve = 0.658518529 Iter = 0.612609618 Bottom = 0.002292498 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 0 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.734865479e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 5.03752993e-21, 7.485752428e-14 MLMG: Timers: Solve = 0.101210191 Iter = 0.094161172 Bottom = 0.001796805 moveKick ... updating velocity only [Level 0 step 7] Advanced 4096 cells [Level 1 step 13] ADVANCE at time 0.01875 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.57065785e-07 MLMG: Final Iter. 6 resid, resid/bnorm = 4.29030563e-19, 7.941972691e-13 MLMG: Timers: Solve = 0.110999161 Iter = 0.10081653 Bottom = 0.00155925 moveKick ... updating velocity only [Level 1 step 13] Advanced 32768 cells [Level 2 step 25] ADVANCE at time 0.01875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 2.64536806e-18, 9.560610219e-13 MLMG: Timers: Solve = 0.114803376 Iter = 0.103008607 Bottom = 0.006595482 moveKick ... updating velocity only [Level 2 step 25] Advanced 7168 cells [Level 2 step 26] ADVANCE at time 0.01953125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.766944786e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.839517367e-19, 1.749047322e-13 MLMG: Timers: Solve = 0.128832338 Iter = 0.117032695 Bottom = 0.007211093 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.650467071e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.632873141e-19, 6.160699593e-14 MLMG: Timers: Solve = 0.128943647 Iter = 0.117139262 Bottom = 0.007392903 moveKick ... updating velocity only [Level 2 step 26] Advanced 7168 cells [Level 1 step 14] ADVANCE at time 0.0203125 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 1.524659305e-19, 1.028238918e-13 MLMG: Timers: Solve = 0.448518767 Iter = 0.415078574 Bottom = 0.002296555 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.444676299e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.456105356e-20, 1.00331789e-13 MLMG: Timers: Solve = 0.127286804 Iter = 0.117116736 Bottom = 0.001797452 moveKick ... updating velocity only [Level 1 step 14] Advanced 32768 cells [Level 2 step 27] ADVANCE at time 0.0203125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.701940044e-20, 3.931297971e-14 MLMG: Timers: Solve = 0.128822255 Iter = 0.117022429 Bottom = 0.007301358 moveKick ... updating velocity only [Level 2 step 27] Advanced 7168 cells [Level 2 step 28] ADVANCE at time 0.02109375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.289115524e-19, 1.937704819e-13 MLMG: Timers: Solve = 0.129186973 Iter = 0.11737236 Bottom = 0.007443799 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 7 resid, resid/resid0 = 1.168936693e-18, 5.57426119e-13 MLMG: Timers: Solve = 0.114792299 Iter = 0.102988434 Bottom = 0.006472994 moveKick ... updating velocity only [Level 2 step 28] Advanced 7168 cells [STEP 7] Coarse TimeStep time: 4.247278062 [STEP 7] FAB kilobyte spread across MPI nodes: [9023 ... 9047] STEP = 7 TIME = 0.021875 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.021875 by dt = 0.003125 Old / new A time 0.021875 0.025 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.018464745 new finest: 2 Setting the current time in the state data to 0.021875 Calling redistribute because BoxArray changed TIME = 0.021875 : REGRID with lbase = 1 Level 2 36 grids 46080 cells 17.578125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 8] ADVANCE at time 0.021875 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 8.570914635e-20, 5.780273639e-14 MLMG: Timers: Solve = 0.774083487 Iter = 0.708260782 Bottom = 0.004887543 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 1.084202172e-19 to ensure solvability MLMG: Initial rhs = 1.432880048e-08 MLMG: Initial residual (resid0) = 4.198898866e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 2.64697796e-21, 6.303981222e-14 MLMG: Timers: Solve = 0.102391497 Iter = 0.095318588 Bottom = 0.002942089 moveKick ... updating velocity only [Level 0 step 8] Advanced 4096 cells [Level 1 step 15] ADVANCE at time 0.021875 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.593886225e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 3.715085266e-20, 6.877157077e-14 MLMG: Timers: Solve = 0.128549584 Iter = 0.118370687 Bottom = 0.002718315 moveKick ... updating velocity only [Level 1 step 15] Advanced 32768 cells [Level 2 step 29] ADVANCE at time 0.021875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 6.047238285e-19, 2.731976488e-13 MLMG: Timers: Solve = 0.182799921 Iter = 0.160996971 Bottom = 0.033559022 moveKick ... updating velocity only [Level 2 step 29] Advanced 46080 cells [Level 2 step 30] ADVANCE at time 0.02265625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 9.264999819e-19, 4.185672942e-13 MLMG: Timers: Solve = 0.202573199 Iter = 0.180734025 Bottom = 0.037756343 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.034363219e-19, 2.877582412e-13 MLMG: Timers: Solve = 0.182052502 Iter = 0.160211928 Bottom = 0.032803779 moveKick ... updating velocity only [Level 2 step 30] Advanced 46080 cells [Level 1 step 16] ADVANCE at time 0.0234375 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 2.434112852e-19, 1.641579569e-13 MLMG: Timers: Solve = 0.506750439 Iter = 0.456875859 Bottom = 0.003891205 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113486436e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.301091709e-20, 1.06025569e-13 MLMG: Timers: Solve = 0.129420969 Iter = 0.119093542 Bottom = 0.003481961 moveKick ... updating velocity only [Level 1 step 16] Advanced 32768 cells [Level 2 step 31] ADVANCE at time 0.0234375 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.94784494e-19, 2.235300712e-13 MLMG: Timers: Solve = 0.181909608 Iter = 0.160107839 Bottom = 0.032581396 moveKick ... updating velocity only [Level 2 step 31] Advanced 46080 cells [Level 2 step 32] ADVANCE at time 0.02421875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.290546235e-06 MLMG: Final Iter. 9 resid, resid/resid0 = 9.266540443e-19, 4.045559221e-13 MLMG: Timers: Solve = 0.203071629 Iter = 0.181163292 Bottom = 0.038009957 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.13248305e-18, 5.400426176e-13 MLMG: Timers: Solve = 0.181810509 Iter = 0.15997668 Bottom = 0.032312094 moveKick ... updating velocity only [Level 2 step 32] Advanced 46080 cells [STEP 8] Coarse TimeStep time: 5.143532649 [STEP 8] FAB kilobyte spread across MPI nodes: [17778 ... 18368] STEP = 8 TIME = 0.025 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.025 by dt = 0.003125 Old / new A time 0.025 0.028125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.052344121 new finest: 2 Setting the current time in the state data to 0.025 Setting the current time in the state data to 0.025 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 7.152210038e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.451280268e-18, 9.787516775e-13 MLMG: Timers: Solve = 0.63853787 Iter = 0.569325427 Bottom = 0.00388331 STEP = 8 TIME = 0.025 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 9] ADVANCE at time 0.025 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 7.674118502e-19, 5.17546922e-13 MLMG: Timers: Solve = 0.714375389 Iter = 0.645822993 Bottom = 0.004377041 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 0 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.789252198e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.438528446e-21, 3.623645018e-14 MLMG: Timers: Solve = 0.102355503 Iter = 0.095262727 Bottom = 0.002895365 moveKick ... updating velocity only [Level 0 step 9] Advanced 4096 cells [Level 1 step 17] ADVANCE at time 0.025 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.573042079e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.613922433e-20, 2.987602514e-14 MLMG: Timers: Solve = 0.129254396 Iter = 0.119065736 Bottom = 0.002914146 moveKick ... updating velocity only [Level 1 step 17] Advanced 32768 cells [Level 2 step 33] ADVANCE at time 0.025 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 3.426428183e-19, 1.547966327e-13 MLMG: Timers: Solve = 0.191591702 Iter = 0.167806228 Bottom = 0.037184278 moveKick ... updating velocity only [Level 2 step 33] Advanced 53248 cells [Level 2 step 34] ADVANCE at time 0.02578125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 1.92678282e-19, 8.704676604e-14 MLMG: Timers: Solve = 0.21502114 Iter = 0.191159599 Bottom = 0.044172009 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.11023636e-19, 2.913763731e-13 MLMG: Timers: Solve = 0.19207331 Iter = 0.168227106 Bottom = 0.037363271 moveKick ... updating velocity only [Level 2 step 34] Advanced 53248 cells [Level 1 step 18] ADVANCE at time 0.0265625 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.728097656e-19, 1.1654389e-13 MLMG: Timers: Solve = 0.521330702 Iter = 0.467830668 Bottom = 0.003976437 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113485678e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 4.645963308e-20, 1.492206417e-13 MLMG: Timers: Solve = 0.128965443 Iter = 0.118608127 Bottom = 0.003030375 moveKick ... updating velocity only [Level 1 step 18] Advanced 32768 cells [Level 2 step 35] ADVANCE at time 0.0265625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.916713998e-19, 2.221236605e-13 MLMG: Timers: Solve = 0.192772939 Iter = 0.168954952 Bottom = 0.037347369 moveKick ... updating velocity only [Level 2 step 35] Advanced 53248 cells [Level 2 step 36] ADVANCE at time 0.02734375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 2.134835288e-19, 9.644600621e-14 MLMG: Timers: Solve = 0.21541408 Iter = 0.191526355 Bottom = 0.044754056 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 2.57430394e-19, 1.227597921e-13 MLMG: Timers: Solve = 0.192249308 Iter = 0.168427887 Bottom = 0.037749857 moveKick ... updating velocity only [Level 2 step 36] Advanced 53248 cells [STEP 9] Coarse TimeStep time: 6.423605827 [STEP 9] FAB kilobyte spread across MPI nodes: [19756 ... 20434] STEP = 9 TIME = 0.028125 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.028125 by dt = 0.003125 Old / new A time 0.028125 0.03125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.024960711 new finest: 2 Setting the current time in the state data to 0.028125 Calling redistribute because BoxArray changed TIME = 0.028125 : REGRID with lbase = 1 Level 2 15 grids 11264 cells 4.296875 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 8 x 8 [Level 0 step 10] ADVANCE at time 0.028125 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 3.150385605e-19, 2.124637993e-13 MLMG: Timers: Solve = 0.672493354 Iter = 0.621421104 Bottom = 0.002387393 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting -2.710505431e-20 to ensure solvability MLMG: Initial rhs = 2.892150254e-08 MLMG: Initial residual (resid0) = 3.873110818e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 3.890075324e-21, 1.004380073e-13 MLMG: Timers: Solve = 0.101414933 Iter = 0.094372092 Bottom = 0.00180908 moveKick ... updating velocity only [Level 0 step 10] Advanced 4096 cells [Level 1 step 19] ADVANCE at time 0.028125 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.641046646e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 2.52967341e-20, 4.682789262e-14 MLMG: Timers: Solve = 0.127766319 Iter = 0.117556937 Bottom = 0.001853064 moveKick ... updating velocity only [Level 1 step 19] Advanced 32768 cells [Level 2 step 37] ADVANCE at time 0.028125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.969760447e-20, 4.052291887e-14 MLMG: Timers: Solve = 0.130741069 Iter = 0.118843551 Bottom = 0.009720886 moveKick ... updating velocity only [Level 2 step 37] Advanced 11264 cells [Level 2 step 38] ADVANCE at time 0.02890625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.614806906e-19, 3.891933608e-13 MLMG: Timers: Solve = 0.130580209 Iter = 0.118657203 Bottom = 0.00965343 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.897798411e-19, 9.049954623e-14 MLMG: Timers: Solve = 0.130758611 Iter = 0.11884906 Bottom = 0.009668741 moveKick ... updating velocity only [Level 2 step 38] Advanced 11264 cells [Level 1 step 20] ADVANCE at time 0.0296875 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 9.867933836e-20, 6.654990774e-14 MLMG: Timers: Solve = 0.456624749 Iter = 0.421725151 Bottom = 0.002455034 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 3.704988249e-07 MLMG: Initial residual (resid0) = 3.495865805e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.085736593e-20, 2.930472432e-14 MLMG: Timers: Solve = 0.127567605 Iter = 0.11729583 Bottom = 0.001866831 moveKick ... updating velocity only [Level 1 step 20] Advanced 32768 cells [Level 2 step 39] ADVANCE at time 0.0296875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.131615442e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.294155088e-19, 4.677198815e-14 MLMG: Timers: Solve = 0.130300823 Iter = 0.118405146 Bottom = 0.009373054 moveKick ... updating velocity only [Level 2 step 39] Advanced 11264 cells [Level 2 step 40] ADVANCE at time 0.03046875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.766944786e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 5.942777781e-19, 2.147776064e-13 MLMG: Timers: Solve = 0.13064645 Iter = 0.118715991 Bottom = 0.009656889 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.793151269e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 1.876328318e-18, 6.326469533e-13 MLMG: Timers: Solve = 0.116157152 Iter = 0.1042447 Bottom = 0.008530853 moveKick ... updating velocity only [Level 2 step 40] Advanced 11264 cells [STEP 10] Coarse TimeStep time: 3.554405951 [STEP 10] FAB kilobyte spread across MPI nodes: [19756 ... 20434] STEP = 10 TIME = 0.03125 DT = 0.003125 PLOTFILE: file = Part-2line_restart-nbody_plt00010 Output file Part-2line_restart-nbody_plt00010.temp at time 1.000000 and step 10 Write plotfile time = 0.133098901 seconds Time w/o init: 19.50120741 Run time = 20.36003942 Unused ParmParse Variables: [TOP]::amr.probin_file(nvals = 1) :: [] [TOP]::particles.particle_output_file(nvals = 1) :: [final_particles] Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [7611 ... 7621] [The Arena] max space (MB) allocated spread across MPI: [33 ... 33] [The Arena] max space (MB) used spread across MPI: [29 ... 30] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Pinned Arena] max space (MB) used spread across MPI: [3 ... 3] AMReX (26.09-190-g541acefee8d0) finalized