Initializing AMReX (26.08-28-g19e6fba747b6)... MPI initialized with 2 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.08-28-g19e6fba747b6) initialized Successfully read inputs file ... AMReX git describe: 26.08-28-g19e6fba747 Nyx git describe: 26.07-14-g6a39d315 Nyx::setting init_sb_vels to 0 since do_santa_barbara = 0 Successfully read inputs file ... Getting Gconst from nyx_constants: 4.300927161e-09 Using -5.404704468e-08 for 4 pi G in Gravity.cpp Initializing the data at level 0 ... setting particle_initrandom_mass to 2.123188769e+11 by dividing 8.696581196e+14 by 4096 Initializing DM particles from "particle_file.2line" ... Redistributing from processor 0 to 0 Redistributing from processor 1 to 1 Total number of particles: 16 Done initializing the level 0 data ...estdt from particles at level 0: 0.003125 Nyx::est_time_step at level 0: estdt = 0.003125 Integrating a from time 0 by dt = 0.003125 Old / new A time 0 0.003125 Old / new A 1 1 Old / new z 0 0 grid_places() time: 0.005456111 new finest: 1 Initializing the data at level 1 BA SIZE 0 FLEV 1 Calling redistribute because the size of BoxArray changed Done initializing the level 1 data grid_places() time: 0.012082896 new finest: 2 Initializing the data at level 2 BA SIZE 2 FLEV 2 Calling redistribute because the size of BoxArray changed Done initializing the level 2 data Now regridding at level lbase = 0 grid_places() time: 0.047082374 new finest: 2 Initializing the data at level 1 Calling redistribute because BoxArray changed Done initializing the level 1 data Initializing the data at level 2 Calling redistribute because BoxArray changed Done initializing the level 2 data NOT calling redistribute because NOT changed STEP = 0 TIME = 0 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 Now regridding at level lbase = 0 grid_places() time: 0.053001128 new finest: 2 Regridding at level lbase = 0 but grids unchanged Setting the current time in the state data to 0 Setting the current time in the state data to 0 Setting the current time in the state data to 0 NOT calling redistribute because NOT changed Gravity ... defining average density in Gravity::set_mass_offset to be 0.0048828125 Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 7.676236084e-19, 5.17689733e-13 MLMG: Timers: Solve = 0.687699778 Iter = 0.61915425 Bottom = 0.004445126 INITIAL GRIDS Level 0 2 grids 4096 cells 100 % of domain smallest grid: 16 x 16 x 8 biggest grid: 16 x 16 x 8 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 CHECKPOINT: file = Part-2line_restart-nomesh_chk00000 checkPoint() time = 0.014650372 secs. PLOTFILE: file = Part-2line_restart-nomesh_plt00000 Output file Part-2line_restart-nomesh_plt00000.temp at time 1.000000 and step 0 Write plotfile time = 0.244636344 seconds ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Re-integrating a from time 0 by dt = 0.003125 Old / new A time 0 0.003125 Old / new A 1 1 Old / new z 0 0 [Level 0 step 1] ADVANCE at time 0 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 7.669883337e-19, 5.172613001e-13 MLMG: Timers: Solve = 0.677972932 Iter = 0.61962286 Bottom = 0.004229516 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 0 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.789252198e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.438476747e-21, 3.623568194e-14 MLMG: Timers: Solve = 0.102462277 Iter = 0.095418849 Bottom = 0.0027824 moveKick ... updating velocity only [Level 0 step 1] Advanced 4096 cells [Level 1 step 1] ADVANCE at time 0 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.573042079e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.614005151e-20, 2.987755637e-14 MLMG: Timers: Solve = 0.119064723 Iter = 0.108886645 Bottom = 0.002817814 moveKick ... updating velocity only [Level 1 step 1] Advanced 32768 cells [Level 2 step 1] ADVANCE at time 0 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 3.426362009e-19, 1.547936431e-13 MLMG: Timers: Solve = 0.185454444 Iter = 0.160063212 Bottom = 0.044302779 moveKick ... updating velocity only [Level 2 step 1] Advanced 53248 cells [Level 2 step 2] ADVANCE at time 0.00078125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 1.92678282e-19, 8.704676604e-14 MLMG: Timers: Solve = 0.207287103 Iter = 0.181794915 Bottom = 0.052109377 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.110434884e-19, 2.9138584e-13 MLMG: Timers: Solve = 0.185291784 Iter = 0.159891928 Bottom = 0.04419534 moveKick ... updating velocity only [Level 2 step 2] Advanced 53248 cells [Level 1 step 2] ADVANCE at time 0.0015625 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.727766784e-19, 1.165215758e-13 MLMG: Timers: Solve = 0.488762614 Iter = 0.440308943 Bottom = 0.003807417 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113485678e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 4.64629418e-20, 1.492312688e-13 MLMG: Timers: Solve = 0.119327239 Iter = 0.109136699 Bottom = 0.002913648 moveKick ... updating velocity only [Level 1 step 2] Advanced 32768 cells [Level 2 step 3] ADVANCE at time 0.0015625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.916846347e-19, 2.221296397e-13 MLMG: Timers: Solve = 0.185409685 Iter = 0.160052129 Bottom = 0.044331509 moveKick ... updating velocity only [Level 2 step 3] Advanced 53248 cells [Level 2 step 4] ADVANCE at time 0.00234375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 2.134901462e-19, 9.644899579e-14 MLMG: Timers: Solve = 0.20735166 Iter = 0.181929914 Bottom = 0.052261427 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 2.574469376e-19, 1.227676812e-13 MLMG: Timers: Solve = 0.185596203 Iter = 0.160182746 Bottom = 0.044569467 moveKick ... updating velocity only [Level 2 step 4] Advanced 53248 cells [STEP 1] Coarse TimeStep time: 5.190228972 [STEP 1] FAB kilobyte spread across MPI nodes: [17669 ... 18099] STEP = 1 TIME = 0.003125 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.003125 by dt = 0.003125 Old / new A time 0.003125 0.00625 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.02471119 new finest: 2 Setting the current time in the state data to 0.003125 Calling redistribute because BoxArray changed TIME = 0.003125 : REGRID with lbase = 1 Level 2 15 grids 11264 cells 4.296875 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 8 x 8 [Level 0 step 2] ADVANCE at time 0.003125 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 3.14747393e-19, 2.122674342e-13 MLMG: Timers: Solve = 0.637148576 Iter = 0.596027102 Bottom = 0.002313353 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 1.084202172e-19 to ensure solvability MLMG: Initial rhs = 2.892150254e-08 MLMG: Initial residual (resid0) = 3.873110818e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 3.890127023e-21, 1.004393421e-13 MLMG: Timers: Solve = 0.101332204 Iter = 0.094259 Bottom = 0.001787659 moveKick ... updating velocity only [Level 0 step 2] Advanced 4096 cells [Level 1 step 3] ADVANCE at time 0.003125 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.641046646e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 2.52967341e-20, 4.682789262e-14 MLMG: Timers: Solve = 0.118028006 Iter = 0.107876298 Bottom = 0.001797457 moveKick ... updating velocity only [Level 1 step 3] Advanced 32768 cells [Level 2 step 5] ADVANCE at time 0.003125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.977701381e-20, 4.055879384e-14 MLMG: Timers: Solve = 0.122569949 Iter = 0.10986221 Bottom = 0.014352388 moveKick ... updating velocity only [Level 2 step 5] Advanced 11264 cells [Level 2 step 6] ADVANCE at time 0.00390625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.61440986e-19, 3.891754233e-13 MLMG: Timers: Solve = 0.122549925 Iter = 0.109838864 Bottom = 0.01427639 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.898195458e-19, 9.051848004e-14 MLMG: Timers: Solve = 0.122517136 Iter = 0.10980292 Bottom = 0.014263847 moveKick ... updating velocity only [Level 2 step 6] Advanced 11264 cells [Level 1 step 4] ADVANCE at time 0.0046875 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 9.8361701e-20, 6.63356913e-14 MLMG: Timers: Solve = 0.427743247 Iter = 0.393430783 Bottom = 0.002448218 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 3.704988249e-07 MLMG: Initial residual (resid0) = 3.495865805e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.085074848e-20, 2.928686341e-14 MLMG: Timers: Solve = 0.117920307 Iter = 0.10769973 Bottom = 0.001859492 moveKick ... updating velocity only [Level 1 step 4] Advanced 32768 cells [Level 2 step 7] ADVANCE at time 0.0046875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.131615442e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.294419785e-19, 4.678155458e-14 MLMG: Timers: Solve = 0.122188109 Iter = 0.109479498 Bottom = 0.013960706 moveKick ... updating velocity only [Level 2 step 7] Advanced 11264 cells [Level 2 step 8] ADVANCE at time 0.00546875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.766944786e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 5.942645432e-19, 2.147728231e-13 MLMG: Timers: Solve = 0.122540053 Iter = 0.109800489 Bottom = 0.014262196 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.793151269e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 1.876315083e-18, 6.326424909e-13 MLMG: Timers: Solve = 0.109184065 Iter = 0.096456316 Bottom = 0.01251016 moveKick ... updating velocity only [Level 2 step 8] Advanced 11264 cells [STEP 2] Coarse TimeStep time: 3.437594627 [STEP 2] FAB kilobyte spread across MPI nodes: [17669 ... 18099] STEP = 2 TIME = 0.00625 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.00625 by dt = 0.003125 Old / new A time 0.00625 0.009375 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.04084758 new finest: 2 Setting the current time in the state data to 0.00625 Setting the current time in the state data to 0.00625 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 7.247393028e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 3.38887832e-19, 1.142637737e-13 MLMG: Timers: Solve = 0.513231309 Iter = 0.463817078 Bottom = 0.001821199 STEP = 2 TIME = 0.00625 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 14 grids 7168 cells 2.734375 % of domain smallest grid: 8 x 8 x 8 biggest grid: 8 x 8 x 8 [Level 0 step 3] ADVANCE at time 0.00625 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.965837911e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 4.679857034e-19, 1.5779207e-13 MLMG: Timers: Solve = 0.636693673 Iter = 0.590263644 Bottom = 0.002357756 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 0 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.734865479e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 5.038046918e-21, 7.48652067e-14 MLMG: Timers: Solve = 0.1013036 Iter = 0.094216458 Bottom = 0.001792573 moveKick ... updating velocity only [Level 0 step 3] Advanced 4096 cells [Level 1 step 5] ADVANCE at time 0.00625 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.57065785e-07 MLMG: Final Iter. 6 resid, resid/bnorm = 4.290437979e-19, 7.942217688e-13 MLMG: Timers: Solve = 0.103125003 Iter = 0.092949571 Bottom = 0.001562851 moveKick ... updating velocity only [Level 1 step 5] Advanced 32768 cells [Level 2 step 9] ADVANCE at time 0.00625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 2.645473939e-18, 9.560992876e-13 MLMG: Timers: Solve = 0.104629621 Iter = 0.092831235 Bottom = 0.009452994 moveKick ... updating velocity only [Level 2 step 9] Advanced 7168 cells [Level 2 step 10] ADVANCE at time 0.00703125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.766944786e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.83925267e-19, 1.748951657e-13 MLMG: Timers: Solve = 0.11764985 Iter = 0.105835381 Bottom = 0.010845076 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.650467071e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.632079047e-19, 6.157703542e-14 MLMG: Timers: Solve = 0.117661267 Iter = 0.105850706 Bottom = 0.010940915 moveKick ... updating velocity only [Level 2 step 10] Advanced 7168 cells [Level 1 step 6] ADVANCE at time 0.0078125 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 1.527835679e-19, 1.030381082e-13 MLMG: Timers: Solve = 0.425070705 Iter = 0.391504475 Bottom = 0.002471793 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.444676299e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.455774484e-20, 1.003221837e-13 MLMG: Timers: Solve = 0.118002965 Iter = 0.107777762 Bottom = 0.001825617 moveKick ... updating velocity only [Level 1 step 6] Advanced 32768 cells [Level 2 step 11] ADVANCE at time 0.0078125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.711866211e-20, 3.935782341e-14 MLMG: Timers: Solve = 0.11743535 Iter = 0.105634719 Bottom = 0.010808614 moveKick ... updating velocity only [Level 2 step 11] Advanced 7168 cells [Level 2 step 12] ADVANCE at time 0.00859375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.289115524e-19, 1.937704819e-13 MLMG: Timers: Solve = 0.117686566 Iter = 0.105862877 Bottom = 0.010970956 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 7 resid, resid/resid0 = 1.168910223e-18, 5.574134965e-13 MLMG: Timers: Solve = 0.10472709 Iter = 0.0929248 Bottom = 0.009533927 moveKick ... updating velocity only [Level 2 step 12] Advanced 7168 cells [STEP 3] Coarse TimeStep time: 4.092254099 [STEP 3] FAB kilobyte spread across MPI nodes: [17669 ... 18099] STEP = 3 TIME = 0.009375 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.009375 by dt = 0.003125 Old / new A time 0.009375 0.0125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.01835143 new finest: 2 Setting the current time in the state data to 0.009375 Calling redistribute because BoxArray changed TIME = 0.009375 : REGRID with lbase = 1 Level 2 36 grids 46080 cells 17.578125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 4] ADVANCE at time 0.009375 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 8.592090459e-20, 5.794554735e-14 MLMG: Timers: Solve = 0.751734594 Iter = 0.685485143 Bottom = 0.004712043 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 1.355252716e-19 to ensure solvability MLMG: Initial rhs = 1.432880048e-08 MLMG: Initial residual (resid0) = 4.198898866e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 2.650286683e-21, 6.311861198e-14 MLMG: Timers: Solve = 0.102590439 Iter = 0.095509019 Bottom = 0.00295471 moveKick ... updating velocity only [Level 0 step 4] Advanced 4096 cells [Level 1 step 7] ADVANCE at time 0.009375 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.593886225e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 3.715085266e-20, 6.877157077e-14 MLMG: Timers: Solve = 0.119138484 Iter = 0.108938927 Bottom = 0.002742986 moveKick ... updating velocity only [Level 1 step 7] Advanced 32768 cells [Level 2 step 13] ADVANCE at time 0.009375 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 6.046444192e-19, 2.731617738e-13 MLMG: Timers: Solve = 0.171681626 Iter = 0.149863811 Bottom = 0.038184776 moveKick ... updating velocity only [Level 2 step 13] Advanced 46080 cells [Level 2 step 14] ADVANCE at time 0.01015625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 9.265529215e-19, 4.185912109e-13 MLMG: Timers: Solve = 0.19014036 Iter = 0.16829034 Bottom = 0.043092555 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.034098521e-19, 2.877456187e-13 MLMG: Timers: Solve = 0.17048412 Iter = 0.14862238 Bottom = 0.037373601 moveKick ... updating velocity only [Level 2 step 14] Advanced 46080 cells [Level 1 step 8] ADVANCE at time 0.0109375 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 2.430936479e-19, 1.639437405e-13 MLMG: Timers: Solve = 0.486179453 Iter = 0.436110062 Bottom = 0.003899747 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113486436e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.300926273e-20, 1.060202555e-13 MLMG: Timers: Solve = 0.119897358 Iter = 0.109610693 Bottom = 0.003512532 moveKick ... updating velocity only [Level 1 step 8] Advanced 32768 cells [Level 2 step 15] ADVANCE at time 0.0109375 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.947580243e-19, 2.235181129e-13 MLMG: Timers: Solve = 0.170412552 Iter = 0.148601337 Bottom = 0.037192388 moveKick ... updating velocity only [Level 2 step 15] Advanced 46080 cells [Level 2 step 16] ADVANCE at time 0.01171875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.290546235e-06 MLMG: Final Iter. 9 resid, resid/resid0 = 9.270775608e-19, 4.047408197e-13 MLMG: Timers: Solve = 0.191025842 Iter = 0.169142857 Bottom = 0.043267511 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.132324232e-18, 5.399668824e-13 MLMG: Timers: Solve = 0.170749235 Iter = 0.14891974 Bottom = 0.036892218 moveKick ... updating velocity only [Level 2 step 16] Advanced 46080 cells [STEP 4] Coarse TimeStep time: 4.992056231 [STEP 4] FAB kilobyte spread across MPI nodes: [17669 ... 18099] STEP = 4 TIME = 0.0125 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.0125 by dt = 0.003125 Old / new A time 0.0125 0.015625 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.051790753 new finest: 2 Setting the current time in the state data to 0.0125 Setting the current time in the state data to 0.0125 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 7.152210038e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.451187675e-18, 9.786892325e-13 MLMG: Timers: Solve = 0.621415965 Iter = 0.551525508 Bottom = 0.003866707 STEP = 4 TIME = 0.0125 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 5] ADVANCE at time 0.0125 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 7.678353667e-19, 5.178325439e-13 MLMG: Timers: Solve = 0.697779661 Iter = 0.628517701 Bottom = 0.004372499 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 0 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.789252198e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.438476747e-21, 3.623568194e-14 MLMG: Timers: Solve = 0.102564391 Iter = 0.095439265 Bottom = 0.002894499 moveKick ... updating velocity only [Level 0 step 5] Advanced 4096 cells [Level 1 step 9] ADVANCE at time 0.0125 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.573042079e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.613922433e-20, 2.987602514e-14 MLMG: Timers: Solve = 0.119603065 Iter = 0.109412571 Bottom = 0.002911697 moveKick ... updating velocity only [Level 1 step 9] Advanced 32768 cells [Level 2 step 17] ADVANCE at time 0.0125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 3.42622966e-19, 1.547876639e-13 MLMG: Timers: Solve = 0.180657516 Iter = 0.156861066 Bottom = 0.041654431 moveKick ... updating velocity only [Level 2 step 17] Advanced 53248 cells [Level 2 step 18] ADVANCE at time 0.01328125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 1.926915169e-19, 8.70527452e-14 MLMG: Timers: Solve = 0.202586333 Iter = 0.178723324 Bottom = 0.049280395 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.110434884e-19, 2.9138584e-13 MLMG: Timers: Solve = 0.181123586 Iter = 0.157286152 Bottom = 0.041937835 moveKick ... updating velocity only [Level 2 step 18] Advanced 53248 cells [Level 1 step 10] ADVANCE at time 0.0140625 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.727965307e-19, 1.165349643e-13 MLMG: Timers: Solve = 0.503575947 Iter = 0.449734897 Bottom = 0.003954479 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113485678e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 4.646128744e-20, 1.492259552e-13 MLMG: Timers: Solve = 0.119476524 Iter = 0.109157816 Bottom = 0.003050149 moveKick ... updating velocity only [Level 1 step 10] Advanced 32768 cells [Level 2 step 19] ADVANCE at time 0.0140625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.916846347e-19, 2.221296397e-13 MLMG: Timers: Solve = 0.180852906 Iter = 0.157081399 Bottom = 0.042013269 moveKick ... updating velocity only [Level 2 step 19] Advanced 53248 cells [Level 2 step 20] ADVANCE at time 0.01484375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 2.134967637e-19, 9.645198537e-14 MLMG: Timers: Solve = 0.203111809 Iter = 0.179179122 Bottom = 0.050013708 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 2.574469376e-19, 1.227676812e-13 MLMG: Timers: Solve = 0.181085339 Iter = 0.157212371 Bottom = 0.042385565 moveKick ... updating velocity only [Level 2 step 20] Advanced 53248 cells [STEP 5] Coarse TimeStep time: 6.252805854 [STEP 5] FAB kilobyte spread across MPI nodes: [18099 ... 18207] STEP = 5 TIME = 0.015625 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.015625 by dt = 0.003125 Old / new A time 0.015625 0.01875 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.024956264 new finest: 2 Setting the current time in the state data to 0.015625 Calling redistribute because BoxArray changed TIME = 0.015625 : REGRID with lbase = 1 Level 2 15 grids 11264 cells 4.296875 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 8 x 8 [Level 0 step 6] ADVANCE at time 0.015625 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 3.152503188e-19, 2.126066103e-13 MLMG: Timers: Solve = 0.650914606 Iter = 0.599722463 Bottom = 0.00239949 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting -2.710505431e-20 to ensure solvability MLMG: Initial rhs = 2.892150254e-08 MLMG: Initial residual (resid0) = 3.873110818e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 3.889816831e-21, 1.004313332e-13 MLMG: Timers: Solve = 0.101626755 Iter = 0.094483198 Bottom = 0.001806376 moveKick ... updating velocity only [Level 0 step 6] Advanced 4096 cells [Level 1 step 11] ADVANCE at time 0.015625 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.641046646e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 2.530004282e-20, 4.683401754e-14 MLMG: Timers: Solve = 0.117959915 Iter = 0.107778503 Bottom = 0.001829886 moveKick ... updating velocity only [Level 1 step 11] Advanced 32768 cells [Level 2 step 21] ADVANCE at time 0.015625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.977701381e-20, 4.055879384e-14 MLMG: Timers: Solve = 0.119538872 Iter = 0.107596938 Bottom = 0.013163398 moveKick ... updating velocity only [Level 2 step 21] Advanced 11264 cells [Level 2 step 22] ADVANCE at time 0.01640625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.614674557e-19, 3.891873816e-13 MLMG: Timers: Solve = 0.119603216 Iter = 0.107686252 Bottom = 0.013169894 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.898327807e-19, 9.052479131e-14 MLMG: Timers: Solve = 0.119724877 Iter = 0.107803284 Bottom = 0.013146681 moveKick ... updating velocity only [Level 2 step 22] Advanced 11264 cells [Level 1 step 12] ADVANCE at time 0.0171875 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 9.846758012e-20, 6.640709678e-14 MLMG: Timers: Solve = 0.432778392 Iter = 0.397862623 Bottom = 0.002362772 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 3.704988249e-07 MLMG: Initial residual (resid0) = 3.495865805e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.084909412e-20, 2.928239818e-14 MLMG: Timers: Solve = 0.118088549 Iter = 0.107782896 Bottom = 0.001845605 moveKick ... updating velocity only [Level 1 step 12] Advanced 32768 cells [Level 2 step 23] ADVANCE at time 0.0171875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.131615442e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.29389039e-19, 4.676242172e-14 MLMG: Timers: Solve = 0.119940634 Iter = 0.108063545 Bottom = 0.013187949 moveKick ... updating velocity only [Level 2 step 23] Advanced 11264 cells [Level 2 step 24] ADVANCE at time 0.01796875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.766944786e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 5.943174828e-19, 2.14791956e-13 MLMG: Timers: Solve = 0.12028147 Iter = 0.108337081 Bottom = 0.01339886 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.793151269e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 1.876301848e-18, 6.326380284e-13 MLMG: Timers: Solve = 0.106529685 Iter = 0.094622642 Bottom = 0.011519927 moveKick ... updating velocity only [Level 2 step 24] Advanced 11264 cells [STEP 6] Coarse TimeStep time: 3.398921088 [STEP 6] FAB kilobyte spread across MPI nodes: [18099 ... 18207] STEP = 6 TIME = 0.01875 DT = 0.003125 CHECKPOINT: file = Part-2line_restart-nomesh_chk00006 checkPoint() time = 0.014217728 secs. ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.01875 by dt = 0.003125 Old / new A time 0.01875 0.021875 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.041275997 new finest: 2 Setting the current time in the state data to 0.01875 Setting the current time in the state data to 0.01875 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 7.247393028e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 3.390201809e-19, 1.143083982e-13 MLMG: Timers: Solve = 0.516681892 Iter = 0.466682721 Bottom = 0.001843801 STEP = 6 TIME = 0.01875 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 14 grids 7168 cells 2.734375 % of domain smallest grid: 8 x 8 x 8 biggest grid: 8 x 8 x 8 [Level 0 step 7] ADVANCE at time 0.01875 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.965837911e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 4.688327363e-19, 1.580776666e-13 MLMG: Timers: Solve = 0.642718266 Iter = 0.593376048 Bottom = 0.002376549 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 0 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.734865479e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 5.03752993e-21, 7.485752428e-14 MLMG: Timers: Solve = 0.101475268 Iter = 0.094389717 Bottom = 0.001793907 moveKick ... updating velocity only [Level 0 step 7] Advanced 4096 cells [Level 1 step 13] ADVANCE at time 0.01875 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.57065785e-07 MLMG: Final Iter. 6 resid, resid/bnorm = 4.29030563e-19, 7.941972691e-13 MLMG: Timers: Solve = 0.103044176 Iter = 0.092855185 Bottom = 0.001572494 moveKick ... updating velocity only [Level 1 step 13] Advanced 32768 cells [Level 2 step 25] ADVANCE at time 0.01875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 2.64536806e-18, 9.560610219e-13 MLMG: Timers: Solve = 0.104758604 Iter = 0.092947587 Bottom = 0.009510571 moveKick ... updating velocity only [Level 2 step 25] Advanced 7168 cells [Level 2 step 26] ADVANCE at time 0.01953125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.766944786e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.839517367e-19, 1.749047322e-13 MLMG: Timers: Solve = 0.117629767 Iter = 0.105798952 Bottom = 0.010879861 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.650467071e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.632873141e-19, 6.160699593e-14 MLMG: Timers: Solve = 0.117917853 Iter = 0.106094291 Bottom = 0.011034366 moveKick ... updating velocity only [Level 2 step 26] Advanced 7168 cells [Level 1 step 14] ADVANCE at time 0.0203125 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 1.524659305e-19, 1.028238918e-13 MLMG: Timers: Solve = 0.428930625 Iter = 0.394683654 Bottom = 0.002375616 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.444676299e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.456105356e-20, 1.00331789e-13 MLMG: Timers: Solve = 0.118105282 Iter = 0.107862001 Bottom = 0.001839242 moveKick ... updating velocity only [Level 1 step 14] Advanced 32768 cells [Level 2 step 27] ADVANCE at time 0.0203125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.701940044e-20, 3.931297971e-14 MLMG: Timers: Solve = 0.117751309 Iter = 0.105919331 Bottom = 0.010936268 moveKick ... updating velocity only [Level 2 step 27] Advanced 7168 cells [Level 2 step 28] ADVANCE at time 0.02109375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.289115524e-19, 1.937704819e-13 MLMG: Timers: Solve = 0.117877411 Iter = 0.106057217 Bottom = 0.011037543 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 7 resid, resid/resid0 = 1.168936693e-18, 5.57426119e-13 MLMG: Timers: Solve = 0.1049208 Iter = 0.093099432 Bottom = 0.00959273 moveKick ... updating velocity only [Level 2 step 28] Advanced 7168 cells [STEP 7] Coarse TimeStep time: 4.111747209 [STEP 7] FAB kilobyte spread across MPI nodes: [18099 ... 18207] STEP = 7 TIME = 0.021875 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.021875 by dt = 0.003125 Old / new A time 0.021875 0.025 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.018622807 new finest: 2 Setting the current time in the state data to 0.021875 Calling redistribute because BoxArray changed TIME = 0.021875 : REGRID with lbase = 1 Level 2 36 grids 46080 cells 17.578125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 8] ADVANCE at time 0.021875 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 8.570914635e-20, 5.780273639e-14 MLMG: Timers: Solve = 0.753079455 Iter = 0.686903825 Bottom = 0.004738153 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 1.084202172e-19 to ensure solvability MLMG: Initial rhs = 1.432880048e-08 MLMG: Initial residual (resid0) = 4.198898866e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 2.642014876e-21, 6.292161257e-14 MLMG: Timers: Solve = 0.102678811 Iter = 0.095570656 Bottom = 0.002976043 moveKick ... updating velocity only [Level 0 step 8] Advanced 4096 cells [Level 1 step 15] ADVANCE at time 0.021875 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.593886225e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 3.714713035e-20, 6.876468024e-14 MLMG: Timers: Solve = 0.119124755 Iter = 0.108911096 Bottom = 0.002760034 moveKick ... updating velocity only [Level 1 step 15] Advanced 32768 cells [Level 2 step 29] ADVANCE at time 0.021875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 6.047238285e-19, 2.731976488e-13 MLMG: Timers: Solve = 0.172069746 Iter = 0.150250107 Bottom = 0.038194653 moveKick ... updating velocity only [Level 2 step 29] Advanced 46080 cells [Level 2 step 30] ADVANCE at time 0.02265625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 9.265793912e-19, 4.186031692e-13 MLMG: Timers: Solve = 0.190657094 Iter = 0.168769915 Bottom = 0.043176157 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.033833823e-19, 2.877329962e-13 MLMG: Timers: Solve = 0.170840266 Iter = 0.148984524 Bottom = 0.037554277 moveKick ... updating velocity only [Level 2 step 30] Advanced 46080 cells [Level 1 step 16] ADVANCE at time 0.0234375 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 2.434112852e-19, 1.641579569e-13 MLMG: Timers: Solve = 0.488024531 Iter = 0.437678162 Bottom = 0.003950965 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113486436e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.301422581e-20, 1.060361961e-13 MLMG: Timers: Solve = 0.119956645 Iter = 0.109547534 Bottom = 0.003542588 moveKick ... updating velocity only [Level 1 step 16] Advanced 32768 cells [Level 2 step 31] ADVANCE at time 0.0234375 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.947778766e-19, 2.235270816e-13 MLMG: Timers: Solve = 0.170501899 Iter = 0.148687356 Bottom = 0.037252009 moveKick ... updating velocity only [Level 2 step 31] Advanced 46080 cells [Level 2 step 32] ADVANCE at time 0.02421875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.290546235e-06 MLMG: Final Iter. 9 resid, resid/resid0 = 9.275010772e-19, 4.049257173e-13 MLMG: Timers: Solve = 0.191011341 Iter = 0.169116364 Bottom = 0.043617365 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.13258893e-18, 5.400931078e-13 MLMG: Timers: Solve = 0.170426059 Iter = 0.148544275 Bottom = 0.037053538 moveKick ... updating velocity only [Level 2 step 32] Advanced 46080 cells [STEP 8] Coarse TimeStep time: 4.993873729 [STEP 8] FAB kilobyte spread across MPI nodes: [18099 ... 18207] STEP = 8 TIME = 0.025 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.025 by dt = 0.003125 Old / new A time 0.025 0.028125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.051840243 new finest: 2 Setting the current time in the state data to 0.025 Setting the current time in the state data to 0.025 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 7.152210038e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.451267033e-18, 9.787427518e-13 MLMG: Timers: Solve = 0.621458081 Iter = 0.551391357 Bottom = 0.003942033 STEP = 8 TIME = 0.025 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 9] ADVANCE at time 0.025 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 7.67200092e-19, 5.174041111e-13 MLMG: Timers: Solve = 0.696102874 Iter = 0.627089929 Bottom = 0.004443934 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 0 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.789252198e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.438528446e-21, 3.623645018e-14 MLMG: Timers: Solve = 0.102638864 Iter = 0.095493581 Bottom = 0.002943851 moveKick ... updating velocity only [Level 0 step 9] Advanced 4096 cells [Level 1 step 17] ADVANCE at time 0.025 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.573042079e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.613922433e-20, 2.987602514e-14 MLMG: Timers: Solve = 0.119665643 Iter = 0.109384357 Bottom = 0.002935741 moveKick ... updating velocity only [Level 1 step 17] Advanced 32768 cells [Level 2 step 33] ADVANCE at time 0.025 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 3.426428183e-19, 1.547966327e-13 MLMG: Timers: Solve = 0.180973638 Iter = 0.157186347 Bottom = 0.041763528 moveKick ... updating velocity only [Level 2 step 33] Advanced 53248 cells [Level 2 step 34] ADVANCE at time 0.02578125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 1.926915169e-19, 8.70527452e-14 MLMG: Timers: Solve = 0.202990968 Iter = 0.179135696 Bottom = 0.049486421 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.110302535e-19, 2.913795287e-13 MLMG: Timers: Solve = 0.181556135 Iter = 0.157690362 Bottom = 0.042028941 moveKick ... updating velocity only [Level 2 step 34] Advanced 53248 cells [Level 1 step 18] ADVANCE at time 0.0265625 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.727965307e-19, 1.165349643e-13 MLMG: Timers: Solve = 0.503294158 Iter = 0.449742023 Bottom = 0.003947171 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113485678e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 4.645632436e-20, 1.492100146e-13 MLMG: Timers: Solve = 0.119291614 Iter = 0.108936271 Bottom = 0.003057364 moveKick ... updating velocity only [Level 1 step 18] Advanced 32768 cells [Level 2 step 35] ADVANCE at time 0.0265625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.916846347e-19, 2.221296397e-13 MLMG: Timers: Solve = 0.180922829 Iter = 0.157122985 Bottom = 0.042188864 moveKick ... updating velocity only [Level 2 step 35] Advanced 53248 cells [Level 2 step 36] ADVANCE at time 0.02734375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 2.134901462e-19, 9.644899579e-14 MLMG: Timers: Solve = 0.203636234 Iter = 0.179715241 Bottom = 0.050050561 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 2.574270852e-19, 1.227582143e-13 MLMG: Timers: Solve = 0.181939014 Iter = 0.158074099 Bottom = 0.042517208 moveKick ... updating velocity only [Level 2 step 36] Advanced 53248 cells [STEP 9] Coarse TimeStep time: 6.257147049 [STEP 9] FAB kilobyte spread across MPI nodes: [18099 ... 18207] STEP = 9 TIME = 0.028125 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.028125 by dt = 0.003125 Old / new A time 0.028125 0.03125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.025108347 new finest: 2 Setting the current time in the state data to 0.028125 Calling redistribute because BoxArray changed TIME = 0.028125 : REGRID with lbase = 1 Level 2 15 grids 11264 cells 4.296875 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 8 x 8 [Level 0 step 10] ADVANCE at time 0.028125 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 3.150385605e-19, 2.124637993e-13 MLMG: Timers: Solve = 0.650149602 Iter = 0.598913758 Bottom = 0.002405468 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting -2.710505431e-20 to ensure solvability MLMG: Initial rhs = 2.892150254e-08 MLMG: Initial residual (resid0) = 3.873110818e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 3.890075324e-21, 1.004380073e-13 MLMG: Timers: Solve = 0.101469628 Iter = 0.094360589 Bottom = 0.001818116 moveKick ... updating velocity only [Level 0 step 10] Advanced 4096 cells [Level 1 step 19] ADVANCE at time 0.028125 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.641046646e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 2.52967341e-20, 4.682789262e-14 MLMG: Timers: Solve = 0.118347917 Iter = 0.108140323 Bottom = 0.001854911 moveKick ... updating velocity only [Level 1 step 19] Advanced 32768 cells [Level 2 step 37] ADVANCE at time 0.028125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.969760447e-20, 4.052291887e-14 MLMG: Timers: Solve = 0.119506825 Iter = 0.107600787 Bottom = 0.01326329 moveKick ... updating velocity only [Level 2 step 37] Advanced 11264 cells [Level 2 step 38] ADVANCE at time 0.02890625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.614806906e-19, 3.891933608e-13 MLMG: Timers: Solve = 0.119696837 Iter = 0.107771715 Bottom = 0.01322518 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.897798411e-19, 9.049954623e-14 MLMG: Timers: Solve = 0.119403849 Iter = 0.107486567 Bottom = 0.013212426 moveKick ... updating velocity only [Level 2 step 38] Advanced 11264 cells [Level 1 step 20] ADVANCE at time 0.0296875 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 9.867933836e-20, 6.654990774e-14 MLMG: Timers: Solve = 0.433266704 Iter = 0.398157601 Bottom = 0.00247286 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 3.704988249e-07 MLMG: Initial residual (resid0) = 3.495865805e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.085736593e-20, 2.930472432e-14 MLMG: Timers: Solve = 0.11818639 Iter = 0.107891519 Bottom = 0.001870136 moveKick ... updating velocity only [Level 1 step 20] Advanced 32768 cells [Level 2 step 39] ADVANCE at time 0.0296875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.131615442e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.294155088e-19, 4.677198815e-14 MLMG: Timers: Solve = 0.119558163 Iter = 0.107646709 Bottom = 0.012900208 moveKick ... updating velocity only [Level 2 step 39] Advanced 11264 cells [Level 2 step 40] ADVANCE at time 0.03046875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.766944786e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 5.942777781e-19, 2.147776064e-13 MLMG: Timers: Solve = 0.119940572 Iter = 0.108013751 Bottom = 0.013172815 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.793151269e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 1.876328318e-18, 6.326469533e-13 MLMG: Timers: Solve = 0.10639587 Iter = 0.094470303 Bottom = 0.011548141 moveKick ... updating velocity only [Level 2 step 40] Advanced 11264 cells [STEP 10] Coarse TimeStep time: 3.413895753 [STEP 10] FAB kilobyte spread across MPI nodes: [18099 ... 18207] STEP = 10 TIME = 0.03125 DT = 0.003125 PLOTFILE: file = Part-2line_restart-nomesh_plt00010 Output file Part-2line_restart-nomesh_plt00010.temp at time 1.000000 and step 10 Write plotfile time = 0.142217007 seconds Time w/o init: 46.29713765 CHECKPOINT: file = Part-2line_restart-nomesh_chk00010 checkPoint() time = 0.013947537 secs. Run time = 47.92302488 Unused ParmParse Variables: [TOP]::amr.probin_file(nvals = 1) :: [] [TOP]::nyx.do_hydro(nvals = 1) :: [0] [TOP]::nyx.do_hydro(nvals = 1) :: [0] [TOP]::particles.particle_output_file(nvals = 1) :: [final_particles] Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [7611 ... 7621] [The Arena] max space (MB) allocated spread across MPI: [33 ... 33] [The Arena] max space (MB) used spread across MPI: [27 ... 28] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Pinned Arena] max space (MB) used spread across MPI: [3 ... 3] AMReX (26.08-28-g19e6fba747b6) finalized Initializing AMReX (26.08-28-g19e6fba747b6)... MPI initialized with 2 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.08-28-g19e6fba747b6) initialized Successfully read inputs file ... AMReX git describe: 26.08-28-g19e6fba747 Nyx git describe: 26.07-14-g6a39d315 Nyx::setting init_sb_vels to 0 since do_santa_barbara = 0 restarting calculation from file: Part-2line_restart-nomesh_chk00006 Successfully read inputs file ... read CPU time: 57.97108538 Getting Gconst from nyx_constants: 4.300927161e-09 Using -5.404704468e-08 for 4 pi G in Gravity.cpp ...setting old_a_time to 0.01875 Gravity ... defining average density in Gravity::set_mass_offset to be 0.0048828125 Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 7.247393028e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 4.499020876e-19, 1.516947659e-13 MLMG: Timers: Solve = 0.516378669 Iter = 0.466295983 Bottom = 0.001900957 Restart time = 0.800298842 seconds. ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.01875 by dt = 0.003125 Old / new A time 0.01875 0.021875 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.041074462 new finest: 2 Setting the current time in the state data to 0.01875 Setting the current time in the state data to 0.01875 BA SIZE 0 FLEV 2 Calling redistribute because the size of BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 5.094599016e-09 MLMG: Final Iter. 7 resid, resid/bnorm = 5.518202516e-19, 1.86058803e-13 MLMG: Timers: Solve = 0.510096717 Iter = 0.463335658 Bottom = 0.001809926 STEP = 6 TIME = 0.01875 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 14 grids 7168 cells 2.734375 % of domain smallest grid: 8 x 8 x 8 biggest grid: 8 x 8 x 8 [Level 0 step 7] ADVANCE at time 0.01875 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.965837911e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 4.688327363e-19, 1.580776666e-13 MLMG: Timers: Solve = 0.637151448 Iter = 0.590029094 Bottom = 0.002318797 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 0 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.734865479e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 5.03752993e-21, 7.485752428e-14 MLMG: Timers: Solve = 0.101308486 Iter = 0.094226881 Bottom = 0.001797095 moveKick ... updating velocity only [Level 0 step 7] Advanced 4096 cells [Level 1 step 13] ADVANCE at time 0.01875 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.57065785e-07 MLMG: Final Iter. 6 resid, resid/bnorm = 4.29030563e-19, 7.941972691e-13 MLMG: Timers: Solve = 0.103028817 Iter = 0.092831169 Bottom = 0.001557494 moveKick ... updating velocity only [Level 1 step 13] Advanced 32768 cells [Level 2 step 25] ADVANCE at time 0.01875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 2.64536806e-18, 9.560610219e-13 MLMG: Timers: Solve = 0.104957176 Iter = 0.093148837 Bottom = 0.009659134 moveKick ... updating velocity only [Level 2 step 25] Advanced 7168 cells [Level 2 step 26] ADVANCE at time 0.01953125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.766944786e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.839517367e-19, 1.749047322e-13 MLMG: Timers: Solve = 0.11770417 Iter = 0.105886591 Bottom = 0.010840778 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.650467071e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.632873141e-19, 6.160699593e-14 MLMG: Timers: Solve = 0.117837355 Iter = 0.106023221 Bottom = 0.011002118 moveKick ... updating velocity only [Level 2 step 26] Advanced 7168 cells [Level 1 step 14] ADVANCE at time 0.0203125 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 1.524659305e-19, 1.028238918e-13 MLMG: Timers: Solve = 0.423807696 Iter = 0.390280021 Bottom = 0.002341044 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.444676299e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.456105356e-20, 1.00331789e-13 MLMG: Timers: Solve = 0.11821085 Iter = 0.107936493 Bottom = 0.00184623 moveKick ... updating velocity only [Level 1 step 14] Advanced 32768 cells [Level 2 step 27] ADVANCE at time 0.0203125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.701940044e-20, 3.931297971e-14 MLMG: Timers: Solve = 0.117758428 Iter = 0.105939698 Bottom = 0.010955986 moveKick ... updating velocity only [Level 2 step 27] Advanced 7168 cells [Level 2 step 28] ADVANCE at time 0.02109375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.289115524e-19, 1.937704819e-13 MLMG: Timers: Solve = 0.117877715 Iter = 0.106054207 Bottom = 0.011065619 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 7 resid, resid/resid0 = 1.168936693e-18, 5.57426119e-13 MLMG: Timers: Solve = 0.104985111 Iter = 0.093155452 Bottom = 0.00965451 moveKick ... updating velocity only [Level 2 step 28] Advanced 7168 cells [STEP 7] Coarse TimeStep time: 4.090276935 [STEP 7] FAB kilobyte spread across MPI nodes: [7974 ... 7998] STEP = 7 TIME = 0.021875 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.021875 by dt = 0.003125 Old / new A time 0.021875 0.025 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.018493237 new finest: 2 Setting the current time in the state data to 0.021875 Calling redistribute because BoxArray changed TIME = 0.021875 : REGRID with lbase = 1 Level 2 36 grids 46080 cells 17.578125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 8] ADVANCE at time 0.021875 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 8.570914635e-20, 5.780273639e-14 MLMG: Timers: Solve = 0.752392197 Iter = 0.686283611 Bottom = 0.004952044 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 1.084202172e-19 to ensure solvability MLMG: Initial rhs = 1.432880048e-08 MLMG: Initial residual (resid0) = 4.198898866e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 2.645323599e-21, 6.300041233e-14 MLMG: Timers: Solve = 0.102773338 Iter = 0.095657771 Bottom = 0.003025546 moveKick ... updating velocity only [Level 0 step 8] Advanced 4096 cells [Level 1 step 15] ADVANCE at time 0.021875 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.593886225e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 3.715209343e-20, 6.877386762e-14 MLMG: Timers: Solve = 0.118892967 Iter = 0.108701205 Bottom = 0.002740225 moveKick ... updating velocity only [Level 1 step 15] Advanced 32768 cells [Level 2 step 29] ADVANCE at time 0.021875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 6.045650098e-19, 2.731258989e-13 MLMG: Timers: Solve = 0.171640741 Iter = 0.14982596 Bottom = 0.038494871 moveKick ... updating velocity only [Level 2 step 29] Advanced 46080 cells [Level 2 step 30] ADVANCE at time 0.02265625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 9.264999819e-19, 4.185672942e-13 MLMG: Timers: Solve = 0.190184191 Iter = 0.168360134 Bottom = 0.043412013 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.033833823e-19, 2.877329962e-13 MLMG: Timers: Solve = 0.170993899 Iter = 0.149122452 Bottom = 0.037736868 moveKick ... updating velocity only [Level 2 step 30] Advanced 46080 cells [Level 1 step 16] ADVANCE at time 0.0234375 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 2.430936479e-19, 1.639437405e-13 MLMG: Timers: Solve = 0.485918423 Iter = 0.435814816 Bottom = 0.003937734 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113486436e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 3.301091709e-20, 1.06025569e-13 MLMG: Timers: Solve = 0.119826375 Iter = 0.109511903 Bottom = 0.003498202 moveKick ... updating velocity only [Level 1 step 16] Advanced 32768 cells [Level 2 step 31] ADVANCE at time 0.0234375 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.947580243e-19, 2.235181129e-13 MLMG: Timers: Solve = 0.170546325 Iter = 0.148702319 Bottom = 0.037445418 moveKick ... updating velocity only [Level 2 step 31] Advanced 46080 cells [Level 2 step 32] ADVANCE at time 0.02421875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.290546235e-06 MLMG: Final Iter. 9 resid, resid/resid0 = 9.270775608e-19, 4.047408197e-13 MLMG: Timers: Solve = 0.190442272 Iter = 0.168561728 Bottom = 0.043589381 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.132641869e-18, 5.401183528e-13 MLMG: Timers: Solve = 0.170171014 Iter = 0.148346814 Bottom = 0.037184449 moveKick ... updating velocity only [Level 2 step 32] Advanced 46080 cells [STEP 8] Coarse TimeStep time: 4.990625463 [STEP 8] FAB kilobyte spread across MPI nodes: [15766 ... 16329] STEP = 8 TIME = 0.025 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.025 by dt = 0.003125 Old / new A time 0.025 0.028125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 0 grid_places() time: 0.052309377 new finest: 2 Setting the current time in the state data to 0.025 Setting the current time in the state data to 0.025 Calling redistribute because BoxArray changed Gravity ... multilevel solve for new phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 7.152210038e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.451200859e-18, 9.786981234e-13 MLMG: Timers: Solve = 0.61887016 Iter = 0.549666888 Bottom = 0.003900553 STEP = 8 TIME = 0.025 : REGRID with lbase = 0 Level 1 8 grids 32768 cells 100 % of domain smallest grid: 16 x 16 x 16 biggest grid: 16 x 16 x 16 Level 2 40 grids 53248 cells 20.3125 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 16 x 16 [Level 0 step 9] ADVANCE at time 0.025 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 7.67200092e-19, 5.174041111e-13 MLMG: Timers: Solve = 0.694143379 Iter = 0.62551723 Bottom = 0.00631978 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting 0 to ensure solvability MLMG: Initial rhs = 6.729490427e-08 MLMG: Initial residual (resid0) = 5.789252198e-08 MLMG: Final Iter. 7 resid, resid/bnorm = 2.438476747e-21, 3.623568194e-14 MLMG: Timers: Solve = 0.102560638 Iter = 0.095360651 Bottom = 0.0029085 moveKick ... updating velocity only [Level 0 step 9] Advanced 4096 cells [Level 1 step 17] ADVANCE at time 0.025 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.573042079e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.614418741e-20, 2.988521253e-14 MLMG: Timers: Solve = 0.119151915 Iter = 0.108955883 Bottom = 0.002965258 moveKick ... updating velocity only [Level 1 step 17] Advanced 32768 cells [Level 2 step 33] ADVANCE at time 0.025 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 3.42622966e-19, 1.547876639e-13 MLMG: Timers: Solve = 0.180623295 Iter = 0.156783576 Bottom = 0.042132593 moveKick ... updating velocity only [Level 2 step 33] Advanced 53248 cells [Level 2 step 34] ADVANCE at time 0.02578125 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 1.926981343e-19, 8.705573478e-14 MLMG: Timers: Solve = 0.201957454 Iter = 0.177976123 Bottom = 0.049697177 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 6.11023636e-19, 2.913763731e-13 MLMG: Timers: Solve = 0.180891554 Iter = 0.1569998 Bottom = 0.042222773 moveKick ... updating velocity only [Level 2 step 34] Advanced 53248 cells [Level 1 step 18] ADVANCE at time 0.0265625 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.727700609e-19, 1.16517113e-13 MLMG: Timers: Solve = 0.50149394 Iter = 0.447841943 Bottom = 0.003999903 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.851174617e-07 MLMG: Initial residual (resid0) = 3.113485678e-07 MLMG: Final Iter. 7 resid, resid/resid0 = 4.645963308e-20, 1.492206417e-13 MLMG: Timers: Solve = 0.11935564 Iter = 0.109011709 Bottom = 0.003066101 moveKick ... updating velocity only [Level 1 step 18] Advanced 32768 cells [Level 2 step 35] ADVANCE at time 0.0265625 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 4.916846347e-19, 2.221296397e-13 MLMG: Timers: Solve = 0.180716161 Iter = 0.156915562 Bottom = 0.042346882 moveKick ... updating velocity only [Level 2 step 35] Advanced 53248 cells [Level 2 step 36] ADVANCE at time 0.02734375 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 2.134702939e-19, 9.644002705e-14 MLMG: Timers: Solve = 0.203097747 Iter = 0.179142048 Bottom = 0.050157273 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 2.574270852e-19, 1.227582143e-13 MLMG: Timers: Solve = 0.18127385 Iter = 0.157442626 Bottom = 0.042657548 moveKick ... updating velocity only [Level 2 step 36] Advanced 53248 cells [STEP 9] Coarse TimeStep time: 6.239821232 [STEP 9] FAB kilobyte spread across MPI nodes: [17561 ... 18207] STEP = 9 TIME = 0.028125 DT = 0.003125 ...there are no particles at level 0 Nyx::est_time_step at level 0: estdt = 1e+200 ...there are no particles at level 1 Nyx::est_time_step at level 1: estdt = 1e+200 ...estdt from particles at level 2: 0.00078125 Nyx::est_time_step at level 2: estdt = 0.00078125 Nyx::compute_new_dt : limiting dt at level 0 ... new dt computed: 1e+200 ... but limiting to: 0.0034375 = 1.1 * 0.003125 Nyx::compute_new_dt : limiting dt at level 1 ... new dt computed: 1e+200 ... but limiting to: 0.00171875 = 1.1 * 0.0015625 Integrating a from time 0.028125 by dt = 0.003125 Old / new A time 0.028125 0.03125 Old / new A 1 1 Old / new z 0 0 Now regridding at level lbase = 1 grid_places() time: 0.024946861 new finest: 2 Setting the current time in the state data to 0.028125 Calling redistribute because BoxArray changed TIME = 0.028125 : REGRID with lbase = 1 Level 2 15 grids 11264 cells 4.296875 % of domain smallest grid: 8 x 8 x 8 biggest grid: 16 x 8 x 8 [Level 0 step 10] ADVANCE at time 0.028125 with dt = 0.003125 Gravity ... multilevel solve for old phi at base level 0 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 3.150385605e-19, 2.124637993e-13 MLMG: Timers: Solve = 0.649227204 Iter = 0.598265524 Bottom = 0.002412283 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 0.0048828125 ... subtracting -2.710505431e-20 to ensure solvability MLMG: Initial rhs = 2.892150254e-08 MLMG: Initial residual (resid0) = 3.873110818e-08 MLMG: Final Iter. 7 resid, resid/resid0 = 3.890075324e-21, 1.004380073e-13 MLMG: Timers: Solve = 0.10145803 Iter = 0.09435438 Bottom = 0.001835156 moveKick ... updating velocity only [Level 0 step 10] Advanced 4096 cells [Level 1 step 19] ADVANCE at time 0.028125 with dt = 0.0015625 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 5.402065453e-07 MLMG: Initial residual (resid0) = 4.641046646e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 2.52967341e-20, 4.682789262e-14 MLMG: Timers: Solve = 0.118110166 Iter = 0.107903841 Bottom = 0.001851709 moveKick ... updating velocity only [Level 1 step 19] Advanced 32768 cells [Level 2 step 37] ADVANCE at time 0.028125 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 1.578173705e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.969760447e-20, 4.052291887e-14 MLMG: Timers: Solve = 0.119584375 Iter = 0.107666688 Bottom = 0.013329133 moveKick ... updating velocity only [Level 2 step 37] Advanced 11264 cells [Level 2 step 38] ADVANCE at time 0.02890625 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.213503049e-06 MLMG: Initial residual (resid0) = 2.213503049e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 8.614806906e-19, 3.891933608e-13 MLMG: Timers: Solve = 0.119744912 Iter = 0.10779921 Bottom = 0.013286691 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 2.097025334e-06 MLMG: Final Iter. 8 resid, resid/resid0 = 1.897798411e-19, 9.049954623e-14 MLMG: Timers: Solve = 0.119772361 Iter = 0.107868121 Bottom = 0.013227915 moveKick ... updating velocity only [Level 2 step 38] Advanced 11264 cells [Level 1 step 20] ADVANCE at time 0.0296875 with dt = 0.0015625 Gravity ... multilevel solve for old phi at base level 1 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level ... subtracting 0 to ensure solvability MLMG: Initial rhs = 1.482787005e-06 MLMG: Initial residual (resid0) = 1.482787005e-06 MLMG: Final Iter. 9 resid, resid/bnorm = 9.867933836e-20, 6.654990774e-14 MLMG: Timers: Solve = 0.433050425 Iter = 0.39791779 Bottom = 0.002487159 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 1 ... solve for phi at level 1 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 3.704988249e-07 MLMG: Initial residual (resid0) = 3.495865805e-07 MLMG: Final Iter. 7 resid, resid/bnorm = 1.085736593e-20, 2.930472432e-14 MLMG: Timers: Solve = 0.118360107 Iter = 0.108051934 Bottom = 0.001875167 moveKick ... updating velocity only [Level 1 step 20] Advanced 32768 cells [Level 2 step 39] ADVANCE at time 0.0296875 with dt = 0.00078125 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.131615442e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 1.294155088e-19, 4.677198815e-14 MLMG: Timers: Solve = 0.119363149 Iter = 0.107450464 Bottom = 0.012980052 moveKick ... updating velocity only [Level 2 step 39] Advanced 11264 cells [Level 2 step 40] ADVANCE at time 0.03046875 with dt = 0.00078125 Gravity ... multilevel solve for old phi at base level 2 to finest level 2 ... subtracting average density 0.0048828125 from RHS at each level MLMG: Initial rhs = 2.766944786e-06 MLMG: Initial residual (resid0) = 2.766944786e-06 MLMG: Final Iter. 8 resid, resid/bnorm = 5.942777781e-19, 2.147776064e-13 MLMG: Timers: Solve = 0.119529516 Iter = 0.10760785 Bottom = 0.013022879 moveKickDrift ... updating particle positions and velocity Gravity ... single level solve for new phi at level 2 ... solve for phi at level 2 ... subtracting average density from RHS in solve ... 0.0048828125 MLMG: Initial rhs = 2.965837911e-06 MLMG: Initial residual (resid0) = 2.793151269e-06 MLMG: Final Iter. 7 resid, resid/bnorm = 1.876328318e-18, 6.326469533e-13 MLMG: Timers: Solve = 0.106394548 Iter = 0.094485023 Bottom = 0.011542357 moveKick ... updating velocity only [Level 2 step 40] Advanced 11264 cells [STEP 10] Coarse TimeStep time: 3.411265078 [STEP 10] FAB kilobyte spread across MPI nodes: [17561 ... 18207] STEP = 10 TIME = 0.03125 DT = 0.003125 PLOTFILE: file = Part-2line_restart-nomesh_plt00010 Output file Part-2line_restart-nomesh_plt00010.temp at time 1.000000 and step 10 Write plotfile time = 0.131514948 seconds Time w/o init: 18.86256259 Run time = 19.66539489 Unused ParmParse Variables: [TOP]::amr.probin_file(nvals = 1) :: [] [TOP]::nyx.do_hydro(nvals = 1) :: [0] [TOP]::nyx.do_hydro(nvals = 1) :: [0] [TOP]::particles.particle_output_file(nvals = 1) :: [final_particles] Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [7611 ... 7621] [The Arena] max space (MB) allocated spread across MPI: [33 ... 33] [The Arena] max space (MB) used spread across MPI: [27 ... 27] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Pinned Arena] max space (MB) used spread across MPI: [3 ... 3] AMReX (26.08-28-g19e6fba747b6) finalized