Initializing AMReX (26.04-109-g60df5ae33414)... MPI initialized with 4 MPI processes MPI initialized with thread support level 0 AMReX (26.04-109-g60df5ae33414) initialized Successfully read inputs file ... AMReX git describe: 26.04-109-g60df5ae33 Nyx git describe: 21.02.1-261-g8b5a29f3-dirty Nyx::hydro_tile_size unset, using fabarray.mfiter_tile_size default: (1024000,8,8) Suggested default for currently compiled CPU / GPU: nyx.hydro_tile_size=(1024,16,16) Nyx::sundials_tile_size unset, using fabarray.mfiter_tile_size default: (1024000,8,8) Suggested default for currently compiled CPU / GPU: nyx.sundials_tile_size=(1024,16,16) Nyx::setting species concentrations to 0.76 and 0.24 in the hydro and in the EOS 0 Species: restarting calculation from file: chk00300_for_rt Successfully read inputs file ... read CPU time: 94.06750558 Getting Gconst from nyx_constants: 4.300927161e-09 Using -5.404704468e-08 for 4 pi G in Gravity.cpp ...setting old_a_time to 0.00154106232 Gravity ... defining average density in Gravity::set_mass_offset to be 3.77696925e+10 Gravity ... multilevel solve for new phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting -5.36441803e-07 to ensure solvability Average gas density 6294948750 Average dm density 3.147474375e+10 Average total density 3.77696925e+10 Average temperature 1262.701286 ... setting small_dens to 51.6247 ... setting small_temp to 0.01 ... setting small_pres to 0.007296935432 Restart time = 0.030450224 seconds. ...estdt from hydro at level 0: 0.0002745046952 ...estdt from particles at level 0: 0.0001571787802 ...estdt after call to comoving : 2.325925567e-05 ...change in a is 0.9990304743 percent Nyx::est_time_step at level 0: estdt = 2.325925567e-05 Integrating a from time 0.00154106232 by dt = 2.325925567e-05 Old / new A time 0.00154106232 0.001564321576 Old / new A 0.1956727325 0.1976275627 Old / new z 4.110574107 4.060022936 [Level 0 step 301] ADVANCE at time 0.00154106232 with dt = 2.325925567e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting -5.36441803e-07 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting 2.861022949e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 301] Advanced 32768 cells [STEP 301] Coarse TimeStep time: 0.313372052 [STEP 301] FAB kilobyte spread across MPI nodes: [0 ... 29250] STEP = 301 TIME = 0.001564321576 DT = 2.325925567e-05 ...estdt from hydro at level 0: 0.0002730659808 ...estdt from particles at level 0: 0.0001580793723 ...estdt after call to comoving : 2.360105682e-05 ...change in a is 0.9990126332 percent Nyx::est_time_step at level 0: estdt = 2.360105682e-05 Integrating a from time 0.001564321576 by dt = 2.360105682e-05 Old / new A time 0.001564321576 0.001587922633 Old / new A 0.1976275627 0.199601887 Old / new z 4.060022936 4.009972676 [Level 0 step 302] ADVANCE at time 0.001564321576 with dt = 2.360105682e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting 2.861022949e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting 5.960464478e-08 to ensure solvability moveKick ... updating velocity only [Level 0 step 302] Advanced 32768 cells [STEP 302] Coarse TimeStep time: 0.287625093 [STEP 302] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 302 TIME = 0.001587922633 DT = 2.360105682e-05 ...estdt from hydro at level 0: 0.0002717564079 ...estdt from particles at level 0: 0.0001572693323 ...estdt after call to comoving : 2.394764586e-05 ...change in a is 0.9989942753 percent Nyx::est_time_step at level 0: estdt = 2.394764586e-05 Integrating a from time 0.001587922633 by dt = 2.394764586e-05 Old / new A time 0.001587922633 0.001611870279 Old / new A 0.199601887 0.2015958985 Old / new z 4.009972676 3.96041838 [Level 0 step 303] ADVANCE at time 0.001587922633 with dt = 2.394764586e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting -4.172325134e-07 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting 2.861022949e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 303] Advanced 32768 cells [STEP 303] Coarse TimeStep time: 0.287395173 [STEP 303] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 303 TIME = 0.001611870279 DT = 2.394764586e-05 ...estdt from hydro at level 0: 0.0002705840118 ...estdt from particles at level 0: 0.0001567438358 ...estdt after call to comoving : 2.429907937e-05 ...change in a is 0.9989753865 percent Nyx::est_time_step at level 0: estdt = 2.429907937e-05 Integrating a from time 0.001611870279 by dt = 2.429907937e-05 Old / new A time 0.001611870279 0.001636169358 Old / new A 0.2015958985 0.2036097919 Old / new z 3.96041838 3.911355151 [Level 0 step 304] ADVANCE at time 0.001611870279 with dt = 2.429907937e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting 2.861022949e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting 1.072883606e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 304] Advanced 32768 cells [STEP 304] Coarse TimeStep time: 0.289398286 [STEP 304] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 304 TIME = 0.001636169358 DT = 2.429907937e-05 ...estdt from hydro at level 0: 0.0002695488881 ...estdt from particles at level 0: 0.0001565489922 ...estdt after call to comoving : 2.465541413e-05 ...change in a is 0.9989559522 percent Nyx::est_time_step at level 0: estdt = 2.465541413e-05 Integrating a from time 0.001636169358 by dt = 2.465541413e-05 Old / new A time 0.001636169358 0.001660824772 Old / new A 0.2036097919 0.205643764 Old / new z 3.911355151 3.862778139 [Level 0 step 305] ADVANCE at time 0.001636169358 with dt = 2.465541413e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting 1.192092896e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting -1.072883606e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 305] Advanced 32768 cells [STEP 305] Coarse TimeStep time: 0.287305036 [STEP 305] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 305 TIME = 0.001660824772 DT = 2.465541413e-05 ...estdt from hydro at level 0: 0.0002686551362 ...estdt from particles at level 0: 0.0001567060827 ...estdt after call to comoving : 2.501670707e-05 ...change in a is 0.9989359573 percent Nyx::est_time_step at level 0: estdt = 2.501670707e-05 Integrating a from time 0.001660824772 by dt = 2.501670707e-05 Old / new A time 0.001660824772 0.001685841479 Old / new A 0.205643764 0.2076980135 Old / new z 3.862778139 3.814682544 [Level 0 step 306] ADVANCE at time 0.001660824772 with dt = 2.501670707e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting -1.072883606e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting -6.675720215e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 306] Advanced 32768 cells [STEP 306] Coarse TimeStep time: 0.287367052 [STEP 306] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 306 TIME = 0.001685841479 DT = 2.501670707e-05 ...estdt from hydro at level 0: 0.0002679137744 ...estdt from particles at level 0: 0.0001572058443 ...estdt after call to comoving : 2.53830153e-05 ...change in a is 0.9989153867 percent Nyx::est_time_step at level 0: estdt = 2.53830153e-05 Integrating a from time 0.001685841479 by dt = 2.53830153e-05 Old / new A time 0.001685841479 0.001711224495 Old / new A 0.2076980135 0.2097727409 Old / new z 3.814682544 3.767063612 [Level 0 step 307] ADVANCE at time 0.001685841479 with dt = 2.53830153e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting -6.675720215e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting -2.62260437e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 307] Advanced 32768 cells [STEP 307] Coarse TimeStep time: 0.286406485 [STEP 307] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 307 TIME = 0.001711224495 DT = 2.53830153e-05 ...estdt from hydro at level 0: 0.000267334368 ...estdt from particles at level 0: 0.0001580382894 ...estdt after call to comoving : 2.575439601e-05 ...change in a is 0.9988942245 percent Nyx::est_time_step at level 0: estdt = 2.575439601e-05 Integrating a from time 0.001711224495 by dt = 2.575439601e-05 Old / new A time 0.001711224495 0.001736978891 Old / new A 0.2097727409 0.2118681487 Old / new z 3.767063612 3.719916637 [Level 0 step 308] ADVANCE at time 0.001711224495 with dt = 2.575439601e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting -3.099441528e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting -1.668930054e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 308] Advanced 32768 cells [STEP 308] Coarse TimeStep time: 0.285634986 [STEP 308] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 308 TIME = 0.001736978891 DT = 2.575439601e-05 ...estdt from hydro at level 0: 0.0002669262705 ...estdt from particles at level 0: 0.0001591947131 ...estdt after call to comoving : 2.61309065e-05 ...change in a is 0.9988724548 percent Nyx::est_time_step at level 0: estdt = 2.61309065e-05 Integrating a from time 0.001736978891 by dt = 2.61309065e-05 Old / new A time 0.001736978891 0.001763109797 Old / new A 0.2118681487 0.2139844413 Old / new z 3.719916637 3.673236961 [Level 0 step 309] ADVANCE at time 0.001736978891 with dt = 2.61309065e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting -1.668930054e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting -1.311302185e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 309] Advanced 32768 cells [STEP 309] Coarse TimeStep time: 0.286339479 [STEP 309] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 309 TIME = 0.001763109797 DT = 2.61309065e-05 ...estdt from hydro at level 0: 0.0002666997914 ...estdt from particles at level 0: 0.0001606673967 ...estdt after call to comoving : 2.651260414e-05 ...change in a is 0.998850061 percent Nyx::est_time_step at level 0: estdt = 2.651260414e-05 Integrating a from time 0.001763109797 by dt = 2.651260414e-05 Old / new A time 0.001763109797 0.001789622401 Old / new A 0.2139844413 0.216121825 Old / new z 3.673236961 3.627019969 [Level 0 step 310] ADVANCE at time 0.001763109797 with dt = 2.651260414e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting -1.311302185e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting 2.384185791e-07 to ensure solvability moveKick ... updating velocity only [Level 0 step 310] Advanced 32768 cells [STEP 310] Coarse TimeStep time: 0.28719504 [STEP 310] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 310 TIME = 0.001789622401 DT = 2.651260414e-05 ...estdt from hydro at level 0: 0.0002666651761 ...estdt from particles at level 0: 0.0001622352181 ...estdt after call to comoving : 2.689954632e-05 ...change in a is 0.9988270265 percent Nyx::est_time_step at level 0: estdt = 2.689954632e-05 Integrating a from time 0.001789622401 by dt = 2.689954632e-05 Old / new A time 0.001789622401 0.001816521948 Old / new A 0.216121825 0.2182805082 Old / new z 3.627019969 3.581261095 [Level 0 step 311] ADVANCE at time 0.001789622401 with dt = 2.689954632e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting 1.192092896e-07 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting -9.536743164e-07 to ensure solvability moveKick ... updating velocity only [Level 0 step 311] Advanced 32768 cells [STEP 311] Coarse TimeStep time: 0.287073494 [STEP 311] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 311 TIME = 0.001816521948 DT = 2.689954632e-05 ...estdt from hydro at level 0: 0.0002668276198 ...estdt from particles at level 0: 0.0001623509983 ...estdt after call to comoving : 2.729179186e-05 ...change in a is 0.9988033869 percent Nyx::est_time_step at level 0: estdt = 2.729179186e-05 Integrating a from time 0.001816521948 by dt = 2.729179186e-05 Old / new A time 0.001816521948 0.001843813739 Old / new A 0.2182805082 0.2204607013 Old / new z 3.581261095 3.535955815 [Level 0 step 312] ADVANCE at time 0.001816521948 with dt = 2.729179186e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting -9.536743164e-07 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting 1.311302185e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 312] Advanced 32768 cells [STEP 312] Coarse TimeStep time: 0.289497845 [STEP 312] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 312 TIME = 0.001843813739 DT = 2.729179186e-05 ...estdt from hydro at level 0: 0.0002671824608 ...estdt from particles at level 0: 0.0001629320165 ...estdt after call to comoving : 2.768939529e-05 ...change in a is 0.9987790193 percent Nyx::est_time_step at level 0: estdt = 2.768939529e-05 Integrating a from time 0.001843813739 by dt = 2.768939529e-05 Old / new A time 0.001843813739 0.001871503135 Old / new A 0.2204607013 0.2226626165 Old / new z 3.535955815 3.491099653 [Level 0 step 313] ADVANCE at time 0.001843813739 with dt = 2.768939529e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting 1.311302185e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting 2.264976501e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 313] Advanced 32768 cells [STEP 313] Coarse TimeStep time: 0.287951827 [STEP 313] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 313 TIME = 0.001871503135 DT = 2.768939529e-05 ...estdt from hydro at level 0: 0.0002677214513 ...estdt from particles at level 0: 0.0001639864461 ...estdt after call to comoving : 2.809241528e-05 ...change in a is 0.9987539581 percent Nyx::est_time_step at level 0: estdt = 2.809241528e-05 Integrating a from time 0.001871503135 by dt = 2.809241528e-05 Old / new A time 0.001871503135 0.00189959555 Old / new A 0.2226626165 0.2248864682 Old / new z 3.491099653 3.446688179 [Level 0 step 314] ADVANCE at time 0.001871503135 with dt = 2.809241528e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting 2.264976501e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting -8.344650269e-07 to ensure solvability moveKick ... updating velocity only [Level 0 step 314] Advanced 32768 cells [STEP 314] Coarse TimeStep time: 0.287264241 [STEP 314] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 314 TIME = 0.00189959555 DT = 2.809241528e-05 ...estdt from hydro at level 0: 0.0002684383846 ...estdt from particles at level 0: 0.0001655289826 ...estdt after call to comoving : 2.8500909e-05 ...change in a is 0.998728185 percent Nyx::est_time_step at level 0: estdt = 2.8500909e-05 Integrating a from time 0.00189959555 by dt = 2.8500909e-05 Old / new A time 0.00189959555 0.001928096459 Old / new A 0.2248864682 0.2271324728 Old / new z 3.446688179 3.402717004 [Level 0 step 315] ADVANCE at time 0.00189959555 with dt = 2.8500909e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting -9.536743164e-07 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting -3.695487976e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 315] Advanced 32768 cells [STEP 315] Coarse TimeStep time: 0.288453714 [STEP 315] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 315 TIME = 0.001928096459 DT = 2.8500909e-05 ...estdt from hydro at level 0: 0.0002693260413 ...estdt from particles at level 0: 0.0001657175794 ...estdt after call to comoving : 2.891493348e-05 ...change in a is 0.998701681 percent Nyx::est_time_step at level 0: estdt = 2.891493348e-05 Integrating a from time 0.001928096459 by dt = 2.891493348e-05 Old / new A time 0.001928096459 0.001957011392 Old / new A 0.2271324728 0.2294008486 Old / new z 3.402717004 3.359181782 [Level 0 step 316] ADVANCE at time 0.001928096459 with dt = 2.891493348e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting -3.457069397e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting 2.503395081e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 316] Advanced 32768 cells [STEP 316] Coarse TimeStep time: 0.287190686 [STEP 316] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 316 TIME = 0.001957011392 DT = 2.891493348e-05 ...estdt from hydro at level 0: 0.0002703761559 ...estdt from particles at level 0: 0.000164960228 ...estdt after call to comoving : 2.933454555e-05 ...change in a is 0.9986744271 percent Nyx::est_time_step at level 0: estdt = 2.933454555e-05 Integrating a from time 0.001957011392 by dt = 2.933454555e-05 Old / new A time 0.001957011392 0.001986345938 Old / new A 0.2294008486 0.2316918162 Old / new z 3.359181782 3.316078213 [Level 0 step 317] ADVANCE at time 0.001957011392 with dt = 2.933454555e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting 2.503395081e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting -1.788139343e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 317] Advanced 32768 cells [STEP 317] Coarse TimeStep time: 0.287083439 [STEP 317] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 317 TIME = 0.001986345938 DT = 2.933454555e-05 ...estdt from hydro at level 0: 0.000271580443 ...estdt from particles at level 0: 0.0001645874739 ...estdt after call to comoving : 2.975980182e-05 ...change in a is 0.9986464035 percent Nyx::est_time_step at level 0: estdt = 2.975980182e-05 Integrating a from time 0.001986345938 by dt = 2.975980182e-05 Old / new A time 0.001986345938 0.00201610574 Old / new A 0.2316918162 0.2340055982 Old / new z 3.316078213 3.273402037 [Level 0 step 318] ADVANCE at time 0.001986345938 with dt = 2.975980182e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting -1.788139343e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting 1.907348633e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 318] Advanced 32768 cells [STEP 318] Coarse TimeStep time: 0.287193578 [STEP 318] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 318 TIME = 0.00201610574 DT = 2.975980182e-05 ...estdt from hydro at level 0: 0.0002728668948 ...estdt from particles at level 0: 0.0001645729478 ...estdt after call to comoving : 3.019075862e-05 ...change in a is 0.9986175902 percent Nyx::est_time_step at level 0: estdt = 3.019075862e-05 Integrating a from time 0.00201610574 by dt = 3.019075862e-05 Old / new A time 0.00201610574 0.002046296498 Old / new A 0.2340055982 0.2363424193 Old / new z 3.273402037 3.231149038 [Level 0 step 319] ADVANCE at time 0.00201610574 with dt = 3.019075862e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting 1.907348633e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting 4.887580872e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 319] Advanced 32768 cells [STEP 319] Coarse TimeStep time: 0.286923213 [STEP 319] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 319 TIME = 0.002046296498 DT = 3.019075862e-05 ...estdt from hydro at level 0: 0.0002742684138 ...estdt from particles at level 0: 0.0001648927257 ...estdt after call to comoving : 3.062747195e-05 ...change in a is 0.9985879667 percent Nyx::est_time_step at level 0: estdt = 3.062747195e-05 Integrating a from time 0.002046296498 by dt = 3.062747195e-05 Old / new A time 0.002046296498 0.00207692397 Old / new A 0.2363424193 0.2387025062 Old / new z 3.231149038 3.189315042 [Level 0 step 320] ADVANCE at time 0.002046296498 with dt = 3.062747195e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting 4.887580872e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting 3.457069397e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 320] Advanced 32768 cells [STEP 320] Coarse TimeStep time: 0.288148645 [STEP 320] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 320 TIME = 0.00207692397 DT = 3.062747195e-05 ...estdt from hydro at level 0: 0.0002757861689 ...estdt from particles at level 0: 0.000165526799 ...estdt after call to comoving : 3.106999745e-05 ...change in a is 0.9985575121 percent Nyx::est_time_step at level 0: estdt = 3.106999745e-05 Integrating a from time 0.00207692397 by dt = 3.106999745e-05 Old / new A time 0.00207692397 0.002107993968 Old / new A 0.2387025062 0.241086088 Old / new z 3.189315042 3.147895916 [Level 0 step 321] ADVANCE at time 0.00207692397 with dt = 3.106999745e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting 3.457069397e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting -3.814697266e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 321] Advanced 32768 cells [STEP 321] Coarse TimeStep time: 0.287615522 [STEP 321] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 321 TIME = 0.002107993968 DT = 3.106999745e-05 ...estdt from hydro at level 0: 0.0002774243087 ...estdt from particles at level 0: 0.0001656032368 ...estdt after call to comoving : 3.151839033e-05 ...change in a is 0.9985262051 percent Nyx::est_time_step at level 0: estdt = 3.151839033e-05 Integrating a from time 0.002107993968 by dt = 3.151839033e-05 Old / new A time 0.002107993968 0.002139512358 Old / new A 0.241086088 0.2434933958 Old / new z 3.147895916 3.106887568 [Level 0 step 322] ADVANCE at time 0.002107993968 with dt = 3.151839033e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting -3.814697266e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting 4.172325134e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 322] Advanced 32768 cells [STEP 322] Coarse TimeStep time: 0.287796674 [STEP 322] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 322 TIME = 0.002139512358 DT = 3.151839033e-05 ...estdt from hydro at level 0: 0.0002791714179 ...estdt from particles at level 0: 0.0001645441583 ...estdt after call to comoving : 3.197270533e-05 ...change in a is 0.9984940239 percent Nyx::est_time_step at level 0: estdt = 3.197270533e-05 Integrating a from time 0.002139512358 by dt = 3.197270533e-05 Old / new A time 0.002139512358 0.002171485063 Old / new A 0.2434933958 0.2459246628 Old / new z 3.106887568 3.066285945 [Level 0 step 323] ADVANCE at time 0.002139512358 with dt = 3.197270533e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting 4.410743713e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting -1.549720764e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 323] Advanced 32768 cells [STEP 323] Coarse TimeStep time: 0.287689633 [STEP 323] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 323 TIME = 0.002171485063 DT = 3.197270533e-05 ...estdt from hydro at level 0: 0.0002810390917 ...estdt from particles at level 0: 0.0001640909434 ...estdt after call to comoving : 3.243299666e-05 ...change in a is 0.9984609463 percent Nyx::est_time_step at level 0: estdt = 3.243299666e-05 Integrating a from time 0.002171485063 by dt = 3.243299666e-05 Old / new A time 0.002171485063 0.00220391806 Old / new A 0.2459246628 0.2483801245 Old / new z 3.066285945 3.026087039 [Level 0 step 324] ADVANCE at time 0.002171485063 with dt = 3.243299666e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting -1.549720764e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting -2.384185791e-07 to ensure solvability moveKick ... updating velocity only [Level 0 step 324] Advanced 32768 cells [STEP 324] Coarse TimeStep time: 0.286751387 [STEP 324] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 324 TIME = 0.00220391806 DT = 3.243299666e-05 ...estdt from hydro at level 0: 0.0002830336378 ...estdt from particles at level 0: 0.0001642487172 ...estdt after call to comoving : 3.289901427e-05 ...change in a is 0.9984177538 percent Nyx::est_time_step at level 0: estdt = 3.289901427e-05 Integrating a from time 0.00220391806 by dt = 3.289901427e-05 Old / new A time 0.00220391806 0.002236817074 Old / new A 0.2483801245 0.2508599958 Old / new z 3.026087039 2.986287239 [Level 0 step 325] ADVANCE at time 0.00220391806 with dt = 3.289901427e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting -2.384185791e-07 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting -5.841255188e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 325] Advanced 32768 cells [STEP 325] Coarse TimeStep time: 0.286367136 [STEP 325] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 325 TIME = 0.002236817074 DT = 3.289901427e-05 ...estdt from hydro at level 0: 0.0002851075876 ...estdt from particles at level 0: 0.0001650317632 ...estdt after call to comoving : 3.336815145e-05 ...change in a is 0.9982855469 percent Nyx::est_time_step at level 0: estdt = 3.336815145e-05 Integrating a from time 0.002236817074 by dt = 3.336815145e-05 Old / new A time 0.002236817074 0.002270185226 Old / new A 0.2508599958 0.2533642949 Old / new z 2.986287239 2.946886046 [Level 0 step 326] ADVANCE at time 0.002236817074 with dt = 3.336815145e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting -5.841255188e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting -7.271766663e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 326] Advanced 32768 cells [STEP 326] Coarse TimeStep time: 0.28627288 [STEP 326] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 326 TIME = 0.002270185226 DT = 3.336815145e-05 ...estdt from hydro at level 0: 0.0002872759952 ...estdt from particles at level 0: 0.0001664627343 ...estdt after call to comoving : 3.384467068e-05 ...change in a is 0.9981932068 percent Nyx::est_time_step at level 0: estdt = 3.384467068e-05 Integrating a from time 0.002270185226 by dt = 3.384467068e-05 Old / new A time 0.002270185226 0.002304029897 Old / new A 0.2533642949 0.25589336 Old / new z 2.946886046 2.907877875 [Level 0 step 327] ADVANCE at time 0.002270185226 with dt = 3.384467068e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting -7.271766663e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting 5.960464478e-07 to ensure solvability moveKick ... updating velocity only [Level 0 step 327] Advanced 32768 cells [STEP 327] Coarse TimeStep time: 0.288133801 [STEP 327] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 327 TIME = 0.002304029897 DT = 3.384467068e-05 ...estdt from hydro at level 0: 0.0002895369397 ...estdt from particles at level 0: 0.0001685763131 ...estdt after call to comoving : 3.432869644e-05 ...change in a is 0.9981406227 percent Nyx::est_time_step at level 0: estdt = 3.432869644e-05 Integrating a from time 0.002304029897 by dt = 3.432869644e-05 Old / new A time 0.002304029897 0.002338358593 Old / new A 0.25589336 0.2584475356 Old / new z 2.907877875 2.869257246 [Level 0 step 328] ADVANCE at time 0.002304029897 with dt = 3.432869644e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting 5.960464478e-07 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting -9.536743164e-07 to ensure solvability moveKick ... updating velocity only [Level 0 step 328] Advanced 32768 cells [STEP 328] Coarse TimeStep time: 0.287800527 [STEP 328] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 328 TIME = 0.002338358593 DT = 3.432869644e-05 ...estdt from hydro at level 0: 0.000291895694 ...estdt from particles at level 0: 0.0001708555667 ...estdt after call to comoving : 3.481922913e-05 ...change in a is 0.9980954894 percent Nyx::est_time_step at level 0: estdt = 3.481922913e-05 Integrating a from time 0.002338358593 by dt = 3.481922913e-05 Old / new A time 0.002338358593 0.002373177822 Old / new A 0.2584475356 0.2610270888 Old / new z 2.869257246 2.831020008 [Level 0 step 329] ADVANCE at time 0.002338358593 with dt = 3.481922913e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting -1.192092896e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting 5.960464478e-07 to ensure solvability moveKick ... updating velocity only [Level 0 step 329] Advanced 32768 cells [STEP 329] Coarse TimeStep time: 0.286399214 [STEP 329] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 329 TIME = 0.002373177822 DT = 3.481922913e-05 ...estdt from hydro at level 0: 0.0002943597556 ...estdt from particles at level 0: 0.0001694429938 ...estdt after call to comoving : 3.530851124e-05 ...change in a is 0.9978371543 percent Nyx::est_time_step at level 0: estdt = 3.530851124e-05 Integrating a from time 0.002373177822 by dt = 3.530851124e-05 Old / new A time 0.002373177822 0.002408486333 Old / new A 0.2610270888 0.2636317141 Old / new z 2.831020008 2.793170345 [Level 0 step 330] ADVANCE at time 0.002373177822 with dt = 3.530851124e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting 3.576278687e-07 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting 7.152557373e-07 to ensure solvability moveKick ... updating velocity only [Level 0 step 330] Advanced 32768 cells [STEP 330] Coarse TimeStep time: 0.288663928 [STEP 330] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 330 TIME = 0.002408486333 DT = 3.530851124e-05 ...estdt from hydro at level 0: 0.0002969371485 ...estdt from particles at level 0: 0.0001686349397 ...estdt after call to comoving : 3.580524335e-05 ...change in a is 0.9976180996 percent Nyx::est_time_step at level 0: estdt = 3.580524335e-05 Integrating a from time 0.002408486333 by dt = 3.580524335e-05 Old / new A time 0.002408486333 0.002444291577 Old / new A 0.2636317141 0.2662617518 Old / new z 2.793170345 2.755702775 [Level 0 step 331] ADVANCE at time 0.002408486333 with dt = 3.580524335e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting 9.536743164e-07 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting 4.529953003e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 331] Advanced 32768 cells [STEP 331] Coarse TimeStep time: 0.287211366 [STEP 331] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 331 TIME = 0.002444291577 DT = 3.580524335e-05 ...estdt from hydro at level 0: 0.0002996383575 ...estdt from particles at level 0: 0.0001684985263 ...estdt after call to comoving : 3.630961039e-05 ...change in a is 0.997440025 percent Nyx::est_time_step at level 0: estdt = 3.630961039e-05 Integrating a from time 0.002444291577 by dt = 3.630961039e-05 Old / new A time 0.002444291577 0.002480601187 Old / new A 0.2662617518 0.2689175531 Old / new z 2.755702775 2.718611852 [Level 0 step 332] ADVANCE at time 0.002444291577 with dt = 3.630961039e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting 4.768371582e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting 1.192092896e-07 to ensure solvability moveKick ... updating velocity only [Level 0 step 332] Advanced 32768 cells [STEP 332] Coarse TimeStep time: 0.288357068 [STEP 332] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 332 TIME = 0.002480601187 DT = 3.630961039e-05 ...estdt from hydro at level 0: 0.0003024741923 ...estdt from particles at level 0: 0.0001690211146 ...estdt after call to comoving : 3.682164068e-05 ...change in a is 0.9973002393 percent Nyx::est_time_step at level 0: estdt = 3.682164068e-05 Integrating a from time 0.002480601187 by dt = 3.682164068e-05 Old / new A time 0.002480601187 0.002517422828 Old / new A 0.2689175531 0.2715994685 Old / new z 2.718611852 2.681892331 [Level 0 step 333] ADVANCE at time 0.002480601187 with dt = 3.682164068e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting 1.192092896e-07 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting -7.152557373e-07 to ensure solvability moveKick ... updating velocity only [Level 0 step 333] Advanced 32768 cells [STEP 333] Coarse TimeStep time: 0.286067093 [STEP 333] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 333 TIME = 0.002517422828 DT = 3.682164068e-05 ...estdt from hydro at level 0: 0.0003054562227 ...estdt from particles at level 0: 0.0001702104023 ...estdt after call to comoving : 3.73413939e-05 ...change in a is 0.9971970346 percent Nyx::est_time_step at level 0: estdt = 3.73413939e-05 Integrating a from time 0.002517422828 by dt = 3.73413939e-05 Old / new A time 0.002517422828 0.002554764222 Old / new A 0.2715994685 0.2743078503 Old / new z 2.681892331 2.645539123 [Level 0 step 334] ADVANCE at time 0.002517422828 with dt = 3.73413939e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting -9.536743164e-07 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting 3.218650818e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 334] Advanced 32768 cells [STEP 334] Coarse TimeStep time: 0.286266147 [STEP 334] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 334 TIME = 0.002554764222 DT = 3.73413939e-05 ...estdt from hydro at level 0: 0.0003085874169 ...estdt from particles at level 0: 0.0001720708169 ...estdt after call to comoving : 3.786892201e-05 ...change in a is 0.9971285852 percent Nyx::est_time_step at level 0: estdt = 3.786892201e-05 Integrating a from time 0.002554764222 by dt = 3.786892201e-05 Old / new A time 0.002554764222 0.002592633144 Old / new A 0.2743078503 0.2770430523 Old / new z 2.645539123 2.609547295 [Level 0 step 335] ADVANCE at time 0.002554764222 with dt = 3.786892201e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting 3.218650818e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting -2.74181366e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 335] Advanced 32768 cells [STEP 335] Coarse TimeStep time: 0.286115036 [STEP 335] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 335 TIME = 0.002592633144 DT = 3.786892201e-05 ...estdt from hydro at level 0: 0.0003118605324 ...estdt from particles at level 0: 0.0001721193929 ...estdt after call to comoving : 3.839938372e-05 ...change in a is 0.9969663805 percent Nyx::est_time_step at level 0: estdt = 3.839938372e-05 Integrating a from time 0.002592633144 by dt = 3.839938372e-05 Old / new A time 0.002592633144 0.002631032527 Old / new A 0.2770430523 0.2798050784 Old / new z 2.609547295 2.573916548 [Level 0 step 336] ADVANCE at time 0.002592633144 with dt = 3.839938372e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting -3.933906555e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting 4.768371582e-07 to ensure solvability moveKick ... updating velocity only [Level 0 step 336] Advanced 32768 cells [STEP 336] Coarse TimeStep time: 0.286281981 [STEP 336] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 336 TIME = 0.002631032527 DT = 3.839938372e-05 ...estdt from hydro at level 0: 0.0003152757 ...estdt from particles at level 0: 0.0001710400243 ...estdt after call to comoving : 3.893416707e-05 ...change in a is 0.9967499891 percent Nyx::est_time_step at level 0: estdt = 3.893416707e-05 Integrating a from time 0.002631032527 by dt = 3.893416707e-05 Old / new A time 0.002631032527 0.002669966694 Old / new A 0.2798050784 0.2825940355 Old / new z 2.573916548 2.538645104 [Level 0 step 337] ADVANCE at time 0.002631032527 with dt = 3.893416707e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting 4.768371582e-07 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting -3.814697266e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 337] Advanced 32768 cells [STEP 337] Coarse TimeStep time: 0.286801888 [STEP 337] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 337 TIME = 0.002669966694 DT = 3.893416707e-05 ...estdt from hydro at level 0: 0.0003188377757 ...estdt from particles at level 0: 0.0001702501777 ...estdt after call to comoving : 3.94760778e-05 ...change in a is 0.996552137 percent Nyx::est_time_step at level 0: estdt = 3.94760778e-05 Integrating a from time 0.002669966694 by dt = 3.94760778e-05 Old / new A time 0.002669966694 0.002709442772 Old / new A 0.2825940355 0.2854102324 Old / new z 2.538645104 2.503728621 [Level 0 step 338] ADVANCE at time 0.002669966694 with dt = 3.94760778e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting -3.814697266e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting -1.192092896e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 338] Advanced 32768 cells [STEP 338] Coarse TimeStep time: 0.288869409 [STEP 338] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 338 TIME = 0.002709442772 DT = 3.94760778e-05 ...estdt from hydro at level 0: 0.0003225503803 ...estdt from particles at level 0: 0.0001697120234 ...estdt after call to comoving : 4.002508356e-05 ...change in a is 0.9963701207 percent Nyx::est_time_step at level 0: estdt = 4.002508356e-05 Integrating a from time 0.002709442772 by dt = 4.002508356e-05 Old / new A time 0.002709442772 0.002749467856 Old / new A 0.2854102324 0.2882539747 Old / new z 2.503728621 2.469162918 [Level 0 step 339] ADVANCE at time 0.002709442772 with dt = 4.002508356e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting -1.192092896e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting -5.36441803e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 339] Advanced 32768 cells [STEP 339] Coarse TimeStep time: 0.288008626 [STEP 339] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 339 TIME = 0.002749467856 DT = 4.002508356e-05 ...estdt from hydro at level 0: 0.0003264058849 ...estdt from particles at level 0: 0.0001696559147 ...estdt after call to comoving : 4.058166641e-05 ...change in a is 0.9962140359 percent Nyx::est_time_step at level 0: estdt = 4.058166641e-05 Integrating a from time 0.002749467856 by dt = 4.058166641e-05 Old / new A time 0.002749467856 0.002790049522 Old / new A 0.2882539747 0.2911256012 Old / new z 2.469162918 2.434943529 [Level 0 step 340] ADVANCE at time 0.002749467856 with dt = 4.058166641e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting -5.24520874e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting -2.861022949e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 340] Advanced 32768 cells [STEP 340] Coarse TimeStep time: 0.290758127 [STEP 340] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 340 TIME = 0.002790049522 DT = 4.058166641e-05 ...estdt from hydro at level 0: 0.0003281810498 ...estdt from particles at level 0: 0.0001703510591 ...estdt after call to comoving : 4.11463755e-05 ...change in a is 0.9960949155 percent Nyx::est_time_step at level 0: estdt = 4.11463755e-05 Integrating a from time 0.002790049522 by dt = 4.11463755e-05 Old / new A time 0.002790049522 0.002831195898 Old / new A 0.2911256012 0.2940254885 Old / new z 2.434943529 2.401065687 [Level 0 step 341] ADVANCE at time 0.002790049522 with dt = 4.11463755e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting -2.861022949e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting 7.510185242e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 341] Advanced 32768 cells [STEP 341] Coarse TimeStep time: 0.286239291 [STEP 341] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 341 TIME = 0.002831195898 DT = 4.11463755e-05 ...estdt from hydro at level 0: 0.0003310983896 ...estdt from particles at level 0: 0.0001718189172 ...estdt after call to comoving : 4.171927957e-05 ...change in a is 0.9960115856 percent Nyx::est_time_step at level 0: estdt = 4.171927957e-05 Integrating a from time 0.002831195898 by dt = 4.171927957e-05 Old / new A time 0.002831195898 0.002872915177 Old / new A 0.2940254885 0.2969540165 Old / new z 2.401065687 2.36752475 [Level 0 step 342] ADVANCE at time 0.002831195898 with dt = 4.171927957e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting 7.510185242e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting -7.390975952e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 342] Advanced 32768 cells [STEP 342] Coarse TimeStep time: 0.288155047 [STEP 342] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 342 TIME = 0.002872915177 DT = 4.171927957e-05 ...estdt from hydro at level 0: 0.0003349231675 ...estdt from particles at level 0: 0.0001740600499 ...estdt after call to comoving : 4.230040284e-05 ...change in a is 0.9959618897 percent Nyx::est_time_step at level 0: estdt = 4.230040284e-05 Integrating a from time 0.002872915177 by dt = 4.230040284e-05 Old / new A time 0.002872915177 0.00291521558 Old / new A 0.2969540165 0.2999115653 Old / new z 2.36752475 2.334316231 [Level 0 step 343] ADVANCE at time 0.002872915177 with dt = 4.230040284e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting -7.9870224e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting -2.264976501e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 343] Advanced 32768 cells [STEP 343] Coarse TimeStep time: 0.286715884 [STEP 343] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 343 TIME = 0.00291521558 DT = 4.230040284e-05 ...estdt from hydro at level 0: 0.0003395007159 ...estdt from particles at level 0: 0.0001770909109 ...estdt after call to comoving : 4.288979439e-05 ...change in a is 0.9959443841 percent Nyx::est_time_step at level 0: estdt = 4.288979439e-05 Integrating a from time 0.00291521558 by dt = 4.288979439e-05 Old / new A time 0.00291521558 0.002958105375 Old / new A 0.2999115653 0.3028985177 Old / new z 2.334316231 2.301435767 [Level 0 step 344] ADVANCE at time 0.00291521558 with dt = 4.288979439e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting -2.264976501e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting 0 to ensure solvability moveKick ... updating velocity only [Level 0 step 344] Advanced 32768 cells [STEP 344] Coarse TimeStep time: 0.286188281 [STEP 344] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 344 TIME = 0.002958105375 DT = 4.288979439e-05 ...estdt from hydro at level 0: 0.0003447065944 ...estdt from particles at level 0: 0.0001809453104 ...estdt after call to comoving : 4.348752992e-05 ...change in a is 0.9959583249 percent Nyx::est_time_step at level 0: estdt = 4.348752992e-05 Integrating a from time 0.002958105375 by dt = 4.348752992e-05 Old / new A time 0.002958105375 0.003001592904 Old / new A 0.3028985177 0.3059152607 Old / new z 2.301435767 2.268879093 [Level 0 step 345] ADVANCE at time 0.002958105375 with dt = 4.348752992e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting 0 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting 3.337860107e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 345] Advanced 32768 cells [STEP 345] Coarse TimeStep time: 0.285485515 [STEP 345] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 345 TIME = 0.003001592904 DT = 4.348752992e-05 ...estdt from hydro at level 0: 0.0003504357852 ...estdt from particles at level 0: 0.0001856710626 ...estdt after call to comoving : 4.409370432e-05 ...change in a is 0.9960034484 percent Nyx::est_time_step at level 0: estdt = 4.409370432e-05 Integrating a from time 0.003001592904 by dt = 4.409370432e-05 Old / new A time 0.003001592904 0.003045686609 Old / new A 0.3059152607 0.3089621872 Old / new z 2.268879093 2.236642027 [Level 0 step 346] ADVANCE at time 0.003001592904 with dt = 4.409370432e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting 3.337860107e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting -5.36441803e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 346] Advanced 32768 cells [STEP 346] Coarse TimeStep time: 0.288099273 [STEP 346] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 346 TIME = 0.003045686609 DT = 4.409370432e-05 ...estdt from hydro at level 0: 0.0003566016553 ...estdt from particles at level 0: 0.0001913295738 ...estdt after call to comoving : 4.470842959e-05 ...change in a is 0.9960798898 percent Nyx::est_time_step at level 0: estdt = 4.470842959e-05 Integrating a from time 0.003045686609 by dt = 4.470842959e-05 Old / new A time 0.003045686609 0.003090395038 Old / new A 0.3089621872 0.3120396974 Old / new z 2.236642027 2.204720451 [Level 0 step 347] ADVANCE at time 0.003045686609 with dt = 4.470842959e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting -5.602836609e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting 1.072883606e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 347] Advanced 32768 cells [STEP 347] Coarse TimeStep time: 0.286193709 [STEP 347] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 347 TIME = 0.003090395038 DT = 4.470842959e-05 ...estdt from hydro at level 0: 0.0003631351167 ...estdt from particles at level 0: 0.0001958936251 ...estdt after call to comoving : 4.532804054e-05 ...change in a is 0.996104929 percent Nyx::est_time_step at level 0: estdt = 4.532804054e-05 Integrating a from time 0.003090395038 by dt = 4.532804054e-05 Old / new A time 0.003090395038 0.003135723079 Old / new A 0.3120396974 0.3151479403 Old / new z 2.204720451 2.173112917 [Level 0 step 348] ADVANCE at time 0.003090395038 with dt = 4.532804054e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting 1.072883606e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting 9.417533875e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 348] Advanced 32768 cells [STEP 348] Coarse TimeStep time: 0.286918077 [STEP 348] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 348 TIME = 0.003135723079 DT = 4.532804054e-05 ...estdt from hydro at level 0: 0.000369977587 ...estdt from particles at level 0: 0.0001966261069 ...estdt after call to comoving : 4.594768422e-05 ...change in a is 0.9959757765 percent Nyx::est_time_step at level 0: estdt = 4.594768422e-05 Integrating a from time 0.003135723079 by dt = 4.594768422e-05 Old / new A time 0.003135723079 0.003181670763 Old / new A 0.3151479403 0.3182867374 Old / new z 2.173112917 2.14182114 [Level 0 step 349] ADVANCE at time 0.003135723079 with dt = 4.594768422e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting 9.417533875e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting -4.053115845e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 349] Advanced 32768 cells [STEP 349] Coarse TimeStep time: 0.285789356 [STEP 349] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 349 TIME = 0.003181670763 DT = 4.594768422e-05 ...estdt from hydro at level 0: 0.0003770798281 ...estdt from particles at level 0: 0.0001982296763 ...estdt after call to comoving : 4.657580516e-05 ...change in a is 0.9958805421 percent Nyx::est_time_step at level 0: estdt = 4.657580516e-05 Integrating a from time 0.003181670763 by dt = 4.657580516e-05 Old / new A time 0.003181670763 0.003228246568 Old / new A 0.3182867374 0.3214564931 Old / new z 2.14182114 2.110840881 [Level 0 step 350] ADVANCE at time 0.003181670763 with dt = 4.657580516e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting -4.053115845e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting -1.430511475e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 350] Advanced 32768 cells [STEP 350] Coarse TimeStep time: 0.287255731 [STEP 350] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 350 TIME = 0.003228246568 DT = 4.657580516e-05 ...estdt from hydro at level 0: 0.0003844065581 ...estdt from particles at level 0: 0.0002007212585 ...estdt after call to comoving : 4.721242655e-05 ...change in a is 0.9958176001 percent Nyx::est_time_step at level 0: estdt = 4.721242655e-05 Integrating a from time 0.003228246568 by dt = 4.721242655e-05 Old / new A time 0.003228246568 0.003275458995 Old / new A 0.3214564931 0.3246576134 Old / new z 2.110840881 2.080168025 [Level 0 step 351] ADVANCE at time 0.003228246568 with dt = 4.721242655e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting -9.536743164e-07 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting -1.096725464e-05 to ensure solvability moveKick ... updating velocity only [Level 0 step 351] Advanced 32768 cells [STEP 351] Coarse TimeStep time: 0.287115697 [STEP 351] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 351 TIME = 0.003275458995 DT = 4.721242655e-05 ...estdt from hydro at level 0: 0.0003919290326 ...estdt from particles at level 0: 0.0002041363872 ...estdt after call to comoving : 4.785759956e-05 ...change in a is 0.9957860232 percent Nyx::est_time_step at level 0: estdt = 4.785759956e-05 Integrating a from time 0.003275458995 by dt = 4.785759956e-05 Old / new A time 0.003275458995 0.003323316594 Old / new A 0.3246576134 0.3278905086 Old / new z 2.080168025 2.049798557 [Level 0 step 352] ADVANCE at time 0.003275458995 with dt = 4.785759956e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting -1.096725464e-05 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting -1.311302185e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 352] Advanced 32768 cells [STEP 352] Coarse TimeStep time: 0.288352493 [STEP 352] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 352 TIME = 0.003323316594 DT = 4.785759956e-05 ...estdt from hydro at level 0: 0.0003996242058 ...estdt from particles at level 0: 0.0002085083549 ...estdt after call to comoving : 4.851135402e-05 ...change in a is 0.9957845223 percent Nyx::est_time_step at level 0: estdt = 4.851135402e-05 Integrating a from time 0.003323316594 by dt = 4.851135402e-05 Old / new A time 0.003323316594 0.003371827948 Old / new A 0.3278905086 0.3311555915 Old / new z 2.049798557 2.019728568 [Level 0 step 353] ADVANCE at time 0.003323316594 with dt = 4.851135402e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting -1.311302185e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting -4.887580872e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 353] Advanced 32768 cells [STEP 353] Coarse TimeStep time: 0.287094374 [STEP 353] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 353 TIME = 0.003371827948 DT = 4.851135402e-05 ...estdt from hydro at level 0: 0.000407474717 ...estdt from particles at level 0: 0.0002088392089 ...estdt after call to comoving : 3.24537021e-05 ...change in a is 0.6576189261 percent Nyx::est_time_step at level 0: estdt = 3.24537021e-05 Integrating a from time 0.003371827948 by dt = 3.24537021e-05 Old / new A time 0.003371827948 0.003404281651 Old / new A 0.3311555915 0.3333333333 Old / new z 2.019728568 2 [Level 0 step 354] ADVANCE at time 0.003371827948 with dt = 3.24537021e-05 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 3.77696925e+10 from RHS at each level ... subtracting -4.887580872e-06 to ensure solvability moveKickDrift ... updating particle positions and velocity ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 3.77696925e+10 ... subtracting -5.006790161e-06 to ensure solvability moveKick ... updating velocity only [Level 0 step 354] Advanced 32768 cells [STEP 354] Coarse TimeStep time: 0.288319888 [STEP 354] FAB kilobyte spread across MPI nodes: [0 ... 29557] STEP = 354 TIME = 0.003404281651 DT = 3.24537021e-05 ...a 0.3333333333 is greater than or equal to final_a 0.3333333333 Time w/o init: 15.54172775 PLOTFILE: file = LyA-adiabatic_plt00354 Output file LyA-adiabatic_plt00354.temp at time 0.333333 and step 354 Write plotfile time = 0.012646067 seconds Run time = 15.58850586 TinyProfiler total time across processes [min...avg...max]: 15.59 ... 15.59 ... 15.59 ---------------------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ---------------------------------------------------------------------------------------------------------- MultiFab::min() 54 0.002993 10.7 14.27 91.52% Nyx::umeth() 216 0 3.358 13.43 86.17% MLMG::ResNormInf() 487 0.001106 0.4613 0.6161 3.95% MLPoisson::Fsmooth() 12096 0.00696 0.09649 0.3645 2.34% numParticlesOutOfRange() 226 0.03453 0.2237 0.2871 1.84% Nyx::umdrv() 216 0 0.06028 0.2411 1.55% vol_weight_sum 113 0.0006042 0.1097 0.1461 0.94% FillPatchIterator::Initialize 383 0.0005451 0.03011 0.1188 0.76% FillBoundary_nowait() 14196 0.005577 0.03227 0.1119 0.72% DarkMatterParticleContainer::moveKickDrift() 108 0.000126 0.0171 0.06803 0.44% ParticleContainer::AssignCellDensitySingleLevel() 111 0.0003346 0.0168 0.06617 0.42% DarkMatterParticleContainer::moveKick() 54 7.228e-05 0.01619 0.06452 0.41% amrex::Copy() 1375 0.0007721 0.01586 0.06106 0.39% Nyx::srctoprim() 216 0 0.01405 0.05621 0.36% Nyx::strang_hydro()::old_tmp_patch 54 0.0001095 0.01392 0.05532 0.35% FabArray::setVal() 5074 0.002515 0.01564 0.05482 0.35% FabArray::ParallelCopy_nowait() 385 0.0002715 0.01337 0.05267 0.34% Nyx::advance_hydro_pc_umdrv() 54 4.951e-05 0.01316 0.05247 0.34% Nyx::update_state_with_sources() 54 0.0002215 0.01291 0.05093 0.33% Nyx::strang_hydro() 54 0.0007271 0.013 0.04974 0.32% MLCellLinOp::applyBC() 14513 0.01098 0.02084 0.04932 0.32% MLMG::addInterpCorrection() 1512 0.001088 0.0126 0.047 0.30% NyxParticleContainer::estTimestep(lev) 54 0.04388 0.04405 0.04413 0.28% Nyx::ctoprim() 216 0 0.009797 0.03919 0.25% Redistribute_partition 55 7.865e-05 0.009187 0.0365 0.23% MLMG::solve() 109 0.0007664 0.02715 0.03613 0.23% Nyx::advance_hydro_plus_particles() 54 0.0006913 0.009121 0.03433 0.22% MLPoisson::Fapply() 2308 0.001029 0.009348 0.03421 0.22% Nyx::reset_internal_energy() 163 0.0001074 0.0083 0.03287 0.21% Nyx::est_time_step() 54 0.01617 0.02764 0.03151 0.20% FabArray::norminf() 1053 0.006725 0.01137 0.02526 0.16% amrex::average_down 1512 0.0009711 0.00681 0.02427 0.16% MLMG::prepareForSolve() 109 0.01631 0.01754 0.01811 0.12% FabArray::sum() 581 0.0004925 0.004739 0.01745 0.11% FabArray::Xpay() 1999 0.001036 0.004765 0.01592 0.10% MLMG::oneIter() 378 0.001274 0.01082 0.01403 0.09% Nyx::compute_new_temp() 163 0.0001358 0.002992 0.01155 0.07% Gravity::get_old_grav_vector() 162 0.0002911 0.002919 0.01077 0.07% FabArray::FillBoundary() 14194 0.007118 0.00806 0.01072 0.07% amrex::Add() 542 0.000379 0.00286 0.0103 0.07% FabArray::plus() 799 0.0005855 0.003004 0.01023 0.07% ParticleCopyPlan::doHandShake 55 0.0002258 0.007683 0.01018 0.07% Amr::restart() 1 0.008181 0.008673 0.008995 0.06% MLCellLinOp::compGrad() 109 0.0001363 0.002106 0.007991 0.05% Gravity::get_new_grav_vector() 109 0.0001449 0.001929 0.007277 0.05% MLCellLinOp::smooth() 3118 0.003058 0.003609 0.004973 0.03% Gravity::multilevel_solve_for_old_phi() 54 0.0004229 0.001526 0.004723 0.03% MLCGSolver::bicgstab 94 0 0.001142 0.004567 0.03% Amr::writePlotFile() 1 0.001337 0.003447 0.004302 0.03% solve_for_old_phi 54 0.000435 0.001388 0.004149 0.03% Nyx::reset_internal_energy_nostore() 108 0.0002509 0.001056 0.00345 0.02% Gravity::actual_multilevel_solve() 55 0.0007077 0.001347 0.003201 0.02% Gravity::solve_for_new_phi() 54 0.0006309 0.001275 0.003145 0.02% Gravity::solve_with_MLMG 109 0.0009852 0.00145 0.002779 0.02% Amr::coarseTimeStep() 54 0.001349 0.002148 0.00242 0.02% MLCellLinOp::apply() 2308 0.001131 0.001462 0.002308 0.01% Nyx::post_timestep()::sum_write 54 0.0007127 0.001141 0.002246 0.01% Gravity::AddParticlesToRhs() 54 0.000163 0.0006674 0.002138 0.01% ParticleContainer::AssignDensity() 57 0.0001653 0.0006036 0.00189 0.01% MLMG::actualBottomSolve() 378 0.0001892 0.0006162 0.001879 0.01% AmrLevel::writePlotFile() 1 1.602e-05 0.000477 0.00185 0.01% AmrLevel::FillPatch() 383 0.0004544 0.0007709 0.001691 0.01% MLCellLinOp::correctionResidual() 1512 0.0009536 0.00107 0.00134 0.01% MLMG:computeResOfCorrection() 1512 0.000854 0.0009715 0.001262 0.01% Amr::timeStep() 54 0.0003711 0.0005724 0.001122 0.01% main() 1 0.0004627 0.0006711 0.001076 0.01% Nyx::computeNewDt() 54 6.467e-05 0.0003027 0.00101 0.01% MLMG::mgVcycle() 378 0.0006337 0.000734 0.0009804 0.01% Gravity::CorrectRhsUsingOffset() 54 0.0004914 0.0005667 0.0007469 0.00% ParticleContainer::Restart() 1 0.0004195 0.0005801 0.0006404 0.00% Nyx::enforce_minimum_density() 54 0.000123 0.0002405 0.0005734 0.00% MLCellLinOp::solutionResidual() 487 0.0003686 0.0004306 0.0005568 0.00% MLMG::mgVcycle_down::1 378 0.0003143 0.0003743 0.0005174 0.00% MLMG::mgVcycle_down::0 378 0.0003755 0.0004196 0.0005153 0.00% FillPatchIterator::FillFromLevel0() 383 0.0002987 0.0003624 0.0004989 0.00% FillPatchSingleLevel 383 0.0003405 0.000395 0.0004916 0.00% Gravity::solve_for_phi() 54 0.0001655 0.000247 0.0004798 0.00% FabArray::ParallelCopy() 385 0.0003 0.0003472 0.0004636 0.00% MLMG::computeResidual() 378 0.0002725 0.0003274 0.0004607 0.00% MLMG::mgVcycle_down::2 378 0.0003396 0.0003646 0.0004197 0.00% MLMG::mgVcycle_up::0 378 0.0002801 0.0003112 0.0004015 0.00% Nyx::particle_est_time_step() 54 0.0001899 0.0002418 0.000379 0.00% MLMG::mgVcycle_down::3 378 0.0003323 0.000349 0.0003744 0.00% ParticleContainer::Redistribute_impl() 55 0.0003291 0.0003559 0.0003743 0.00% MLMG::mgVcycle_up::3 378 0.0002776 0.0003004 0.0003518 0.00% MLMG::mgVcycle_up::1 378 0.0002831 0.0002998 0.000335 0.00% MLMG::mgVcycle_up::2 378 0.0002597 0.0002801 0.0003214 0.00% MLMG::mgVcycle_bottom 378 0.0002538 0.0002743 0.0003143 0.00% Nyx::post_restart() 1 5.164e-05 0.0001208 0.0003086 0.00% ParticleCopyPlan::build 55 0.0001627 0.0001844 0.0002246 0.00% Gravity::AddParticlesToRhsML() 55 0.0001361 0.0001608 0.0002195 0.00% solve_for_new_phi 54 0.0001348 0.0001533 0.0001799 0.00% REG::R::Nyx::advance::STEP1 54 0.0001569 0.0001628 0.0001719 0.00% MLMG::computeMLResidual() 109 0.0001388 0.0001479 0.0001637 0.00% MLMG::getGradSolution() 109 0.0001355 0.0001412 0.0001513 0.00% Nyx::post_timestep()::redist 54 0.0001291 0.0001341 0.0001413 0.00% Nyx::post_timestep() 54 8.921e-05 0.0001058 0.0001339 0.00% just_the_hydro 54 9.486e-05 0.0001034 0.0001207 0.00% REG::R::Nyx::advance_hydro_plus_particles 54 8.267e-05 9.601e-05 0.0001076 0.00% ParticleCopyPlan::buildMPIStart 55 6.341e-05 9.057e-05 0.0001066 0.00% Nyx::post_timestep()::compute_temp 54 4.719e-05 5.247e-05 6.409e-05 0.00% Nyx::particle_post_restart() 1 3.968e-05 4.629e-05 5.068e-05 0.00% REG::R::Nyx::coarseTimeStep 1 3.564e-05 4.248e-05 4.694e-05 0.00% Amr::init() 1 1.092e-06 1.206e-06 1.331e-06 0.00% Other 35033 0.02067 0.04236 0.08249 0.53% ---------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ---------------------------------------------------------------------------------------------------------- main() 1 15.59 15.59 15.59 100.00% REG::R::Nyx::coarseTimeStep 1 15.54 15.54 15.54 99.70% Amr::coarseTimeStep() 54 15.54 15.54 15.54 99.70% Amr::timeStep() 54 15.46 15.47 15.48 99.30% REG::R::Nyx::advance::STEP1 54 15.16 15.22 15.37 98.59% REG::R::Nyx::advance_hydro_plus_particles 54 15.16 15.22 15.37 98.59% Nyx::advance_hydro_plus_particles() 54 15.16 15.22 15.37 98.59% just_the_hydro 54 14.19 14.25 14.27 91.54% Nyx::strang_hydro() 54 14.19 14.25 14.27 91.54% Nyx::update_state_with_sources() 54 0.0545 10.71 14.27 91.52% Nyx::enforce_minimum_density() 54 0.003566 10.7 14.27 91.52% MultiFab::min() 54 0.002993 10.7 14.27 91.52% Nyx::advance_hydro_pc_umdrv() 54 4.951e-05 3.456 13.82 88.67% Nyx::umdrv() 216 0 3.419 13.67 87.72% Nyx::umeth() 216 0 3.358 13.43 86.17% solve_for_new_phi 54 0.7682 0.7888 0.7957 5.10% Gravity::solve_for_new_phi() 54 0.7681 0.7886 0.7956 5.10% Gravity::solve_for_phi() 54 0.7217 0.7757 0.7938 5.09% Gravity::solve_with_MLMG 109 0.7426 0.7444 0.7497 4.81% MLMG::solve() 109 0.7347 0.7387 0.7401 4.75% MLMG::oneIter() 378 0.06414 0.209 0.6396 4.10% MLMG::ResNormInf() 487 0.01913 0.466 0.6164 3.95% MLMG::mgVcycle() 378 0.04931 0.1913 0.6132 3.93% MLCellLinOp::smooth() 3118 0.03501 0.1441 0.4681 3.00% MLPoisson::Fsmooth() 12096 0.00696 0.09649 0.3645 2.34% Nyx::post_timestep() 54 0.1084 0.251 0.2986 1.92% numParticlesOutOfRange() 226 0.03453 0.2237 0.2871 1.84% Nyx::post_timestep()::redist 54 0.07167 0.2274 0.2794 1.79% MLMG::mgVcycle_down::0 378 0.007522 0.06335 0.2302 1.48% MLMG::mgVcycle_up::0 378 0.00502 0.05929 0.2218 1.42% AmrLevel::FillPatch() 383 0.003508 0.05532 0.2104 1.35% FillPatchIterator::Initialize 383 0.002881 0.04599 0.175 1.12% Nyx::strang_hydro()::old_tmp_patch 54 0.0009491 0.04224 0.166 1.07% vol_weight_sum 113 0.004703 0.1108 0.1462 0.94% MLCellLinOp::applyBC() 14513 0.0308 0.05676 0.1319 0.85% FabArray::FillBoundary() 14194 0.02179 0.0493 0.13 0.83% FillBoundary_nowait() 14196 0.01077 0.03811 0.1191 0.76% Gravity::get_old_grav_vector() 162 0.003443 0.03193 0.1171 0.75% solve_for_old_phi 54 0.09243 0.09323 0.09543 0.61% Gravity::actual_multilevel_solve() 55 0.08769 0.0932 0.09512 0.61% Gravity::multilevel_solve_for_old_phi() 54 0.08888 0.09111 0.09192 0.59% Gravity::CorrectRhsUsingOffset() 54 0.004909 0.06295 0.08237 0.53% ParticleContainer::AssignCellDensitySingleLevel() 111 0.001243 0.02013 0.07675 0.49% Nyx::computeNewDt() 54 0.06144 0.07224 0.07589 0.49% Nyx::est_time_step() 54 0.06043 0.07194 0.07582 0.49% DarkMatterParticleContainer::moveKickDrift() 108 0.000126 0.0171 0.06803 0.44% MLCellLinOp::apply() 2308 0.00748 0.02268 0.06755 0.43% DarkMatterParticleContainer::moveKick() 54 7.228e-05 0.01619 0.06452 0.41% ParticleContainer::Redistribute_impl() 55 0.05589 0.06231 0.06448 0.41% amrex::Copy() 1375 0.0007721 0.01586 0.06106 0.39% Gravity::get_new_grav_vector() 109 0.001657 0.01539 0.05642 0.36% Nyx::srctoprim() 216 0 0.01405 0.05621 0.36% FillPatchIterator::FillFromLevel0() 383 0.002065 0.01554 0.05573 0.36% FillPatchSingleLevel 383 0.001767 0.01517 0.05524 0.35% FabArray::setVal() 5074 0.002515 0.01564 0.05482 0.35% FabArray::ParallelCopy() 385 0.001167 0.01445 0.05426 0.35% FabArray::ParallelCopy_nowait() 385 0.0006888 0.01388 0.05344 0.34% MLMG::addInterpCorrection() 1512 0.001088 0.0126 0.047 0.30% Nyx::particle_est_time_step() 54 0.04426 0.0443 0.04432 0.28% MLMG::mgVcycle_down::1 378 0.006862 0.01635 0.04423 0.28% NyxParticleContainer::estTimestep(lev) 54 0.04388 0.04405 0.04413 0.28% ParticleContainer::AssignDensity() 57 0.0007718 0.01099 0.04151 0.27% Gravity::AddParticlesToRhs() 54 0.0008393 0.01095 0.04117 0.26% MLMG:computeResOfCorrection() 1512 0.007908 0.01637 0.04115 0.26% Gravity::AddParticlesToRhsML() 55 0.0009503 0.01101 0.04101 0.26% MLCellLinOp::correctionResidual() 1512 0.007054 0.0154 0.03989 0.26% MLMG::mgVcycle_up::1 378 0.005027 0.01377 0.03953 0.25% Nyx::ctoprim() 216 0 0.009797 0.03919 0.25% MLCellLinOp::solutionResidual() 487 0.002807 0.0116 0.0377 0.24% Redistribute_partition 55 7.865e-05 0.009187 0.0365 0.23% MLPoisson::Fapply() 2308 0.001029 0.009348 0.03421 0.22% Nyx::reset_internal_energy() 163 0.0001074 0.0083 0.03287 0.21% MLMG::prepareForSolve() 109 0.01998 0.02324 0.03269 0.21% Amr::init() 1 0.03047 0.03072 0.03085 0.20% Amr::restart() 1 0.03047 0.03072 0.03085 0.20% MLMG::computeResidual() 378 0.002083 0.008556 0.02782 0.18% Nyx::reset_internal_energy_nostore() 108 0.0003745 0.0068 0.02605 0.17% FabArray::norminf() 1053 0.006725 0.01137 0.02526 0.16% amrex::average_down 1512 0.0009711 0.00681 0.02427 0.16% MLMG::mgVcycle_bottom 378 0.0004431 0.005837 0.02198 0.14% MLMG::actualBottomSolve() 378 0.0001892 0.005562 0.02166 0.14% Nyx::post_timestep()::sum_write 54 0.01857 0.019 0.02006 0.13% Nyx::post_restart() 1 0.01876 0.01893 0.01899 0.12% MLCGSolver::bicgstab 94 0 0.004612 0.01845 0.12% FabArray::sum() 581 0.0004925 0.004739 0.01745 0.11% MLMG::mgVcycle_down::2 378 0.006775 0.009489 0.01711 0.11% Nyx::post_timestep()::compute_temp 54 0.0003006 0.004278 0.01619 0.10% FabArray::Xpay() 1999 0.001036 0.004765 0.01592 0.10% MLMG::mgVcycle_up::2 378 0.005118 0.007439 0.01401 0.09% Amr::writePlotFile() 1 0.01322 0.01348 0.01357 0.09% MLMG::mgVcycle_down::3 378 0.006667 0.008294 0.01268 0.08% Nyx::particle_post_restart() 1 0.01167 0.01186 0.01193 0.08% ParticleContainer::Restart() 1 0.01164 0.01182 0.01189 0.08% Nyx::compute_new_temp() 163 0.0001358 0.002992 0.01155 0.07% MLMG::mgVcycle_up::3 378 0.005238 0.006712 0.01066 0.07% ParticleCopyPlan::build 55 0.0009401 0.008202 0.01065 0.07% MLMG::computeMLResidual() 109 0.001135 0.003521 0.01051 0.07% MLMG::getGradSolution() 109 0.0007699 0.003177 0.01036 0.07% amrex::Add() 542 0.000379 0.00286 0.0103 0.07% ParticleCopyPlan::buildMPIStart 55 0.0002892 0.007774 0.01027 0.07% FabArray::plus() 799 0.0005855 0.003004 0.01023 0.07% MLCellLinOp::compGrad() 109 0.0006326 0.003036 0.01021 0.07% ParticleCopyPlan::doHandShake 55 0.0002258 0.007683 0.01018 0.07% AmrLevel::writePlotFile() 1 0.003926 0.00533 0.00908 0.06% Other 35033 0.058 0.09109 0.1542 0.99% ---------------------------------------------------------------------------------------------------------- BEGIN REGION R::Nyx::advance::STEP1 -------------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------------- MultiFab::min() 54 0.002993 10.7 14.27 91.52% Nyx::umeth() 216 0 3.358 13.43 86.17% MLMG::ResNormInf() 486 0.001105 0.4613 0.6161 3.95% MLPoisson::Fsmooth() 12096 0.00696 0.09649 0.3645 2.34% Nyx::umdrv() 216 0 0.06028 0.2411 1.55% vol_weight_sum 108 0.0005854 0.1061 0.1414 0.91% FillPatchIterator::Initialize 378 0.0005376 0.02984 0.1177 0.75% FillBoundary_nowait() 14187 0.005573 0.03219 0.1116 0.72% DarkMatterParticleContainer::moveKickDrift() 108 0.000126 0.0171 0.06803 0.44% DarkMatterParticleContainer::moveKick() 54 7.228e-05 0.01619 0.06452 0.41% ParticleContainer::AssignCellDensitySingleLevel() 108 0.0003294 0.01619 0.06377 0.41% amrex::Copy() 1350 0.0007679 0.01567 0.0603 0.39% Nyx::srctoprim() 216 0 0.01405 0.05621 0.36% Nyx::strang_hydro()::old_tmp_patch 54 0.0001095 0.01392 0.05532 0.35% FabArray::setVal() 4981 0.002457 0.01524 0.05337 0.34% Nyx::advance_hydro_pc_umdrv() 54 4.951e-05 0.01316 0.05247 0.34% FabArray::ParallelCopy_nowait() 378 0.000267 0.0133 0.05237 0.34% Nyx::update_state_with_sources() 54 0.0002215 0.01291 0.05093 0.33% Nyx::strang_hydro() 54 0.0007271 0.013 0.04974 0.32% MLCellLinOp::applyBC() 14511 0.01098 0.02083 0.04929 0.32% MLMG::addInterpCorrection() 1512 0.001088 0.0126 0.047 0.30% Nyx::ctoprim() 216 0 0.009797 0.03919 0.25% MLMG::solve() 108 0.000761 0.02655 0.03532 0.23% Nyx::advance_hydro_plus_particles() 54 0.0006913 0.009121 0.03433 0.22% MLPoisson::Fapply() 2307 0.001028 0.009333 0.03415 0.22% amrex::average_down 1512 0.0009711 0.00681 0.02427 0.16% FabArray::norminf() 997 0.000338 0.005995 0.02293 0.15% Nyx::reset_internal_energy() 108 7.9e-05 0.005634 0.02229 0.14% FabArray::sum() 580 0.0004921 0.00473 0.01742 0.11% MLMG::prepareForSolve() 108 0.01578 0.01676 0.01722 0.11% FabArray::Xpay() 1998 0.001035 0.004757 0.01589 0.10% MLMG::oneIter() 378 0.001274 0.01082 0.01403 0.09% Gravity::get_old_grav_vector() 162 0.0002911 0.002919 0.01077 0.07% FabArray::FillBoundary() 14187 0.007115 0.008056 0.01071 0.07% Gravity::get_new_grav_vector() 108 0.0001395 0.001908 0.007205 0.05% MLCellLinOp::smooth() 3118 0.003058 0.003609 0.004973 0.03% Gravity::multilevel_solve_for_old_phi() 54 0.0004229 0.001526 0.004723 0.03% MLCGSolver::bicgstab 94 0 0.001142 0.004567 0.03% solve_for_old_phi 54 0.000435 0.001388 0.004149 0.03% Gravity::solve_for_new_phi() 54 0.0006309 0.001275 0.003145 0.02% Gravity::actual_multilevel_solve() 54 0.0006898 0.001314 0.003138 0.02% Gravity::solve_with_MLMG 108 0.0009628 0.001424 0.002742 0.02% MLCellLinOp::apply() 2307 0.001128 0.001461 0.002307 0.01% Gravity::AddParticlesToRhs() 54 0.000163 0.0006674 0.002138 0.01% MLMG::actualBottomSolve() 378 0.0001892 0.0006162 0.001879 0.01% AmrLevel::FillPatch() 378 0.0004481 0.0007603 0.001674 0.01% ParticleContainer::AssignDensity() 54 0.0001575 0.0005312 0.001624 0.01% MLCellLinOp::correctionResidual() 1512 0.0009536 0.00107 0.00134 0.01% MLMG:computeResOfCorrection() 1512 0.000854 0.0009715 0.001262 0.01% MLMG::mgVcycle() 378 0.0006337 0.000734 0.0009804 0.01% Gravity::CorrectRhsUsingOffset() 54 0.0004914 0.0005667 0.0007469 0.00% Nyx::enforce_minimum_density() 54 0.000123 0.0002405 0.0005734 0.00% MLCellLinOp::solutionResidual() 486 0.0003678 0.0004295 0.0005555 0.00% MLMG::mgVcycle_down::1 378 0.0003143 0.0003743 0.0005174 0.00% MLMG::mgVcycle_down::0 378 0.0003755 0.0004196 0.0005153 0.00% FillPatchIterator::FillFromLevel0() 378 0.0002952 0.0003551 0.0004885 0.00% FillPatchSingleLevel 378 0.0003368 0.0003897 0.0004867 0.00% Gravity::solve_for_phi() 54 0.0001655 0.000247 0.0004798 0.00% MLMG::computeResidual() 378 0.0002725 0.0003274 0.0004607 0.00% FabArray::ParallelCopy() 378 0.0002947 0.0003414 0.0004568 0.00% MLMG::mgVcycle_down::2 378 0.0003396 0.0003646 0.0004197 0.00% MLMG::mgVcycle_up::0 378 0.0002801 0.0003112 0.0004015 0.00% MLMG::mgVcycle_up::1 378 0.0002831 0.0002998 0.000335 0.00% MLMG::mgVcycle_up::2 378 0.0002597 0.0002801 0.0003214 0.00% MLMG::mgVcycle_bottom 378 0.0002538 0.0002743 0.0003143 0.00% Gravity::AddParticlesToRhsML() 54 0.0001341 0.0001584 0.0002159 0.00% solve_for_new_phi 54 0.0001348 0.0001533 0.0001799 0.00% REG::R::Nyx::advance::STEP1 54 0.0001569 0.0001628 0.0001719 0.00% just_the_hydro 54 9.486e-05 0.0001034 0.0001207 0.00% REG::R::Nyx::advance_hydro_plus_particles 54 8.267e-05 9.601e-05 0.0001076 0.00% Other 35907 0.01511 0.02871 0.06776 0.43% -------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------------- REG::R::Nyx::advance::STEP1 54 15.16 15.22 15.37 98.59% REG::R::Nyx::advance_hydro_plus_particles 54 15.16 15.22 15.37 98.59% Nyx::advance_hydro_plus_particles() 54 15.16 15.22 15.37 98.59% just_the_hydro 54 14.19 14.25 14.27 91.54% Nyx::strang_hydro() 54 14.19 14.25 14.27 91.54% Nyx::update_state_with_sources() 54 0.0545 10.71 14.27 91.52% Nyx::enforce_minimum_density() 54 0.003566 10.7 14.27 91.52% MultiFab::min() 54 0.002993 10.7 14.27 91.52% Nyx::advance_hydro_pc_umdrv() 54 4.951e-05 3.456 13.82 88.67% Nyx::umdrv() 216 0 3.419 13.67 87.72% Nyx::umeth() 216 0 3.358 13.43 86.17% solve_for_new_phi 54 0.7682 0.7888 0.7957 5.10% Gravity::solve_for_new_phi() 54 0.7681 0.7886 0.7956 5.10% Gravity::solve_for_phi() 54 0.7217 0.7757 0.7938 5.09% Gravity::solve_with_MLMG 108 0.7405 0.7424 0.7476 4.80% MLMG::solve() 108 0.7338 0.7372 0.7384 4.74% MLMG::oneIter() 378 0.06414 0.209 0.6396 4.10% MLMG::ResNormInf() 486 0.01909 0.466 0.6164 3.95% MLMG::mgVcycle() 378 0.04931 0.1913 0.6132 3.93% MLCellLinOp::smooth() 3118 0.03501 0.1441 0.4681 3.00% MLPoisson::Fsmooth() 12096 0.00696 0.09649 0.3645 2.34% MLMG::mgVcycle_down::0 378 0.007522 0.06335 0.2302 1.48% MLMG::mgVcycle_up::0 378 0.00502 0.05929 0.2218 1.42% AmrLevel::FillPatch() 378 0.003467 0.05486 0.2088 1.34% FillPatchIterator::Initialize 378 0.002848 0.04561 0.1736 1.11% Nyx::strang_hydro()::old_tmp_patch 54 0.0009491 0.04224 0.166 1.07% vol_weight_sum 108 0.004511 0.1072 0.1415 0.91% MLCellLinOp::applyBC() 14511 0.0308 0.05673 0.1318 0.85% FabArray::FillBoundary() 14187 0.02178 0.04923 0.1298 0.83% FillBoundary_nowait() 14187 0.01076 0.038 0.1187 0.76% Gravity::get_old_grav_vector() 162 0.003443 0.03193 0.1171 0.75% solve_for_old_phi 54 0.09243 0.09323 0.09543 0.61% Gravity::multilevel_solve_for_old_phi() 54 0.08888 0.09111 0.09192 0.59% Gravity::actual_multilevel_solve() 54 0.08416 0.08958 0.09148 0.59% Gravity::CorrectRhsUsingOffset() 54 0.004909 0.06295 0.08237 0.53% ParticleContainer::AssignCellDensitySingleLevel() 108 0.00122 0.01944 0.07405 0.48% DarkMatterParticleContainer::moveKickDrift() 108 0.000126 0.0171 0.06803 0.44% MLCellLinOp::apply() 2307 0.007472 0.02264 0.06743 0.43% DarkMatterParticleContainer::moveKick() 54 7.228e-05 0.01619 0.06452 0.41% amrex::Copy() 1350 0.0007679 0.01567 0.0603 0.39% Nyx::srctoprim() 216 0 0.01405 0.05621 0.36% Gravity::get_new_grav_vector() 108 0.001641 0.01518 0.05563 0.36% FillPatchIterator::FillFromLevel0() 378 0.002042 0.01543 0.05542 0.36% FillPatchSingleLevel 378 0.001747 0.01508 0.05493 0.35% FabArray::ParallelCopy() 378 0.001149 0.01435 0.05391 0.35% FabArray::setVal() 4981 0.002457 0.01524 0.05337 0.34% FabArray::ParallelCopy_nowait() 378 0.0006769 0.01379 0.0531 0.34% MLMG::addInterpCorrection() 1512 0.001088 0.0126 0.047 0.30% MLMG::mgVcycle_down::1 378 0.006862 0.01635 0.04423 0.28% Gravity::AddParticlesToRhs() 54 0.0008393 0.01095 0.04117 0.26% MLMG:computeResOfCorrection() 1512 0.007908 0.01637 0.04115 0.26% MLCellLinOp::correctionResidual() 1512 0.007054 0.0154 0.03989 0.26% Gravity::AddParticlesToRhsML() 54 0.0009316 0.0107 0.03985 0.26% MLMG::mgVcycle_up::1 378 0.005027 0.01377 0.03953 0.25% Nyx::ctoprim() 216 0 0.009797 0.03919 0.25% ParticleContainer::AssignDensity() 54 0.00074 0.01021 0.03848 0.25% MLCellLinOp::solutionResidual() 486 0.002797 0.01155 0.03754 0.24% MLPoisson::Fapply() 2307 0.001028 0.009333 0.03415 0.22% MLMG::prepareForSolve() 108 0.01908 0.0224 0.03199 0.21% MLMG::computeResidual() 378 0.002083 0.008556 0.02782 0.18% amrex::average_down 1512 0.0009711 0.00681 0.02427 0.16% FabArray::norminf() 997 0.000338 0.005995 0.02293 0.15% Nyx::reset_internal_energy() 108 7.9e-05 0.005634 0.02229 0.14% MLMG::mgVcycle_bottom 378 0.0004431 0.005837 0.02198 0.14% MLMG::actualBottomSolve() 378 0.0001892 0.005562 0.02166 0.14% MLCGSolver::bicgstab 94 0 0.004612 0.01845 0.12% FabArray::sum() 580 0.0004921 0.00473 0.01742 0.11% MLMG::mgVcycle_down::2 378 0.006775 0.009489 0.01711 0.11% FabArray::Xpay() 1998 0.001035 0.004757 0.01589 0.10% MLMG::mgVcycle_up::2 378 0.005118 0.007439 0.01401 0.09% Other 35907 0.03039 0.06075 0.1488 0.95% -------------------------------------------------------------------------------------------------- END REGION R::Nyx::advance::STEP1 BEGIN REGION R::Nyx::advance_hydro_plus_particles -------------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------------- MultiFab::min() 54 0.002993 10.7 14.27 91.52% Nyx::umeth() 216 0 3.358 13.43 86.17% MLMG::ResNormInf() 486 0.001105 0.4613 0.6161 3.95% MLPoisson::Fsmooth() 12096 0.00696 0.09649 0.3645 2.34% Nyx::umdrv() 216 0 0.06028 0.2411 1.55% vol_weight_sum 108 0.0005854 0.1061 0.1414 0.91% FillPatchIterator::Initialize 378 0.0005376 0.02984 0.1177 0.75% FillBoundary_nowait() 14187 0.005573 0.03219 0.1116 0.72% DarkMatterParticleContainer::moveKickDrift() 108 0.000126 0.0171 0.06803 0.44% DarkMatterParticleContainer::moveKick() 54 7.228e-05 0.01619 0.06452 0.41% ParticleContainer::AssignCellDensitySingleLevel() 108 0.0003294 0.01619 0.06377 0.41% amrex::Copy() 1350 0.0007679 0.01567 0.0603 0.39% Nyx::srctoprim() 216 0 0.01405 0.05621 0.36% Nyx::strang_hydro()::old_tmp_patch 54 0.0001095 0.01392 0.05532 0.35% FabArray::setVal() 4981 0.002457 0.01524 0.05337 0.34% Nyx::advance_hydro_pc_umdrv() 54 4.951e-05 0.01316 0.05247 0.34% FabArray::ParallelCopy_nowait() 378 0.000267 0.0133 0.05237 0.34% Nyx::update_state_with_sources() 54 0.0002215 0.01291 0.05093 0.33% Nyx::strang_hydro() 54 0.0007271 0.013 0.04974 0.32% MLCellLinOp::applyBC() 14511 0.01098 0.02083 0.04929 0.32% MLMG::addInterpCorrection() 1512 0.001088 0.0126 0.047 0.30% Nyx::ctoprim() 216 0 0.009797 0.03919 0.25% MLMG::solve() 108 0.000761 0.02655 0.03532 0.23% Nyx::advance_hydro_plus_particles() 54 0.0006913 0.009121 0.03433 0.22% MLPoisson::Fapply() 2307 0.001028 0.009333 0.03415 0.22% amrex::average_down 1512 0.0009711 0.00681 0.02427 0.16% FabArray::norminf() 997 0.000338 0.005995 0.02293 0.15% Nyx::reset_internal_energy() 108 7.9e-05 0.005634 0.02229 0.14% FabArray::sum() 580 0.0004921 0.00473 0.01742 0.11% MLMG::prepareForSolve() 108 0.01578 0.01676 0.01722 0.11% FabArray::Xpay() 1998 0.001035 0.004757 0.01589 0.10% MLMG::oneIter() 378 0.001274 0.01082 0.01403 0.09% Gravity::get_old_grav_vector() 162 0.0002911 0.002919 0.01077 0.07% FabArray::FillBoundary() 14187 0.007115 0.008056 0.01071 0.07% Gravity::get_new_grav_vector() 108 0.0001395 0.001908 0.007205 0.05% MLCellLinOp::smooth() 3118 0.003058 0.003609 0.004973 0.03% Gravity::multilevel_solve_for_old_phi() 54 0.0004229 0.001526 0.004723 0.03% MLCGSolver::bicgstab 94 0 0.001142 0.004567 0.03% solve_for_old_phi 54 0.000435 0.001388 0.004149 0.03% Gravity::solve_for_new_phi() 54 0.0006309 0.001275 0.003145 0.02% Gravity::actual_multilevel_solve() 54 0.0006898 0.001314 0.003138 0.02% Gravity::solve_with_MLMG 108 0.0009628 0.001424 0.002742 0.02% MLCellLinOp::apply() 2307 0.001128 0.001461 0.002307 0.01% Gravity::AddParticlesToRhs() 54 0.000163 0.0006674 0.002138 0.01% MLMG::actualBottomSolve() 378 0.0001892 0.0006162 0.001879 0.01% AmrLevel::FillPatch() 378 0.0004481 0.0007603 0.001674 0.01% ParticleContainer::AssignDensity() 54 0.0001575 0.0005312 0.001624 0.01% MLCellLinOp::correctionResidual() 1512 0.0009536 0.00107 0.00134 0.01% MLMG:computeResOfCorrection() 1512 0.000854 0.0009715 0.001262 0.01% MLMG::mgVcycle() 378 0.0006337 0.000734 0.0009804 0.01% Gravity::CorrectRhsUsingOffset() 54 0.0004914 0.0005667 0.0007469 0.00% Nyx::enforce_minimum_density() 54 0.000123 0.0002405 0.0005734 0.00% MLCellLinOp::solutionResidual() 486 0.0003678 0.0004295 0.0005555 0.00% MLMG::mgVcycle_down::1 378 0.0003143 0.0003743 0.0005174 0.00% MLMG::mgVcycle_down::0 378 0.0003755 0.0004196 0.0005153 0.00% FillPatchIterator::FillFromLevel0() 378 0.0002952 0.0003551 0.0004885 0.00% FillPatchSingleLevel 378 0.0003368 0.0003897 0.0004867 0.00% Gravity::solve_for_phi() 54 0.0001655 0.000247 0.0004798 0.00% MLMG::computeResidual() 378 0.0002725 0.0003274 0.0004607 0.00% FabArray::ParallelCopy() 378 0.0002947 0.0003414 0.0004568 0.00% MLMG::mgVcycle_down::2 378 0.0003396 0.0003646 0.0004197 0.00% MLMG::mgVcycle_up::0 378 0.0002801 0.0003112 0.0004015 0.00% MLMG::mgVcycle_up::1 378 0.0002831 0.0002998 0.000335 0.00% MLMG::mgVcycle_up::2 378 0.0002597 0.0002801 0.0003214 0.00% MLMG::mgVcycle_bottom 378 0.0002538 0.0002743 0.0003143 0.00% Gravity::AddParticlesToRhsML() 54 0.0001341 0.0001584 0.0002159 0.00% solve_for_new_phi 54 0.0001348 0.0001533 0.0001799 0.00% just_the_hydro 54 9.486e-05 0.0001034 0.0001207 0.00% REG::R::Nyx::advance_hydro_plus_particles 54 8.267e-05 9.601e-05 0.0001076 0.00% Other 35907 0.01511 0.02871 0.06776 0.43% -------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------------- REG::R::Nyx::advance_hydro_plus_particles 54 15.16 15.22 15.37 98.59% Nyx::advance_hydro_plus_particles() 54 15.16 15.22 15.37 98.59% just_the_hydro 54 14.19 14.25 14.27 91.54% Nyx::strang_hydro() 54 14.19 14.25 14.27 91.54% Nyx::update_state_with_sources() 54 0.0545 10.71 14.27 91.52% Nyx::enforce_minimum_density() 54 0.003566 10.7 14.27 91.52% MultiFab::min() 54 0.002993 10.7 14.27 91.52% Nyx::advance_hydro_pc_umdrv() 54 4.951e-05 3.456 13.82 88.67% Nyx::umdrv() 216 0 3.419 13.67 87.72% Nyx::umeth() 216 0 3.358 13.43 86.17% solve_for_new_phi 54 0.7682 0.7888 0.7957 5.10% Gravity::solve_for_new_phi() 54 0.7681 0.7886 0.7956 5.10% Gravity::solve_for_phi() 54 0.7217 0.7757 0.7938 5.09% Gravity::solve_with_MLMG 108 0.7405 0.7424 0.7476 4.80% MLMG::solve() 108 0.7338 0.7372 0.7384 4.74% MLMG::oneIter() 378 0.06414 0.209 0.6396 4.10% MLMG::ResNormInf() 486 0.01909 0.466 0.6164 3.95% MLMG::mgVcycle() 378 0.04931 0.1913 0.6132 3.93% MLCellLinOp::smooth() 3118 0.03501 0.1441 0.4681 3.00% MLPoisson::Fsmooth() 12096 0.00696 0.09649 0.3645 2.34% MLMG::mgVcycle_down::0 378 0.007522 0.06335 0.2302 1.48% MLMG::mgVcycle_up::0 378 0.00502 0.05929 0.2218 1.42% AmrLevel::FillPatch() 378 0.003467 0.05486 0.2088 1.34% FillPatchIterator::Initialize 378 0.002848 0.04561 0.1736 1.11% Nyx::strang_hydro()::old_tmp_patch 54 0.0009491 0.04224 0.166 1.07% vol_weight_sum 108 0.004511 0.1072 0.1415 0.91% MLCellLinOp::applyBC() 14511 0.0308 0.05673 0.1318 0.85% FabArray::FillBoundary() 14187 0.02178 0.04923 0.1298 0.83% FillBoundary_nowait() 14187 0.01076 0.038 0.1187 0.76% Gravity::get_old_grav_vector() 162 0.003443 0.03193 0.1171 0.75% solve_for_old_phi 54 0.09243 0.09323 0.09543 0.61% Gravity::multilevel_solve_for_old_phi() 54 0.08888 0.09111 0.09192 0.59% Gravity::actual_multilevel_solve() 54 0.08416 0.08958 0.09148 0.59% Gravity::CorrectRhsUsingOffset() 54 0.004909 0.06295 0.08237 0.53% ParticleContainer::AssignCellDensitySingleLevel() 108 0.00122 0.01944 0.07405 0.48% DarkMatterParticleContainer::moveKickDrift() 108 0.000126 0.0171 0.06803 0.44% MLCellLinOp::apply() 2307 0.007472 0.02264 0.06743 0.43% DarkMatterParticleContainer::moveKick() 54 7.228e-05 0.01619 0.06452 0.41% amrex::Copy() 1350 0.0007679 0.01567 0.0603 0.39% Nyx::srctoprim() 216 0 0.01405 0.05621 0.36% Gravity::get_new_grav_vector() 108 0.001641 0.01518 0.05563 0.36% FillPatchIterator::FillFromLevel0() 378 0.002042 0.01543 0.05542 0.36% FillPatchSingleLevel 378 0.001747 0.01508 0.05493 0.35% FabArray::ParallelCopy() 378 0.001149 0.01435 0.05391 0.35% FabArray::setVal() 4981 0.002457 0.01524 0.05337 0.34% FabArray::ParallelCopy_nowait() 378 0.0006769 0.01379 0.0531 0.34% MLMG::addInterpCorrection() 1512 0.001088 0.0126 0.047 0.30% MLMG::mgVcycle_down::1 378 0.006862 0.01635 0.04423 0.28% Gravity::AddParticlesToRhs() 54 0.0008393 0.01095 0.04117 0.26% MLMG:computeResOfCorrection() 1512 0.007908 0.01637 0.04115 0.26% MLCellLinOp::correctionResidual() 1512 0.007054 0.0154 0.03989 0.26% Gravity::AddParticlesToRhsML() 54 0.0009316 0.0107 0.03985 0.26% MLMG::mgVcycle_up::1 378 0.005027 0.01377 0.03953 0.25% Nyx::ctoprim() 216 0 0.009797 0.03919 0.25% ParticleContainer::AssignDensity() 54 0.00074 0.01021 0.03848 0.25% MLCellLinOp::solutionResidual() 486 0.002797 0.01155 0.03754 0.24% MLPoisson::Fapply() 2307 0.001028 0.009333 0.03415 0.22% MLMG::prepareForSolve() 108 0.01908 0.0224 0.03199 0.21% MLMG::computeResidual() 378 0.002083 0.008556 0.02782 0.18% amrex::average_down 1512 0.0009711 0.00681 0.02427 0.16% FabArray::norminf() 997 0.000338 0.005995 0.02293 0.15% Nyx::reset_internal_energy() 108 7.9e-05 0.005634 0.02229 0.14% MLMG::mgVcycle_bottom 378 0.0004431 0.005837 0.02198 0.14% MLMG::actualBottomSolve() 378 0.0001892 0.005562 0.02166 0.14% MLCGSolver::bicgstab 94 0 0.004612 0.01845 0.12% FabArray::sum() 580 0.0004921 0.00473 0.01742 0.11% MLMG::mgVcycle_down::2 378 0.006775 0.009489 0.01711 0.11% FabArray::Xpay() 1998 0.001035 0.004757 0.01589 0.10% MLMG::mgVcycle_up::2 378 0.005118 0.007439 0.01401 0.09% Other 35907 0.03039 0.06075 0.1488 0.95% -------------------------------------------------------------------------------------------------- END REGION R::Nyx::advance_hydro_plus_particles BEGIN REGION R::Nyx::coarseTimeStep -------------------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------------------- MultiFab::min() 54 0.002993 10.7 14.27 91.52% Nyx::umeth() 216 0 3.358 13.43 86.17% MLMG::ResNormInf() 486 0.001105 0.4613 0.6161 3.95% MLPoisson::Fsmooth() 12096 0.00696 0.09649 0.3645 2.34% numParticlesOutOfRange() 216 0.03256 0.2165 0.278 1.78% Nyx::umdrv() 216 0 0.06028 0.2411 1.55% vol_weight_sum 108 0.0005854 0.1061 0.1414 0.91% FillPatchIterator::Initialize 378 0.0005376 0.02984 0.1177 0.75% FillBoundary_nowait() 14188 0.005574 0.0322 0.1116 0.72% DarkMatterParticleContainer::moveKickDrift() 108 0.000126 0.0171 0.06803 0.44% DarkMatterParticleContainer::moveKick() 54 7.228e-05 0.01619 0.06452 0.41% ParticleContainer::AssignCellDensitySingleLevel() 108 0.0003294 0.01619 0.06377 0.41% amrex::Copy() 1350 0.0007679 0.01567 0.0603 0.39% Nyx::srctoprim() 216 0 0.01405 0.05621 0.36% Nyx::strang_hydro()::old_tmp_patch 54 0.0001095 0.01392 0.05532 0.35% FabArray::setVal() 5036 0.0025 0.01551 0.05433 0.35% Nyx::advance_hydro_pc_umdrv() 54 4.951e-05 0.01316 0.05247 0.34% FabArray::ParallelCopy_nowait() 378 0.000267 0.0133 0.05237 0.34% Nyx::update_state_with_sources() 54 0.0002215 0.01291 0.05093 0.33% Nyx::strang_hydro() 54 0.0007271 0.013 0.04974 0.32% MLCellLinOp::applyBC() 14511 0.01098 0.02083 0.04929 0.32% MLMG::addInterpCorrection() 1512 0.001088 0.0126 0.047 0.30% NyxParticleContainer::estTimestep(lev) 54 0.04388 0.04405 0.04413 0.28% Nyx::ctoprim() 216 0 0.009797 0.03919 0.25% MLMG::solve() 108 0.000761 0.02655 0.03532 0.23% Redistribute_partition 54 7.478e-05 0.008842 0.03513 0.23% Nyx::advance_hydro_plus_particles() 54 0.0006913 0.009121 0.03433 0.22% MLPoisson::Fapply() 2307 0.001028 0.009333 0.03415 0.22% Nyx::reset_internal_energy() 162 0.0001067 0.008228 0.03258 0.21% Nyx::est_time_step() 54 0.01617 0.02764 0.03151 0.20% FabArray::norminf() 1051 0.006725 0.01135 0.02518 0.16% amrex::average_down 1512 0.0009711 0.00681 0.02427 0.16% FabArray::sum() 580 0.0004921 0.00473 0.01742 0.11% MLMG::prepareForSolve() 108 0.01578 0.01676 0.01722 0.11% FabArray::Xpay() 1998 0.001035 0.004757 0.01589 0.10% MLMG::oneIter() 378 0.001274 0.01082 0.01403 0.09% Nyx::compute_new_temp() 162 0.0001353 0.002961 0.01142 0.07% Gravity::get_old_grav_vector() 162 0.0002911 0.002919 0.01077 0.07% FabArray::FillBoundary() 14188 0.007116 0.008057 0.01071 0.07% Gravity::get_new_grav_vector() 108 0.0001395 0.001908 0.007205 0.05% MLCellLinOp::smooth() 3118 0.003058 0.003609 0.004973 0.03% Gravity::multilevel_solve_for_old_phi() 54 0.0004229 0.001526 0.004723 0.03% MLCGSolver::bicgstab 94 0 0.001142 0.004567 0.03% solve_for_old_phi 54 0.000435 0.001388 0.004149 0.03% Nyx::reset_internal_energy_nostore() 108 0.0002509 0.001056 0.00345 0.02% Gravity::solve_for_new_phi() 54 0.0006309 0.001275 0.003145 0.02% Gravity::actual_multilevel_solve() 54 0.0006898 0.001314 0.003138 0.02% Gravity::solve_with_MLMG 108 0.0009628 0.001424 0.002742 0.02% Amr::coarseTimeStep() 54 0.001349 0.002148 0.00242 0.02% MLCellLinOp::apply() 2307 0.001128 0.001461 0.002307 0.01% Nyx::post_timestep()::sum_write 54 0.0007127 0.001141 0.002246 0.01% Gravity::AddParticlesToRhs() 54 0.000163 0.0006674 0.002138 0.01% MLMG::actualBottomSolve() 378 0.0001892 0.0006162 0.001879 0.01% AmrLevel::FillPatch() 378 0.0004481 0.0007603 0.001674 0.01% ParticleContainer::AssignDensity() 54 0.0001575 0.0005312 0.001624 0.01% MLCellLinOp::correctionResidual() 1512 0.0009536 0.00107 0.00134 0.01% MLMG:computeResOfCorrection() 1512 0.000854 0.0009715 0.001262 0.01% Amr::timeStep() 54 0.0003711 0.0005724 0.001122 0.01% Nyx::computeNewDt() 54 6.467e-05 0.0003027 0.00101 0.01% MLMG::mgVcycle() 378 0.0006337 0.000734 0.0009804 0.01% Gravity::CorrectRhsUsingOffset() 54 0.0004914 0.0005667 0.0007469 0.00% Nyx::enforce_minimum_density() 54 0.000123 0.0002405 0.0005734 0.00% MLCellLinOp::solutionResidual() 486 0.0003678 0.0004295 0.0005555 0.00% MLMG::mgVcycle_down::1 378 0.0003143 0.0003743 0.0005174 0.00% MLMG::mgVcycle_down::0 378 0.0003755 0.0004196 0.0005153 0.00% FillPatchIterator::FillFromLevel0() 378 0.0002952 0.0003551 0.0004885 0.00% FillPatchSingleLevel 378 0.0003368 0.0003897 0.0004867 0.00% Gravity::solve_for_phi() 54 0.0001655 0.000247 0.0004798 0.00% MLMG::computeResidual() 378 0.0002725 0.0003274 0.0004607 0.00% FabArray::ParallelCopy() 378 0.0002947 0.0003414 0.0004568 0.00% MLMG::mgVcycle_down::2 378 0.0003396 0.0003646 0.0004197 0.00% MLMG::mgVcycle_up::0 378 0.0002801 0.0003112 0.0004015 0.00% Nyx::particle_est_time_step() 54 0.0001899 0.0002418 0.000379 0.00% MLMG::mgVcycle_down::3 378 0.0003323 0.000349 0.0003744 0.00% ParticleContainer::Redistribute_impl() 54 0.0003232 0.0003477 0.0003647 0.00% MLMG::mgVcycle_up::1 378 0.0002831 0.0002998 0.000335 0.00% MLMG::mgVcycle_up::2 378 0.0002597 0.0002801 0.0003214 0.00% MLMG::mgVcycle_bottom 378 0.0002538 0.0002743 0.0003143 0.00% Gravity::AddParticlesToRhsML() 54 0.0001341 0.0001584 0.0002159 0.00% solve_for_new_phi 54 0.0001348 0.0001533 0.0001799 0.00% REG::R::Nyx::advance::STEP1 54 0.0001569 0.0001628 0.0001719 0.00% Nyx::post_timestep()::redist 54 0.0001291 0.0001341 0.0001413 0.00% Nyx::post_timestep() 54 8.921e-05 0.0001058 0.0001339 0.00% just_the_hydro 54 9.486e-05 0.0001034 0.0001207 0.00% REG::R::Nyx::advance_hydro_plus_particles 54 8.267e-05 9.601e-05 0.0001076 0.00% Nyx::post_timestep()::compute_temp 54 4.719e-05 5.247e-05 6.409e-05 0.00% REG::R::Nyx::coarseTimeStep 1 3.564e-05 4.248e-05 4.694e-05 0.00% Other 36990 0.01614 0.04019 0.08818 0.57% -------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------------------- REG::R::Nyx::coarseTimeStep 1 15.54 15.54 15.54 99.70% Amr::coarseTimeStep() 54 15.54 15.54 15.54 99.70% Amr::timeStep() 54 15.46 15.47 15.48 99.30% REG::R::Nyx::advance::STEP1 54 15.16 15.22 15.37 98.59% REG::R::Nyx::advance_hydro_plus_particles 54 15.16 15.22 15.37 98.59% Nyx::advance_hydro_plus_particles() 54 15.16 15.22 15.37 98.59% just_the_hydro 54 14.19 14.25 14.27 91.54% Nyx::strang_hydro() 54 14.19 14.25 14.27 91.54% Nyx::update_state_with_sources() 54 0.0545 10.71 14.27 91.52% Nyx::enforce_minimum_density() 54 0.003566 10.7 14.27 91.52% MultiFab::min() 54 0.002993 10.7 14.27 91.52% Nyx::advance_hydro_pc_umdrv() 54 4.951e-05 3.456 13.82 88.67% Nyx::umdrv() 216 0 3.419 13.67 87.72% Nyx::umeth() 216 0 3.358 13.43 86.17% solve_for_new_phi 54 0.7682 0.7888 0.7957 5.10% Gravity::solve_for_new_phi() 54 0.7681 0.7886 0.7956 5.10% Gravity::solve_for_phi() 54 0.7217 0.7757 0.7938 5.09% Gravity::solve_with_MLMG 108 0.7405 0.7424 0.7476 4.80% MLMG::solve() 108 0.7338 0.7372 0.7384 4.74% MLMG::oneIter() 378 0.06414 0.209 0.6396 4.10% MLMG::ResNormInf() 486 0.01909 0.466 0.6164 3.95% MLMG::mgVcycle() 378 0.04931 0.1913 0.6132 3.93% MLCellLinOp::smooth() 3118 0.03501 0.1441 0.4681 3.00% MLPoisson::Fsmooth() 12096 0.00696 0.09649 0.3645 2.34% Nyx::post_timestep() 54 0.1084 0.251 0.2986 1.92% Nyx::post_timestep()::redist 54 0.07167 0.2274 0.2794 1.79% numParticlesOutOfRange() 216 0.03256 0.2165 0.278 1.78% MLMG::mgVcycle_down::0 378 0.007522 0.06335 0.2302 1.48% MLMG::mgVcycle_up::0 378 0.00502 0.05929 0.2218 1.42% AmrLevel::FillPatch() 378 0.003467 0.05486 0.2088 1.34% FillPatchIterator::Initialize 378 0.002848 0.04561 0.1736 1.11% Nyx::strang_hydro()::old_tmp_patch 54 0.0009491 0.04224 0.166 1.07% vol_weight_sum 108 0.004511 0.1072 0.1415 0.91% MLCellLinOp::applyBC() 14511 0.0308 0.05673 0.1318 0.85% FabArray::FillBoundary() 14188 0.02178 0.04924 0.1298 0.83% FillBoundary_nowait() 14188 0.01076 0.03801 0.1187 0.76% Gravity::get_old_grav_vector() 162 0.003443 0.03193 0.1171 0.75% solve_for_old_phi 54 0.09243 0.09323 0.09543 0.61% Gravity::multilevel_solve_for_old_phi() 54 0.08888 0.09111 0.09192 0.59% Gravity::actual_multilevel_solve() 54 0.08416 0.08958 0.09148 0.59% Gravity::CorrectRhsUsingOffset() 54 0.004909 0.06295 0.08237 0.53% Nyx::computeNewDt() 54 0.06144 0.07224 0.07589 0.49% Nyx::est_time_step() 54 0.06043 0.07194 0.07582 0.49% ParticleContainer::AssignCellDensitySingleLevel() 108 0.00122 0.01944 0.07405 0.48% DarkMatterParticleContainer::moveKickDrift() 108 0.000126 0.0171 0.06803 0.44% MLCellLinOp::apply() 2307 0.007472 0.02264 0.06743 0.43% DarkMatterParticleContainer::moveKick() 54 7.228e-05 0.01619 0.06452 0.41% amrex::Copy() 1350 0.0007679 0.01567 0.0603 0.39% Nyx::srctoprim() 216 0 0.01405 0.05621 0.36% Gravity::get_new_grav_vector() 108 0.001641 0.01518 0.05563 0.36% FillPatchIterator::FillFromLevel0() 378 0.002042 0.01543 0.05542 0.36% FillPatchSingleLevel 378 0.001747 0.01508 0.05493 0.35% FabArray::setVal() 5036 0.0025 0.01551 0.05433 0.35% ParticleContainer::Redistribute_impl() 54 0.05369 0.05378 0.05393 0.35% FabArray::ParallelCopy() 378 0.001149 0.01435 0.05391 0.35% FabArray::ParallelCopy_nowait() 378 0.0006769 0.01379 0.0531 0.34% MLMG::addInterpCorrection() 1512 0.001088 0.0126 0.047 0.30% Nyx::particle_est_time_step() 54 0.04426 0.0443 0.04432 0.28% MLMG::mgVcycle_down::1 378 0.006862 0.01635 0.04423 0.28% NyxParticleContainer::estTimestep(lev) 54 0.04388 0.04405 0.04413 0.28% Gravity::AddParticlesToRhs() 54 0.0008393 0.01095 0.04117 0.26% MLMG:computeResOfCorrection() 1512 0.007908 0.01637 0.04115 0.26% MLCellLinOp::correctionResidual() 1512 0.007054 0.0154 0.03989 0.26% Gravity::AddParticlesToRhsML() 54 0.0009316 0.0107 0.03985 0.26% MLMG::mgVcycle_up::1 378 0.005027 0.01377 0.03953 0.25% Nyx::ctoprim() 216 0 0.009797 0.03919 0.25% ParticleContainer::AssignDensity() 54 0.00074 0.01021 0.03848 0.25% MLCellLinOp::solutionResidual() 486 0.002797 0.01155 0.03754 0.24% Redistribute_partition 54 7.478e-05 0.008842 0.03513 0.23% MLPoisson::Fapply() 2307 0.001028 0.009333 0.03415 0.22% Nyx::reset_internal_energy() 162 0.0001067 0.008228 0.03258 0.21% MLMG::prepareForSolve() 108 0.01908 0.0224 0.03199 0.21% MLMG::computeResidual() 378 0.002083 0.008556 0.02782 0.18% Nyx::reset_internal_energy_nostore() 108 0.0003745 0.0068 0.02605 0.17% FabArray::norminf() 1051 0.006725 0.01135 0.02518 0.16% amrex::average_down 1512 0.0009711 0.00681 0.02427 0.16% MLMG::mgVcycle_bottom 378 0.0004431 0.005837 0.02198 0.14% MLMG::actualBottomSolve() 378 0.0001892 0.005562 0.02166 0.14% Nyx::post_timestep()::sum_write 54 0.01857 0.019 0.02006 0.13% MLCGSolver::bicgstab 94 0 0.004612 0.01845 0.12% FabArray::sum() 580 0.0004921 0.00473 0.01742 0.11% MLMG::mgVcycle_down::2 378 0.006775 0.009489 0.01711 0.11% Nyx::post_timestep()::compute_temp 54 0.0003006 0.004278 0.01619 0.10% FabArray::Xpay() 1998 0.001035 0.004757 0.01589 0.10% MLMG::mgVcycle_up::2 378 0.005118 0.007439 0.01401 0.09% MLMG::mgVcycle_down::3 378 0.006667 0.008294 0.01268 0.08% Nyx::compute_new_temp() 162 0.0001353 0.002961 0.01142 0.07% Other 36990 0.03662 0.0649 0.1469 0.94% -------------------------------------------------------------------------------------------------------- END REGION R::Nyx::coarseTimeStep Unused ParmParse Variables: [TOP]::amr.probin_file(nvals = 1) :: [] Async Memory Usage: ------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ------------------------------------------------------------------------------------------------------------- Nyx::umeth() 32832 0 B 691 KiB 2766 KiB 0 B 1902 KiB 7608 KiB Nyx::advance_hydro_pc_umdrv() 4320 0 B 281 KiB 1126 KiB 0 B 318 KiB 1275 KiB Nyx::umdrv() 4320 0 B 182 KiB 728 KiB 0 B 208 KiB 832 KiB ------------------------------------------------------------------------------------------------------------- Pinned Memory Usage: -------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max -------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 4 1 B 1 B 2 B 8192 KiB 8192 KiB 8192 KiB -------------------------------------------------------------------------------------------------------------- Cpu Memory Usage: ------------------------------------------------------------------------------------------------------------------------ Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ------------------------------------------------------------------------------------------------------------------------ Nyx::umeth() 32832 0 B 691 KiB 2766 KiB 0 B 1902 KiB 7610 KiB Nyx::strang_hydro() 216 0 B 1364 KiB 5457 KiB 0 B 1634 KiB 6536 KiB Nyx::advance_hydro_plus_particles() 274 0 B 923 KiB 3694 KiB 0 B 1305 KiB 5221 KiB Nyx::strang_hydro()::old_tmp_patch 108 0 B 899 KiB 3598 KiB 0 B 1000 KiB 4000 KiB AmrLevel::writePlotFile() 1 0 B 555 B 2222 B 0 B 960 KiB 3840 KiB StateData::restartDoit() 4 0 B 918 KiB 3675 KiB 0 B 921 KiB 3685 KiB FillPatchIterator::Initialize 383 0 B 7018 B 27 KiB 0 B 750 KiB 3000 KiB solve_for_old_phi 162 0 B 236 KiB 945 KiB 0 B 474 KiB 1897 KiB Nyx::post_restart() 8 0 B 181 B 726 B 0 B 474 KiB 1897 KiB AmrLevel::derive() 5 0 B 28 B 115 B 0 B 448 KiB 1792 KiB MLMG::prepareForSolve() 2180 0 B 18 KiB 73 KiB 0 B 391 KiB 1567 KiB Nyx::advance_hydro_pc_umdrv() 4320 0 B 281 KiB 1126 KiB 0 B 318 KiB 1275 KiB Gravity::multilevel_solve_for_old_phi() 162 0 B 236 KiB 944 KiB 0 B 237 KiB 948 KiB Gravity::multilevel_solve_for_new_phi() 3 0 B 161 B 644 B 0 B 237 KiB 948 KiB Nyx::umdrv() 4320 0 B 182 KiB 728 KiB 0 B 208 KiB 832 KiB amrex::ParticleToMesh 2 0 B 3 B 14 B 0 B 128 KiB 512 KiB Gravity::actual_multilevel_solve() 110 0 B 554 B 2217 B 0 B 128 KiB 512 KiB Nyx::derive(mf) 3 0 B 13 B 52 B 0 B 128 KiB 512 KiB Nyx::reset_internal_energy_nostore() 108 0 B 203 B 815 B 0 B 125 KiB 500 KiB Gravity::AddParticlesToRhs() 54 0 B 282 B 1131 B 0 B 107 KiB 428 KiB ParticleContainer::AssignDensity() 57 0 B 254 B 1018 B 0 B 91 KiB 364 KiB ParticleContainer::BuildRedistributeMask 1 0 B 75 KiB 300 KiB 0 B 76 KiB 307 KiB Gravity::solve_for_new_phi() 54 0 B 3214 B 12 KiB 0 B 64 KiB 256 KiB FillBoundary_nowait() 2886 0 B 11 B 45 B 0 B 43 KiB 173 KiB BndryData::define() 12 0 B 34 KiB 138 KiB 0 B 34 KiB 139 KiB MLCellLinOp::defineAuxData() 60 0 B 25 KiB 100 KiB 0 B 25 KiB 100 KiB MLCGSolver::bicgstab 1890 0 B 0 B 1 B 0 B 448 B 1792 B MLMG::actualBottomSolve() 378 0 B 0 B 0 B 0 B 64 B 256 B MLCellLinOp::applyBC() 58052 0 B 0 B 0 B 256 B 256 B 256 B ------------------------------------------------------------------------------------------------------------------------ AMReX (26.04-109-g60df5ae33414) finalized