Initializing AMReX (26.06-8-g5bee7705813e)... MPI initialized with 1 MPI processes MPI initialized with thread support level 0 Initializing SUNDIALS with 1 threads... SUNDIALS initialized. AMReX (26.06-8-g5bee7705813e) initialized Successfully read inputs file ... AMReX git describe: 26.06-8-g5bee77058 Nyx git describe: 21.02.1-261-g8b5a29f3-dirty Integrating heating/cooling method with the following method: Vectorized CVODE Nyx::hydro_tile_size unset, using fabarray.mfiter_tile_size default: (1024000,8,8) Suggested default for currently compiled CPU / GPU: nyx.hydro_tile_size=(1024,16,16) Nyx::sundials_tile_size unset, using fabarray.mfiter_tile_size default: (1024000,8,8) Suggested default for currently compiled CPU / GPU: nyx.sundials_tile_size=(1024,16,16) Nyx::setting species concentrations to 0.76 and 0.24 in the hydro and in the EOS 0 Species: Successfully read inputs file ... Getting Gconst from nyx_constants: 4.300927161e-09 Using -5.404704468e-08 for 4 pi G in Gravity.cpp Initializing the data at level 0 ... setting particle_initrandom_mass to 2.653985961e+10 by dividing 8.696581196e+14 by 32768 Initializing DM particles from "32.nyx" ... Reading with 1 readers Redistributing after every 2097152 particles for each reader Total number of particles: 32768 Initializing Neutrino particles from "32.nyx" ... Reading with 1 readers Redistributing after every 2097152 particles for each reader Total number of particles: 32768 ... time and comoving a when data is initialized at level 0 0 0.009900990099 Average gas density 6294948659 Average dm density 3.14747433e+10 Average neutrino density 3.776969114e+10 Average total density 7.553938309e+10 Done initializing the level 0 data ...estdt from hydro at level 0: 0.0001023913166 ...estdt from particles at level 0: 5.732919201e-05 ...estdt from neutrinos at level 0: 5.732919201e-05 ...estdt after call to comoving : 2.676083073e-07 ...change in a is 0.9996324158 percent Nyx::est_time_step at level 0: estdt = 2.676083073e-07 Integrating a from time 0 by dt = 2.676083073e-07 Old / new A time 0 2.676083073e-07 Old / new A 0.009900990099 0.009999963606 Old / new z 100 99.00036395 Re-integrating a from time 0 by dt = 2.676083073e-07 Old / new A time 0 2.676083073e-07 Old / new A 0.009900990099 0.009999963606 Old / new z 100 99.00036395 Setting the current time in the state data to 0 BA SIZE 0 FLEV 0 Calling redistribute because the size of BoxArray changed Gravity ... defining average density in Gravity::set_mass_offset to be 7.553938309e+10 Gravity ... multilevel solve for new phi at base level 0 to finest level 0 ... subtracting average density 7.553938309e+10 from RHS at each level ... subtracting -1.27479434e-05 to ensure solvability Average gas density 6294948659 Average dm density 3.14747433e+10 Average neutrino density 3.776969114e+10 Average total density 7.553938309e+10 Average temperature 214.2287907 ... setting small_dens to 51.6247 ... setting small_temp to 0.01 ... setting small_pres to 0.006732869773 INITIAL GRIDS Level 0 1 grids 32768 cells 100 % of domain PLOTFILE: file = LyA_Neutrinos_plt00000 Output file LyA_Neutrinos_plt00000.temp at time 0.009901 and step 0 Write plotfile time = 0.013821985 seconds ...estdt from hydro at level 0: 0.0001023913166 ...estdt from particles at level 0: 5.732919201e-05 ...estdt from neutrinos at level 0: 5.732919201e-05 ...advancing from old_a_time rather than new_a_time! ...estdt after call to comoving : 2.676083073e-07 ...change in a is 0.9996324158 percent Nyx::est_time_step at level 0: estdt = 2.676083073e-07 Re-integrating a from time 0 by dt = 2.676083073e-07 Old / new A time 0 2.676083073e-07 Old / new A 0.009900990099 0.009999963606 Old / new z 100 99.00036395 Re-integrating a from time 0 by dt = 2.676083073e-07 Old / new A time 0 2.676083073e-07 Old / new A 0.009900990099 0.009999963606 Old / new z 100 99.00036395 [Level 0 step 1] ADVANCE at time 0 with dt = 2.676083073e-07 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 7.553938309e+10 from RHS at each level ... subtracting -1.27479434e-05 to ensure solvability moveKickDrift ... updating particle positions and velocity STARTING SDC_ITER LOOP 0 ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... ... Solving heating-cooling with SDC and CVode Nyx::sdc_reactions() time = 0.10405321 Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 7.553938309e+10 ... subtracting -1.273304224e-05 to ensure solvability moveKick ... updating velocity only [Level 0 step 1] Advanced 32768 cells [STEP 1] Coarse TimeStep time: 0.435144955 [STEP 1] FAB kilobyte spread across MPI nodes: [30364 ... 30364] STEP = 1 TIME = 2.676083073e-07 DT = 2.676083073e-07 ...estdt from hydro at level 0: 0.0001015989185 ...estdt from particles at level 0: 5.690884694e-05 ...estdt from neutrinos at level 0: 5.690884694e-05 ...estdt after call to comoving : 2.71630956e-07 ...change in a is 0.9996324134 percent Nyx::est_time_step at level 0: estdt = 2.71630956e-07 Integrating a from time 2.676083073e-07 by dt = 2.71630956e-07 Old / new A time 2.676083073e-07 5.392392633e-07 Old / new A 0.009999963606 0.01009992648 Old / new z 99.00036395 98.01062168 [Level 0 step 2] ADVANCE at time 2.676083073e-07 with dt = 2.71630956e-07 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 7.553938309e+10 from RHS at each level ... subtracting -1.262128353e-05 to ensure solvability moveKickDrift ... updating particle positions and velocity STARTING SDC_ITER LOOP 0 ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... ... Solving heating-cooling with SDC and CVode Nyx::sdc_reactions() time = 0.104868491 Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 7.553938309e+10 ... subtracting -1.26734376e-05 to ensure solvability moveKick ... updating velocity only [Level 0 step 2] Advanced 32768 cells [STEP 2] Coarse TimeStep time: 0.427623297 [STEP 2] FAB kilobyte spread across MPI nodes: [30978 ... 30978] STEP = 2 TIME = 5.392392633e-07 DT = 2.71630956e-07 ...estdt from hydro at level 0: 0.0001008463241 ...estdt from particles at level 0: 5.650951544e-05 ...estdt from neutrinos at level 0: 5.650951544e-05 ...estdt after call to comoving : 2.757140723e-07 ...change in a is 0.9996324109 percent Nyx::est_time_step at level 0: estdt = 2.757140723e-07 Integrating a from time 5.392392633e-07 by dt = 2.757140723e-07 Old / new A time 5.392392633e-07 8.149533356e-07 Old / new A 0.01009992648 0.01020088862 Old / new z 98.01062168 97.03067528 [Level 0 step 3] ADVANCE at time 5.392392633e-07 with dt = 2.757140723e-07 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 7.553938309e+10 from RHS at each level ... subtracting -1.285225153e-05 to ensure solvability moveKickDrift ... updating particle positions and velocity STARTING SDC_ITER LOOP 0 ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... ... Solving heating-cooling with SDC and CVode Nyx::sdc_reactions() time = 0.103413287 Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 7.553938309e+10 ... subtracting -1.256167889e-05 to ensure solvability moveKick ... updating velocity only [Level 0 step 3] Advanced 32768 cells [STEP 3] Coarse TimeStep time: 0.419994206 [STEP 3] FAB kilobyte spread across MPI nodes: [30978 ... 30978] STEP = 3 TIME = 8.149533356e-07 DT = 2.757140723e-07 ...estdt from hydro at level 0: 0.0001001310929 ...estdt from particles at level 0: 5.612993074e-05 ...estdt from neutrinos at level 0: 5.612993074e-05 ...estdt after call to comoving : 2.798585649e-07 ...change in a is 0.9996324083 percent Nyx::est_time_step at level 0: estdt = 2.798585649e-07 Integrating a from time 8.149533356e-07 by dt = 2.798585649e-07 Old / new A time 8.149533356e-07 1.094811901e-06 Old / new A 0.01020088862 0.01030286001 Old / new z 97.03067528 96.06042778 [Level 0 step 4] ADVANCE at time 8.149533356e-07 with dt = 2.798585649e-07 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 7.553938309e+10 from RHS at each level ... subtracting -1.257658005e-05 to ensure solvability moveKickDrift ... updating particle positions and velocity STARTING SDC_ITER LOOP 0 ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... ... Solving heating-cooling with SDC and CVode Nyx::sdc_reactions() time = 0.104775159 Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 7.553938309e+10 ... subtracting -1.281499863e-05 to ensure solvability moveKick ... updating velocity only [Level 0 step 4] Advanced 32768 cells [STEP 4] Coarse TimeStep time: 0.428659723 [STEP 4] FAB kilobyte spread across MPI nodes: [30978 ... 30978] STEP = 4 TIME = 1.094811901e-06 DT = 2.798585649e-07 ...estdt from hydro at level 0: 9.945097053e-05 ...estdt from particles at level 0: 5.576890888e-05 ...estdt from neutrinos at level 0: 5.576890888e-05 ...estdt after call to comoving : 2.840653566e-07 ...change in a is 0.9996324057 percent Nyx::est_time_step at level 0: estdt = 2.840653566e-07 Integrating a from time 1.094811901e-06 by dt = 2.840653566e-07 Old / new A time 1.094811901e-06 1.378877257e-06 Old / new A 0.01030286001 0.01040585074 Old / new z 96.06042778 95.09978321 [Level 0 step 5] ADVANCE at time 1.094811901e-06 with dt = 2.840653566e-07 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 7.553938309e+10 from RHS at each level ... subtracting -1.272559166e-05 to ensure solvability moveKickDrift ... updating particle positions and velocity STARTING SDC_ITER LOOP 0 ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... ... Solving heating-cooling with SDC and CVode Nyx::sdc_reactions() time = 0.104710594 Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 7.553938309e+10 ... subtracting -1.27479434e-05 to ensure solvability moveKick ... updating velocity only [Level 0 step 5] Advanced 32768 cells [STEP 5] Coarse TimeStep time: 0.421845183 [STEP 5] FAB kilobyte spread across MPI nodes: [30978 ... 30978] STEP = 5 TIME = 1.378877257e-06 DT = 2.840653566e-07 ...estdt from hydro at level 0: 9.880387578e-05 ...estdt from particles at level 0: 5.542536387e-05 ...estdt from neutrinos at level 0: 5.542536387e-05 ...estdt after call to comoving : 2.883353837e-07 ...change in a is 0.999632403 percent Nyx::est_time_step at level 0: estdt = 2.883353837e-07 Integrating a from time 1.378877257e-06 by dt = 2.883353837e-07 Old / new A time 1.378877257e-06 1.667212641e-06 Old / new A 0.01040585074 0.01050987099 Old / new z 95.09978321 94.14864651 [Level 0 step 6] ADVANCE at time 1.378877257e-06 with dt = 2.883353837e-07 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 7.553938309e+10 from RHS at each level ... subtracting -1.26734376e-05 to ensure solvability moveKickDrift ... updating particle positions and velocity STARTING SDC_ITER LOOP 0 ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... ... Solving heating-cooling with SDC and CVode Nyx::sdc_reactions() time = 0.105336445 Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 7.553938309e+10 ... subtracting -1.261383295e-05 to ensure solvability moveKick ... updating velocity only [Level 0 step 6] Advanced 32768 cells [STEP 6] Coarse TimeStep time: 0.429468215 [STEP 6] FAB kilobyte spread across MPI nodes: [30978 ... 30978] STEP = 6 TIME = 1.667212641e-06 DT = 2.883353837e-07 ...estdt from hydro at level 0: 9.818787984e-05 ...estdt from particles at level 0: 5.509828101e-05 ...estdt from neutrinos at level 0: 5.509828101e-05 ...estdt after call to comoving : 2.926695968e-07 ...change in a is 0.9996324002 percent Nyx::est_time_step at level 0: estdt = 2.926695968e-07 Integrating a from time 1.667212641e-06 by dt = 2.926695968e-07 Old / new A time 1.667212641e-06 1.959882238e-06 Old / new A 0.01050987099 0.01061493107 Old / new z 94.14864651 93.20692358 [Level 0 step 7] ADVANCE at time 1.667212641e-06 with dt = 2.926695968e-07 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 7.553938309e+10 from RHS at each level ... subtracting -1.281499863e-05 to ensure solvability moveKickDrift ... updating particle positions and velocity STARTING SDC_ITER LOOP 0 ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... ... Solving heating-cooling with SDC and CVode Nyx::sdc_reactions() time = 0.105203428 Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 7.553938309e+10 ... subtracting -1.355260611e-05 to ensure solvability moveKick ... updating velocity only [Level 0 step 7] Advanced 32768 cells [STEP 7] Coarse TimeStep time: 0.422569455 [STEP 7] FAB kilobyte spread across MPI nodes: [30978 ... 30978] STEP = 7 TIME = 1.959882238e-06 DT = 2.926695968e-07 ...estdt from hydro at level 0: 9.760119277e-05 ...estdt from particles at level 0: 5.478672374e-05 ...estdt from neutrinos at level 0: 5.478672374e-05 ...estdt after call to comoving : 2.970689606e-07 ...change in a is 0.9996323973 percent Nyx::est_time_step at level 0: estdt = 2.970689606e-07 Integrating a from time 1.959882238e-06 by dt = 2.970689606e-07 Old / new A time 1.959882238e-06 2.256951198e-06 Old / new A 0.01061493107 0.01072104136 Old / new z 93.20692358 92.27452124 [Level 0 step 8] ADVANCE at time 1.959882238e-06 with dt = 2.970689606e-07 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 7.553938309e+10 from RHS at each level ... subtracting -1.349300146e-05 to ensure solvability moveKickDrift ... updating particle positions and velocity STARTING SDC_ITER LOOP 0 ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... ... Solving heating-cooling with SDC and CVode Nyx::sdc_reactions() time = 0.103972562 Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 7.553938309e+10 ... subtracting -1.242011786e-05 to ensure solvability moveKick ... updating velocity only [Level 0 step 8] Advanced 32768 cells [STEP 8] Coarse TimeStep time: 0.4213935 [STEP 8] FAB kilobyte spread across MPI nodes: [30978 ... 30978] STEP = 8 TIME = 2.256951198e-06 DT = 2.970689606e-07 ...estdt from hydro at level 0: 9.70421515e-05 ...estdt from particles at level 0: 5.448982672e-05 ...estdt from neutrinos at level 0: 5.448982672e-05 ...estdt after call to comoving : 3.015344545e-07 ...change in a is 0.9996323943 percent Nyx::est_time_step at level 0: estdt = 3.015344545e-07 Integrating a from time 2.256951198e-06 by dt = 3.015344545e-07 Old / new A time 2.256951198e-06 2.558485653e-06 Old / new A 0.01072104136 0.01082821236 Old / new z 92.27452124 91.35134726 [Level 0 step 9] ADVANCE at time 2.256951198e-06 with dt = 3.015344545e-07 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 7.553938309e+10 from RHS at each level ... subtracting -1.240521669e-05 to ensure solvability moveKickDrift ... updating particle positions and velocity STARTING SDC_ITER LOOP 0 ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... ... Solving heating-cooling with SDC and CVode Nyx::sdc_reactions() time = 0.103096842 Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 7.553938309e+10 ... subtracting -1.295655966e-05 to ensure solvability moveKick ... updating velocity only [Level 0 step 9] Advanced 32768 cells [STEP 9] Coarse TimeStep time: 0.419485932 [STEP 9] FAB kilobyte spread across MPI nodes: [30978 ... 30978] STEP = 9 TIME = 2.558485653e-06 DT = 3.015344545e-07 ...estdt from hydro at level 0: 9.650921021e-05 ...estdt from particles at level 0: 5.420676485e-05 ...estdt from neutrinos at level 0: 5.420676485e-05 ...estdt after call to comoving : 3.060670725e-07 ...change in a is 0.9996323912 percent Nyx::est_time_step at level 0: estdt = 3.060670725e-07 Integrating a from time 2.558485653e-06 by dt = 3.060670725e-07 Old / new A time 2.558485653e-06 2.864552725e-06 Old / new A 0.01082821236 0.01093645468 Old / new z 91.35134726 90.43731029 [Level 0 step 10] ADVANCE at time 2.558485653e-06 with dt = 3.060670725e-07 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 7.553938309e+10 from RHS at each level ... subtracting -1.266598701e-05 to ensure solvability moveKickDrift ... updating particle positions and velocity STARTING SDC_ITER LOOP 0 ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... ... Solving heating-cooling with SDC and CVode Nyx::sdc_reactions() time = 0.106150488 Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 7.553938309e+10 ... subtracting -1.199543476e-05 to ensure solvability moveKick ... updating velocity only [Level 0 step 10] Advanced 32768 cells [STEP 10] Coarse TimeStep time: 0.423666675 [STEP 10] FAB kilobyte spread across MPI nodes: [30978 ... 30978] STEP = 10 TIME = 2.864552725e-06 DT = 3.060670725e-07 Time w/o init: 4.2502003 PLOTFILE: file = LyA_Neutrinos_plt00010 Output file LyA_Neutrinos_plt00010.temp at time 0.010936 and step 10 Write plotfile time = 0.009241687 seconds Run time = 4.347162285 TinyProfiler total time across processes [min...avg...max]: 4.347 ... 4.347 ... 4.347 -------------------------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------------------------- Nyx::umeth() 160 2.451 2.451 2.451 56.39% Nyx::reactions_f 1440 0.9259 0.9259 0.9259 21.30% Nyx::compute_new_temp() 42 0.3052 0.3052 0.3052 7.02% Nyx::reactions_cells_finalize 160 0.0901 0.0901 0.0901 2.07% MLPoisson::Fsmooth() 3104 0.08456 0.08456 0.08456 1.95% Nyx::umdrv() 160 0.04436 0.04436 0.04436 1.02% ParticleContainer::AssignCellDensitySingleLevel() 49 0.0336 0.0336 0.0336 0.77% FillBoundary_nowait() 3783 0.02935 0.02935 0.02935 0.68% DarkMatterParticleContainer::moveKickDrift() 40 0.0248 0.0248 0.0248 0.57% DarkMatterParticleContainer::moveKick() 20 0.02024 0.02024 0.02024 0.47% Nyx::reactions_cvode 160 0.01986 0.01986 0.01986 0.46% numParticlesOutOfRange() 108 0.01635 0.01635 0.01635 0.38% NyxParticleContainer::estTimestep(lev) 22 0.01626 0.01626 0.01626 0.37% Redistribute_partition 24 0.01473 0.01473 0.01473 0.34% amrex::Copy() 636 0.01318 0.01318 0.01318 0.30% ParticleContainer::InitFromBinaryFile() 2 0.01291 0.01291 0.01291 0.30% FabArray::ParallelCopy_nowait() 95 0.01254 0.01254 0.01254 0.29% FabArray::setVal() 1370 0.01248 0.01248 0.01248 0.29% MLCellLinOp::applyBC() 3897 0.01174 0.01174 0.01174 0.27% MLMG::addInterpCorrection() 388 0.0114 0.0114 0.0114 0.26% Nyx::srctoprim() 160 0.01035 0.01035 0.01035 0.24% FillPatchIterator::Initialize 91 0.009882 0.009882 0.009882 0.23% Nyx::advance_hydro_pc_umdrv() 10 0.009367 0.009367 0.009367 0.22% Nyx::sdc_hydro() 10 0.008647 0.008647 0.008647 0.20% Nyx::update_state_with_sources() 10 0.008597 0.008597 0.008597 0.20% MLPoisson::Fapply() 772 0.008109 0.008109 0.008109 0.19% Nyx::ctoprim() 160 0.007667 0.007667 0.007667 0.18% VisMF::Write(FabArray) 2 0.006944 0.006944 0.006944 0.16% Nyx::advance_hydro_plus_particles() 10 0.006426 0.006426 0.006426 0.15% Nyx::reset_internal_energy() 41 0.006164 0.006164 0.006164 0.14% Nyx::reactions_cells_initialize 160 0.005933 0.005933 0.005933 0.14% amrex::average_down 388 0.005902 0.005902 0.005902 0.14% FabArray::norminf() 513 0.005795 0.005795 0.005795 0.13% Nyx::compute_rho_temp()::OnHost 11 0.004516 0.004516 0.004516 0.10% Amr::InitAmr() 1 0.004056 0.004056 0.004056 0.09% FabArray::sum() 215 0.004029 0.004029 0.004029 0.09% FabArray::Xpay() 506 0.003911 0.003911 0.003911 0.09% ParticleContainer::BuildRedistributeMask 20 0.003737 0.003737 0.003737 0.09% amrex::Add() 172 0.003405 0.003405 0.003405 0.08% ParticleContainer::WriteParticles() 4 0.003224 0.003224 0.003224 0.07% MLMG::prepareForSolve() 21 0.003121 0.003121 0.003121 0.07% StateData::define() 5 0.003072 0.003072 0.003072 0.07% MLCellLinOp::defineAuxData() 21 0.002979 0.002979 0.002979 0.07% Nyx::est_time_step() 11 0.002846 0.002846 0.002846 0.07% FabArray::FillBoundary() 3755 0.002497 0.002497 0.002497 0.06% AmrLevel::writePlotFile() 2 0.002192 0.002192 0.002192 0.05% Gravity::get_old_grav_vector() 30 0.001999 0.001999 0.001999 0.05% FabArrayBase::CPC::define() 279 0.001982 0.001982 0.001982 0.05% Nyx::init_santa_barbara()::init 1 0.001857 0.001857 0.001857 0.04% WriteBinaryParticleData() 4 0.001798 0.001798 0.001798 0.04% Gravity::solve_with_MLMG 21 0.00176 0.00176 0.00176 0.04% FabArrayBase::getFB() 3783 0.00166 0.00166 0.00166 0.04% Gravity::get_new_grav_vector() 21 0.001361 0.001361 0.001361 0.03% MLCellLinOp::smooth() 873 0.001219 0.001219 0.001219 0.03% Amr::writePlotFile() 2 0.001066 0.001066 0.001066 0.02% MLCGSolver::bicgstab 97 0.001064 0.001064 0.001064 0.02% Gravity::multilevel_solve_for_old_phi() 10 0.0009008 0.0009008 0.0009008 0.02% FabArrayBase::getCPC() 849 0.000836 0.000836 0.000836 0.02% Gravity::actual_multilevel_solve() 11 0.0007478 0.0007478 0.0007478 0.02% solve_for_old_phi 10 0.0007442 0.0007442 0.0007442 0.02% ParticleContainer::AssignDensity() 29 0.0006948 0.0006948 0.0006948 0.02% AmrLevel::derive() 8 0.0005698 0.0005698 0.0005698 0.01% MLCellLinOp::apply() 772 0.0005438 0.0005438 0.0005438 0.01% Nyx::reset_internal_energy_nostore() 20 0.0005363 0.0005363 0.0005363 0.01% main() 1 0.0005249 0.0005249 0.0005249 0.01% Gravity::AddParticlesToRhs() 10 0.0004861 0.0004861 0.0004861 0.01% Gravity::solve_for_new_phi() 10 0.0004711 0.0004711 0.0004711 0.01% Nyx::post_timestep()::sum_write 10 0.0004389 0.0004389 0.0004389 0.01% MLMG::actualBottomSolve() 97 0.000431 0.000431 0.000431 0.01% AmrLevel::FillPatch() 91 0.0003414 0.0003414 0.0003414 0.01% Nyx::integrate_state_struct_mfin 160 0.000314 0.000314 0.000314 0.01% Nyx::sdc_reactions() 10 0.0003017 0.0003017 0.0003017 0.01% MLCellLinOp::correctionResidual() 388 0.0002956 0.0002956 0.0002956 0.01% MLMG:computeResOfCorrection() 388 0.0002772 0.0002772 0.0002772 0.01% Amr::coarseTimeStep() 10 0.0002551 0.0002551 0.0002551 0.01% MLMG::mgVcycle() 97 0.000219 0.000219 0.000219 0.01% Amr::timeStep() 10 0.0001973 0.0001973 0.0001973 0.00% MLMG::oneIter() 97 0.0001815 0.0001815 0.0001815 0.00% Nyx::post_init() 1 0.0001506 0.0001506 0.0001506 0.00% Nyx::post_timestep() 10 0.0001435 0.0001435 0.0001435 0.00% ParticleContainer::Redistribute_impl() 24 0.0001315 0.0001315 0.0001315 0.00% MLMG::mgVcycle_down::1 97 0.0001254 0.0001254 0.0001254 0.00% MLCellLinOp::solutionResidual() 118 0.0001253 0.0001253 0.0001253 0.00% MLMG::solve() 21 0.0001246 0.0001246 0.0001246 0.00% MLMG::ResNormInf() 118 0.0001234 0.0001234 0.0001234 0.00% MLMG::mgVcycle_down::0 97 0.0001192 0.0001192 0.0001192 0.00% Nyx::particle_est_time_step() 11 0.0001179 0.0001179 0.0001179 0.00% FillPatchSingleLevel 91 0.0001141 0.0001141 0.0001141 0.00% Nyx::computeNewDt() 9 0.0001134 0.0001134 0.0001134 0.00% FillPatchIterator::FillFromLevel0() 91 0.0001123 0.0001123 0.0001123 0.00% MLMG::computeResidual() 97 0.0001114 0.0001114 0.0001114 0.00% FabArray::ParallelCopy() 95 0.0001075 0.0001075 0.0001075 0.00% Nyx::init_santa_barbara() 1 0.0001033 0.0001033 0.0001033 0.00% Nyx::init_particles() 1 9.642e-05 9.642e-05 9.642e-05 0.00% MLMG::mgVcycle_down::2 97 9.602e-05 9.602e-05 9.602e-05 0.00% Nyx::derive(mf) 8 9.551e-05 9.551e-05 9.551e-05 0.00% MLMG::mgVcycle_down::3 97 9.528e-05 9.528e-05 9.528e-05 0.00% MLMG::mgVcycle_up::0 97 9.401e-05 9.401e-05 9.401e-05 0.00% MLMG::mgVcycle_up::3 97 8.922e-05 8.922e-05 8.922e-05 0.00% MLMG::mgVcycle_up::1 97 8.693e-05 8.693e-05 8.693e-05 0.00% MLMG::mgVcycle_up::2 97 8.522e-05 8.522e-05 8.522e-05 0.00% MLMG::mgVcycle_bottom 97 8.448e-05 8.448e-05 8.448e-05 0.00% Gravity::solve_for_phi() 10 7.76e-05 7.76e-05 7.76e-05 0.00% Gravity::AddParticlesToRhsML() 11 6.615e-05 6.615e-05 6.615e-05 0.00% MLPoisson::define() 21 6.324e-05 6.324e-05 6.324e-05 0.00% FabArray::SumBoundary() 49 6.218e-05 6.218e-05 6.218e-05 0.00% FabArray::SumBoundary_nowait() 49 5.165e-05 5.165e-05 5.165e-05 0.00% Gravity::multilevel_solve_for_new_phi() 1 5.157e-05 5.157e-05 5.157e-05 0.00% solve_for_new_phi 10 5.029e-05 5.029e-05 5.029e-05 0.00% Nyx::initData() 1 4.772e-05 4.772e-05 4.772e-05 0.00% Nyx::computeInitialDt() 2 4.572e-05 4.572e-05 4.572e-05 0.00% Nyx::initial_time_step() 2 4.459e-05 4.459e-05 4.459e-05 0.00% Amr::defBaseLevel() 1 3.987e-05 3.987e-05 3.987e-05 0.00% MLMG::computeMLResidual() 21 3.332e-05 3.332e-05 3.332e-05 0.00% Nyx::post_timestep()::redist 10 3.172e-05 3.172e-05 3.172e-05 0.00% sdc_reactions 10 2.945e-05 2.945e-05 2.945e-05 0.00% REG::R::Nyx::advance::STEP1 10 2.937e-05 2.937e-05 2.937e-05 0.00% Amr::FinalizeInit() 1 2.813e-05 2.813e-05 2.813e-05 0.00% just_the_hydro 10 2.81e-05 2.81e-05 2.81e-05 0.00% REG::R::Nyx::coarseTimeStep 1 2.79e-05 2.79e-05 2.79e-05 0.00% Nyx::compute_rho_temp() 11 1.831e-05 1.831e-05 1.831e-05 0.00% Nyx::post_timestep()::compute_temp 10 1.305e-05 1.305e-05 1.305e-05 0.00% REG::R::Nyx::advance_hydro_plus_particles 10 1.285e-05 1.285e-05 1.285e-05 0.00% AmrLevel::AmrLevel(dm) 1 1.223e-05 1.223e-05 1.223e-05 0.00% Amr::InitializeInit() 1 1.162e-05 1.162e-05 1.162e-05 0.00% NyxParticleContainer::WriteNyxPlotFile() 4 6.854e-06 6.854e-06 6.854e-06 0.00% ParticleContainer::OK() 8 5.15e-06 5.15e-06 5.15e-06 0.00% ParticleContainer::Increment 2 2.379e-06 2.379e-06 2.379e-06 0.00% Amr::init() 1 1.643e-06 1.643e-06 1.643e-06 0.00% Amr::initialInit() 1 1.115e-06 1.115e-06 1.115e-06 0.00% Other 8636 0.02326 0.02326 0.02326 0.53% -------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------------------------- main() 1 4.347 4.347 4.347 100.00% REG::R::Nyx::coarseTimeStep 1 4.25 4.25 4.25 97.77% Amr::coarseTimeStep() 10 4.25 4.25 4.25 97.77% Amr::timeStep() 10 4.232 4.232 4.232 97.35% REG::R::Nyx::advance::STEP1 10 4.051 4.051 4.051 93.18% REG::R::Nyx::advance_hydro_plus_particles 10 4.051 4.051 4.051 93.18% Nyx::advance_hydro_plus_particles() 10 4.051 4.051 4.051 93.18% just_the_hydro 10 3.697 3.697 3.697 85.04% Nyx::sdc_hydro() 10 3.697 3.697 3.697 85.04% Nyx::advance_hydro_pc_umdrv() 10 2.523 2.523 2.523 58.04% Nyx::umdrv() 160 2.496 2.496 2.496 57.41% Nyx::umeth() 160 2.451 2.451 2.451 56.39% sdc_reactions 10 1.12 1.12 1.12 25.77% Nyx::sdc_reactions() 10 1.12 1.12 1.12 25.77% Nyx::integrate_state_struct_mfin 160 1.045 1.045 1.045 24.05% Nyx::reactions_cvode 160 0.9458 0.9458 0.9458 21.76% Nyx::reactions_f 1440 0.9259 0.9259 0.9259 21.30% Nyx::compute_new_temp() 42 0.3052 0.3052 0.3052 7.02% Gravity::solve_with_MLMG 21 0.1844 0.1844 0.1844 4.24% Nyx::post_timestep() 10 0.1809 0.1809 0.1809 4.16% MLMG::solve() 21 0.1713 0.1713 0.1713 3.94% solve_for_new_phi 10 0.1626 0.1626 0.1626 3.74% Gravity::solve_for_new_phi() 10 0.1625 0.1625 0.1625 3.74% MLMG::oneIter() 97 0.151 0.151 0.151 3.47% MLMG::mgVcycle() 97 0.1448 0.1448 0.1448 3.33% Gravity::solve_for_phi() 10 0.1445 0.1445 0.1445 3.32% MLCellLinOp::smooth() 873 0.1099 0.1099 0.1099 2.53% Nyx::reactions_cells_finalize 160 0.0901 0.0901 0.0901 2.07% MLPoisson::Fsmooth() 3104 0.08456 0.08456 0.08456 1.95% Amr::init() 1 0.08247 0.08247 0.08247 1.90% Nyx::post_timestep()::sum_write 10 0.07842 0.07842 0.07842 1.80% Nyx::post_timestep()::compute_temp 10 0.07414 0.07414 0.07414 1.71% Amr::initialInit() 1 0.06859 0.06859 0.06859 1.58% Gravity::actual_multilevel_solve() 11 0.06066 0.06066 0.06066 1.40% MLMG::mgVcycle_down::0 97 0.05425 0.05425 0.05425 1.25% MLMG::mgVcycle_up::0 97 0.05228 0.05228 0.05228 1.20% solve_for_old_phi 10 0.04258 0.04258 0.04258 0.98% Amr::FinalizeInit() 1 0.04151 0.04151 0.04151 0.95% Gravity::multilevel_solve_for_old_phi() 10 0.04132 0.04132 0.04132 0.95% Nyx::post_init() 1 0.03807 0.03807 0.03807 0.88% ParticleContainer::AssignCellDensitySingleLevel() 49 0.03796 0.03796 0.03796 0.87% FabArray::FillBoundary() 3755 0.03275 0.03275 0.03275 0.75% MLCellLinOp::applyBC() 3897 0.03176 0.03176 0.03176 0.73% FillBoundary_nowait() 3783 0.03144 0.03144 0.03144 0.72% AmrLevel::FillPatch() 91 0.03039 0.03039 0.03039 0.70% Nyx::post_timestep()::redist 10 0.02806 0.02806 0.02806 0.65% Amr::InitializeInit() 1 0.02708 0.02708 0.02708 0.62% Amr::defBaseLevel() 1 0.02707 0.02707 0.02707 0.62% ParticleContainer::Redistribute_impl() 24 0.02596 0.02596 0.02596 0.60% DarkMatterParticleContainer::moveKickDrift() 40 0.0248 0.0248 0.0248 0.57% FillPatchIterator::Initialize 91 0.02321 0.02321 0.02321 0.53% Amr::writePlotFile() 2 0.02316 0.02316 0.02316 0.53% ParticleContainer::AssignDensity() 29 0.02261 0.02261 0.02261 0.52% Nyx::initData() 1 0.02206 0.02206 0.02206 0.51% Gravity::multilevel_solve_for_new_phi() 1 0.02029 0.02029 0.02029 0.47% DarkMatterParticleContainer::moveKick() 20 0.02024 0.02024 0.02024 0.47% Nyx::est_time_step() 11 0.01923 0.01923 0.01923 0.44% Gravity::get_old_grav_vector() 30 0.01761 0.01761 0.01761 0.41% Gravity::AddParticlesToRhs() 10 0.01729 0.01729 0.01729 0.40% Gravity::AddParticlesToRhsML() 11 0.01706 0.01706 0.01706 0.39% Nyx::particle_est_time_step() 11 0.01638 0.01638 0.01638 0.38% numParticlesOutOfRange() 108 0.01635 0.01635 0.01635 0.38% NyxParticleContainer::estTimestep(lev) 22 0.01626 0.01626 0.01626 0.37% Nyx::init_particles() 1 0.01617 0.01617 0.01617 0.37% ParticleContainer::InitFromBinaryFile() 2 0.01607 0.01607 0.01607 0.37% Nyx::computeNewDt() 9 0.01598 0.01598 0.01598 0.37% MLCellLinOp::apply() 772 0.01585 0.01585 0.01585 0.36% AmrLevel::writePlotFile() 2 0.01573 0.01573 0.01573 0.36% Redistribute_partition 24 0.01473 0.01473 0.01473 0.34% amrex::Copy() 636 0.01318 0.01318 0.01318 0.30% FillPatchIterator::FillFromLevel0() 91 0.01318 0.01318 0.01318 0.30% FillPatchSingleLevel 91 0.01307 0.01307 0.01307 0.30% FabArray::ParallelCopy() 95 0.01291 0.01291 0.01291 0.30% FabArray::ParallelCopy_nowait() 95 0.01272 0.01272 0.01272 0.29% FabArray::setVal() 1370 0.01248 0.01248 0.01248 0.29% MLMG::addInterpCorrection() 388 0.0114 0.0114 0.0114 0.26% Gravity::get_new_grav_vector() 21 0.01059 0.01059 0.01059 0.24% MLMG::mgVcycle_down::1 97 0.01049 0.01049 0.01049 0.24% Nyx::srctoprim() 160 0.01035 0.01035 0.01035 0.24% MLMG:computeResOfCorrection() 388 0.01 0.01 0.01 0.23% MLCellLinOp::correctionResidual() 388 0.009727 0.009727 0.009727 0.22% MLMG::mgVcycle_up::1 97 0.009386 0.009386 0.009386 0.22% MLPoisson::define() 21 0.009378 0.009378 0.009378 0.22% Nyx::update_state_with_sources() 10 0.009255 0.009255 0.009255 0.21% MLCellLinOp::solutionResidual() 118 0.008708 0.008708 0.008708 0.20% MLPoisson::Fapply() 772 0.008109 0.008109 0.008109 0.19% Nyx::ctoprim() 160 0.007667 0.007667 0.007667 0.18% VisMF::Write(FabArray) 2 0.006944 0.006944 0.006944 0.16% MLMG::computeResidual() 97 0.006905 0.006905 0.006905 0.16% NyxParticleContainer::WriteNyxPlotFile() 4 0.006249 0.006249 0.006249 0.14% WriteBinaryParticleData() 4 0.006243 0.006243 0.006243 0.14% Nyx::reset_internal_energy() 41 0.006164 0.006164 0.006164 0.14% MLMG::prepareForSolve() 21 0.005989 0.005989 0.005989 0.14% Nyx::derive(mf) 8 0.00598 0.00598 0.00598 0.14% Nyx::reactions_cells_initialize 160 0.005933 0.005933 0.005933 0.14% amrex::average_down 388 0.005902 0.005902 0.005902 0.14% MLCellLinOp::defineAuxData() 21 0.005799 0.005799 0.005799 0.13% FabArray::norminf() 513 0.005795 0.005795 0.005795 0.13% MLMG::mgVcycle_bottom 97 0.004999 0.004999 0.004999 0.11% MLMG::actualBottomSolve() 97 0.004914 0.004914 0.004914 0.11% Amr::InitAmr() 1 0.004694 0.004694 0.004694 0.11% Nyx::compute_rho_temp() 11 0.004534 0.004534 0.004534 0.10% MLMG::ResNormInf() 118 0.004532 0.004532 0.004532 0.10% Nyx::compute_rho_temp()::OnHost 11 0.004516 0.004516 0.004516 0.10% MLCGSolver::bicgstab 97 0.004141 0.004141 0.004141 0.10% MLMG::mgVcycle_down::2 97 0.004072 0.004072 0.004072 0.09% FabArray::sum() 215 0.004029 0.004029 0.004029 0.09% FabArray::Xpay() 506 0.003911 0.003911 0.003911 0.09% ParticleContainer::BuildRedistributeMask 20 0.003812 0.003812 0.003812 0.09% Nyx::init_santa_barbara() 1 0.003784 0.003784 0.003784 0.09% Nyx::reset_internal_energy_nostore() 20 0.003734 0.003734 0.003734 0.09% Nyx::computeInitialDt() 2 0.003445 0.003445 0.003445 0.08% amrex::Add() 172 0.003405 0.003405 0.003405 0.08% Nyx::initial_time_step() 2 0.003399 0.003399 0.003399 0.08% MLMG::mgVcycle_up::2 97 0.003388 0.003388 0.003388 0.08% ParticleContainer::WriteParticles() 4 0.003224 0.003224 0.003224 0.07% MLMG::mgVcycle_down::3 97 0.003201 0.003201 0.003201 0.07% AmrLevel::AmrLevel(dm) 1 0.003084 0.003084 0.003084 0.07% StateData::define() 5 0.003072 0.003072 0.003072 0.07% FabArray::SumBoundary() 49 0.002855 0.002855 0.002855 0.07% FabArrayBase::getCPC() 849 0.002818 0.002818 0.002818 0.06% FabArray::SumBoundary_nowait() 49 0.002722 0.002722 0.002722 0.06% ParticleContainer::OK() 8 0.002573 0.002573 0.002573 0.06% MLMG::mgVcycle_up::3 97 0.002561 0.002561 0.002561 0.06% AmrLevel::derive() 8 0.002383 0.002383 0.002383 0.05% FabArrayBase::getFB() 3783 0.002087 0.002087 0.002087 0.05% ParticleContainer::Increment 2 0.002061 0.002061 0.002061 0.05% FabArrayBase::CPC::define() 279 0.001982 0.001982 0.001982 0.05% MLMG::computeMLResidual() 21 0.001947 0.001947 0.001947 0.04% Nyx::init_santa_barbara()::init 1 0.001921 0.001921 0.001921 0.04% Other 8636 0.04206 0.04206 0.04206 0.97% -------------------------------------------------------------------------------------------------------------- BEGIN REGION R::Nyx::advance::STEP1 -------------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------------- Nyx::umeth() 160 2.451 2.451 2.451 56.39% Nyx::reactions_f 1440 0.9259 0.9259 0.9259 21.30% Nyx::compute_new_temp() 20 0.1455 0.1455 0.1455 3.35% Nyx::reactions_cells_finalize 160 0.0901 0.0901 0.0901 2.07% MLPoisson::Fsmooth() 2752 0.07489 0.07489 0.07489 1.72% Nyx::umdrv() 160 0.04436 0.04436 0.04436 1.02% ParticleContainer::AssignCellDensitySingleLevel() 40 0.02734 0.02734 0.02734 0.63% FillBoundary_nowait() 3380 0.02729 0.02729 0.02729 0.63% DarkMatterParticleContainer::moveKickDrift() 40 0.0248 0.0248 0.0248 0.57% DarkMatterParticleContainer::moveKick() 20 0.02024 0.02024 0.02024 0.47% Nyx::reactions_cvode 160 0.01986 0.01986 0.01986 0.46% FabArray::ParallelCopy_nowait() 80 0.01194 0.01194 0.01194 0.27% amrex::Copy() 544 0.01186 0.01186 0.01186 0.27% FabArray::setVal() 1222 0.01118 0.01118 0.01118 0.26% MLCellLinOp::applyBC() 3464 0.01056 0.01056 0.01056 0.24% Nyx::srctoprim() 160 0.01035 0.01035 0.01035 0.24% MLMG::addInterpCorrection() 344 0.01011 0.01011 0.01011 0.23% Nyx::advance_hydro_pc_umdrv() 10 0.009367 0.009367 0.009367 0.22% FillPatchIterator::Initialize 80 0.008945 0.008945 0.008945 0.21% Nyx::sdc_hydro() 10 0.008647 0.008647 0.008647 0.20% Nyx::update_state_with_sources() 10 0.008597 0.008597 0.008597 0.20% Nyx::ctoprim() 160 0.007667 0.007667 0.007667 0.18% MLPoisson::Fapply() 692 0.007293 0.007293 0.007293 0.17% Nyx::advance_hydro_plus_particles() 10 0.006426 0.006426 0.006426 0.15% Nyx::reactions_cells_initialize 160 0.005933 0.005933 0.005933 0.14% amrex::average_down 344 0.005254 0.005254 0.005254 0.12% FabArray::norminf() 454 0.004905 0.004905 0.004905 0.11% Nyx::reset_internal_energy() 30 0.004571 0.004571 0.004571 0.11% FabArray::sum() 192 0.003628 0.003628 0.003628 0.08% FabArray::Xpay() 450 0.003519 0.003519 0.003519 0.08% amrex::Add() 156 0.003083 0.003083 0.003083 0.07% MLMG::prepareForSolve() 20 0.002994 0.002994 0.002994 0.07% MLCellLinOp::defineAuxData() 20 0.002839 0.002839 0.002839 0.07% FabArray::FillBoundary() 3360 0.002367 0.002367 0.002367 0.05% Gravity::get_old_grav_vector() 30 0.001999 0.001999 0.001999 0.05% Gravity::solve_with_MLMG 20 0.001731 0.001731 0.001731 0.04% Gravity::get_new_grav_vector() 20 0.001301 0.001301 0.001301 0.03% MLCellLinOp::smooth() 774 0.001128 0.001128 0.001128 0.03% MLCGSolver::bicgstab 86 0.0009607 0.0009607 0.0009607 0.02% Gravity::multilevel_solve_for_old_phi() 10 0.0009008 0.0009008 0.0009008 0.02% FabArrayBase::getCPC() 800 0.0008071 0.0008071 0.0008071 0.02% solve_for_old_phi 10 0.0007442 0.0007442 0.0007442 0.02% Gravity::actual_multilevel_solve() 10 0.0006763 0.0006763 0.0006763 0.02% MLCellLinOp::apply() 692 0.0005164 0.0005164 0.0005164 0.01% Gravity::AddParticlesToRhs() 10 0.0004861 0.0004861 0.0004861 0.01% Gravity::solve_for_new_phi() 10 0.0004711 0.0004711 0.0004711 0.01% ParticleContainer::AssignDensity() 20 0.0004204 0.0004204 0.0004204 0.01% MLMG::actualBottomSolve() 86 0.0003887 0.0003887 0.0003887 0.01% AmrLevel::FillPatch() 80 0.000317 0.000317 0.000317 0.01% Nyx::integrate_state_struct_mfin 160 0.000314 0.000314 0.000314 0.01% Nyx::sdc_reactions() 10 0.0003017 0.0003017 0.0003017 0.01% MLCellLinOp::correctionResidual() 344 0.000279 0.000279 0.000279 0.01% MLMG:computeResOfCorrection() 344 0.0002657 0.0002657 0.0002657 0.01% MLMG::mgVcycle() 86 0.0002022 0.0002022 0.0002022 0.00% MLMG::oneIter() 86 0.0001672 0.0001672 0.0001672 0.00% MLCellLinOp::solutionResidual() 106 0.0001187 0.0001187 0.0001187 0.00% MLMG::mgVcycle_down::1 86 0.0001181 0.0001181 0.0001181 0.00% MLMG::ResNormInf() 106 0.0001177 0.0001177 0.0001177 0.00% MLMG::solve() 20 0.000116 0.000116 0.000116 0.00% MLMG::mgVcycle_down::0 86 0.0001101 0.0001101 0.0001101 0.00% MLMG::computeResidual() 86 0.0001069 0.0001069 0.0001069 0.00% FillPatchSingleLevel 80 0.0001064 0.0001064 0.0001064 0.00% FillPatchIterator::FillFromLevel0() 80 0.0001035 0.0001035 0.0001035 0.00% FabArray::ParallelCopy() 80 9.689e-05 9.689e-05 9.689e-05 0.00% MLMG::mgVcycle_down::2 86 9.067e-05 9.067e-05 9.067e-05 0.00% MLMG::mgVcycle_down::3 86 9.028e-05 9.028e-05 9.028e-05 0.00% MLMG::mgVcycle_up::0 86 8.98e-05 8.98e-05 8.98e-05 0.00% MLMG::mgVcycle_up::1 86 8.309e-05 8.309e-05 8.309e-05 0.00% MLMG::mgVcycle_up::2 86 8.145e-05 8.145e-05 8.145e-05 0.00% MLMG::mgVcycle_bottom 86 8.123e-05 8.123e-05 8.123e-05 0.00% Gravity::solve_for_phi() 10 7.76e-05 7.76e-05 7.76e-05 0.00% Gravity::AddParticlesToRhsML() 10 6.149e-05 6.149e-05 6.149e-05 0.00% solve_for_new_phi 10 5.029e-05 5.029e-05 5.029e-05 0.00% MLPoisson::define() 20 5.026e-05 5.026e-05 5.026e-05 0.00% sdc_reactions 10 2.945e-05 2.945e-05 2.945e-05 0.00% REG::R::Nyx::advance::STEP1 10 2.937e-05 2.937e-05 2.937e-05 0.00% just_the_hydro 10 2.81e-05 2.81e-05 2.81e-05 0.00% REG::R::Nyx::advance_hydro_plus_particles 10 1.285e-05 1.285e-05 1.285e-05 0.00% Other 11255 0.02098 0.02098 0.02098 0.48% -------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------------- REG::R::Nyx::advance::STEP1 10 4.051 4.051 4.051 93.18% REG::R::Nyx::advance_hydro_plus_particles 10 4.051 4.051 4.051 93.18% Nyx::advance_hydro_plus_particles() 10 4.051 4.051 4.051 93.18% just_the_hydro 10 3.697 3.697 3.697 85.04% Nyx::sdc_hydro() 10 3.697 3.697 3.697 85.04% Nyx::advance_hydro_pc_umdrv() 10 2.523 2.523 2.523 58.04% Nyx::umdrv() 160 2.496 2.496 2.496 57.41% Nyx::umeth() 160 2.451 2.451 2.451 56.39% sdc_reactions 10 1.12 1.12 1.12 25.77% Nyx::sdc_reactions() 10 1.12 1.12 1.12 25.77% Nyx::integrate_state_struct_mfin 160 1.045 1.045 1.045 24.05% Nyx::reactions_cvode 160 0.9458 0.9458 0.9458 21.76% Nyx::reactions_f 1440 0.9259 0.9259 0.9259 21.30% Gravity::solve_with_MLMG 20 0.1659 0.1659 0.1659 3.82% solve_for_new_phi 10 0.1626 0.1626 0.1626 3.74% Gravity::solve_for_new_phi() 10 0.1625 0.1625 0.1625 3.74% MLMG::solve() 20 0.1535 0.1535 0.1535 3.53% Nyx::compute_new_temp() 20 0.1455 0.1455 0.1455 3.35% Gravity::solve_for_phi() 10 0.1445 0.1445 0.1445 3.32% MLMG::oneIter() 86 0.1347 0.1347 0.1347 3.10% MLMG::mgVcycle() 86 0.1293 0.1293 0.1293 2.97% MLCellLinOp::smooth() 774 0.09786 0.09786 0.09786 2.25% Nyx::reactions_cells_finalize 160 0.0901 0.0901 0.0901 2.07% MLPoisson::Fsmooth() 2752 0.07489 0.07489 0.07489 1.72% MLMG::mgVcycle_down::0 86 0.04795 0.04795 0.04795 1.10% MLMG::mgVcycle_up::0 86 0.04651 0.04651 0.04651 1.07% solve_for_old_phi 10 0.04258 0.04258 0.04258 0.98% Gravity::multilevel_solve_for_old_phi() 10 0.04132 0.04132 0.04132 0.95% Gravity::actual_multilevel_solve() 10 0.04042 0.04042 0.04042 0.93% ParticleContainer::AssignCellDensitySingleLevel() 40 0.0309 0.0309 0.0309 0.71% FabArray::FillBoundary() 3360 0.03085 0.03085 0.03085 0.71% FillBoundary_nowait() 3380 0.0292 0.0292 0.0292 0.67% MLCellLinOp::applyBC() 3464 0.0288 0.0288 0.0288 0.66% AmrLevel::FillPatch() 80 0.0284 0.0284 0.0284 0.65% DarkMatterParticleContainer::moveKickDrift() 40 0.0248 0.0248 0.0248 0.57% FillPatchIterator::Initialize 80 0.02168 0.02168 0.02168 0.50% DarkMatterParticleContainer::moveKick() 20 0.02024 0.02024 0.02024 0.47% Gravity::get_old_grav_vector() 30 0.01761 0.01761 0.01761 0.41% Gravity::AddParticlesToRhs() 10 0.01729 0.01729 0.01729 0.40% Gravity::AddParticlesToRhsML() 10 0.01557 0.01557 0.01557 0.36% ParticleContainer::AssignDensity() 20 0.01513 0.01513 0.01513 0.35% MLCellLinOp::apply() 692 0.01438 0.01438 0.01438 0.33% FillPatchIterator::FillFromLevel0() 80 0.01259 0.01259 0.01259 0.29% FillPatchSingleLevel 80 0.01249 0.01249 0.01249 0.29% FabArray::ParallelCopy() 80 0.01228 0.01228 0.01228 0.28% FabArray::ParallelCopy_nowait() 80 0.01211 0.01211 0.01211 0.28% amrex::Copy() 544 0.01186 0.01186 0.01186 0.27% FabArray::setVal() 1222 0.01118 0.01118 0.01118 0.26% Nyx::srctoprim() 160 0.01035 0.01035 0.01035 0.24% Gravity::get_new_grav_vector() 20 0.01021 0.01021 0.01021 0.23% MLMG::addInterpCorrection() 344 0.01011 0.01011 0.01011 0.23% MLMG::mgVcycle_down::1 86 0.009426 0.009426 0.009426 0.22% Nyx::update_state_with_sources() 10 0.009255 0.009255 0.009255 0.21% MLMG:computeResOfCorrection() 344 0.009027 0.009027 0.009027 0.21% MLPoisson::define() 20 0.008777 0.008777 0.008777 0.20% MLCellLinOp::correctionResidual() 344 0.008762 0.008762 0.008762 0.20% MLMG::mgVcycle_up::1 86 0.008417 0.008417 0.008417 0.19% MLCellLinOp::solutionResidual() 106 0.007897 0.007897 0.007897 0.18% Nyx::ctoprim() 160 0.007667 0.007667 0.007667 0.18% MLPoisson::Fapply() 692 0.007293 0.007293 0.007293 0.17% MLMG::computeResidual() 86 0.006186 0.006186 0.006186 0.14% Nyx::reactions_cells_initialize 160 0.005933 0.005933 0.005933 0.14% MLMG::prepareForSolve() 20 0.005738 0.005738 0.005738 0.13% MLCellLinOp::defineAuxData() 20 0.005442 0.005442 0.005442 0.13% amrex::average_down 344 0.005254 0.005254 0.005254 0.12% FabArray::norminf() 454 0.004905 0.004905 0.004905 0.11% MLMG::mgVcycle_bottom 86 0.004666 0.004666 0.004666 0.11% MLMG::actualBottomSolve() 86 0.004585 0.004585 0.004585 0.11% Nyx::reset_internal_energy() 30 0.004571 0.004571 0.004571 0.11% MLMG::ResNormInf() 106 0.00409 0.00409 0.00409 0.09% MLCGSolver::bicgstab 86 0.003871 0.003871 0.003871 0.09% MLMG::mgVcycle_down::2 86 0.003711 0.003711 0.003711 0.09% FabArray::sum() 192 0.003628 0.003628 0.003628 0.08% FabArray::Xpay() 450 0.003519 0.003519 0.003519 0.08% MLMG::mgVcycle_up::2 86 0.003088 0.003088 0.003088 0.07% amrex::Add() 156 0.003083 0.003083 0.003083 0.07% MLMG::mgVcycle_down::3 86 0.002963 0.002963 0.002963 0.07% FabArrayBase::getCPC() 800 0.002551 0.002551 0.002551 0.06% Other 11255 0.04205 0.04205 0.04205 0.97% -------------------------------------------------------------------------------------------------- END REGION R::Nyx::advance::STEP1 BEGIN REGION R::Nyx::advance_hydro_plus_particles -------------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------------- Nyx::umeth() 160 2.451 2.451 2.451 56.39% Nyx::reactions_f 1440 0.9259 0.9259 0.9259 21.30% Nyx::compute_new_temp() 20 0.1455 0.1455 0.1455 3.35% Nyx::reactions_cells_finalize 160 0.0901 0.0901 0.0901 2.07% MLPoisson::Fsmooth() 2752 0.07489 0.07489 0.07489 1.72% Nyx::umdrv() 160 0.04436 0.04436 0.04436 1.02% ParticleContainer::AssignCellDensitySingleLevel() 40 0.02734 0.02734 0.02734 0.63% FillBoundary_nowait() 3380 0.02729 0.02729 0.02729 0.63% DarkMatterParticleContainer::moveKickDrift() 40 0.0248 0.0248 0.0248 0.57% DarkMatterParticleContainer::moveKick() 20 0.02024 0.02024 0.02024 0.47% Nyx::reactions_cvode 160 0.01986 0.01986 0.01986 0.46% FabArray::ParallelCopy_nowait() 80 0.01194 0.01194 0.01194 0.27% amrex::Copy() 544 0.01186 0.01186 0.01186 0.27% FabArray::setVal() 1222 0.01118 0.01118 0.01118 0.26% MLCellLinOp::applyBC() 3464 0.01056 0.01056 0.01056 0.24% Nyx::srctoprim() 160 0.01035 0.01035 0.01035 0.24% MLMG::addInterpCorrection() 344 0.01011 0.01011 0.01011 0.23% Nyx::advance_hydro_pc_umdrv() 10 0.009367 0.009367 0.009367 0.22% FillPatchIterator::Initialize 80 0.008945 0.008945 0.008945 0.21% Nyx::sdc_hydro() 10 0.008647 0.008647 0.008647 0.20% Nyx::update_state_with_sources() 10 0.008597 0.008597 0.008597 0.20% Nyx::ctoprim() 160 0.007667 0.007667 0.007667 0.18% MLPoisson::Fapply() 692 0.007293 0.007293 0.007293 0.17% Nyx::advance_hydro_plus_particles() 10 0.006426 0.006426 0.006426 0.15% Nyx::reactions_cells_initialize 160 0.005933 0.005933 0.005933 0.14% amrex::average_down 344 0.005254 0.005254 0.005254 0.12% FabArray::norminf() 454 0.004905 0.004905 0.004905 0.11% Nyx::reset_internal_energy() 30 0.004571 0.004571 0.004571 0.11% FabArray::sum() 192 0.003628 0.003628 0.003628 0.08% FabArray::Xpay() 450 0.003519 0.003519 0.003519 0.08% amrex::Add() 156 0.003083 0.003083 0.003083 0.07% MLMG::prepareForSolve() 20 0.002994 0.002994 0.002994 0.07% MLCellLinOp::defineAuxData() 20 0.002839 0.002839 0.002839 0.07% FabArray::FillBoundary() 3360 0.002367 0.002367 0.002367 0.05% Gravity::get_old_grav_vector() 30 0.001999 0.001999 0.001999 0.05% Gravity::solve_with_MLMG 20 0.001731 0.001731 0.001731 0.04% Gravity::get_new_grav_vector() 20 0.001301 0.001301 0.001301 0.03% MLCellLinOp::smooth() 774 0.001128 0.001128 0.001128 0.03% MLCGSolver::bicgstab 86 0.0009607 0.0009607 0.0009607 0.02% Gravity::multilevel_solve_for_old_phi() 10 0.0009008 0.0009008 0.0009008 0.02% FabArrayBase::getCPC() 800 0.0008071 0.0008071 0.0008071 0.02% solve_for_old_phi 10 0.0007442 0.0007442 0.0007442 0.02% Gravity::actual_multilevel_solve() 10 0.0006763 0.0006763 0.0006763 0.02% MLCellLinOp::apply() 692 0.0005164 0.0005164 0.0005164 0.01% Gravity::AddParticlesToRhs() 10 0.0004861 0.0004861 0.0004861 0.01% Gravity::solve_for_new_phi() 10 0.0004711 0.0004711 0.0004711 0.01% ParticleContainer::AssignDensity() 20 0.0004204 0.0004204 0.0004204 0.01% MLMG::actualBottomSolve() 86 0.0003887 0.0003887 0.0003887 0.01% AmrLevel::FillPatch() 80 0.000317 0.000317 0.000317 0.01% Nyx::integrate_state_struct_mfin 160 0.000314 0.000314 0.000314 0.01% Nyx::sdc_reactions() 10 0.0003017 0.0003017 0.0003017 0.01% MLCellLinOp::correctionResidual() 344 0.000279 0.000279 0.000279 0.01% MLMG:computeResOfCorrection() 344 0.0002657 0.0002657 0.0002657 0.01% MLMG::mgVcycle() 86 0.0002022 0.0002022 0.0002022 0.00% MLMG::oneIter() 86 0.0001672 0.0001672 0.0001672 0.00% MLCellLinOp::solutionResidual() 106 0.0001187 0.0001187 0.0001187 0.00% MLMG::mgVcycle_down::1 86 0.0001181 0.0001181 0.0001181 0.00% MLMG::ResNormInf() 106 0.0001177 0.0001177 0.0001177 0.00% MLMG::solve() 20 0.000116 0.000116 0.000116 0.00% MLMG::mgVcycle_down::0 86 0.0001101 0.0001101 0.0001101 0.00% MLMG::computeResidual() 86 0.0001069 0.0001069 0.0001069 0.00% FillPatchSingleLevel 80 0.0001064 0.0001064 0.0001064 0.00% FillPatchIterator::FillFromLevel0() 80 0.0001035 0.0001035 0.0001035 0.00% FabArray::ParallelCopy() 80 9.689e-05 9.689e-05 9.689e-05 0.00% MLMG::mgVcycle_down::2 86 9.067e-05 9.067e-05 9.067e-05 0.00% MLMG::mgVcycle_down::3 86 9.028e-05 9.028e-05 9.028e-05 0.00% MLMG::mgVcycle_up::0 86 8.98e-05 8.98e-05 8.98e-05 0.00% MLMG::mgVcycle_up::1 86 8.309e-05 8.309e-05 8.309e-05 0.00% MLMG::mgVcycle_up::2 86 8.145e-05 8.145e-05 8.145e-05 0.00% MLMG::mgVcycle_bottom 86 8.123e-05 8.123e-05 8.123e-05 0.00% Gravity::solve_for_phi() 10 7.76e-05 7.76e-05 7.76e-05 0.00% Gravity::AddParticlesToRhsML() 10 6.149e-05 6.149e-05 6.149e-05 0.00% solve_for_new_phi 10 5.029e-05 5.029e-05 5.029e-05 0.00% MLPoisson::define() 20 5.026e-05 5.026e-05 5.026e-05 0.00% sdc_reactions 10 2.945e-05 2.945e-05 2.945e-05 0.00% just_the_hydro 10 2.81e-05 2.81e-05 2.81e-05 0.00% REG::R::Nyx::advance_hydro_plus_particles 10 1.285e-05 1.285e-05 1.285e-05 0.00% Other 11255 0.02098 0.02098 0.02098 0.48% -------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------------- REG::R::Nyx::advance_hydro_plus_particles 10 4.051 4.051 4.051 93.18% Nyx::advance_hydro_plus_particles() 10 4.051 4.051 4.051 93.18% just_the_hydro 10 3.697 3.697 3.697 85.04% Nyx::sdc_hydro() 10 3.697 3.697 3.697 85.04% Nyx::advance_hydro_pc_umdrv() 10 2.523 2.523 2.523 58.04% Nyx::umdrv() 160 2.496 2.496 2.496 57.41% Nyx::umeth() 160 2.451 2.451 2.451 56.39% sdc_reactions 10 1.12 1.12 1.12 25.77% Nyx::sdc_reactions() 10 1.12 1.12 1.12 25.77% Nyx::integrate_state_struct_mfin 160 1.045 1.045 1.045 24.05% Nyx::reactions_cvode 160 0.9458 0.9458 0.9458 21.76% Nyx::reactions_f 1440 0.9259 0.9259 0.9259 21.30% Gravity::solve_with_MLMG 20 0.1659 0.1659 0.1659 3.82% solve_for_new_phi 10 0.1626 0.1626 0.1626 3.74% Gravity::solve_for_new_phi() 10 0.1625 0.1625 0.1625 3.74% MLMG::solve() 20 0.1535 0.1535 0.1535 3.53% Nyx::compute_new_temp() 20 0.1455 0.1455 0.1455 3.35% Gravity::solve_for_phi() 10 0.1445 0.1445 0.1445 3.32% MLMG::oneIter() 86 0.1347 0.1347 0.1347 3.10% MLMG::mgVcycle() 86 0.1293 0.1293 0.1293 2.97% MLCellLinOp::smooth() 774 0.09786 0.09786 0.09786 2.25% Nyx::reactions_cells_finalize 160 0.0901 0.0901 0.0901 2.07% MLPoisson::Fsmooth() 2752 0.07489 0.07489 0.07489 1.72% MLMG::mgVcycle_down::0 86 0.04795 0.04795 0.04795 1.10% MLMG::mgVcycle_up::0 86 0.04651 0.04651 0.04651 1.07% solve_for_old_phi 10 0.04258 0.04258 0.04258 0.98% Gravity::multilevel_solve_for_old_phi() 10 0.04132 0.04132 0.04132 0.95% Gravity::actual_multilevel_solve() 10 0.04042 0.04042 0.04042 0.93% ParticleContainer::AssignCellDensitySingleLevel() 40 0.0309 0.0309 0.0309 0.71% FabArray::FillBoundary() 3360 0.03085 0.03085 0.03085 0.71% FillBoundary_nowait() 3380 0.0292 0.0292 0.0292 0.67% MLCellLinOp::applyBC() 3464 0.0288 0.0288 0.0288 0.66% AmrLevel::FillPatch() 80 0.0284 0.0284 0.0284 0.65% DarkMatterParticleContainer::moveKickDrift() 40 0.0248 0.0248 0.0248 0.57% FillPatchIterator::Initialize 80 0.02168 0.02168 0.02168 0.50% DarkMatterParticleContainer::moveKick() 20 0.02024 0.02024 0.02024 0.47% Gravity::get_old_grav_vector() 30 0.01761 0.01761 0.01761 0.41% Gravity::AddParticlesToRhs() 10 0.01729 0.01729 0.01729 0.40% Gravity::AddParticlesToRhsML() 10 0.01557 0.01557 0.01557 0.36% ParticleContainer::AssignDensity() 20 0.01513 0.01513 0.01513 0.35% MLCellLinOp::apply() 692 0.01438 0.01438 0.01438 0.33% FillPatchIterator::FillFromLevel0() 80 0.01259 0.01259 0.01259 0.29% FillPatchSingleLevel 80 0.01249 0.01249 0.01249 0.29% FabArray::ParallelCopy() 80 0.01228 0.01228 0.01228 0.28% FabArray::ParallelCopy_nowait() 80 0.01211 0.01211 0.01211 0.28% amrex::Copy() 544 0.01186 0.01186 0.01186 0.27% FabArray::setVal() 1222 0.01118 0.01118 0.01118 0.26% Nyx::srctoprim() 160 0.01035 0.01035 0.01035 0.24% Gravity::get_new_grav_vector() 20 0.01021 0.01021 0.01021 0.23% MLMG::addInterpCorrection() 344 0.01011 0.01011 0.01011 0.23% MLMG::mgVcycle_down::1 86 0.009426 0.009426 0.009426 0.22% Nyx::update_state_with_sources() 10 0.009255 0.009255 0.009255 0.21% MLMG:computeResOfCorrection() 344 0.009027 0.009027 0.009027 0.21% MLPoisson::define() 20 0.008777 0.008777 0.008777 0.20% MLCellLinOp::correctionResidual() 344 0.008762 0.008762 0.008762 0.20% MLMG::mgVcycle_up::1 86 0.008417 0.008417 0.008417 0.19% MLCellLinOp::solutionResidual() 106 0.007897 0.007897 0.007897 0.18% Nyx::ctoprim() 160 0.007667 0.007667 0.007667 0.18% MLPoisson::Fapply() 692 0.007293 0.007293 0.007293 0.17% MLMG::computeResidual() 86 0.006186 0.006186 0.006186 0.14% Nyx::reactions_cells_initialize 160 0.005933 0.005933 0.005933 0.14% MLMG::prepareForSolve() 20 0.005738 0.005738 0.005738 0.13% MLCellLinOp::defineAuxData() 20 0.005442 0.005442 0.005442 0.13% amrex::average_down 344 0.005254 0.005254 0.005254 0.12% FabArray::norminf() 454 0.004905 0.004905 0.004905 0.11% MLMG::mgVcycle_bottom 86 0.004666 0.004666 0.004666 0.11% MLMG::actualBottomSolve() 86 0.004585 0.004585 0.004585 0.11% Nyx::reset_internal_energy() 30 0.004571 0.004571 0.004571 0.11% MLMG::ResNormInf() 106 0.00409 0.00409 0.00409 0.09% MLCGSolver::bicgstab 86 0.003871 0.003871 0.003871 0.09% MLMG::mgVcycle_down::2 86 0.003711 0.003711 0.003711 0.09% FabArray::sum() 192 0.003628 0.003628 0.003628 0.08% FabArray::Xpay() 450 0.003519 0.003519 0.003519 0.08% MLMG::mgVcycle_up::2 86 0.003088 0.003088 0.003088 0.07% amrex::Add() 156 0.003083 0.003083 0.003083 0.07% MLMG::mgVcycle_down::3 86 0.002963 0.002963 0.002963 0.07% FabArrayBase::getCPC() 800 0.002551 0.002551 0.002551 0.06% Other 11255 0.04205 0.04205 0.04205 0.97% -------------------------------------------------------------------------------------------------- END REGION R::Nyx::advance_hydro_plus_particles BEGIN REGION R::Nyx::coarseTimeStep -------------------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------------------- Nyx::umeth() 160 2.451 2.451 2.451 56.39% Nyx::reactions_f 1440 0.9259 0.9259 0.9259 21.30% Nyx::compute_new_temp() 40 0.2905 0.2905 0.2905 6.68% Nyx::reactions_cells_finalize 160 0.0901 0.0901 0.0901 2.07% MLPoisson::Fsmooth() 2752 0.07489 0.07489 0.07489 1.72% Nyx::umdrv() 160 0.04436 0.04436 0.04436 1.02% ParticleContainer::AssignCellDensitySingleLevel() 40 0.02734 0.02734 0.02734 0.63% FillBoundary_nowait() 3382 0.02732 0.02732 0.02732 0.63% DarkMatterParticleContainer::moveKickDrift() 40 0.0248 0.0248 0.0248 0.57% DarkMatterParticleContainer::moveKick() 20 0.02024 0.02024 0.02024 0.47% Nyx::reactions_cvode 160 0.01986 0.01986 0.01986 0.46% NyxParticleContainer::estTimestep(lev) 20 0.01502 0.01502 0.01502 0.35% FabArray::ParallelCopy_nowait() 80 0.01194 0.01194 0.01194 0.27% numParticlesOutOfRange() 80 0.0119 0.0119 0.0119 0.27% amrex::Copy() 544 0.01186 0.01186 0.01186 0.27% Redistribute_partition 20 0.01185 0.01185 0.01185 0.27% FabArray::setVal() 1234 0.01137 0.01137 0.01137 0.26% MLCellLinOp::applyBC() 3464 0.01056 0.01056 0.01056 0.24% Nyx::srctoprim() 160 0.01035 0.01035 0.01035 0.24% MLMG::addInterpCorrection() 344 0.01011 0.01011 0.01011 0.23% Nyx::advance_hydro_pc_umdrv() 10 0.009367 0.009367 0.009367 0.22% FillPatchIterator::Initialize 80 0.008945 0.008945 0.008945 0.21% Nyx::sdc_hydro() 10 0.008647 0.008647 0.008647 0.20% Nyx::update_state_with_sources() 10 0.008597 0.008597 0.008597 0.20% Nyx::ctoprim() 160 0.007667 0.007667 0.007667 0.18% MLPoisson::Fapply() 692 0.007293 0.007293 0.007293 0.17% Nyx::advance_hydro_plus_particles() 10 0.006426 0.006426 0.006426 0.15% Nyx::reset_internal_energy() 40 0.005989 0.005989 0.005989 0.14% Nyx::reactions_cells_initialize 160 0.005933 0.005933 0.005933 0.14% FabArray::norminf() 464 0.005279 0.005279 0.005279 0.12% amrex::average_down 344 0.005254 0.005254 0.005254 0.12% Nyx::compute_rho_temp()::OnHost 10 0.004132 0.004132 0.004132 0.10% ParticleContainer::BuildRedistributeMask 20 0.003737 0.003737 0.003737 0.09% FabArray::sum() 192 0.003628 0.003628 0.003628 0.08% FabArray::Xpay() 450 0.003519 0.003519 0.003519 0.08% amrex::Add() 156 0.003083 0.003083 0.003083 0.07% MLMG::prepareForSolve() 20 0.002994 0.002994 0.002994 0.07% MLCellLinOp::defineAuxData() 20 0.002839 0.002839 0.002839 0.07% Nyx::est_time_step() 10 0.002586 0.002586 0.002586 0.06% FabArray::FillBoundary() 3362 0.002369 0.002369 0.002369 0.05% Gravity::get_old_grav_vector() 30 0.001999 0.001999 0.001999 0.05% Gravity::solve_with_MLMG 20 0.001731 0.001731 0.001731 0.04% Gravity::get_new_grav_vector() 20 0.001301 0.001301 0.001301 0.03% MLCellLinOp::smooth() 774 0.001128 0.001128 0.001128 0.03% MLCGSolver::bicgstab 86 0.0009607 0.0009607 0.0009607 0.02% Gravity::multilevel_solve_for_old_phi() 10 0.0009008 0.0009008 0.0009008 0.02% FabArrayBase::getCPC() 800 0.0008071 0.0008071 0.0008071 0.02% solve_for_old_phi 10 0.0007442 0.0007442 0.0007442 0.02% Gravity::actual_multilevel_solve() 10 0.0006763 0.0006763 0.0006763 0.02% Nyx::reset_internal_energy_nostore() 20 0.0005363 0.0005363 0.0005363 0.01% MLCellLinOp::apply() 692 0.0005164 0.0005164 0.0005164 0.01% Gravity::AddParticlesToRhs() 10 0.0004861 0.0004861 0.0004861 0.01% Gravity::solve_for_new_phi() 10 0.0004711 0.0004711 0.0004711 0.01% Nyx::post_timestep()::sum_write 10 0.0004389 0.0004389 0.0004389 0.01% ParticleContainer::AssignDensity() 20 0.0004204 0.0004204 0.0004204 0.01% MLMG::actualBottomSolve() 86 0.0003887 0.0003887 0.0003887 0.01% AmrLevel::FillPatch() 80 0.000317 0.000317 0.000317 0.01% Nyx::integrate_state_struct_mfin 160 0.000314 0.000314 0.000314 0.01% Nyx::sdc_reactions() 10 0.0003017 0.0003017 0.0003017 0.01% MLCellLinOp::correctionResidual() 344 0.000279 0.000279 0.000279 0.01% MLMG:computeResOfCorrection() 344 0.0002657 0.0002657 0.0002657 0.01% Amr::coarseTimeStep() 10 0.0002551 0.0002551 0.0002551 0.01% MLMG::mgVcycle() 86 0.0002022 0.0002022 0.0002022 0.00% Amr::timeStep() 10 0.0001973 0.0001973 0.0001973 0.00% MLMG::oneIter() 86 0.0001672 0.0001672 0.0001672 0.00% Nyx::post_timestep() 10 0.0001435 0.0001435 0.0001435 0.00% MLCellLinOp::solutionResidual() 106 0.0001187 0.0001187 0.0001187 0.00% MLMG::mgVcycle_down::1 86 0.0001181 0.0001181 0.0001181 0.00% MLMG::ResNormInf() 106 0.0001177 0.0001177 0.0001177 0.00% MLMG::solve() 20 0.000116 0.000116 0.000116 0.00% Nyx::computeNewDt() 9 0.0001134 0.0001134 0.0001134 0.00% MLMG::mgVcycle_down::0 86 0.0001101 0.0001101 0.0001101 0.00% ParticleContainer::Redistribute_impl() 20 0.0001079 0.0001079 0.0001079 0.00% MLMG::computeResidual() 86 0.0001069 0.0001069 0.0001069 0.00% FillPatchSingleLevel 80 0.0001064 0.0001064 0.0001064 0.00% Nyx::particle_est_time_step() 10 0.0001063 0.0001063 0.0001063 0.00% FillPatchIterator::FillFromLevel0() 80 0.0001035 0.0001035 0.0001035 0.00% FabArray::ParallelCopy() 80 9.689e-05 9.689e-05 9.689e-05 0.00% MLMG::mgVcycle_down::2 86 9.067e-05 9.067e-05 9.067e-05 0.00% MLMG::mgVcycle_down::3 86 9.028e-05 9.028e-05 9.028e-05 0.00% MLMG::mgVcycle_up::0 86 8.98e-05 8.98e-05 8.98e-05 0.00% MLMG::mgVcycle_up::3 86 8.536e-05 8.536e-05 8.536e-05 0.00% MLMG::mgVcycle_up::1 86 8.309e-05 8.309e-05 8.309e-05 0.00% MLMG::mgVcycle_up::2 86 8.145e-05 8.145e-05 8.145e-05 0.00% MLMG::mgVcycle_bottom 86 8.123e-05 8.123e-05 8.123e-05 0.00% Gravity::solve_for_phi() 10 7.76e-05 7.76e-05 7.76e-05 0.00% Gravity::AddParticlesToRhsML() 10 6.149e-05 6.149e-05 6.149e-05 0.00% FabArray::SumBoundary() 40 5.623e-05 5.623e-05 5.623e-05 0.00% solve_for_new_phi 10 5.029e-05 5.029e-05 5.029e-05 0.00% MLPoisson::define() 20 5.026e-05 5.026e-05 5.026e-05 0.00% Nyx::post_timestep()::redist 10 3.172e-05 3.172e-05 3.172e-05 0.00% sdc_reactions 10 2.945e-05 2.945e-05 2.945e-05 0.00% REG::R::Nyx::advance::STEP1 10 2.937e-05 2.937e-05 2.937e-05 0.00% just_the_hydro 10 2.81e-05 2.81e-05 2.81e-05 0.00% REG::R::Nyx::coarseTimeStep 1 2.79e-05 2.79e-05 2.79e-05 0.00% Nyx::compute_rho_temp() 10 1.685e-05 1.685e-05 1.685e-05 0.00% Nyx::post_timestep()::compute_temp 10 1.305e-05 1.305e-05 1.305e-05 0.00% REG::R::Nyx::advance_hydro_plus_particles 10 1.285e-05 1.285e-05 1.285e-05 0.00% Other 11526 0.02191 0.02191 0.02191 0.50% -------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------------------- REG::R::Nyx::coarseTimeStep 1 4.25 4.25 4.25 97.77% Amr::coarseTimeStep() 10 4.25 4.25 4.25 97.77% Amr::timeStep() 10 4.232 4.232 4.232 97.35% REG::R::Nyx::advance::STEP1 10 4.051 4.051 4.051 93.18% REG::R::Nyx::advance_hydro_plus_particles 10 4.051 4.051 4.051 93.18% Nyx::advance_hydro_plus_particles() 10 4.051 4.051 4.051 93.18% just_the_hydro 10 3.697 3.697 3.697 85.04% Nyx::sdc_hydro() 10 3.697 3.697 3.697 85.04% Nyx::advance_hydro_pc_umdrv() 10 2.523 2.523 2.523 58.04% Nyx::umdrv() 160 2.496 2.496 2.496 57.41% Nyx::umeth() 160 2.451 2.451 2.451 56.39% sdc_reactions 10 1.12 1.12 1.12 25.77% Nyx::sdc_reactions() 10 1.12 1.12 1.12 25.77% Nyx::integrate_state_struct_mfin 160 1.045 1.045 1.045 24.05% Nyx::reactions_cvode 160 0.9458 0.9458 0.9458 21.76% Nyx::reactions_f 1440 0.9259 0.9259 0.9259 21.30% Nyx::compute_new_temp() 40 0.2905 0.2905 0.2905 6.68% Nyx::post_timestep() 10 0.1809 0.1809 0.1809 4.16% Gravity::solve_with_MLMG 20 0.1659 0.1659 0.1659 3.82% solve_for_new_phi 10 0.1626 0.1626 0.1626 3.74% Gravity::solve_for_new_phi() 10 0.1625 0.1625 0.1625 3.74% MLMG::solve() 20 0.1535 0.1535 0.1535 3.53% Gravity::solve_for_phi() 10 0.1445 0.1445 0.1445 3.32% MLMG::oneIter() 86 0.1347 0.1347 0.1347 3.10% MLMG::mgVcycle() 86 0.1293 0.1293 0.1293 2.97% MLCellLinOp::smooth() 774 0.09786 0.09786 0.09786 2.25% Nyx::reactions_cells_finalize 160 0.0901 0.0901 0.0901 2.07% Nyx::post_timestep()::sum_write 10 0.07842 0.07842 0.07842 1.80% MLPoisson::Fsmooth() 2752 0.07489 0.07489 0.07489 1.72% Nyx::post_timestep()::compute_temp 10 0.07414 0.07414 0.07414 1.71% MLMG::mgVcycle_down::0 86 0.04795 0.04795 0.04795 1.10% MLMG::mgVcycle_up::0 86 0.04651 0.04651 0.04651 1.07% solve_for_old_phi 10 0.04258 0.04258 0.04258 0.98% Gravity::multilevel_solve_for_old_phi() 10 0.04132 0.04132 0.04132 0.95% Gravity::actual_multilevel_solve() 10 0.04042 0.04042 0.04042 0.93% FabArray::FillBoundary() 3362 0.0309 0.0309 0.0309 0.71% ParticleContainer::AssignCellDensitySingleLevel() 40 0.0309 0.0309 0.0309 0.71% FillBoundary_nowait() 3382 0.02925 0.02925 0.02925 0.67% MLCellLinOp::applyBC() 3464 0.0288 0.0288 0.0288 0.66% AmrLevel::FillPatch() 80 0.0284 0.0284 0.0284 0.65% Nyx::post_timestep()::redist 10 0.02806 0.02806 0.02806 0.65% DarkMatterParticleContainer::moveKickDrift() 40 0.0248 0.0248 0.0248 0.57% ParticleContainer::Redistribute_impl() 20 0.02171 0.02171 0.02171 0.50% FillPatchIterator::Initialize 80 0.02168 0.02168 0.02168 0.50% DarkMatterParticleContainer::moveKick() 20 0.02024 0.02024 0.02024 0.47% Nyx::est_time_step() 10 0.01771 0.01771 0.01771 0.41% Gravity::get_old_grav_vector() 30 0.01761 0.01761 0.01761 0.41% Gravity::AddParticlesToRhs() 10 0.01729 0.01729 0.01729 0.40% Nyx::computeNewDt() 9 0.01598 0.01598 0.01598 0.37% Gravity::AddParticlesToRhsML() 10 0.01557 0.01557 0.01557 0.36% ParticleContainer::AssignDensity() 20 0.01513 0.01513 0.01513 0.35% Nyx::particle_est_time_step() 10 0.01512 0.01512 0.01512 0.35% NyxParticleContainer::estTimestep(lev) 20 0.01502 0.01502 0.01502 0.35% MLCellLinOp::apply() 692 0.01438 0.01438 0.01438 0.33% FillPatchIterator::FillFromLevel0() 80 0.01259 0.01259 0.01259 0.29% FillPatchSingleLevel 80 0.01249 0.01249 0.01249 0.29% FabArray::ParallelCopy() 80 0.01228 0.01228 0.01228 0.28% FabArray::ParallelCopy_nowait() 80 0.01211 0.01211 0.01211 0.28% numParticlesOutOfRange() 80 0.0119 0.0119 0.0119 0.27% amrex::Copy() 544 0.01186 0.01186 0.01186 0.27% Redistribute_partition 20 0.01185 0.01185 0.01185 0.27% FabArray::setVal() 1234 0.01137 0.01137 0.01137 0.26% Nyx::srctoprim() 160 0.01035 0.01035 0.01035 0.24% Gravity::get_new_grav_vector() 20 0.01021 0.01021 0.01021 0.23% MLMG::addInterpCorrection() 344 0.01011 0.01011 0.01011 0.23% MLMG::mgVcycle_down::1 86 0.009426 0.009426 0.009426 0.22% Nyx::update_state_with_sources() 10 0.009255 0.009255 0.009255 0.21% MLMG:computeResOfCorrection() 344 0.009027 0.009027 0.009027 0.21% MLPoisson::define() 20 0.008777 0.008777 0.008777 0.20% MLCellLinOp::correctionResidual() 344 0.008762 0.008762 0.008762 0.20% MLMG::mgVcycle_up::1 86 0.008417 0.008417 0.008417 0.19% MLCellLinOp::solutionResidual() 106 0.007897 0.007897 0.007897 0.18% Nyx::ctoprim() 160 0.007667 0.007667 0.007667 0.18% MLPoisson::Fapply() 692 0.007293 0.007293 0.007293 0.17% MLMG::computeResidual() 86 0.006186 0.006186 0.006186 0.14% Nyx::reset_internal_energy() 40 0.005989 0.005989 0.005989 0.14% Nyx::reactions_cells_initialize 160 0.005933 0.005933 0.005933 0.14% MLMG::prepareForSolve() 20 0.005738 0.005738 0.005738 0.13% MLCellLinOp::defineAuxData() 20 0.005442 0.005442 0.005442 0.13% FabArray::norminf() 464 0.005279 0.005279 0.005279 0.12% amrex::average_down 344 0.005254 0.005254 0.005254 0.12% MLMG::mgVcycle_bottom 86 0.004666 0.004666 0.004666 0.11% MLMG::actualBottomSolve() 86 0.004585 0.004585 0.004585 0.11% Nyx::compute_rho_temp() 10 0.004149 0.004149 0.004149 0.10% Nyx::compute_rho_temp()::OnHost 10 0.004132 0.004132 0.004132 0.10% MLMG::ResNormInf() 106 0.00409 0.00409 0.00409 0.09% MLCGSolver::bicgstab 86 0.003871 0.003871 0.003871 0.09% ParticleContainer::BuildRedistributeMask 20 0.003812 0.003812 0.003812 0.09% Nyx::reset_internal_energy_nostore() 20 0.003734 0.003734 0.003734 0.09% MLMG::mgVcycle_down::2 86 0.003711 0.003711 0.003711 0.09% FabArray::sum() 192 0.003628 0.003628 0.003628 0.08% FabArray::Xpay() 450 0.003519 0.003519 0.003519 0.08% MLMG::mgVcycle_up::2 86 0.003088 0.003088 0.003088 0.07% amrex::Add() 156 0.003083 0.003083 0.003083 0.07% MLMG::mgVcycle_down::3 86 0.002963 0.002963 0.002963 0.07% FabArrayBase::getCPC() 800 0.002551 0.002551 0.002551 0.06% MLMG::mgVcycle_up::3 86 0.002345 0.002345 0.002345 0.05% FabArray::SumBoundary() 40 0.002337 0.002337 0.002337 0.05% Other 11526 0.0415 0.0415 0.0415 0.95% -------------------------------------------------------------------------------------------------------- END REGION R::Nyx::coarseTimeStep Unused ParmParse Variables: [TOP]::amr.probin_file(nvals = 1) :: [] [TOP]::particles.neutrino_dm_model(nvals = 1) :: [1] [TOP]::particles.relativistic(nvals = 1) :: [0] [TOP]::plot_int(nvals = 1) :: [10] Async Memory Usage: --------------------------------------------------------- Name Nalloc AvgMem MaxMem --------------------------------------------------------- Nyx::umeth() 6080 1751 KiB 7608 KiB Nyx::advance_hydro_pc_umdrv() 800 735 KiB 1275 KiB Nyx::umdrv() 800 475 KiB 832 KiB --------------------------------------------------------- Pinned Memory Usage: -------------------------------------------------------- Name Nalloc AvgMem MaxMem -------------------------------------------------------- The_Pinned_Arena::Initialize() 1 5 B 8192 KiB -------------------------------------------------------- Cpu Memory Usage: --------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem MaxMem CurrentMem --------------------------------------------------------------------------------------- Nyx::sdc_hydro() 70 70 9012 KiB 10 MiB 0 B Nyx::umeth() 6080 6080 1752 KiB 7610 KiB 0 B Nyx::advance_hydro_plus_particles() 55 55 3920 KiB 5528 KiB 0 B AmrLevel::writePlotFile() 2 2 14 KiB 4096 KiB 0 B StateData::define() 5 5 3966 KiB 3992 KiB 0 B FillPatchIterator::Initialize 91 91 12 KiB 3000 KiB 0 B solve_for_old_phi 30 30 924 KiB 1897 KiB 0 B Nyx::Nyx(Amr) 6 6 23 KiB 1897 KiB 0 B AmrLevel::derive() 12 12 727 B 1792 KiB 0 B MLMG::prepareForSolve() 420 420 60 KiB 1567 KiB 0 B ParticleContainer::AssignDensity() 29 29 3078 B 1458 KiB 0 B Nyx::advance_hydro_pc_umdrv() 800 800 735 KiB 1275 KiB 0 B Gravity::multilevel_solve_for_old_phi() 30 30 924 KiB 948 KiB 0 B Gravity::multilevel_solve_for_new_phi() 3 3 11 KiB 948 KiB 0 B Nyx::umdrv() 800 800 475 KiB 832 KiB 0 B Nyx::post_init() 2 2 983 B 768 KiB 0 B ParticleContainer::BuildRedistributeMask 2 2 541 KiB 614 KiB 0 B Gravity::actual_multilevel_solve() 22 22 6216 B 512 KiB 0 B Nyx::derive(mf) 6 6 354 B 512 KiB 0 B amrex::ParticleToMesh 4 4 96 B 512 KiB 0 B Nyx::reset_internal_energy_nostore() 20 20 426 B 500 KiB 0 B FillBoundary_nowait() 1274 1274 71 B 434 KiB 0 B Gravity::AddParticlesToRhs() 10 10 1732 B 428 KiB 0 B BndryData::define() 252 252 137 KiB 279 KiB 0 B Gravity::solve_for_new_phi() 10 10 9732 B 256 KiB 0 B Nyx::read_params() 1 0 250 KiB 251 KiB 251 KiB MLCellLinOp::defineAuxData() 1260 1260 99 KiB 201 KiB 0 B MLCGSolver::bicgstab 485 485 1 B 1792 B 0 B MLMG::actualBottomSolve() 97 97 0 B 256 B 0 B Nyx::reactions_alloc 160 160 61 B 256 B 0 B MLCellLinOp::applyBC() 3897 3897 0 B 256 B 0 B --------------------------------------------------------------------------------------- AMReX (26.06-8-g5bee7705813e) finalized