Initializing AMReX (26.08-4-gcb098067c32e)... MPI initialized with 1 MPI processes MPI initialized with thread support level 0 Initializing SUNDIALS with 1 threads... SUNDIALS initialized. AMReX (26.08-4-gcb098067c32e) initialized Successfully read inputs file ... AMReX git describe: 26.08-4-gcb098067c Nyx git describe: 26.07-2-g24a9d95a Integrating heating/cooling method with the following method: Vectorized CVODE Nyx::hydro_tile_size unset, using fabarray.mfiter_tile_size default: (1024000,8,8) Suggested default for currently compiled CPU / GPU: nyx.hydro_tile_size=(1024,16,16) Nyx::sundials_tile_size unset, using fabarray.mfiter_tile_size default: (1024000,8,8) Suggested default for currently compiled CPU / GPU: nyx.sundials_tile_size=(1024,16,16) Nyx::setting species concentrations to 0.76 and 0.24 in the hydro and in the EOS 0 Species: Successfully read inputs file ... Getting Gconst from nyx_constants: 4.300927161e-09 Using -5.404704468e-08 for 4 pi G in Gravity.cpp Initializing the data at level 0 ... setting particle_initrandom_mass to 2.653985961e+10 by dividing 8.696581196e+14 by 32768 Initializing DM particles from "32.nyx" ... Reading with 1 readers Redistributing after every 2097152 particles for each reader Total number of particles: 32768 Initializing Neutrino particles from "32.nyx" ... Reading with 1 readers Redistributing after every 2097152 particles for each reader Total number of particles: 32768 ... time and comoving a when data is initialized at level 0 0 0.009900990099 Average gas density 6294948659 Average dm density 3.14747433e+10 Average neutrino density 3.776969114e+10 Average total density 7.553938309e+10 Done initializing the level 0 data ...estdt from hydro at level 0: 0.0001023913166 ...estdt from particles at level 0: 5.732919201e-05 ...estdt from neutrinos at level 0: 5.732919201e-05 ...estdt after call to comoving : 2.676083073e-07 ...change in a is 0.9996324158 percent Nyx::est_time_step at level 0: estdt = 2.676083073e-07 Integrating a from time 0 by dt = 2.676083073e-07 Old / new A time 0 2.676083073e-07 Old / new A 0.009900990099 0.009999963606 Old / new z 100 99.00036395 Re-integrating a from time 0 by dt = 2.676083073e-07 Old / new A time 0 2.676083073e-07 Old / new A 0.009900990099 0.009999963606 Old / new z 100 99.00036395 Setting the current time in the state data to 0 BA SIZE 0 FLEV 0 Calling redistribute because the size of BoxArray changed Gravity ... defining average density in Gravity::set_mass_offset to be 7.553938309e+10 Gravity ... multilevel solve for new phi at base level 0 to finest level 0 ... subtracting average density 7.553938309e+10 from RHS at each level ... subtracting -1.27479434e-05 to ensure solvability Average gas density 6294948659 Average dm density 3.14747433e+10 Average neutrino density 3.776969114e+10 Average total density 7.553938309e+10 Average temperature 214.2287907 ... setting small_dens to 51.6247 ... setting small_temp to 0.01 ... setting small_pres to 0.006732869773 INITIAL GRIDS Level 0 1 grids 32768 cells 100 % of domain PLOTFILE: file = LyA_Neutrinos_plt00000 Output file LyA_Neutrinos_plt00000.temp at time 0.009901 and step 0 Write plotfile time = 0.013892812 seconds ...estdt from hydro at level 0: 0.0001023913166 ...estdt from particles at level 0: 5.732919201e-05 ...estdt from neutrinos at level 0: 5.732919201e-05 ...advancing from old_a_time rather than new_a_time! ...estdt after call to comoving : 2.676083073e-07 ...change in a is 0.9996324158 percent Nyx::est_time_step at level 0: estdt = 2.676083073e-07 Re-integrating a from time 0 by dt = 2.676083073e-07 Old / new A time 0 2.676083073e-07 Old / new A 0.009900990099 0.009999963606 Old / new z 100 99.00036395 Re-integrating a from time 0 by dt = 2.676083073e-07 Old / new A time 0 2.676083073e-07 Old / new A 0.009900990099 0.009999963606 Old / new z 100 99.00036395 [Level 0 step 1] ADVANCE at time 0 with dt = 2.676083073e-07 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 7.553938309e+10 from RHS at each level ... subtracting -1.27479434e-05 to ensure solvability moveKickDrift ... updating particle positions and velocity STARTING SDC_ITER LOOP 0 ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... ... Solving heating-cooling with SDC and CVode Nyx::sdc_reactions() time = 0.104645417 Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 7.553938309e+10 ... subtracting -1.273304224e-05 to ensure solvability moveKick ... updating velocity only [Level 0 step 1] Advanced 32768 cells [STEP 1] Coarse TimeStep time: 0.43671898 [STEP 1] FAB kilobyte spread across MPI nodes: [30364 ... 30364] STEP = 1 TIME = 2.676083073e-07 DT = 2.676083073e-07 ...estdt from hydro at level 0: 0.0001015989185 ...estdt from particles at level 0: 5.690884694e-05 ...estdt from neutrinos at level 0: 5.690884694e-05 ...estdt after call to comoving : 2.71630956e-07 ...change in a is 0.9996324134 percent Nyx::est_time_step at level 0: estdt = 2.71630956e-07 Integrating a from time 2.676083073e-07 by dt = 2.71630956e-07 Old / new A time 2.676083073e-07 5.392392633e-07 Old / new A 0.009999963606 0.01009992648 Old / new z 99.00036395 98.01062168 [Level 0 step 2] ADVANCE at time 2.676083073e-07 with dt = 2.71630956e-07 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 7.553938309e+10 from RHS at each level ... subtracting -1.262128353e-05 to ensure solvability moveKickDrift ... updating particle positions and velocity STARTING SDC_ITER LOOP 0 ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... ... Solving heating-cooling with SDC and CVode Nyx::sdc_reactions() time = 0.104998311 Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 7.553938309e+10 ... subtracting -1.26734376e-05 to ensure solvability moveKick ... updating velocity only [Level 0 step 2] Advanced 32768 cells [STEP 2] Coarse TimeStep time: 0.430884372 [STEP 2] FAB kilobyte spread across MPI nodes: [30978 ... 30978] STEP = 2 TIME = 5.392392633e-07 DT = 2.71630956e-07 ...estdt from hydro at level 0: 0.0001008463241 ...estdt from particles at level 0: 5.650951544e-05 ...estdt from neutrinos at level 0: 5.650951544e-05 ...estdt after call to comoving : 2.757140723e-07 ...change in a is 0.9996324109 percent Nyx::est_time_step at level 0: estdt = 2.757140723e-07 Integrating a from time 5.392392633e-07 by dt = 2.757140723e-07 Old / new A time 5.392392633e-07 8.149533356e-07 Old / new A 0.01009992648 0.01020088862 Old / new z 98.01062168 97.03067528 [Level 0 step 3] ADVANCE at time 5.392392633e-07 with dt = 2.757140723e-07 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 7.553938309e+10 from RHS at each level ... subtracting -1.285225153e-05 to ensure solvability moveKickDrift ... updating particle positions and velocity STARTING SDC_ITER LOOP 0 ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... ... Solving heating-cooling with SDC and CVode Nyx::sdc_reactions() time = 0.105679391 Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 7.553938309e+10 ... subtracting -1.256167889e-05 to ensure solvability moveKick ... updating velocity only [Level 0 step 3] Advanced 32768 cells [STEP 3] Coarse TimeStep time: 0.432979758 [STEP 3] FAB kilobyte spread across MPI nodes: [30978 ... 30978] STEP = 3 TIME = 8.149533356e-07 DT = 2.757140723e-07 ...estdt from hydro at level 0: 0.0001001310929 ...estdt from particles at level 0: 5.612993074e-05 ...estdt from neutrinos at level 0: 5.612993074e-05 ...estdt after call to comoving : 2.798585649e-07 ...change in a is 0.9996324083 percent Nyx::est_time_step at level 0: estdt = 2.798585649e-07 Integrating a from time 8.149533356e-07 by dt = 2.798585649e-07 Old / new A time 8.149533356e-07 1.094811901e-06 Old / new A 0.01020088862 0.01030286001 Old / new z 97.03067528 96.06042778 [Level 0 step 4] ADVANCE at time 8.149533356e-07 with dt = 2.798585649e-07 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 7.553938309e+10 from RHS at each level ... subtracting -1.257658005e-05 to ensure solvability moveKickDrift ... updating particle positions and velocity STARTING SDC_ITER LOOP 0 ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... ... Solving heating-cooling with SDC and CVode Nyx::sdc_reactions() time = 0.106577377 Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 7.553938309e+10 ... subtracting -1.281499863e-05 to ensure solvability moveKick ... updating velocity only [Level 0 step 4] Advanced 32768 cells [STEP 4] Coarse TimeStep time: 0.43951267 [STEP 4] FAB kilobyte spread across MPI nodes: [30978 ... 30978] STEP = 4 TIME = 1.094811901e-06 DT = 2.798585649e-07 ...estdt from hydro at level 0: 9.945097053e-05 ...estdt from particles at level 0: 5.576890888e-05 ...estdt from neutrinos at level 0: 5.576890888e-05 ...estdt after call to comoving : 2.840653566e-07 ...change in a is 0.9996324057 percent Nyx::est_time_step at level 0: estdt = 2.840653566e-07 Integrating a from time 1.094811901e-06 by dt = 2.840653566e-07 Old / new A time 1.094811901e-06 1.378877257e-06 Old / new A 0.01030286001 0.01040585074 Old / new z 96.06042778 95.09978321 [Level 0 step 5] ADVANCE at time 1.094811901e-06 with dt = 2.840653566e-07 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 7.553938309e+10 from RHS at each level ... subtracting -1.272559166e-05 to ensure solvability moveKickDrift ... updating particle positions and velocity STARTING SDC_ITER LOOP 0 ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... ... Solving heating-cooling with SDC and CVode Nyx::sdc_reactions() time = 0.107125743 Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 7.553938309e+10 ... subtracting -1.27479434e-05 to ensure solvability moveKick ... updating velocity only [Level 0 step 5] Advanced 32768 cells [STEP 5] Coarse TimeStep time: 0.43594165 [STEP 5] FAB kilobyte spread across MPI nodes: [30978 ... 30978] STEP = 5 TIME = 1.378877257e-06 DT = 2.840653566e-07 ...estdt from hydro at level 0: 9.880387578e-05 ...estdt from particles at level 0: 5.542536387e-05 ...estdt from neutrinos at level 0: 5.542536387e-05 ...estdt after call to comoving : 2.883353837e-07 ...change in a is 0.999632403 percent Nyx::est_time_step at level 0: estdt = 2.883353837e-07 Integrating a from time 1.378877257e-06 by dt = 2.883353837e-07 Old / new A time 1.378877257e-06 1.667212641e-06 Old / new A 0.01040585074 0.01050987099 Old / new z 95.09978321 94.14864651 [Level 0 step 6] ADVANCE at time 1.378877257e-06 with dt = 2.883353837e-07 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 7.553938309e+10 from RHS at each level ... subtracting -1.26734376e-05 to ensure solvability moveKickDrift ... updating particle positions and velocity STARTING SDC_ITER LOOP 0 ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... ... Solving heating-cooling with SDC and CVode Nyx::sdc_reactions() time = 0.108224038 Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 7.553938309e+10 ... subtracting -1.261383295e-05 to ensure solvability moveKick ... updating velocity only [Level 0 step 6] Advanced 32768 cells [STEP 6] Coarse TimeStep time: 0.441994932 [STEP 6] FAB kilobyte spread across MPI nodes: [30978 ... 30978] STEP = 6 TIME = 1.667212641e-06 DT = 2.883353837e-07 ...estdt from hydro at level 0: 9.818787984e-05 ...estdt from particles at level 0: 5.509828101e-05 ...estdt from neutrinos at level 0: 5.509828101e-05 ...estdt after call to comoving : 2.926695968e-07 ...change in a is 0.9996324002 percent Nyx::est_time_step at level 0: estdt = 2.926695968e-07 Integrating a from time 1.667212641e-06 by dt = 2.926695968e-07 Old / new A time 1.667212641e-06 1.959882238e-06 Old / new A 0.01050987099 0.01061493107 Old / new z 94.14864651 93.20692358 [Level 0 step 7] ADVANCE at time 1.667212641e-06 with dt = 2.926695968e-07 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 7.553938309e+10 from RHS at each level ... subtracting -1.281499863e-05 to ensure solvability moveKickDrift ... updating particle positions and velocity STARTING SDC_ITER LOOP 0 ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... ... Solving heating-cooling with SDC and CVode Nyx::sdc_reactions() time = 0.107552347 Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 7.553938309e+10 ... subtracting -1.355260611e-05 to ensure solvability moveKick ... updating velocity only [Level 0 step 7] Advanced 32768 cells [STEP 7] Coarse TimeStep time: 0.435300425 [STEP 7] FAB kilobyte spread across MPI nodes: [30978 ... 30978] STEP = 7 TIME = 1.959882238e-06 DT = 2.926695968e-07 ...estdt from hydro at level 0: 9.760119277e-05 ...estdt from particles at level 0: 5.478672374e-05 ...estdt from neutrinos at level 0: 5.478672374e-05 ...estdt after call to comoving : 2.970689606e-07 ...change in a is 0.9996323973 percent Nyx::est_time_step at level 0: estdt = 2.970689606e-07 Integrating a from time 1.959882238e-06 by dt = 2.970689606e-07 Old / new A time 1.959882238e-06 2.256951198e-06 Old / new A 0.01061493107 0.01072104136 Old / new z 93.20692358 92.27452124 [Level 0 step 8] ADVANCE at time 1.959882238e-06 with dt = 2.970689606e-07 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 7.553938309e+10 from RHS at each level ... subtracting -1.349300146e-05 to ensure solvability moveKickDrift ... updating particle positions and velocity STARTING SDC_ITER LOOP 0 ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... ... Solving heating-cooling with SDC and CVode Nyx::sdc_reactions() time = 0.106210322 Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 7.553938309e+10 ... subtracting -1.242011786e-05 to ensure solvability moveKick ... updating velocity only [Level 0 step 8] Advanced 32768 cells [STEP 8] Coarse TimeStep time: 0.433245159 [STEP 8] FAB kilobyte spread across MPI nodes: [30978 ... 30978] STEP = 8 TIME = 2.256951198e-06 DT = 2.970689606e-07 ...estdt from hydro at level 0: 9.70421515e-05 ...estdt from particles at level 0: 5.448982672e-05 ...estdt from neutrinos at level 0: 5.448982672e-05 ...estdt after call to comoving : 3.015344545e-07 ...change in a is 0.9996323943 percent Nyx::est_time_step at level 0: estdt = 3.015344545e-07 Integrating a from time 2.256951198e-06 by dt = 3.015344545e-07 Old / new A time 2.256951198e-06 2.558485653e-06 Old / new A 0.01072104136 0.01082821236 Old / new z 92.27452124 91.35134726 [Level 0 step 9] ADVANCE at time 2.256951198e-06 with dt = 3.015344545e-07 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 7.553938309e+10 from RHS at each level ... subtracting -1.240521669e-05 to ensure solvability moveKickDrift ... updating particle positions and velocity STARTING SDC_ITER LOOP 0 ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... ... Solving heating-cooling with SDC and CVode Nyx::sdc_reactions() time = 0.105555609 Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 7.553938309e+10 ... subtracting -1.295655966e-05 to ensure solvability moveKick ... updating velocity only [Level 0 step 9] Advanced 32768 cells [STEP 9] Coarse TimeStep time: 0.434611136 [STEP 9] FAB kilobyte spread across MPI nodes: [30978 ... 30978] STEP = 9 TIME = 2.558485653e-06 DT = 3.015344545e-07 ...estdt from hydro at level 0: 9.650921021e-05 ...estdt from particles at level 0: 5.420676485e-05 ...estdt from neutrinos at level 0: 5.420676485e-05 ...estdt after call to comoving : 3.060670725e-07 ...change in a is 0.9996323912 percent Nyx::est_time_step at level 0: estdt = 3.060670725e-07 Integrating a from time 2.558485653e-06 by dt = 3.060670725e-07 Old / new A time 2.558485653e-06 2.864552725e-06 Old / new A 0.01082821236 0.01093645468 Old / new z 91.35134726 90.43731029 [Level 0 step 10] ADVANCE at time 2.558485653e-06 with dt = 3.060670725e-07 Gravity ... multilevel solve for old phi at base level 0 to finest level 0 ... subtracting average density 7.553938309e+10 from RHS at each level ... subtracting -1.266598701e-05 to ensure solvability moveKickDrift ... updating particle positions and velocity STARTING SDC_ITER LOOP 0 ... Computing hydro advance Updating state with the hydro sources ... Enforce minimum density... ... Solving heating-cooling with SDC and CVode Nyx::sdc_reactions() time = 0.108555772 Gravity ... single level solve for new phi at level 0 ... solve for phi at level 0 ... subtracting average density from RHS in solve ... 7.553938309e+10 ... subtracting -1.199543476e-05 to ensure solvability moveKick ... updating velocity only [Level 0 step 10] Advanced 32768 cells [STEP 10] Coarse TimeStep time: 0.435489483 [STEP 10] FAB kilobyte spread across MPI nodes: [30978 ... 30978] STEP = 10 TIME = 2.864552725e-06 DT = 3.060670725e-07 Time w/o init: 4.357031659 PLOTFILE: file = LyA_Neutrinos_plt00010 Output file LyA_Neutrinos_plt00010.temp at time 0.010936 and step 10 Write plotfile time = 0.011370926 seconds Run time = 4.456673897 TinyProfiler total time across processes [min...avg...max]: 4.457 ... 4.457 ... 4.457 -------------------------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------------------------- Nyx::umeth() 160 2.492 2.492 2.492 55.91% Nyx::reactions_f 1440 0.9433 0.9433 0.9433 21.17% Nyx::compute_new_temp() 42 0.3123 0.3123 0.3123 7.01% Nyx::reactions_cells_finalize 160 0.0917 0.0917 0.0917 2.06% MLPoisson::Fsmooth() 3104 0.08959 0.08959 0.08959 2.01% Nyx::umdrv() 160 0.0463 0.0463 0.0463 1.04% ParticleContainer::AssignCellDensitySingleLevel() 49 0.03379 0.03379 0.03379 0.76% FillBoundary_nowait() 3783 0.02979 0.02979 0.02979 0.67% Nyx::sdc_hydro() 10 0.0297 0.0297 0.0297 0.67% DarkMatterParticleContainer::moveKickDrift() 40 0.02532 0.02532 0.02532 0.57% DarkMatterParticleContainer::moveKick() 20 0.02012 0.02012 0.02012 0.45% Nyx::reactions_cvode 160 0.02011 0.02011 0.02011 0.45% FillPatchIterator::Initialize 91 0.01915 0.01915 0.01915 0.43% NyxParticleContainer::estTimestep(lev) 22 0.01645 0.01645 0.01645 0.37% numParticlesOutOfRange() 64 0.01628 0.01628 0.01628 0.37% Redistribute_partition 24 0.01497 0.01497 0.01497 0.34% amrex::Copy() 636 0.01308 0.01308 0.01308 0.29% ParticleContainer::InitFromBinaryFile() 2 0.01295 0.01295 0.01295 0.29% MLMG::addInterpCorrection() 388 0.01272 0.01272 0.01272 0.29% MLCellLinOp::applyBC() 3897 0.0122 0.0122 0.0122 0.27% FabArray::setVal() 1370 0.01202 0.01202 0.01202 0.27% FabArray::ParallelCopy_nowait() 95 0.01132 0.01132 0.01132 0.25% Nyx::srctoprim() 160 0.01078 0.01078 0.01078 0.24% Nyx::advance_hydro_pc_umdrv() 10 0.009535 0.009535 0.009535 0.21% Nyx::update_state_with_sources() 10 0.00864 0.00864 0.00864 0.19% MLPoisson::Fapply() 772 0.00837 0.00837 0.00837 0.19% Nyx::ctoprim() 160 0.007545 0.007545 0.007545 0.17% VisMF::Write(FabArray) 2 0.006531 0.006531 0.006531 0.15% Nyx::advance_hydro_plus_particles() 10 0.006352 0.006352 0.006352 0.14% Nyx::reset_internal_energy() 41 0.006157 0.006157 0.006157 0.14% Nyx::reactions_cells_initialize 160 0.006018 0.006018 0.006018 0.14% FabArray::norminf() 513 0.005936 0.005936 0.005936 0.13% amrex::average_down 388 0.005602 0.005602 0.005602 0.13% Nyx::compute_rho_temp()::OnHost 11 0.004702 0.004702 0.004702 0.11% Amr::InitAmr() 1 0.0043 0.0043 0.0043 0.10% FabArray::sum() 215 0.00411 0.00411 0.00411 0.09% FabArray::Xpay() 506 0.003951 0.003951 0.003951 0.09% ParticleContainer::BuildRedistributeMask 20 0.00391 0.00391 0.00391 0.09% amrex::Add() 172 0.003422 0.003422 0.003422 0.08% AmrLevel::writePlotFile() 2 0.003402 0.003402 0.003402 0.08% ParticleContainer::WriteParticles() 4 0.003207 0.003207 0.003207 0.07% MLMG::prepareForSolve() 21 0.003168 0.003168 0.003168 0.07% StateData::define() 5 0.0031 0.0031 0.0031 0.07% MLCellLinOp::defineAuxData() 21 0.003064 0.003064 0.003064 0.07% Nyx::est_time_step() 11 0.00283 0.00283 0.00283 0.06% FabArray::FillBoundary() 3755 0.002733 0.002733 0.002733 0.06% WriteBinaryParticleData() 4 0.002051 0.002051 0.002051 0.05% Gravity::get_old_grav_vector() 30 0.001996 0.001996 0.001996 0.04% Gravity::solve_with_MLMG 21 0.001904 0.001904 0.001904 0.04% FabArrayBase::getFB() 3783 0.00182 0.00182 0.00182 0.04% Gravity::get_new_grav_vector() 21 0.001396 0.001396 0.001396 0.03% AmrLevel::derive() 8 0.001311 0.001311 0.001311 0.03% MLCellLinOp::smooth() 873 0.00128 0.00128 0.00128 0.03% MLCGSolver::bicgstab 97 0.001151 0.001151 0.001151 0.03% Amr::writePlotFile() 2 0.001074 0.001074 0.001074 0.02% Gravity::multilevel_solve_for_old_phi() 10 0.0008906 0.0008906 0.0008906 0.02% FabArrayBase::getCPC() 849 0.0008336 0.0008336 0.0008336 0.02% solve_for_old_phi 10 0.0008269 0.0008269 0.0008269 0.02% Gravity::actual_multilevel_solve() 11 0.0006965 0.0006965 0.0006965 0.02% ParticleContainer::AssignDensity() 29 0.0006921 0.0006921 0.0006921 0.02% MLCellLinOp::apply() 772 0.0005879 0.0005879 0.0005879 0.01% Nyx::reset_internal_energy_nostore() 20 0.0004952 0.0004952 0.0004952 0.01% Gravity::solve_for_new_phi() 10 0.0004822 0.0004822 0.0004822 0.01% main() 1 0.0004646 0.0004646 0.0004646 0.01% MLMG::actualBottomSolve() 97 0.0004489 0.0004489 0.0004489 0.01% Nyx::post_timestep()::sum_write 10 0.0004331 0.0004331 0.0004331 0.01% AmrLevel::FillPatch() 91 0.000387 0.000387 0.000387 0.01% Nyx::integrate_state_struct_mfin 160 0.000337 0.000337 0.000337 0.01% MLCellLinOp::correctionResidual() 388 0.0003305 0.0003305 0.0003305 0.01% Gravity::AddParticlesToRhs() 10 0.0003275 0.0003275 0.0003275 0.01% Nyx::sdc_reactions() 10 0.0003034 0.0003034 0.0003034 0.01% MLMG:computeResOfCorrection() 388 0.0002962 0.0002962 0.0002962 0.01% Amr::coarseTimeStep() 10 0.0002785 0.0002785 0.0002785 0.01% MLMG::mgVcycle() 97 0.0002329 0.0002329 0.0002329 0.01% MLMG::oneIter() 97 0.0001784 0.0001784 0.0001784 0.00% Amr::timeStep() 10 0.000172 0.000172 0.000172 0.00% MLCellLinOp::solutionResidual() 118 0.0001443 0.0001443 0.0001443 0.00% MLMG::solve() 21 0.0001403 0.0001403 0.0001403 0.00% Nyx::post_init() 1 0.0001394 0.0001394 0.0001394 0.00% MLMG::mgVcycle_down::1 97 0.0001347 0.0001347 0.0001347 0.00% MLMG::ResNormInf() 118 0.0001341 0.0001341 0.0001341 0.00% FillPatchIterator::FillFromLevel0() 91 0.0001339 0.0001339 0.0001339 0.00% MLMG::mgVcycle_down::0 97 0.00013 0.00013 0.00013 0.00% FabArray::ParallelCopy() 95 0.000129 0.000129 0.000129 0.00% ParticleContainer::Redistribute_impl() 24 0.0001264 0.0001264 0.0001264 0.00% FillPatchSingleLevel 91 0.0001225 0.0001225 0.0001225 0.00% Nyx::computeNewDt() 9 0.0001162 0.0001162 0.0001162 0.00% MLMG::computeResidual() 97 0.0001089 0.0001089 0.0001089 0.00% MLMG::mgVcycle_up::1 97 0.0001055 0.0001055 0.0001055 0.00% MLMG::mgVcycle_down::2 97 0.0001041 0.0001041 0.0001041 0.00% Nyx::init_santa_barbara() 1 0.0001025 0.0001025 0.0001025 0.00% MLMG::mgVcycle_down::3 97 0.0001024 0.0001024 0.0001024 0.00% MLMG::mgVcycle_up::0 97 0.0001003 0.0001003 0.0001003 0.00% Nyx::init_particles() 1 9.799e-05 9.799e-05 9.799e-05 0.00% MLMG::mgVcycle_up::2 97 9.452e-05 9.452e-05 9.452e-05 0.00% Nyx::particle_est_time_step() 11 9.426e-05 9.426e-05 9.426e-05 0.00% MLMG::mgVcycle_up::3 97 9.25e-05 9.25e-05 9.25e-05 0.00% Nyx::derive(mf) 8 8.689e-05 8.689e-05 8.689e-05 0.00% Gravity::AddParticlesToRhsML() 11 8.064e-05 8.064e-05 8.064e-05 0.00% MLMG::mgVcycle_bottom 97 8.034e-05 8.034e-05 8.034e-05 0.00% Gravity::solve_for_phi() 10 6.982e-05 6.982e-05 6.982e-05 0.00% MLPoisson::define() 21 6.859e-05 6.859e-05 6.859e-05 0.00% Nyx::computeInitialDt() 2 6.789e-05 6.789e-05 6.789e-05 0.00% FabArray::SumBoundary() 49 6.329e-05 6.329e-05 6.329e-05 0.00% Nyx::initData() 1 5.889e-05 5.889e-05 5.889e-05 0.00% Gravity::multilevel_solve_for_new_phi() 1 5.538e-05 5.538e-05 5.538e-05 0.00% FabArray::SumBoundary_nowait() 49 4.818e-05 4.818e-05 4.818e-05 0.00% REG::R::Nyx::coarseTimeStep 1 4.083e-05 4.083e-05 4.083e-05 0.00% Nyx::post_timestep() 10 3.892e-05 3.892e-05 3.892e-05 0.00% REG::R::Nyx::advance_hydro_plus_particles 10 3.812e-05 3.812e-05 3.812e-05 0.00% MLMG::computeMLResidual() 21 3.407e-05 3.407e-05 3.407e-05 0.00% Amr::FinalizeInit() 1 2.928e-05 2.928e-05 2.928e-05 0.00% Amr::defBaseLevel() 1 2.902e-05 2.902e-05 2.902e-05 0.00% Nyx::post_timestep()::redist 10 2.876e-05 2.876e-05 2.876e-05 0.00% solve_for_new_phi 10 2.846e-05 2.846e-05 2.846e-05 0.00% REG::R::Nyx::advance::STEP1 10 2.774e-05 2.774e-05 2.774e-05 0.00% Nyx::initial_time_step() 2 2.757e-05 2.757e-05 2.757e-05 0.00% just_the_hydro 10 2.718e-05 2.718e-05 2.718e-05 0.00% Nyx::compute_rho_temp() 11 1.841e-05 1.841e-05 1.841e-05 0.00% sdc_reactions 10 1.837e-05 1.837e-05 1.837e-05 0.00% AmrLevel::AmrLevel(dm) 1 1.739e-05 1.739e-05 1.739e-05 0.00% Nyx::post_timestep()::compute_temp 10 1.332e-05 1.332e-05 1.332e-05 0.00% Amr::InitializeInit() 1 1.146e-05 1.146e-05 1.146e-05 0.00% Nyx::particle_redistribute() 1 9.195e-06 9.195e-06 9.195e-06 0.00% NyxParticleContainer::WriteNyxPlotFile() 4 7.205e-06 7.205e-06 7.205e-06 0.00% ParticleContainer::OK() 8 4.857e-06 4.857e-06 4.857e-06 0.00% Amr::init() 1 1.725e-06 1.725e-06 1.725e-06 0.00% Amr::initialInit() 1 1.333e-06 1.333e-06 1.333e-06 0.00% Nyx::post_regrid() 1 9.11e-07 9.11e-07 9.11e-07 0.00% Other 8916 0.02728 0.02728 0.02728 0.61% -------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------------------------- main() 1 4.457 4.457 4.457 100.00% REG::R::Nyx::coarseTimeStep 1 4.357 4.357 4.357 97.76% Amr::coarseTimeStep() 10 4.357 4.357 4.357 97.76% Amr::timeStep() 10 4.339 4.339 4.339 97.35% REG::R::Nyx::advance::STEP1 10 4.155 4.155 4.155 93.23% REG::R::Nyx::advance_hydro_plus_particles 10 4.155 4.155 4.155 93.23% Nyx::advance_hydro_plus_particles() 10 4.155 4.155 4.155 93.23% just_the_hydro 10 3.79 3.79 3.79 85.03% Nyx::sdc_hydro() 10 3.789 3.789 3.789 85.03% Nyx::advance_hydro_pc_umdrv() 10 2.566 2.566 2.566 57.57% Nyx::umdrv() 160 2.538 2.538 2.538 56.94% Nyx::umeth() 160 2.492 2.492 2.492 55.91% sdc_reactions 10 1.142 1.142 1.142 25.62% Nyx::sdc_reactions() 10 1.142 1.142 1.142 25.62% Nyx::integrate_state_struct_mfin 160 1.065 1.065 1.065 23.90% Nyx::reactions_cvode 160 0.9634 0.9634 0.9634 21.62% Nyx::reactions_f 1440 0.9433 0.9433 0.9433 21.17% Nyx::compute_new_temp() 42 0.3123 0.3123 0.3123 7.01% Gravity::solve_with_MLMG 21 0.1932 0.1932 0.1932 4.33% Nyx::post_timestep() 10 0.1834 0.1834 0.1834 4.12% MLMG::solve() 21 0.1799 0.1799 0.1799 4.04% solve_for_new_phi 10 0.1709 0.1709 0.1709 3.83% Gravity::solve_for_new_phi() 10 0.1709 0.1709 0.1709 3.83% MLMG::oneIter() 97 0.1592 0.1592 0.1592 3.57% MLMG::mgVcycle() 97 0.153 0.153 0.153 3.43% Gravity::solve_for_phi() 10 0.1525 0.1525 0.1525 3.42% MLCellLinOp::smooth() 873 0.1161 0.1161 0.1161 2.60% Nyx::reactions_cells_finalize 160 0.0917 0.0917 0.0917 2.06% MLPoisson::Fsmooth() 3104 0.08959 0.08959 0.08959 2.01% Amr::init() 1 0.08282 0.08282 0.08282 1.86% Nyx::post_timestep()::sum_write 10 0.07891 0.07891 0.07891 1.77% Nyx::post_timestep()::compute_temp 10 0.0761 0.0761 0.0761 1.71% Amr::initialInit() 1 0.06887 0.06887 0.06887 1.55% Gravity::actual_multilevel_solve() 11 0.06157 0.06157 0.06157 1.38% MLMG::mgVcycle_down::0 97 0.05637 0.05637 0.05637 1.26% MLMG::mgVcycle_up::0 97 0.05499 0.05499 0.05499 1.23% solve_for_old_phi 10 0.04321 0.04321 0.04321 0.97% Amr::FinalizeInit() 1 0.04243 0.04243 0.04243 0.95% Gravity::multilevel_solve_for_old_phi() 10 0.0419 0.0419 0.0419 0.94% Nyx::post_init() 1 0.03877 0.03877 0.03877 0.87% AmrLevel::FillPatch() 91 0.03866 0.03866 0.03866 0.87% ParticleContainer::AssignCellDensitySingleLevel() 49 0.03815 0.03815 0.03815 0.86% FabArray::FillBoundary() 3755 0.03382 0.03382 0.03382 0.76% MLCellLinOp::applyBC() 3897 0.03316 0.03316 0.03316 0.74% FillBoundary_nowait() 3783 0.03207 0.03207 0.03207 0.72% FillPatchIterator::Initialize 91 0.03135 0.03135 0.03135 0.70% Nyx::post_timestep()::redist 10 0.02818 0.02818 0.02818 0.63% Amr::InitializeInit() 1 0.02644 0.02644 0.02644 0.59% Amr::defBaseLevel() 1 0.02642 0.02642 0.02642 0.59% ParticleContainer::Redistribute_impl() 24 0.0263 0.0263 0.0263 0.59% Amr::writePlotFile() 2 0.02536 0.02536 0.02536 0.57% DarkMatterParticleContainer::moveKickDrift() 40 0.02532 0.02532 0.02532 0.57% ParticleContainer::AssignDensity() 29 0.02235 0.02235 0.02235 0.50% Nyx::initData() 1 0.02168 0.02168 0.02168 0.49% Gravity::multilevel_solve_for_new_phi() 1 0.02062 0.02062 0.02062 0.46% DarkMatterParticleContainer::moveKick() 20 0.02012 0.02012 0.02012 0.45% Nyx::est_time_step() 11 0.01937 0.01937 0.01937 0.43% Gravity::get_old_grav_vector() 30 0.01777 0.01777 0.01777 0.40% AmrLevel::writePlotFile() 2 0.01765 0.01765 0.01765 0.40% Gravity::AddParticlesToRhs() 10 0.0176 0.0176 0.0176 0.39% Gravity::AddParticlesToRhsML() 11 0.01716 0.01716 0.01716 0.39% Nyx::particle_est_time_step() 11 0.01654 0.01654 0.01654 0.37% MLCellLinOp::apply() 772 0.01648 0.01648 0.01648 0.37% NyxParticleContainer::estTimestep(lev) 22 0.01645 0.01645 0.01645 0.37% numParticlesOutOfRange() 64 0.01628 0.01628 0.01628 0.37% Nyx::init_particles() 1 0.01615 0.01615 0.01615 0.36% Nyx::computeNewDt() 9 0.01606 0.01606 0.01606 0.36% ParticleContainer::InitFromBinaryFile() 2 0.01605 0.01605 0.01605 0.36% Redistribute_partition 24 0.01497 0.01497 0.01497 0.34% amrex::Copy() 636 0.01308 0.01308 0.01308 0.29% MLMG::addInterpCorrection() 388 0.01272 0.01272 0.01272 0.29% FillPatchIterator::FillFromLevel0() 91 0.01204 0.01204 0.01204 0.27% FabArray::setVal() 1370 0.01202 0.01202 0.01202 0.27% FillPatchSingleLevel 91 0.01191 0.01191 0.01191 0.27% FabArray::ParallelCopy() 95 0.01172 0.01172 0.01172 0.26% FabArray::ParallelCopy_nowait() 95 0.01151 0.01151 0.01151 0.26% MLMG::mgVcycle_down::1 97 0.01121 0.01121 0.01121 0.25% Nyx::srctoprim() 160 0.01078 0.01078 0.01078 0.24% Gravity::get_new_grav_vector() 21 0.01044 0.01044 0.01044 0.23% MLMG::mgVcycle_up::1 97 0.01038 0.01038 0.01038 0.23% MLMG:computeResOfCorrection() 388 0.01036 0.01036 0.01036 0.23% MLCellLinOp::correctionResidual() 388 0.01006 0.01006 0.01006 0.23% MLPoisson::define() 21 0.009319 0.009319 0.009319 0.21% Nyx::update_state_with_sources() 10 0.009315 0.009315 0.009315 0.21% MLCellLinOp::solutionResidual() 118 0.008932 0.008932 0.008932 0.20% MLPoisson::Fapply() 772 0.00837 0.00837 0.00837 0.19% Nyx::ctoprim() 160 0.007545 0.007545 0.007545 0.17% Nyx::derive(mf) 8 0.007154 0.007154 0.007154 0.16% MLMG::computeResidual() 97 0.007027 0.007027 0.007027 0.16% NyxParticleContainer::WriteNyxPlotFile() 4 0.006537 0.006537 0.006537 0.15% VisMF::Write(FabArray) 2 0.006531 0.006531 0.006531 0.15% WriteBinaryParticleData() 4 0.00653 0.00653 0.00653 0.15% Nyx::reset_internal_energy() 41 0.006157 0.006157 0.006157 0.14% MLMG::prepareForSolve() 21 0.006049 0.006049 0.006049 0.14% Nyx::reactions_cells_initialize 160 0.006018 0.006018 0.006018 0.14% FabArray::norminf() 513 0.005936 0.005936 0.005936 0.13% MLCellLinOp::defineAuxData() 21 0.005877 0.005877 0.005877 0.13% amrex::average_down 388 0.005602 0.005602 0.005602 0.13% MLMG::mgVcycle_bottom 97 0.005468 0.005468 0.005468 0.12% MLMG::actualBottomSolve() 97 0.005387 0.005387 0.005387 0.12% Amr::InitAmr() 1 0.004955 0.004955 0.004955 0.11% Nyx::compute_rho_temp() 11 0.004721 0.004721 0.004721 0.11% Nyx::compute_rho_temp()::OnHost 11 0.004702 0.004702 0.004702 0.11% MLMG::ResNormInf() 118 0.004582 0.004582 0.004582 0.10% MLCGSolver::bicgstab 97 0.00457 0.00457 0.00457 0.10% MLMG::mgVcycle_down::2 97 0.004291 0.004291 0.004291 0.10% FabArray::sum() 215 0.00411 0.00411 0.00411 0.09% ParticleContainer::BuildRedistributeMask 20 0.003985 0.003985 0.003985 0.09% FabArray::Xpay() 506 0.003951 0.003951 0.003951 0.09% MLMG::mgVcycle_up::2 97 0.003827 0.003827 0.003827 0.09% Nyx::reset_internal_energy_nostore() 20 0.003772 0.003772 0.003772 0.08% Nyx::init_santa_barbara() 1 0.003686 0.003686 0.003686 0.08% AmrLevel::derive() 8 0.003579 0.003579 0.003579 0.08% Nyx::computeInitialDt() 2 0.003524 0.003524 0.003524 0.08% Nyx::initial_time_step() 2 0.003457 0.003457 0.003457 0.08% amrex::Add() 172 0.003422 0.003422 0.003422 0.08% MLMG::mgVcycle_down::3 97 0.003345 0.003345 0.003345 0.08% ParticleContainer::WriteParticles() 4 0.003207 0.003207 0.003207 0.07% AmrLevel::AmrLevel(dm) 1 0.003118 0.003118 0.003118 0.07% StateData::define() 5 0.0031 0.0031 0.0031 0.07% MLMG::mgVcycle_up::3 97 0.002843 0.002843 0.002843 0.06% FabArray::SumBoundary() 49 0.002801 0.002801 0.002801 0.06% FabArrayBase::getCPC() 849 0.002801 0.002801 0.002801 0.06% FabArray::SumBoundary_nowait() 49 0.002668 0.002668 0.002668 0.06% ParticleContainer::OK() 8 0.002613 0.002613 0.002613 0.06% FabArrayBase::getFB() 3783 0.002272 0.002272 0.002272 0.05% Nyx::post_regrid() 1 0.00209 0.00209 0.00209 0.05% Nyx::particle_redistribute() 1 0.002089 0.002089 0.002089 0.05% MLMG::computeMLResidual() 21 0.002048 0.002048 0.002048 0.05% Other 8916 0.04411 0.04411 0.04411 0.99% -------------------------------------------------------------------------------------------------------------- BEGIN REGION R::Nyx::advance::STEP1 -------------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------------- Nyx::umeth() 160 2.492 2.492 2.492 55.91% Nyx::reactions_f 1440 0.9433 0.9433 0.9433 21.17% Nyx::compute_new_temp() 20 0.1499 0.1499 0.1499 3.36% Nyx::reactions_cells_finalize 160 0.0917 0.0917 0.0917 2.06% MLPoisson::Fsmooth() 2752 0.07965 0.07965 0.07965 1.79% Nyx::umdrv() 160 0.0463 0.0463 0.0463 1.04% Nyx::sdc_hydro() 10 0.0297 0.0297 0.0297 0.67% ParticleContainer::AssignCellDensitySingleLevel() 40 0.0278 0.0278 0.0278 0.62% FillBoundary_nowait() 3380 0.02774 0.02774 0.02774 0.62% DarkMatterParticleContainer::moveKickDrift() 40 0.02532 0.02532 0.02532 0.57% DarkMatterParticleContainer::moveKick() 20 0.02012 0.02012 0.02012 0.45% Nyx::reactions_cvode 160 0.02011 0.02011 0.02011 0.45% FillPatchIterator::Initialize 80 0.01778 0.01778 0.01778 0.40% amrex::Copy() 544 0.01178 0.01178 0.01178 0.26% MLMG::addInterpCorrection() 344 0.01135 0.01135 0.01135 0.25% MLCellLinOp::applyBC() 3464 0.01105 0.01105 0.01105 0.25% Nyx::srctoprim() 160 0.01078 0.01078 0.01078 0.24% FabArray::setVal() 1222 0.01075 0.01075 0.01075 0.24% FabArray::ParallelCopy_nowait() 80 0.0107 0.0107 0.0107 0.24% Nyx::advance_hydro_pc_umdrv() 10 0.009535 0.009535 0.009535 0.21% Nyx::update_state_with_sources() 10 0.00864 0.00864 0.00864 0.19% Nyx::ctoprim() 160 0.007545 0.007545 0.007545 0.17% MLPoisson::Fapply() 692 0.007499 0.007499 0.007499 0.17% Nyx::advance_hydro_plus_particles() 10 0.006352 0.006352 0.006352 0.14% Nyx::reactions_cells_initialize 160 0.006018 0.006018 0.006018 0.14% amrex::average_down 344 0.005027 0.005027 0.005027 0.11% FabArray::norminf() 454 0.005024 0.005024 0.005024 0.11% Nyx::reset_internal_energy() 30 0.004535 0.004535 0.004535 0.10% FabArray::sum() 192 0.003691 0.003691 0.003691 0.08% FabArray::Xpay() 450 0.003552 0.003552 0.003552 0.08% amrex::Add() 156 0.003088 0.003088 0.003088 0.07% MLMG::prepareForSolve() 20 0.003048 0.003048 0.003048 0.07% MLCellLinOp::defineAuxData() 20 0.002933 0.002933 0.002933 0.07% FabArray::FillBoundary() 3360 0.0026 0.0026 0.0026 0.06% Gravity::get_old_grav_vector() 30 0.001996 0.001996 0.001996 0.04% Gravity::solve_with_MLMG 20 0.001876 0.001876 0.001876 0.04% Gravity::get_new_grav_vector() 20 0.00133 0.00133 0.00133 0.03% MLCellLinOp::smooth() 774 0.001187 0.001187 0.001187 0.03% MLCGSolver::bicgstab 86 0.001062 0.001062 0.001062 0.02% Gravity::multilevel_solve_for_old_phi() 10 0.0008906 0.0008906 0.0008906 0.02% solve_for_old_phi 10 0.0008269 0.0008269 0.0008269 0.02% Gravity::actual_multilevel_solve() 10 0.0006432 0.0006432 0.0006432 0.01% MLCellLinOp::apply() 692 0.0005588 0.0005588 0.0005588 0.01% Gravity::solve_for_new_phi() 10 0.0004822 0.0004822 0.0004822 0.01% ParticleContainer::AssignDensity() 20 0.0004392 0.0004392 0.0004392 0.01% MLMG::actualBottomSolve() 86 0.0004124 0.0004124 0.0004124 0.01% AmrLevel::FillPatch() 80 0.0003619 0.0003619 0.0003619 0.01% Nyx::integrate_state_struct_mfin 160 0.000337 0.000337 0.000337 0.01% Gravity::AddParticlesToRhs() 10 0.0003275 0.0003275 0.0003275 0.01% MLCellLinOp::correctionResidual() 344 0.0003142 0.0003142 0.0003142 0.01% Nyx::sdc_reactions() 10 0.0003034 0.0003034 0.0003034 0.01% MLMG:computeResOfCorrection() 344 0.0002854 0.0002854 0.0002854 0.01% MLMG::mgVcycle() 86 0.000216 0.000216 0.000216 0.00% MLMG::oneIter() 86 0.0001649 0.0001649 0.0001649 0.00% MLCellLinOp::solutionResidual() 106 0.0001369 0.0001369 0.0001369 0.00% MLMG::solve() 20 0.0001307 0.0001307 0.0001307 0.00% MLMG::ResNormInf() 106 0.0001273 0.0001273 0.0001273 0.00% MLMG::mgVcycle_down::1 86 0.0001265 0.0001265 0.0001265 0.00% MLMG::mgVcycle_down::0 86 0.00012 0.00012 0.00012 0.00% FillPatchIterator::FillFromLevel0() 80 0.0001183 0.0001183 0.0001183 0.00% FabArray::ParallelCopy() 80 0.0001177 0.0001177 0.0001177 0.00% FillPatchSingleLevel 80 0.000113 0.000113 0.000113 0.00% MLMG::computeResidual() 86 0.0001044 0.0001044 0.0001044 0.00% MLMG::mgVcycle_up::1 86 0.0001014 0.0001014 0.0001014 0.00% MLMG::mgVcycle_down::2 86 9.823e-05 9.823e-05 9.823e-05 0.00% MLMG::mgVcycle_down::3 86 9.718e-05 9.718e-05 9.718e-05 0.00% MLMG::mgVcycle_up::0 86 9.543e-05 9.543e-05 9.543e-05 0.00% MLMG::mgVcycle_up::2 86 9.054e-05 9.054e-05 9.054e-05 0.00% MLMG::mgVcycle_up::3 86 8.852e-05 8.852e-05 8.852e-05 0.00% MLMG::mgVcycle_bottom 86 7.727e-05 7.727e-05 7.727e-05 0.00% Gravity::AddParticlesToRhsML() 10 7.605e-05 7.605e-05 7.605e-05 0.00% Gravity::solve_for_phi() 10 6.982e-05 6.982e-05 6.982e-05 0.00% MLPoisson::define() 20 5.521e-05 5.521e-05 5.521e-05 0.00% REG::R::Nyx::advance_hydro_plus_particles 10 3.812e-05 3.812e-05 3.812e-05 0.00% solve_for_new_phi 10 2.846e-05 2.846e-05 2.846e-05 0.00% REG::R::Nyx::advance::STEP1 10 2.774e-05 2.774e-05 2.774e-05 0.00% just_the_hydro 10 2.718e-05 2.718e-05 2.718e-05 0.00% sdc_reactions 10 1.837e-05 1.837e-05 1.837e-05 0.00% Other 11969 0.02237 0.02237 0.02237 0.50% -------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------------- REG::R::Nyx::advance::STEP1 10 4.155 4.155 4.155 93.23% REG::R::Nyx::advance_hydro_plus_particles 10 4.155 4.155 4.155 93.23% Nyx::advance_hydro_plus_particles() 10 4.155 4.155 4.155 93.23% just_the_hydro 10 3.79 3.79 3.79 85.03% Nyx::sdc_hydro() 10 3.789 3.789 3.789 85.03% Nyx::advance_hydro_pc_umdrv() 10 2.566 2.566 2.566 57.57% Nyx::umdrv() 160 2.538 2.538 2.538 56.94% Nyx::umeth() 160 2.492 2.492 2.492 55.91% sdc_reactions 10 1.142 1.142 1.142 25.62% Nyx::sdc_reactions() 10 1.142 1.142 1.142 25.62% Nyx::integrate_state_struct_mfin 160 1.065 1.065 1.065 23.90% Nyx::reactions_cvode 160 0.9634 0.9634 0.9634 21.62% Nyx::reactions_f 1440 0.9433 0.9433 0.9433 21.17% Gravity::solve_with_MLMG 20 0.1743 0.1743 0.1743 3.91% solve_for_new_phi 10 0.1709 0.1709 0.1709 3.83% Gravity::solve_for_new_phi() 10 0.1709 0.1709 0.1709 3.83% MLMG::solve() 20 0.1618 0.1618 0.1618 3.63% Gravity::solve_for_phi() 10 0.1525 0.1525 0.1525 3.42% Nyx::compute_new_temp() 20 0.1499 0.1499 0.1499 3.36% MLMG::oneIter() 86 0.1427 0.1427 0.1427 3.20% MLMG::mgVcycle() 86 0.1372 0.1372 0.1372 3.08% MLCellLinOp::smooth() 774 0.1038 0.1038 0.1038 2.33% Nyx::reactions_cells_finalize 160 0.0917 0.0917 0.0917 2.06% MLPoisson::Fsmooth() 2752 0.07965 0.07965 0.07965 1.79% MLMG::mgVcycle_down::0 86 0.05027 0.05027 0.05027 1.13% MLMG::mgVcycle_up::0 86 0.04882 0.04882 0.04882 1.10% solve_for_old_phi 10 0.04321 0.04321 0.04321 0.97% Gravity::multilevel_solve_for_old_phi() 10 0.0419 0.0419 0.0419 0.94% Gravity::actual_multilevel_solve() 10 0.04101 0.04101 0.04101 0.92% AmrLevel::FillPatch() 80 0.03617 0.03617 0.03617 0.81% FabArray::FillBoundary() 3360 0.03192 0.03192 0.03192 0.72% ParticleContainer::AssignCellDensitySingleLevel() 40 0.03136 0.03136 0.03136 0.70% MLCellLinOp::applyBC() 3464 0.03023 0.03023 0.03023 0.68% FillBoundary_nowait() 3380 0.02984 0.02984 0.02984 0.67% FillPatchIterator::Initialize 80 0.02935 0.02935 0.02935 0.66% DarkMatterParticleContainer::moveKickDrift() 40 0.02532 0.02532 0.02532 0.57% DarkMatterParticleContainer::moveKick() 20 0.02012 0.02012 0.02012 0.45% Gravity::get_old_grav_vector() 30 0.01777 0.01777 0.01777 0.40% Gravity::AddParticlesToRhs() 10 0.0176 0.0176 0.0176 0.39% Gravity::AddParticlesToRhsML() 10 0.01566 0.01566 0.01566 0.35% ParticleContainer::AssignDensity() 20 0.01517 0.01517 0.01517 0.34% MLCellLinOp::apply() 692 0.01495 0.01495 0.01495 0.34% amrex::Copy() 544 0.01178 0.01178 0.01178 0.26% FillPatchIterator::FillFromLevel0() 80 0.01142 0.01142 0.01142 0.26% MLMG::addInterpCorrection() 344 0.01135 0.01135 0.01135 0.25% FillPatchSingleLevel 80 0.01131 0.01131 0.01131 0.25% FabArray::ParallelCopy() 80 0.01108 0.01108 0.01108 0.25% FabArray::ParallelCopy_nowait() 80 0.01088 0.01088 0.01088 0.24% Nyx::srctoprim() 160 0.01078 0.01078 0.01078 0.24% FabArray::setVal() 1222 0.01075 0.01075 0.01075 0.24% MLMG::mgVcycle_down::1 86 0.01014 0.01014 0.01014 0.23% Gravity::get_new_grav_vector() 20 0.01 0.01 0.01 0.22% MLMG:computeResOfCorrection() 344 0.009394 0.009394 0.009394 0.21% MLMG::mgVcycle_up::1 86 0.009377 0.009377 0.009377 0.21% Nyx::update_state_with_sources() 10 0.009315 0.009315 0.009315 0.21% MLCellLinOp::correctionResidual() 344 0.009109 0.009109 0.009109 0.20% MLPoisson::define() 20 0.008719 0.008719 0.008719 0.20% MLCellLinOp::solutionResidual() 106 0.008028 0.008028 0.008028 0.18% Nyx::ctoprim() 160 0.007545 0.007545 0.007545 0.17% MLPoisson::Fapply() 692 0.007499 0.007499 0.007499 0.17% MLMG::computeResidual() 86 0.006213 0.006213 0.006213 0.14% Nyx::reactions_cells_initialize 160 0.006018 0.006018 0.006018 0.14% MLMG::prepareForSolve() 20 0.005804 0.005804 0.005804 0.13% MLCellLinOp::defineAuxData() 20 0.005531 0.005531 0.005531 0.12% MLMG::mgVcycle_bottom 86 0.005166 0.005166 0.005166 0.12% MLMG::actualBottomSolve() 86 0.005089 0.005089 0.005089 0.11% amrex::average_down 344 0.005027 0.005027 0.005027 0.11% FabArray::norminf() 454 0.005024 0.005024 0.005024 0.11% Nyx::reset_internal_energy() 30 0.004535 0.004535 0.004535 0.10% MLCGSolver::bicgstab 86 0.004324 0.004324 0.004324 0.10% MLMG::ResNormInf() 106 0.004113 0.004113 0.004113 0.09% MLMG::mgVcycle_down::2 86 0.003936 0.003936 0.003936 0.09% FabArray::sum() 192 0.003691 0.003691 0.003691 0.08% FabArray::Xpay() 450 0.003552 0.003552 0.003552 0.08% MLMG::mgVcycle_up::2 86 0.003522 0.003522 0.003522 0.08% MLMG::mgVcycle_down::3 86 0.003107 0.003107 0.003107 0.07% amrex::Add() 156 0.003088 0.003088 0.003088 0.07% MLMG::mgVcycle_up::3 86 0.002645 0.002645 0.002645 0.06% Other 11969 0.04269 0.04269 0.04269 0.96% -------------------------------------------------------------------------------------------------- END REGION R::Nyx::advance::STEP1 BEGIN REGION R::Nyx::advance_hydro_plus_particles -------------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------------- Nyx::umeth() 160 2.492 2.492 2.492 55.91% Nyx::reactions_f 1440 0.9433 0.9433 0.9433 21.17% Nyx::compute_new_temp() 20 0.1499 0.1499 0.1499 3.36% Nyx::reactions_cells_finalize 160 0.0917 0.0917 0.0917 2.06% MLPoisson::Fsmooth() 2752 0.07965 0.07965 0.07965 1.79% Nyx::umdrv() 160 0.0463 0.0463 0.0463 1.04% Nyx::sdc_hydro() 10 0.0297 0.0297 0.0297 0.67% ParticleContainer::AssignCellDensitySingleLevel() 40 0.0278 0.0278 0.0278 0.62% FillBoundary_nowait() 3380 0.02774 0.02774 0.02774 0.62% DarkMatterParticleContainer::moveKickDrift() 40 0.02532 0.02532 0.02532 0.57% DarkMatterParticleContainer::moveKick() 20 0.02012 0.02012 0.02012 0.45% Nyx::reactions_cvode 160 0.02011 0.02011 0.02011 0.45% FillPatchIterator::Initialize 80 0.01778 0.01778 0.01778 0.40% amrex::Copy() 544 0.01178 0.01178 0.01178 0.26% MLMG::addInterpCorrection() 344 0.01135 0.01135 0.01135 0.25% MLCellLinOp::applyBC() 3464 0.01105 0.01105 0.01105 0.25% Nyx::srctoprim() 160 0.01078 0.01078 0.01078 0.24% FabArray::setVal() 1222 0.01075 0.01075 0.01075 0.24% FabArray::ParallelCopy_nowait() 80 0.0107 0.0107 0.0107 0.24% Nyx::advance_hydro_pc_umdrv() 10 0.009535 0.009535 0.009535 0.21% Nyx::update_state_with_sources() 10 0.00864 0.00864 0.00864 0.19% Nyx::ctoprim() 160 0.007545 0.007545 0.007545 0.17% MLPoisson::Fapply() 692 0.007499 0.007499 0.007499 0.17% Nyx::advance_hydro_plus_particles() 10 0.006352 0.006352 0.006352 0.14% Nyx::reactions_cells_initialize 160 0.006018 0.006018 0.006018 0.14% amrex::average_down 344 0.005027 0.005027 0.005027 0.11% FabArray::norminf() 454 0.005024 0.005024 0.005024 0.11% Nyx::reset_internal_energy() 30 0.004535 0.004535 0.004535 0.10% FabArray::sum() 192 0.003691 0.003691 0.003691 0.08% FabArray::Xpay() 450 0.003552 0.003552 0.003552 0.08% amrex::Add() 156 0.003088 0.003088 0.003088 0.07% MLMG::prepareForSolve() 20 0.003048 0.003048 0.003048 0.07% MLCellLinOp::defineAuxData() 20 0.002933 0.002933 0.002933 0.07% FabArray::FillBoundary() 3360 0.0026 0.0026 0.0026 0.06% Gravity::get_old_grav_vector() 30 0.001996 0.001996 0.001996 0.04% Gravity::solve_with_MLMG 20 0.001876 0.001876 0.001876 0.04% Gravity::get_new_grav_vector() 20 0.00133 0.00133 0.00133 0.03% MLCellLinOp::smooth() 774 0.001187 0.001187 0.001187 0.03% MLCGSolver::bicgstab 86 0.001062 0.001062 0.001062 0.02% Gravity::multilevel_solve_for_old_phi() 10 0.0008906 0.0008906 0.0008906 0.02% solve_for_old_phi 10 0.0008269 0.0008269 0.0008269 0.02% Gravity::actual_multilevel_solve() 10 0.0006432 0.0006432 0.0006432 0.01% MLCellLinOp::apply() 692 0.0005588 0.0005588 0.0005588 0.01% Gravity::solve_for_new_phi() 10 0.0004822 0.0004822 0.0004822 0.01% ParticleContainer::AssignDensity() 20 0.0004392 0.0004392 0.0004392 0.01% MLMG::actualBottomSolve() 86 0.0004124 0.0004124 0.0004124 0.01% AmrLevel::FillPatch() 80 0.0003619 0.0003619 0.0003619 0.01% Nyx::integrate_state_struct_mfin 160 0.000337 0.000337 0.000337 0.01% Gravity::AddParticlesToRhs() 10 0.0003275 0.0003275 0.0003275 0.01% MLCellLinOp::correctionResidual() 344 0.0003142 0.0003142 0.0003142 0.01% Nyx::sdc_reactions() 10 0.0003034 0.0003034 0.0003034 0.01% MLMG:computeResOfCorrection() 344 0.0002854 0.0002854 0.0002854 0.01% MLMG::mgVcycle() 86 0.000216 0.000216 0.000216 0.00% MLMG::oneIter() 86 0.0001649 0.0001649 0.0001649 0.00% MLCellLinOp::solutionResidual() 106 0.0001369 0.0001369 0.0001369 0.00% MLMG::solve() 20 0.0001307 0.0001307 0.0001307 0.00% MLMG::ResNormInf() 106 0.0001273 0.0001273 0.0001273 0.00% MLMG::mgVcycle_down::1 86 0.0001265 0.0001265 0.0001265 0.00% MLMG::mgVcycle_down::0 86 0.00012 0.00012 0.00012 0.00% FillPatchIterator::FillFromLevel0() 80 0.0001183 0.0001183 0.0001183 0.00% FabArray::ParallelCopy() 80 0.0001177 0.0001177 0.0001177 0.00% FillPatchSingleLevel 80 0.000113 0.000113 0.000113 0.00% MLMG::computeResidual() 86 0.0001044 0.0001044 0.0001044 0.00% MLMG::mgVcycle_up::1 86 0.0001014 0.0001014 0.0001014 0.00% MLMG::mgVcycle_down::2 86 9.823e-05 9.823e-05 9.823e-05 0.00% MLMG::mgVcycle_down::3 86 9.718e-05 9.718e-05 9.718e-05 0.00% MLMG::mgVcycle_up::0 86 9.543e-05 9.543e-05 9.543e-05 0.00% MLMG::mgVcycle_up::2 86 9.054e-05 9.054e-05 9.054e-05 0.00% MLMG::mgVcycle_up::3 86 8.852e-05 8.852e-05 8.852e-05 0.00% MLMG::mgVcycle_bottom 86 7.727e-05 7.727e-05 7.727e-05 0.00% Gravity::AddParticlesToRhsML() 10 7.605e-05 7.605e-05 7.605e-05 0.00% Gravity::solve_for_phi() 10 6.982e-05 6.982e-05 6.982e-05 0.00% MLPoisson::define() 20 5.521e-05 5.521e-05 5.521e-05 0.00% REG::R::Nyx::advance_hydro_plus_particles 10 3.812e-05 3.812e-05 3.812e-05 0.00% solve_for_new_phi 10 2.846e-05 2.846e-05 2.846e-05 0.00% just_the_hydro 10 2.718e-05 2.718e-05 2.718e-05 0.00% sdc_reactions 10 1.837e-05 1.837e-05 1.837e-05 0.00% Other 11969 0.02237 0.02237 0.02237 0.50% -------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------------- REG::R::Nyx::advance_hydro_plus_particles 10 4.155 4.155 4.155 93.23% Nyx::advance_hydro_plus_particles() 10 4.155 4.155 4.155 93.23% just_the_hydro 10 3.79 3.79 3.79 85.03% Nyx::sdc_hydro() 10 3.789 3.789 3.789 85.03% Nyx::advance_hydro_pc_umdrv() 10 2.566 2.566 2.566 57.57% Nyx::umdrv() 160 2.538 2.538 2.538 56.94% Nyx::umeth() 160 2.492 2.492 2.492 55.91% sdc_reactions 10 1.142 1.142 1.142 25.62% Nyx::sdc_reactions() 10 1.142 1.142 1.142 25.62% Nyx::integrate_state_struct_mfin 160 1.065 1.065 1.065 23.90% Nyx::reactions_cvode 160 0.9634 0.9634 0.9634 21.62% Nyx::reactions_f 1440 0.9433 0.9433 0.9433 21.17% Gravity::solve_with_MLMG 20 0.1743 0.1743 0.1743 3.91% solve_for_new_phi 10 0.1709 0.1709 0.1709 3.83% Gravity::solve_for_new_phi() 10 0.1709 0.1709 0.1709 3.83% MLMG::solve() 20 0.1618 0.1618 0.1618 3.63% Gravity::solve_for_phi() 10 0.1525 0.1525 0.1525 3.42% Nyx::compute_new_temp() 20 0.1499 0.1499 0.1499 3.36% MLMG::oneIter() 86 0.1427 0.1427 0.1427 3.20% MLMG::mgVcycle() 86 0.1372 0.1372 0.1372 3.08% MLCellLinOp::smooth() 774 0.1038 0.1038 0.1038 2.33% Nyx::reactions_cells_finalize 160 0.0917 0.0917 0.0917 2.06% MLPoisson::Fsmooth() 2752 0.07965 0.07965 0.07965 1.79% MLMG::mgVcycle_down::0 86 0.05027 0.05027 0.05027 1.13% MLMG::mgVcycle_up::0 86 0.04882 0.04882 0.04882 1.10% solve_for_old_phi 10 0.04321 0.04321 0.04321 0.97% Gravity::multilevel_solve_for_old_phi() 10 0.0419 0.0419 0.0419 0.94% Gravity::actual_multilevel_solve() 10 0.04101 0.04101 0.04101 0.92% AmrLevel::FillPatch() 80 0.03617 0.03617 0.03617 0.81% FabArray::FillBoundary() 3360 0.03192 0.03192 0.03192 0.72% ParticleContainer::AssignCellDensitySingleLevel() 40 0.03136 0.03136 0.03136 0.70% MLCellLinOp::applyBC() 3464 0.03023 0.03023 0.03023 0.68% FillBoundary_nowait() 3380 0.02984 0.02984 0.02984 0.67% FillPatchIterator::Initialize 80 0.02935 0.02935 0.02935 0.66% DarkMatterParticleContainer::moveKickDrift() 40 0.02532 0.02532 0.02532 0.57% DarkMatterParticleContainer::moveKick() 20 0.02012 0.02012 0.02012 0.45% Gravity::get_old_grav_vector() 30 0.01777 0.01777 0.01777 0.40% Gravity::AddParticlesToRhs() 10 0.0176 0.0176 0.0176 0.39% Gravity::AddParticlesToRhsML() 10 0.01566 0.01566 0.01566 0.35% ParticleContainer::AssignDensity() 20 0.01517 0.01517 0.01517 0.34% MLCellLinOp::apply() 692 0.01495 0.01495 0.01495 0.34% amrex::Copy() 544 0.01178 0.01178 0.01178 0.26% FillPatchIterator::FillFromLevel0() 80 0.01142 0.01142 0.01142 0.26% MLMG::addInterpCorrection() 344 0.01135 0.01135 0.01135 0.25% FillPatchSingleLevel 80 0.01131 0.01131 0.01131 0.25% FabArray::ParallelCopy() 80 0.01108 0.01108 0.01108 0.25% FabArray::ParallelCopy_nowait() 80 0.01088 0.01088 0.01088 0.24% Nyx::srctoprim() 160 0.01078 0.01078 0.01078 0.24% FabArray::setVal() 1222 0.01075 0.01075 0.01075 0.24% MLMG::mgVcycle_down::1 86 0.01014 0.01014 0.01014 0.23% Gravity::get_new_grav_vector() 20 0.01 0.01 0.01 0.22% MLMG:computeResOfCorrection() 344 0.009394 0.009394 0.009394 0.21% MLMG::mgVcycle_up::1 86 0.009377 0.009377 0.009377 0.21% Nyx::update_state_with_sources() 10 0.009315 0.009315 0.009315 0.21% MLCellLinOp::correctionResidual() 344 0.009109 0.009109 0.009109 0.20% MLPoisson::define() 20 0.008719 0.008719 0.008719 0.20% MLCellLinOp::solutionResidual() 106 0.008028 0.008028 0.008028 0.18% Nyx::ctoprim() 160 0.007545 0.007545 0.007545 0.17% MLPoisson::Fapply() 692 0.007499 0.007499 0.007499 0.17% MLMG::computeResidual() 86 0.006213 0.006213 0.006213 0.14% Nyx::reactions_cells_initialize 160 0.006018 0.006018 0.006018 0.14% MLMG::prepareForSolve() 20 0.005804 0.005804 0.005804 0.13% MLCellLinOp::defineAuxData() 20 0.005531 0.005531 0.005531 0.12% MLMG::mgVcycle_bottom 86 0.005166 0.005166 0.005166 0.12% MLMG::actualBottomSolve() 86 0.005089 0.005089 0.005089 0.11% amrex::average_down 344 0.005027 0.005027 0.005027 0.11% FabArray::norminf() 454 0.005024 0.005024 0.005024 0.11% Nyx::reset_internal_energy() 30 0.004535 0.004535 0.004535 0.10% MLCGSolver::bicgstab 86 0.004324 0.004324 0.004324 0.10% MLMG::ResNormInf() 106 0.004113 0.004113 0.004113 0.09% MLMG::mgVcycle_down::2 86 0.003936 0.003936 0.003936 0.09% FabArray::sum() 192 0.003691 0.003691 0.003691 0.08% FabArray::Xpay() 450 0.003552 0.003552 0.003552 0.08% MLMG::mgVcycle_up::2 86 0.003522 0.003522 0.003522 0.08% MLMG::mgVcycle_down::3 86 0.003107 0.003107 0.003107 0.07% amrex::Add() 156 0.003088 0.003088 0.003088 0.07% MLMG::mgVcycle_up::3 86 0.002645 0.002645 0.002645 0.06% Other 11969 0.04269 0.04269 0.04269 0.96% -------------------------------------------------------------------------------------------------- END REGION R::Nyx::advance_hydro_plus_particles BEGIN REGION R::Nyx::coarseTimeStep -------------------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------------------- Nyx::umeth() 160 2.492 2.492 2.492 55.91% Nyx::reactions_f 1440 0.9433 0.9433 0.9433 21.17% Nyx::compute_new_temp() 40 0.2973 0.2973 0.2973 6.67% Nyx::reactions_cells_finalize 160 0.0917 0.0917 0.0917 2.06% MLPoisson::Fsmooth() 2752 0.07965 0.07965 0.07965 1.79% Nyx::umdrv() 160 0.0463 0.0463 0.0463 1.04% Nyx::sdc_hydro() 10 0.0297 0.0297 0.0297 0.67% ParticleContainer::AssignCellDensitySingleLevel() 40 0.0278 0.0278 0.0278 0.62% FillBoundary_nowait() 3382 0.02777 0.02777 0.02777 0.62% DarkMatterParticleContainer::moveKickDrift() 40 0.02532 0.02532 0.02532 0.57% DarkMatterParticleContainer::moveKick() 20 0.02012 0.02012 0.02012 0.45% Nyx::reactions_cvode 160 0.02011 0.02011 0.02011 0.45% FillPatchIterator::Initialize 80 0.01778 0.01778 0.01778 0.40% NyxParticleContainer::estTimestep(lev) 20 0.01522 0.01522 0.01522 0.34% Redistribute_partition 20 0.01186 0.01186 0.01186 0.27% numParticlesOutOfRange() 40 0.01182 0.01182 0.01182 0.27% amrex::Copy() 544 0.01178 0.01178 0.01178 0.26% MLMG::addInterpCorrection() 344 0.01135 0.01135 0.01135 0.25% MLCellLinOp::applyBC() 3464 0.01105 0.01105 0.01105 0.25% FabArray::setVal() 1234 0.01094 0.01094 0.01094 0.25% Nyx::srctoprim() 160 0.01078 0.01078 0.01078 0.24% FabArray::ParallelCopy_nowait() 80 0.0107 0.0107 0.0107 0.24% Nyx::advance_hydro_pc_umdrv() 10 0.009535 0.009535 0.009535 0.21% Nyx::update_state_with_sources() 10 0.00864 0.00864 0.00864 0.19% Nyx::ctoprim() 160 0.007545 0.007545 0.007545 0.17% MLPoisson::Fapply() 692 0.007499 0.007499 0.007499 0.17% Nyx::advance_hydro_plus_particles() 10 0.006352 0.006352 0.006352 0.14% Nyx::reactions_cells_initialize 160 0.006018 0.006018 0.006018 0.14% Nyx::reset_internal_energy() 40 0.00599 0.00599 0.00599 0.13% FabArray::norminf() 464 0.005394 0.005394 0.005394 0.12% amrex::average_down 344 0.005027 0.005027 0.005027 0.11% Nyx::compute_rho_temp()::OnHost 10 0.004279 0.004279 0.004279 0.10% ParticleContainer::BuildRedistributeMask 20 0.00391 0.00391 0.00391 0.09% FabArray::sum() 192 0.003691 0.003691 0.003691 0.08% FabArray::Xpay() 450 0.003552 0.003552 0.003552 0.08% amrex::Add() 156 0.003088 0.003088 0.003088 0.07% MLMG::prepareForSolve() 20 0.003048 0.003048 0.003048 0.07% MLCellLinOp::defineAuxData() 20 0.002933 0.002933 0.002933 0.07% FabArray::FillBoundary() 3362 0.002602 0.002602 0.002602 0.06% Nyx::est_time_step() 10 0.002576 0.002576 0.002576 0.06% Gravity::get_old_grav_vector() 30 0.001996 0.001996 0.001996 0.04% Gravity::solve_with_MLMG 20 0.001876 0.001876 0.001876 0.04% Gravity::get_new_grav_vector() 20 0.00133 0.00133 0.00133 0.03% MLCellLinOp::smooth() 774 0.001187 0.001187 0.001187 0.03% MLCGSolver::bicgstab 86 0.001062 0.001062 0.001062 0.02% Gravity::multilevel_solve_for_old_phi() 10 0.0008906 0.0008906 0.0008906 0.02% solve_for_old_phi 10 0.0008269 0.0008269 0.0008269 0.02% FabArrayBase::getCPC() 800 0.0008032 0.0008032 0.0008032 0.02% Gravity::actual_multilevel_solve() 10 0.0006432 0.0006432 0.0006432 0.01% MLCellLinOp::apply() 692 0.0005588 0.0005588 0.0005588 0.01% Nyx::reset_internal_energy_nostore() 20 0.0004952 0.0004952 0.0004952 0.01% Gravity::solve_for_new_phi() 10 0.0004822 0.0004822 0.0004822 0.01% ParticleContainer::AssignDensity() 20 0.0004392 0.0004392 0.0004392 0.01% Nyx::post_timestep()::sum_write 10 0.0004331 0.0004331 0.0004331 0.01% MLMG::actualBottomSolve() 86 0.0004124 0.0004124 0.0004124 0.01% AmrLevel::FillPatch() 80 0.0003619 0.0003619 0.0003619 0.01% Nyx::integrate_state_struct_mfin 160 0.000337 0.000337 0.000337 0.01% Gravity::AddParticlesToRhs() 10 0.0003275 0.0003275 0.0003275 0.01% MLCellLinOp::correctionResidual() 344 0.0003142 0.0003142 0.0003142 0.01% Nyx::sdc_reactions() 10 0.0003034 0.0003034 0.0003034 0.01% MLMG:computeResOfCorrection() 344 0.0002854 0.0002854 0.0002854 0.01% Amr::coarseTimeStep() 10 0.0002785 0.0002785 0.0002785 0.01% MLMG::mgVcycle() 86 0.000216 0.000216 0.000216 0.00% Amr::timeStep() 10 0.000172 0.000172 0.000172 0.00% MLMG::oneIter() 86 0.0001649 0.0001649 0.0001649 0.00% MLCellLinOp::solutionResidual() 106 0.0001369 0.0001369 0.0001369 0.00% MLMG::solve() 20 0.0001307 0.0001307 0.0001307 0.00% MLMG::ResNormInf() 106 0.0001273 0.0001273 0.0001273 0.00% MLMG::mgVcycle_down::1 86 0.0001265 0.0001265 0.0001265 0.00% MLMG::mgVcycle_down::0 86 0.00012 0.00012 0.00012 0.00% FillPatchIterator::FillFromLevel0() 80 0.0001183 0.0001183 0.0001183 0.00% FabArray::ParallelCopy() 80 0.0001177 0.0001177 0.0001177 0.00% Nyx::computeNewDt() 9 0.0001162 0.0001162 0.0001162 0.00% FillPatchSingleLevel 80 0.000113 0.000113 0.000113 0.00% MLMG::computeResidual() 86 0.0001044 0.0001044 0.0001044 0.00% ParticleContainer::Redistribute_impl() 20 0.0001038 0.0001038 0.0001038 0.00% MLMG::mgVcycle_up::1 86 0.0001014 0.0001014 0.0001014 0.00% MLMG::mgVcycle_down::2 86 9.823e-05 9.823e-05 9.823e-05 0.00% MLMG::mgVcycle_down::3 86 9.718e-05 9.718e-05 9.718e-05 0.00% MLMG::mgVcycle_up::0 86 9.543e-05 9.543e-05 9.543e-05 0.00% MLMG::mgVcycle_up::2 86 9.054e-05 9.054e-05 9.054e-05 0.00% MLMG::mgVcycle_up::3 86 8.852e-05 8.852e-05 8.852e-05 0.00% Nyx::particle_est_time_step() 10 8.518e-05 8.518e-05 8.518e-05 0.00% MLMG::mgVcycle_bottom 86 7.727e-05 7.727e-05 7.727e-05 0.00% Gravity::AddParticlesToRhsML() 10 7.605e-05 7.605e-05 7.605e-05 0.00% Gravity::solve_for_phi() 10 6.982e-05 6.982e-05 6.982e-05 0.00% MLPoisson::define() 20 5.521e-05 5.521e-05 5.521e-05 0.00% REG::R::Nyx::coarseTimeStep 1 4.083e-05 4.083e-05 4.083e-05 0.00% Nyx::post_timestep() 10 3.892e-05 3.892e-05 3.892e-05 0.00% REG::R::Nyx::advance_hydro_plus_particles 10 3.812e-05 3.812e-05 3.812e-05 0.00% Nyx::post_timestep()::redist 10 2.876e-05 2.876e-05 2.876e-05 0.00% solve_for_new_phi 10 2.846e-05 2.846e-05 2.846e-05 0.00% REG::R::Nyx::advance::STEP1 10 2.774e-05 2.774e-05 2.774e-05 0.00% just_the_hydro 10 2.718e-05 2.718e-05 2.718e-05 0.00% sdc_reactions 10 1.837e-05 1.837e-05 1.837e-05 0.00% Nyx::compute_rho_temp() 10 1.692e-05 1.692e-05 1.692e-05 0.00% Nyx::post_timestep()::compute_temp 10 1.332e-05 1.332e-05 1.332e-05 0.00% Other 11566 0.02266 0.02266 0.02266 0.51% -------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------------------- REG::R::Nyx::coarseTimeStep 1 4.357 4.357 4.357 97.76% Amr::coarseTimeStep() 10 4.357 4.357 4.357 97.76% Amr::timeStep() 10 4.339 4.339 4.339 97.35% REG::R::Nyx::advance::STEP1 10 4.155 4.155 4.155 93.23% REG::R::Nyx::advance_hydro_plus_particles 10 4.155 4.155 4.155 93.23% Nyx::advance_hydro_plus_particles() 10 4.155 4.155 4.155 93.23% just_the_hydro 10 3.79 3.79 3.79 85.03% Nyx::sdc_hydro() 10 3.789 3.789 3.789 85.03% Nyx::advance_hydro_pc_umdrv() 10 2.566 2.566 2.566 57.57% Nyx::umdrv() 160 2.538 2.538 2.538 56.94% Nyx::umeth() 160 2.492 2.492 2.492 55.91% sdc_reactions 10 1.142 1.142 1.142 25.62% Nyx::sdc_reactions() 10 1.142 1.142 1.142 25.62% Nyx::integrate_state_struct_mfin 160 1.065 1.065 1.065 23.90% Nyx::reactions_cvode 160 0.9634 0.9634 0.9634 21.62% Nyx::reactions_f 1440 0.9433 0.9433 0.9433 21.17% Nyx::compute_new_temp() 40 0.2973 0.2973 0.2973 6.67% Nyx::post_timestep() 10 0.1834 0.1834 0.1834 4.12% Gravity::solve_with_MLMG 20 0.1743 0.1743 0.1743 3.91% solve_for_new_phi 10 0.1709 0.1709 0.1709 3.83% Gravity::solve_for_new_phi() 10 0.1709 0.1709 0.1709 3.83% MLMG::solve() 20 0.1618 0.1618 0.1618 3.63% Gravity::solve_for_phi() 10 0.1525 0.1525 0.1525 3.42% MLMG::oneIter() 86 0.1427 0.1427 0.1427 3.20% MLMG::mgVcycle() 86 0.1372 0.1372 0.1372 3.08% MLCellLinOp::smooth() 774 0.1038 0.1038 0.1038 2.33% Nyx::reactions_cells_finalize 160 0.0917 0.0917 0.0917 2.06% MLPoisson::Fsmooth() 2752 0.07965 0.07965 0.07965 1.79% Nyx::post_timestep()::sum_write 10 0.07891 0.07891 0.07891 1.77% Nyx::post_timestep()::compute_temp 10 0.0761 0.0761 0.0761 1.71% MLMG::mgVcycle_down::0 86 0.05027 0.05027 0.05027 1.13% MLMG::mgVcycle_up::0 86 0.04882 0.04882 0.04882 1.10% solve_for_old_phi 10 0.04321 0.04321 0.04321 0.97% Gravity::multilevel_solve_for_old_phi() 10 0.0419 0.0419 0.0419 0.94% Gravity::actual_multilevel_solve() 10 0.04101 0.04101 0.04101 0.92% AmrLevel::FillPatch() 80 0.03617 0.03617 0.03617 0.81% FabArray::FillBoundary() 3362 0.03197 0.03197 0.03197 0.72% ParticleContainer::AssignCellDensitySingleLevel() 40 0.03136 0.03136 0.03136 0.70% MLCellLinOp::applyBC() 3464 0.03023 0.03023 0.03023 0.68% FillBoundary_nowait() 3382 0.02989 0.02989 0.02989 0.67% FillPatchIterator::Initialize 80 0.02935 0.02935 0.02935 0.66% Nyx::post_timestep()::redist 10 0.02818 0.02818 0.02818 0.63% DarkMatterParticleContainer::moveKickDrift() 40 0.02532 0.02532 0.02532 0.57% ParticleContainer::Redistribute_impl() 20 0.02186 0.02186 0.02186 0.49% DarkMatterParticleContainer::moveKick() 20 0.02012 0.02012 0.02012 0.45% Nyx::est_time_step() 10 0.01788 0.01788 0.01788 0.40% Gravity::get_old_grav_vector() 30 0.01777 0.01777 0.01777 0.40% Gravity::AddParticlesToRhs() 10 0.0176 0.0176 0.0176 0.39% Nyx::computeNewDt() 9 0.01606 0.01606 0.01606 0.36% Gravity::AddParticlesToRhsML() 10 0.01566 0.01566 0.01566 0.35% Nyx::particle_est_time_step() 10 0.0153 0.0153 0.0153 0.34% NyxParticleContainer::estTimestep(lev) 20 0.01522 0.01522 0.01522 0.34% ParticleContainer::AssignDensity() 20 0.01517 0.01517 0.01517 0.34% MLCellLinOp::apply() 692 0.01495 0.01495 0.01495 0.34% Redistribute_partition 20 0.01186 0.01186 0.01186 0.27% numParticlesOutOfRange() 40 0.01182 0.01182 0.01182 0.27% amrex::Copy() 544 0.01178 0.01178 0.01178 0.26% FillPatchIterator::FillFromLevel0() 80 0.01142 0.01142 0.01142 0.26% MLMG::addInterpCorrection() 344 0.01135 0.01135 0.01135 0.25% FillPatchSingleLevel 80 0.01131 0.01131 0.01131 0.25% FabArray::ParallelCopy() 80 0.01108 0.01108 0.01108 0.25% FabArray::setVal() 1234 0.01094 0.01094 0.01094 0.25% FabArray::ParallelCopy_nowait() 80 0.01088 0.01088 0.01088 0.24% Nyx::srctoprim() 160 0.01078 0.01078 0.01078 0.24% MLMG::mgVcycle_down::1 86 0.01014 0.01014 0.01014 0.23% Gravity::get_new_grav_vector() 20 0.01 0.01 0.01 0.22% MLMG:computeResOfCorrection() 344 0.009394 0.009394 0.009394 0.21% MLMG::mgVcycle_up::1 86 0.009377 0.009377 0.009377 0.21% Nyx::update_state_with_sources() 10 0.009315 0.009315 0.009315 0.21% MLCellLinOp::correctionResidual() 344 0.009109 0.009109 0.009109 0.20% MLPoisson::define() 20 0.008719 0.008719 0.008719 0.20% MLCellLinOp::solutionResidual() 106 0.008028 0.008028 0.008028 0.18% Nyx::ctoprim() 160 0.007545 0.007545 0.007545 0.17% MLPoisson::Fapply() 692 0.007499 0.007499 0.007499 0.17% MLMG::computeResidual() 86 0.006213 0.006213 0.006213 0.14% Nyx::reactions_cells_initialize 160 0.006018 0.006018 0.006018 0.14% Nyx::reset_internal_energy() 40 0.00599 0.00599 0.00599 0.13% MLMG::prepareForSolve() 20 0.005804 0.005804 0.005804 0.13% MLCellLinOp::defineAuxData() 20 0.005531 0.005531 0.005531 0.12% FabArray::norminf() 464 0.005394 0.005394 0.005394 0.12% MLMG::mgVcycle_bottom 86 0.005166 0.005166 0.005166 0.12% MLMG::actualBottomSolve() 86 0.005089 0.005089 0.005089 0.11% amrex::average_down 344 0.005027 0.005027 0.005027 0.11% MLCGSolver::bicgstab 86 0.004324 0.004324 0.004324 0.10% Nyx::compute_rho_temp() 10 0.004296 0.004296 0.004296 0.10% Nyx::compute_rho_temp()::OnHost 10 0.004279 0.004279 0.004279 0.10% MLMG::ResNormInf() 106 0.004113 0.004113 0.004113 0.09% ParticleContainer::BuildRedistributeMask 20 0.003985 0.003985 0.003985 0.09% MLMG::mgVcycle_down::2 86 0.003936 0.003936 0.003936 0.09% Nyx::reset_internal_energy_nostore() 20 0.003772 0.003772 0.003772 0.08% FabArray::sum() 192 0.003691 0.003691 0.003691 0.08% FabArray::Xpay() 450 0.003552 0.003552 0.003552 0.08% MLMG::mgVcycle_up::2 86 0.003522 0.003522 0.003522 0.08% MLMG::mgVcycle_down::3 86 0.003107 0.003107 0.003107 0.07% amrex::Add() 156 0.003088 0.003088 0.003088 0.07% MLMG::mgVcycle_up::3 86 0.002645 0.002645 0.002645 0.06% FabArrayBase::getCPC() 800 0.002534 0.002534 0.002534 0.06% Other 11566 0.04439 0.04439 0.04439 1.00% -------------------------------------------------------------------------------------------------------- END REGION R::Nyx::coarseTimeStep Unused ParmParse Variables: [TOP]::amr.probin_file(nvals = 1) :: [] [TOP]::particles.neutrino_dm_model(nvals = 1) :: [1] [TOP]::particles.relativistic(nvals = 1) :: [0] [TOP]::plot_int(nvals = 1) :: [10] Async Memory Usage: --------------------------------------------------------- Name Nalloc AvgMem MaxMem --------------------------------------------------------- Nyx::umeth() 6080 1736 KiB 7608 KiB Nyx::advance_hydro_pc_umdrv() 800 729 KiB 1275 KiB Nyx::umdrv() 800 471 KiB 832 KiB --------------------------------------------------------- Pinned Memory Usage: -------------------------------------------------------- Name Nalloc AvgMem MaxMem -------------------------------------------------------- The_Pinned_Arena::Initialize() 1 6 B 8192 KiB -------------------------------------------------------- Cpu Memory Usage: --------------------------------------------------------------------------------------- Name Nalloc Nfree AvgMem MaxMem CurrentMem --------------------------------------------------------------------------------------- Nyx::sdc_hydro() 70 70 8976 KiB 10 MiB 0 B Nyx::umeth() 6080 6080 1736 KiB 7610 KiB 0 B Nyx::advance_hydro_plus_particles() 55 55 3921 KiB 5528 KiB 0 B AmrLevel::writePlotFile() 2 2 15 KiB 4096 KiB 0 B StateData::define() 5 5 3966 KiB 3992 KiB 0 B FillPatchIterator::Initialize 91 91 17 KiB 3000 KiB 0 B solve_for_old_phi 30 30 925 KiB 1897 KiB 0 B Nyx::Nyx(Amr) 6 6 22 KiB 1897 KiB 0 B AmrLevel::derive() 12 12 1104 B 1792 KiB 0 B MLMG::prepareForSolve() 420 420 62 KiB 1567 KiB 0 B ParticleContainer::AssignDensity() 29 29 2959 B 1458 KiB 0 B Nyx::advance_hydro_pc_umdrv() 800 800 729 KiB 1275 KiB 0 B Gravity::multilevel_solve_for_old_phi() 30 30 924 KiB 948 KiB 0 B Gravity::multilevel_solve_for_new_phi() 3 3 11 KiB 948 KiB 0 B Nyx::umdrv() 800 800 471 KiB 832 KiB 0 B Nyx::post_init() 2 2 936 B 768 KiB 0 B ParticleContainer::BuildRedistributeMask 2 2 542 KiB 614 KiB 0 B Gravity::actual_multilevel_solve() 22 22 6169 B 512 KiB 0 B Nyx::derive(mf) 6 6 343 B 512 KiB 0 B amrex::ParticleToMesh 4 4 93 B 512 KiB 0 B Nyx::reset_internal_energy_nostore() 20 20 420 B 500 KiB 0 B FillBoundary_nowait() 1274 1274 68 B 434 KiB 0 B Gravity::AddParticlesToRhs() 10 10 1721 B 428 KiB 0 B BndryData::define() 252 252 137 KiB 279 KiB 0 B Gravity::solve_for_new_phi() 10 10 9984 B 256 KiB 0 B Nyx::read_params() 1 0 249 KiB 251 KiB 251 KiB MLCellLinOp::defineAuxData() 1260 1260 99 KiB 201 KiB 0 B MLCGSolver::bicgstab 485 485 1 B 1792 B 0 B MLMG::actualBottomSolve() 97 97 0 B 256 B 0 B Nyx::reactions_alloc 160 160 60 B 256 B 0 B MLCellLinOp::applyBC() 3897 3897 0 B 256 B 0 B --------------------------------------------------------------------------------------- AMReX (26.08-4-gcb098067c32e) finalized