Initializing AMReX (26.05-54-g012f8ddff80e)... MPI initialized with 2 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.05-54-g012f8ddff80e) initialized Running redistribute test About to initialize particles pass TinyProfiler total time across processes [min...avg...max]: 0.7899 ... 0.7916 ... 0.7933 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- numParticlesOutOfRange() 614 0.1349 0.1458 0.1567 19.75% amrex::unpackBuffer 103 0.1324 0.1337 0.135 17.02% amrex::unpackRemotes 103 0.1061 0.1101 0.1141 14.39% ParticleContainer::Redistribute_impl() 103 0.08392 0.0966 0.1093 13.77% Redistribute_partition 103 0.09257 0.09328 0.09399 11.85% ParticleCopyPlan::build 103 0.0576 0.05769 0.05778 7.28% TestParticleContainer::moveParticles 100 0.05024 0.05037 0.0505 6.37% amrex::communicateParticlesStart 103 0.01707 0.02389 0.03071 3.87% TestParticleContainer::checkAnswer 103 0.01377 0.01869 0.02361 2.98% amrex::computeNeighborProcs 101 0.02017 0.02073 0.02129 2.68% ParticleCopyPlan::buildMPIStart 103 0.01099 0.0145 0.018 2.27% amrex::communicateParticlesFinish 103 0.005888 0.01072 0.01556 1.96% ParticleCopyPlan::doHandShake 103 0.001449 0.005032 0.008614 1.09% InitParticles 1 0.00461 0.004816 0.005021 0.63% testRedistribute 1 0.0008032 0.0008345 0.0008657 0.11% ParticleContainer::OK() 103 2.834e-05 2.878e-05 2.922e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 2.222e-06 3.682e-06 5.143e-06 0.00% Other 521 0.002886 0.004739 0.006593 0.83% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- testRedistribute 1 0.7899 0.7916 0.7933 100.00% ParticleContainer::Redistribute_impl() 103 0.6226 0.6227 0.6228 78.51% numParticlesOutOfRange() 614 0.1349 0.1458 0.1567 19.75% amrex::unpackBuffer 103 0.1324 0.1337 0.135 17.02% amrex::unpackRemotes 103 0.1061 0.1101 0.1141 14.39% ParticleCopyPlan::build 103 0.09767 0.09841 0.09914 12.50% Redistribute_partition 103 0.09257 0.09328 0.09399 11.85% TestParticleContainer::checkAnswer 103 0.05629 0.06121 0.06613 8.34% TestParticleContainer::moveParticles 100 0.05024 0.05037 0.0505 6.37% ParticleContainer::OK() 103 0.04252 0.04252 0.04252 5.36% amrex::communicateParticlesStart 103 0.01707 0.02389 0.03071 3.87% amrex::computeNeighborProcs 101 0.02017 0.02073 0.02129 2.68% ParticleCopyPlan::buildMPIStart 103 0.01945 0.01953 0.01961 2.47% amrex::communicateParticlesFinish 103 0.005888 0.01072 0.01556 1.96% InitParticles 1 0.009763 0.009767 0.00977 1.23% ParticleCopyPlan::doHandShake 103 0.001449 0.005032 0.008614 1.09% DistributionMapping::SFCProcessorMapDoIt() 1 9.837e-06 0.001674 0.003338 0.42% Other 521 0.003353 0.005289 0.007226 0.91% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.check_file(nvals = 1) :: [Redistribute_chk] [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] [TOP]::amr.plot_file(nvals = 1) :: [Redistribute_plt] Device Memory Usage: --------------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------------- ResizeRandomSeed 2 9145 KiB 9145 KiB 9145 KiB 9216 KiB 9216 KiB 9216 KiB ParticleContainer::ReserveForRedistribute() 72 100 KiB 104 KiB 109 KiB 8307 KiB 8331 KiB 8356 KiB InitParticles 48 7033 KiB 7034 KiB 7034 KiB 8331 KiB 8331 KiB 8331 KiB ParticleContainer::Redistribute_impl() 210 126 KiB 128 KiB 129 KiB 8177 KiB 8201 KiB 8225 KiB amrex::packBuffer 204 314 KiB 316 KiB 318 KiB 8176 KiB 8200 KiB 8224 KiB Redistribute_partition 4054 89 KiB 89 KiB 90 KiB 1817 KiB 1823 KiB 1828 KiB ParticleCopyPlan::buildCopiesAtomicScatter 406 11 KiB 11 KiB 11 KiB 259 KiB 260 KiB 261 KiB testRedistribute 4 26 B 26 B 26 B 48 KiB 48 KiB 48 KiB numParticlesOutOfRange() 1228 3423 B 3430 B 3438 B 24 KiB 24 KiB 24 KiB DenseBins::buildGPU 12 1111 B 1111 B 1111 B 2048 B 2048 B 2048 B ParticleCopyPlan::build 1236 670 B 675 B 681 B 1280 B 1280 B 1280 B ParticleBufferMap::define 8 889 B 889 B 889 B 1024 B 1024 B 1024 B amrex::communicateParticlesStart 206 100 B 103 B 106 B 256 B 256 B 256 B --------------------------------------------------------------------------------------------------------------------------- Managed Memory Usage: --------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------- The_Managed_Arena::Initialize() 2 5 B 6 B 8 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------- Pinned Memory Usage: ---------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ---------------------------------------------------------------------------------------------------------------------- ParticleContainer::Redistribute_impl() 416 141 KiB 161 KiB 181 KiB 8176 KiB 8200 KiB 8225 KiB amrex::communicateParticlesStart 204 82 KiB 85 KiB 89 KiB 8176 KiB 8200 KiB 8224 KiB The_Pinned_Arena::Initialize() 2 8 B 11 B 15 B 8192 KiB 8192 KiB 8192 KiB InitParticles 564 18 KiB 19 KiB 21 KiB 6884 KiB 6884 KiB 6884 KiB Redistribute_partition 420 871 B 871 B 872 B 1280 B 1280 B 1280 B numParticlesOutOfRange() 1248 901 B 901 B 902 B 1280 B 1280 B 1280 B amrex::unpackBuffer 12 12 B 12 B 12 B 1024 B 1024 B 1024 B ParticleCopyPlan::build 206 127 B 128 B 129 B 256 B 256 B 256 B ParticleCopyPlan::buildMPIStart 204 121 B 121 B 121 B 256 B 256 B 256 B testRedistribute 4 0 B 0 B 0 B 256 B 256 B 256 B ---------------------------------------------------------------------------------------------------------------------- Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [7591 ... 7591] [The Arena] max space (MB) allocated spread across MPI: [41 ... 41] [The Arena] max space (MB) used spread across MPI: [35 ... 35] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [16 ... 16] [The Pinned Arena] max space (MB) used spread across MPI: [16 ... 16] AMReX (26.05-54-g012f8ddff80e) finalized