Initializing AMReX (26.06-13-g87eac2327e9f)... MPI initialized with 2 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.06-13-g87eac2327e9f) initialized Running redistribute test About to initialize particles pass TinyProfiler total time across processes [min...avg...max]: 0.7808 ... 0.7825 ... 0.7842 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- numParticlesOutOfRange() 614 0.1302 0.144 0.1579 20.13% amrex::unpackBuffer 103 0.1288 0.1305 0.1321 16.85% amrex::unpackRemotes 103 0.1033 0.1079 0.1125 14.35% ParticleContainer::Redistribute_impl() 103 0.08247 0.0955 0.1085 13.84% Redistribute_partition 103 0.0907 0.09157 0.09244 11.79% ParticleCopyPlan::build 103 0.05628 0.05635 0.05643 7.20% TestParticleContainer::moveParticles 100 0.04905 0.04926 0.04947 6.31% amrex::communicateParticlesStart 103 0.02181 0.02716 0.03252 4.15% TestParticleContainer::checkAnswer 103 0.01309 0.01928 0.02548 3.25% amrex::computeNeighborProcs 101 0.01962 0.02038 0.02113 2.69% ParticleCopyPlan::buildMPIStart 103 0.01003 0.01412 0.01821 2.32% amrex::communicateParticlesFinish 103 0.004685 0.01108 0.01747 2.23% ParticleCopyPlan::doHandShake 103 0.0008217 0.004906 0.00899 1.15% InitParticles 1 0.004531 0.004741 0.004951 0.63% testRedistribute 1 0.0008127 0.0008361 0.0008595 0.11% ParticleContainer::OK() 103 2.83e-05 2.851e-05 2.871e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 2.107e-06 2.932e-06 3.757e-06 0.00% Other 521 0.003147 0.004869 0.006591 0.84% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- testRedistribute 1 0.7808 0.7825 0.7842 100.00% ParticleContainer::Redistribute_impl() 103 0.615 0.6151 0.6152 78.45% numParticlesOutOfRange() 614 0.1302 0.144 0.1579 20.13% amrex::unpackBuffer 103 0.1288 0.1305 0.1321 16.85% amrex::unpackRemotes 103 0.1033 0.1079 0.1125 14.35% ParticleCopyPlan::build 103 0.09539 0.0962 0.09701 12.37% Redistribute_partition 103 0.0907 0.09157 0.09244 11.79% TestParticleContainer::checkAnswer 103 0.05575 0.06194 0.06812 8.69% TestParticleContainer::moveParticles 100 0.04905 0.04926 0.04947 6.31% ParticleContainer::OK() 103 0.04264 0.04265 0.04266 5.44% amrex::communicateParticlesStart 103 0.02181 0.02716 0.03252 4.15% amrex::computeNeighborProcs 101 0.01962 0.02038 0.02113 2.69% ParticleCopyPlan::buildMPIStart 103 0.01902 0.01902 0.01903 2.43% amrex::communicateParticlesFinish 103 0.004685 0.01108 0.01747 2.23% InitParticles 1 0.009692 0.009694 0.009695 1.24% ParticleCopyPlan::doHandShake 103 0.0008217 0.004906 0.00899 1.15% DistributionMapping::SFCProcessorMapDoIt() 1 9.508e-06 0.001659 0.003308 0.42% Other 521 0.003678 0.005426 0.007173 0.91% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.check_file(nvals = 1) :: [Redistribute_chk] [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] [TOP]::amr.plot_file(nvals = 1) :: [Redistribute_plt] Device Memory Usage: --------------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------------- ResizeRandomSeed 2 9142 KiB 9143 KiB 9143 KiB 9216 KiB 9216 KiB 9216 KiB ParticleContainer::ReserveForRedistribute() 72 101 KiB 108 KiB 115 KiB 8324 KiB 8331 KiB 8339 KiB InitParticles 48 6979 KiB 6979 KiB 6980 KiB 8331 KiB 8331 KiB 8331 KiB ParticleContainer::Redistribute_impl() 210 123 KiB 131 KiB 138 KiB 8194 KiB 8201 KiB 8207 KiB amrex::packBuffer 204 346 KiB 348 KiB 349 KiB 8193 KiB 8200 KiB 8207 KiB Redistribute_partition 4054 96 KiB 96 KiB 97 KiB 1821 KiB 1823 KiB 1824 KiB ParticleCopyPlan::buildCopiesAtomicScatter 406 12 KiB 12 KiB 12 KiB 260 KiB 260 KiB 260 KiB testRedistribute 4 27 B 27 B 27 B 48 KiB 48 KiB 48 KiB numParticlesOutOfRange() 1228 3394 B 3419 B 3444 B 24 KiB 24 KiB 24 KiB DenseBins::buildGPU 12 1108 B 1108 B 1108 B 2048 B 2048 B 2048 B ParticleCopyPlan::build 1236 669 B 674 B 680 B 1280 B 1280 B 1280 B ParticleBufferMap::define 8 886 B 886 B 887 B 1024 B 1024 B 1024 B amrex::communicateParticlesStart 206 100 B 103 B 106 B 256 B 256 B 256 B --------------------------------------------------------------------------------------------------------------------------- Managed Memory Usage: --------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------- The_Managed_Arena::Initialize() 2 7 B 7 B 7 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------- Pinned Memory Usage: ---------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ---------------------------------------------------------------------------------------------------------------------- ParticleContainer::Redistribute_impl() 416 178 KiB 182 KiB 185 KiB 8194 KiB 8200 KiB 8207 KiB amrex::communicateParticlesStart 204 84 KiB 85 KiB 87 KiB 8193 KiB 8200 KiB 8207 KiB The_Pinned_Arena::Initialize() 2 10 B 11 B 13 B 8192 KiB 8192 KiB 8192 KiB InitParticles 564 18 KiB 19 KiB 21 KiB 6884 KiB 6884 KiB 6884 KiB Redistribute_partition 420 864 B 864 B 865 B 1280 B 1280 B 1280 B numParticlesOutOfRange() 1248 894 B 895 B 896 B 1280 B 1280 B 1280 B amrex::unpackBuffer 12 12 B 12 B 13 B 1024 B 1024 B 1024 B ParticleCopyPlan::build 206 127 B 128 B 129 B 256 B 256 B 256 B ParticleCopyPlan::buildMPIStart 204 121 B 121 B 121 B 256 B 256 B 256 B testRedistribute 4 0 B 0 B 0 B 256 B 256 B 256 B ---------------------------------------------------------------------------------------------------------------------- Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [7571 ... 7571] [The Arena] max space (MB) allocated spread across MPI: [49 ... 49] [The Arena] max space (MB) used spread across MPI: [35 ... 35] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [32 ... 32] [The Pinned Arena] max space (MB) used spread across MPI: [16 ... 16] AMReX (26.06-13-g87eac2327e9f) finalized