Initializing AMReX (26.07-17-g9a0ac5569bd4)... MPI initialized with 2 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.07-17-g9a0ac5569bd4) initialized Running redistribute test About to initialize particles pass TinyProfiler total time across processes [min...avg...max]: 0.2357 ... 0.2388 ... 0.2418 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- ParticleCopyPlan::build 103 0.06153 0.0616 0.06167 25.50% numParticlesOutOfRange() 614 0.03678 0.04438 0.05198 21.50% Redistribute_partition 103 0.03075 0.03096 0.03117 12.89% ParticleContainer::Redistribute_impl() 103 0.02602 0.02762 0.02922 12.08% amrex::communicateParticlesStart 103 0.01637 0.01698 0.01759 7.28% amrex::unpackBuffer 103 0.01355 0.01366 0.01376 5.69% amrex::unpackRemotes 103 1.177e-05 0.006531 0.01305 5.40% amrex::computeNeighborProcs 101 0.007088 0.007222 0.007355 3.04% TestParticleContainer::moveParticles 100 0.007131 0.007136 0.007141 2.95% ParticleCopyPlan::doHandShake 103 0.00414 0.005324 0.006507 2.69% DistributionMapping::LeastUsedCPUs() 1 7.337e-06 0.003025 0.006043 2.50% ParticleCopyPlan::buildMPIStart 103 0.00368 0.004423 0.005167 2.14% TestParticleContainer::checkAnswer 103 0.002138 0.003369 0.0046 1.90% InitParticles 1 0.002584 0.002748 0.002912 1.20% amrex::communicateParticlesFinish 103 0.0004916 0.0008521 0.001213 0.50% amrex::packBuffer 103 0.0008062 0.000818 0.0008298 0.34% testRedistribute 1 0.0004658 0.0005141 0.0005625 0.23% ParticleContainer::OK() 103 2.166e-05 2.194e-05 2.223e-05 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 2.39e-06 3.31e-06 4.23e-06 0.00% Other 417 0.001371 0.001578 0.001784 0.74% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- testRedistribute 1 0.2357 0.2388 0.2418 100.00% ParticleContainer::Redistribute_impl() 103 0.1912 0.1912 0.1913 79.10% ParticleCopyPlan::build 103 0.07809 0.07874 0.07939 32.83% numParticlesOutOfRange() 614 0.03678 0.04438 0.05198 21.50% Redistribute_partition 103 0.03075 0.03096 0.03117 12.89% TestParticleContainer::checkAnswer 103 0.01642 0.01767 0.01893 7.83% amrex::communicateParticlesStart 103 0.01637 0.01698 0.01759 7.28% ParticleContainer::OK() 103 0.01428 0.01431 0.01433 5.93% amrex::unpackBuffer 103 0.01355 0.01366 0.01376 5.69% amrex::unpackRemotes 103 1.177e-05 0.006531 0.01305 5.40% ParticleCopyPlan::buildMPIStart 103 0.009307 0.009747 0.01019 4.21% amrex::computeNeighborProcs 101 0.007088 0.007222 0.007355 3.04% TestParticleContainer::moveParticles 100 0.007131 0.007136 0.007141 2.95% InitParticles 1 0.006931 0.006936 0.006942 2.87% ParticleCopyPlan::doHandShake 103 0.00414 0.005324 0.006507 2.69% DistributionMapping::SFCProcessorMapDoIt() 1 1.048e-05 0.00303 0.006049 2.50% DistributionMapping::LeastUsedCPUs() 1 7.337e-06 0.003025 0.006043 2.50% amrex::communicateParticlesFinish 103 0.0004916 0.0008521 0.001213 0.50% amrex::packBuffer 103 0.0008062 0.000818 0.0008298 0.34% Other 417 0.001506 0.001867 0.002227 0.92% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.check_file(nvals = 1) :: [RedistributeNonPeriodic_chk] [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] [TOP]::amr.plot_file(nvals = 1) :: [RedistributeNonPeriodic_plt] Device Memory Usage: --------------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------------- ResizeRandomSeed 2 9026 KiB 9026 KiB 9026 KiB 9216 KiB 9216 KiB 9216 KiB InitParticles 24 3086 KiB 3087 KiB 3088 KiB 6768 KiB 6768 KiB 6768 KiB amrex::packBuffer 62 7384 B 12 KiB 16 KiB 98 KiB 198 KiB 298 KiB ParticleContainer::Redistribute_impl() 37 923 B 5299 B 9675 B 216 KiB 216 KiB 216 KiB Redistribute_partition 1276 21 KiB 25 KiB 30 KiB 199 KiB 199 KiB 199 KiB testRedistribute 2 36 B 36 B 37 B 48 KiB 48 KiB 48 KiB ParticleCopyPlan::buildCopiesAtomicScatter 128 2046 B 2482 B 2919 B 25 KiB 25 KiB 25 KiB numParticlesOutOfRange() 388 2018 B 2312 B 2606 B 24 KiB 24 KiB 24 KiB DenseBins::buildGPU 12 839 B 839 B 840 B 2048 B 2048 B 2048 B ParticleCopyPlan::build 1236 426 B 431 B 436 B 1280 B 1280 B 1280 B ParticleBufferMap::define 8 672 B 672 B 673 B 1024 B 1024 B 1024 B ParticleContainer::ReserveForRedistribute() 568 177 B 178 B 179 B 1024 B 1024 B 1024 B amrex::communicateParticlesStart 206 39 B 39 B 40 B 256 B 256 B 256 B --------------------------------------------------------------------------------------------------------------------------- Managed Memory Usage: --------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------- The_Managed_Arena::Initialize() 2 14 B 17 B 20 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------- Pinned Memory Usage: ---------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ---------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 2 20 B 27 B 35 B 8192 KiB 8192 KiB 8192 KiB InitParticles 296 18 KiB 20 KiB 22 KiB 4168 KiB 4168 KiB 4168 KiB ParticleContainer::Redistribute_impl() 274 5397 B 6746 B 8096 B 99 KiB 198 KiB 298 KiB amrex::communicateParticlesStart 31 0 B 3534 B 7069 B 0 B 99 KiB 199 KiB Redistribute_partition 136 239 B 239 B 239 B 768 B 768 B 768 B numParticlesOutOfRange() 392 252 B 255 B 259 B 768 B 768 B 768 B TestParticleContainer::checkAnswer 284 82 B 82 B 82 B 512 B 512 B 512 B amrex::unpackBuffer 284 88 B 88 B 89 B 512 B 512 B 512 B ParticleCopyPlan::build 206 67 B 68 B 69 B 256 B 256 B 256 B ParticleCopyPlan::buildMPIStart 31 0 B 18 B 37 B 0 B 128 B 256 B testRedistribute 2 0 B 0 B 0 B 256 B 256 B 256 B ---------------------------------------------------------------------------------------------------------------------- Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [7643 ... 7643] [The Arena] max space (MB) allocated spread across MPI: [17 ... 17] [The Arena] max space (MB) used spread across MPI: [16 ... 16] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Pinned Arena] max space (MB) used spread across MPI: [4 ... 4] AMReX (26.07-17-g9a0ac5569bd4) finalized