Initializing AMReX (26.05-55-g750b74d10a21)... MPI initialized with 2 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.05-55-g750b74d10a21) initialized Running redistribute test About to initialize particles 131072 131072 pass TinyProfiler total time across processes [min...avg...max]: 1.552 ... 1.566 ... 1.58 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- numParticlesOutOfRange() 616 0.3619 0.3743 0.3867 24.48% amrex::unpackBuffer 104 0.2748 0.2758 0.2769 17.53% Redistribute_partition 104 0.2617 0.262 0.2623 16.60% amrex::unpackRemotes 104 0.2077 0.2131 0.2185 13.83% TestParticleContainer::moveParticles 100 0.1213 0.1214 0.1215 7.69% ParticleContainer::Redistribute_impl() 104 0.08005 0.09406 0.1081 6.84% TestParticleContainer::checkAnswer 103 0.05345 0.0581 0.06275 3.97% ParticleCopyPlan::build 104 0.05215 0.05232 0.0525 3.32% amrex::communicateParticlesStart 104 0.0191 0.02674 0.03438 2.18% DistributionMapping::LeastUsedCPUs() 3 1.588e-05 0.01366 0.0273 1.73% amrex::computeNeighborProcs 101 0.02426 0.02431 0.02435 1.54% ParticleCopyPlan::buildMPIStart 104 0.01033 0.01454 0.01874 1.19% amrex::communicateParticlesFinish 104 0.00644 0.009666 0.01289 0.82% ParticleCopyPlan::doHandShake 104 0.0006252 0.004942 0.009259 0.59% InitParticles 1 0.003305 0.003495 0.003686 0.23% testRedistribute 1 0.002773 0.002872 0.002972 0.19% ParticleContainer::OK() 103 3.206e-05 3.279e-05 3.352e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 3 5.163e-06 1.232e-05 1.948e-05 0.00% Other 532 0.01447 0.01466 0.01486 0.94% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- testRedistribute 1 1.552 1.566 1.58 100.00% ParticleContainer::Redistribute_impl() 104 1.125 1.125 1.125 71.19% numParticlesOutOfRange() 616 0.3619 0.3743 0.3867 24.48% amrex::unpackBuffer 104 0.2748 0.2758 0.2769 17.53% Redistribute_partition 104 0.2617 0.262 0.2623 16.60% amrex::unpackRemotes 104 0.2077 0.2131 0.2185 13.83% TestParticleContainer::checkAnswer 103 0.173 0.1776 0.1822 11.54% TestParticleContainer::moveParticles 100 0.1213 0.1214 0.1215 7.69% ParticleContainer::OK() 103 0.1195 0.1195 0.1195 7.57% ParticleCopyPlan::build 104 0.09704 0.09736 0.09768 6.18% amrex::communicateParticlesStart 104 0.0191 0.02674 0.03438 2.18% DistributionMapping::SFCProcessorMapDoIt() 3 3.685e-05 0.01367 0.0273 1.73% DistributionMapping::LeastUsedCPUs() 3 1.588e-05 0.01366 0.0273 1.73% amrex::computeNeighborProcs 101 0.02426 0.02431 0.02435 1.54% ParticleCopyPlan::buildMPIStart 104 0.01937 0.01948 0.01959 1.24% InitParticles 1 0.01579 0.01579 0.0158 1.00% amrex::communicateParticlesFinish 104 0.00644 0.009666 0.01289 0.82% ParticleCopyPlan::doHandShake 104 0.0006252 0.004942 0.009259 0.59% Other 532 0.01502 0.01532 0.01562 0.99% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.check_file(nvals = 1) :: [RedistributeMR_chk] [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] [TOP]::amr.plot_file(nvals = 1) :: [RedistributeMR_plt] Device Memory Usage: --------------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------------- ResizeRandomSeed 2 9175 KiB 9175 KiB 9176 KiB 9216 KiB 9216 KiB 9216 KiB ParticleContainer::ReserveForRedistribute() 365 1157 KiB 1161 KiB 1166 KiB 7082 KiB 7085 KiB 7087 KiB InitParticles 24 6289 KiB 6290 KiB 6291 KiB 7028 KiB 7028 KiB 7028 KiB ParticleContainer::Redistribute_impl() 224 82 KiB 83 KiB 84 KiB 6918 KiB 6921 KiB 6924 KiB amrex::packBuffer 208 198 KiB 200 KiB 201 KiB 6917 KiB 6920 KiB 6923 KiB Redistribute_partition 12146 78 KiB 78 KiB 79 KiB 1838 KiB 1839 KiB 1840 KiB ParticleCopyPlan::buildCopiesAtomicScatter 1218 8945 B 8997 B 9049 B 262 KiB 262 KiB 263 KiB testRedistribute 24 64 B 68 B 72 B 48 KiB 48 KiB 48 KiB numParticlesOutOfRange() 3684 5067 B 5084 B 5101 B 24 KiB 24 KiB 24 KiB DenseBins::buildGPU 40 3494 B 3494 B 3495 B 4608 B 4608 B 4608 B ParticleCopyPlan::build 1248 605 B 608 B 611 B 1280 B 1280 B 1280 B ParticleBufferMap::define 8 934 B 934 B 935 B 1024 B 1024 B 1024 B amrex::communicateParticlesStart 208 103 B 104 B 106 B 256 B 256 B 256 B --------------------------------------------------------------------------------------------------------------------------- Managed Memory Usage: --------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------- The_Managed_Arena::Initialize() 2 2 B 3 B 5 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------- Pinned Memory Usage: ---------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ---------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 2 3 B 4 B 6 B 8192 KiB 8192 KiB 8192 KiB ParticleContainer::Redistribute_impl() 436 134 KiB 138 KiB 141 KiB 6918 KiB 6920 KiB 6923 KiB amrex::communicateParticlesStart 206 48 KiB 55 KiB 63 KiB 6917 KiB 6919 KiB 6922 KiB InitParticles 300 6432 B 6928 B 7425 B 6233 KiB 6233 KiB 6233 KiB numParticlesOutOfRange() 3718 1430 B 1431 B 1433 B 1792 B 1792 B 1792 B amrex::unpackBuffer 30 929 B 929 B 930 B 1536 B 1536 B 1536 B Redistribute_partition 1244 476 B 476 B 477 B 768 B 768 B 768 B ParticleCopyPlan::build 208 117 B 118 B 119 B 256 B 256 B 256 B ParticleCopyPlan::buildMPIStart 206 113 B 113 B 113 B 256 B 256 B 256 B testRedistribute 24 0 B 0 B 0 B 256 B 256 B 256 B ---------------------------------------------------------------------------------------------------------------------- Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [7595 ... 7595] [The Arena] max space (MB) allocated spread across MPI: [41 ... 41] [The Arena] max space (MB) used spread across MPI: [31 ... 31] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [16 ... 16] [The Pinned Arena] max space (MB) used spread across MPI: [13 ... 13] AMReX (26.05-55-g750b74d10a21) finalized