Initializing AMReX (26.07-50-g525c31011b65)... MPI initialized with 2 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.07-50-g525c31011b65) initialized Running redistribute test testNeighborProcsCoarseToFine: pass About to initialize particles 131072 131072 pass TinyProfiler total time across processes [min...avg...max]: 1.546 ... 1.547 ... 1.547 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- numParticlesOutOfRange() 411 0.3591 0.3718 0.3846 24.85% amrex::unpackBuffer 104 0.2743 0.2749 0.2754 17.80% Redistribute_partition 104 0.2619 0.2622 0.2625 16.96% amrex::unpackRemotes 104 0.2066 0.2122 0.2178 14.08% TestParticleContainer::moveParticles 100 0.1212 0.1213 0.1213 7.84% ParticleContainer::Redistribute_impl() 104 0.07882 0.09385 0.1089 7.04% TestParticleContainer::checkAnswer 103 0.05319 0.05772 0.06225 4.02% ParticleCopyPlan::build 104 0.05093 0.05123 0.05152 3.33% amrex::communicateParticlesStart 104 0.01811 0.02587 0.03364 2.17% amrex::computeNeighborProcs 102 0.02435 0.02454 0.02474 1.60% ParticleCopyPlan::buildMPIStart 104 0.01003 0.0145 0.01898 1.23% amrex::communicateParticlesFinish 104 0.00637 0.01027 0.01418 0.92% ParticleCopyPlan::doHandShake 104 0.000417 0.005164 0.009911 0.64% ParticleContainer::ReserveForRedistribute() 104 0.006813 0.007182 0.007551 0.49% InitParticles 1 0.003385 0.003559 0.003734 0.24% testRedistribute 1 0.002819 0.002918 0.003017 0.19% ParticleContainer::OK() 103 3.484e-05 3.606e-05 3.728e-05 0.00% Other 435 0.006548 0.007428 0.008308 0.54% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- testRedistribute 1 1.546 1.546 1.546 99.90% ParticleContainer::Redistribute_impl() 104 1.119 1.119 1.119 72.33% numParticlesOutOfRange() 411 0.3591 0.3718 0.3846 24.85% amrex::unpackBuffer 104 0.2743 0.2749 0.2754 17.80% Redistribute_partition 104 0.2619 0.2622 0.2625 16.96% amrex::unpackRemotes 104 0.2066 0.2122 0.2178 14.08% TestParticleContainer::checkAnswer 103 0.1731 0.1776 0.1821 11.77% TestParticleContainer::moveParticles 100 0.1212 0.1213 0.1213 7.84% ParticleContainer::OK() 103 0.1199 0.1199 0.1199 7.75% ParticleCopyPlan::build 104 0.09633 0.09666 0.09699 6.27% amrex::communicateParticlesStart 104 0.01811 0.02587 0.03364 2.17% amrex::computeNeighborProcs 102 0.02435 0.02454 0.02474 1.60% ParticleCopyPlan::buildMPIStart 104 0.01939 0.01967 0.01994 1.29% InitParticles 1 0.01577 0.01577 0.01577 1.02% amrex::communicateParticlesFinish 104 0.00637 0.01027 0.01418 0.92% ParticleCopyPlan::doHandShake 104 0.000417 0.005164 0.009911 0.64% ParticleContainer::ReserveForRedistribute() 104 0.006813 0.007182 0.007551 0.49% Other 435 0.007136 0.00802 0.008903 0.58% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.check_file(nvals = 1) :: [RedistributeMR_chk] [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] [TOP]::amr.plot_file(nvals = 1) :: [RedistributeMR_plt] Device Memory Usage: --------------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------------- ResizeRandomSeed 2 9175 KiB 9175 KiB 9175 KiB 9216 KiB 9216 KiB 9216 KiB ParticleContainer::ReserveForRedistribute() 361 1177 KiB 1183 KiB 1188 KiB 7080 KiB 7089 KiB 7098 KiB InitParticles 24 6403 KiB 6404 KiB 6405 KiB 7028 KiB 7028 KiB 7028 KiB ParticleContainer::Redistribute_impl() 224 81 KiB 83 KiB 85 KiB 6908 KiB 6921 KiB 6934 KiB amrex::packBuffer 208 196 KiB 197 KiB 198 KiB 6907 KiB 6920 KiB 6933 KiB Redistribute_partition 12146 78 KiB 78 KiB 79 KiB 1835 KiB 1839 KiB 1843 KiB ParticleCopyPlan::buildCopiesAtomicScatter 1218 8883 B 8932 B 8982 B 262 KiB 262 KiB 263 KiB testRedistribute 24 66 B 70 B 74 B 48 KiB 48 KiB 48 KiB numParticlesOutOfRange() 3684 5150 B 5159 B 5169 B 24 KiB 24 KiB 24 KiB DenseBins::buildGPU 40 3555 B 3555 B 3556 B 4608 B 4608 B 4608 B ParticleCopyPlan::build 1248 613 B 617 B 621 B 1280 B 1280 B 1280 B ParticleBufferMap::define 8 950 B 950 B 951 B 1024 B 1024 B 1024 B amrex::communicateParticlesStart 208 104 B 106 B 108 B 256 B 256 B 256 B --------------------------------------------------------------------------------------------------------------------------- Managed Memory Usage: --------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------- The_Managed_Arena::Initialize() 2 2 B 2 B 3 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------- Pinned Memory Usage: ---------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ---------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 2 5 B 5 B 5 B 8192 KiB 8192 KiB 8192 KiB ParticleContainer::Redistribute_impl() 436 130 KiB 134 KiB 138 KiB 6908 KiB 6920 KiB 6933 KiB amrex::communicateParticlesStart 206 47 KiB 54 KiB 61 KiB 6907 KiB 6919 KiB 6932 KiB InitParticles 300 6736 B 7166 B 7596 B 6233 KiB 6233 KiB 6233 KiB numParticlesOutOfRange() 3718 1456 B 1457 B 1459 B 1792 B 1792 B 1792 B amrex::unpackBuffer 30 946 B 946 B 947 B 1536 B 1536 B 1536 B Redistribute_partition 1244 484 B 484 B 485 B 768 B 768 B 768 B ParticleCopyPlan::build 208 119 B 119 B 120 B 256 B 256 B 256 B ParticleCopyPlan::buildMPIStart 206 115 B 115 B 115 B 256 B 256 B 256 B testRedistribute 24 0 B 0 B 0 B 256 B 256 B 256 B ---------------------------------------------------------------------------------------------------------------------- Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [7603 ... 7603] [The Arena] max space (MB) allocated spread across MPI: [33 ... 41] [The Arena] max space (MB) used spread across MPI: [31 ... 31] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [16 ... 16] [The Pinned Arena] max space (MB) used spread across MPI: [13 ... 13] AMReX (26.07-50-g525c31011b65) finalized