Initializing AMReX (26.09-2-gbb04a2468103)... MPI initialized with 2 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.09-2-gbb04a2468103) initialized Running redistribute test testNeighborProcsCoarseToFine: pass About to initialize particles pass TinyProfiler total time across processes [min...avg...max]: 1.325 ... 1.327 ... 1.329 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- ParticleContainer::SortParticlesByBin() 101 0.3595 0.3596 0.3598 27.08% numParticlesOutOfRange() 410 0.1747 0.1846 0.1945 14.64% amrex::unpackBuffer 103 0.1297 0.1307 0.1317 9.91% Redistribute_partition 103 0.1267 0.1271 0.1275 9.59% amrex::unpackRemotes 103 0.1037 0.1081 0.1124 8.46% DenseBins::buildGPU 203 0.109 0.1104 0.1118 8.41% ParticleContainer::Redistribute_impl() 103 0.08741 0.09522 0.103 7.75% ParticleCopyPlan::build 103 0.05648 0.05654 0.05659 4.26% TestParticleContainer::moveParticles 100 0.04952 0.04953 0.04954 3.73% amrex::communicateParticlesStart 103 0.02396 0.02767 0.03137 2.36% amrex::computeNeighborProcs 102 0.02003 0.02038 0.02072 1.56% TestParticleContainer::checkAnswer 103 0.01507 0.01761 0.02015 1.52% ParticleCopyPlan::buildMPIStart 103 0.01135 0.01382 0.01629 1.23% amrex::communicateParticlesFinish 103 0.006962 0.01086 0.01476 1.11% ParticleCopyPlan::doHandShake 103 0.003095 0.004943 0.006791 0.51% InitParticles 1 0.004647 0.004841 0.005035 0.38% testRedistribute 1 0.0007381 0.0008833 0.001029 0.08% ParticleContainer::OK() 103 3.092e-05 3.18e-05 3.269e-05 0.00% Other 522 0.002553 0.004335 0.006117 0.46% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- testRedistribute 1 1.325 1.325 1.325 99.74% ParticleContainer::Redistribute_impl() 103 0.6983 0.7004 0.7026 52.87% ParticleContainer::SortParticlesByBin() 101 0.4678 0.4693 0.4709 35.44% numParticlesOutOfRange() 410 0.1747 0.1846 0.1945 14.64% amrex::unpackBuffer 103 0.1297 0.1307 0.1317 9.91% Redistribute_partition 103 0.1267 0.1271 0.1275 9.59% amrex::unpackRemotes 103 0.1037 0.1081 0.1124 8.46% DenseBins::buildGPU 203 0.109 0.1104 0.1118 8.41% TestParticleContainer::checkAnswer 103 0.09939 0.1003 0.1013 7.62% ParticleCopyPlan::build 103 0.09588 0.09612 0.09637 7.25% ParticleContainer::OK() 103 0.08114 0.08273 0.08432 6.35% TestParticleContainer::moveParticles 100 0.04952 0.04953 0.04954 3.73% amrex::communicateParticlesStart 103 0.02396 0.02767 0.03137 2.36% amrex::computeNeighborProcs 102 0.02003 0.02038 0.02072 1.56% ParticleCopyPlan::buildMPIStart 103 0.01814 0.01876 0.01938 1.46% amrex::communicateParticlesFinish 103 0.006962 0.01086 0.01476 1.11% InitParticles 1 0.009668 0.00967 0.009672 0.73% ParticleCopyPlan::doHandShake 103 0.003095 0.004943 0.006791 0.51% Other 522 0.002998 0.004812 0.006625 0.50% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.check_file(nvals = 1) :: [SortParticlesByCell_chk] [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] [TOP]::amr.plot_file(nvals = 1) :: [SortParticlesByCell_plt] Device Memory Usage: --------------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------------- ResizeRandomSeed 2 9171 KiB 9171 KiB 9172 KiB 9216 KiB 9216 KiB 9216 KiB ParticleContainer::ReserveForRedistribute() 72 63 KiB 66 KiB 69 KiB 8331 KiB 8331 KiB 8332 KiB InitParticles 48 5206 KiB 5208 KiB 5209 KiB 8331 KiB 8331 KiB 8331 KiB ParticleContainer::Redistribute_impl() 210 77 KiB 80 KiB 83 KiB 8200 KiB 8201 KiB 8201 KiB amrex::packBuffer 204 215 KiB 216 KiB 217 KiB 8200 KiB 8200 KiB 8201 KiB ParticleContainer::SortParticlesByBin() 1212 2340 KiB 2344 KiB 2348 KiB 2866 KiB 2870 KiB 2873 KiB Redistribute_partition 4054 61 KiB 61 KiB 61 KiB 1823 KiB 1823 KiB 1823 KiB DenseBins::buildGPU 426 596 KiB 596 KiB 596 KiB 653 KiB 653 KiB 653 KiB ParticleCopyPlan::buildCopiesAtomicScatter 406 7821 B 7850 B 7879 B 260 KiB 260 KiB 260 KiB testRedistribute 4 16 B 16 B 17 B 48 KiB 48 KiB 48 KiB numParticlesOutOfRange() 1228 2137 B 2165 B 2193 B 24 KiB 24 KiB 24 KiB ParticleCopyPlan::build 1236 419 B 420 B 422 B 1280 B 1280 B 1280 B ParticleBufferMap::define 8 939 B 939 B 940 B 1024 B 1024 B 1024 B amrex::communicateParticlesStart 206 63 B 64 B 65 B 256 B 256 B 256 B --------------------------------------------------------------------------------------------------------------------------- Managed Memory Usage: --------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------- The_Managed_Arena::Initialize() 2 4 B 4 B 4 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------- Pinned Memory Usage: ---------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ---------------------------------------------------------------------------------------------------------------------- ParticleContainer::Redistribute_impl() 416 110 KiB 113 KiB 115 KiB 8200 KiB 8200 KiB 8201 KiB amrex::communicateParticlesStart 204 45 KiB 51 KiB 58 KiB 8200 KiB 8200 KiB 8201 KiB The_Pinned_Arena::Initialize() 2 6 B 7 B 9 B 8192 KiB 8192 KiB 8192 KiB InitParticles 564 11 KiB 12 KiB 13 KiB 6884 KiB 6884 KiB 6884 KiB Redistribute_partition 420 925 B 925 B 926 B 1280 B 1280 B 1280 B numParticlesOutOfRange() 1248 944 B 945 B 946 B 1280 B 1280 B 1280 B amrex::unpackBuffer 12 7 B 7 B 8 B 1024 B 1024 B 1024 B ParticleCopyPlan::build 206 79 B 79 B 80 B 256 B 256 B 256 B ParticleCopyPlan::buildMPIStart 204 75 B 75 B 75 B 256 B 256 B 256 B testRedistribute 4 0 B 0 B 0 B 256 B 256 B 256 B ---------------------------------------------------------------------------------------------------------------------- Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [7571 ... 7571] [The Arena] max space (MB) allocated spread across MPI: [49 ... 49] [The Arena] max space (MB) used spread across MPI: [35 ... 35] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [32 ... 32] [The Pinned Arena] max space (MB) used spread across MPI: [16 ... 16] AMReX (26.09-2-gbb04a2468103) finalized