Initializing AMReX (26.08-21-g3b31af42a8b8)... MPI initialized with 2 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.08-21-g3b31af42a8b8) initialized Running redistribute test testNeighborProcsCoarseToFine: pass About to initialize particles 131072 131072 pass TinyProfiler total time across processes [min...avg...max]: 1.554 ... 1.571 ... 1.588 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- numParticlesOutOfRange() 411 0.3605 0.374 0.3876 24.40% amrex::unpackBuffer 104 0.2714 0.273 0.2747 17.29% Redistribute_partition 104 0.2615 0.2619 0.2623 16.51% amrex::unpackRemotes 104 0.2069 0.213 0.2191 13.80% TestParticleContainer::moveParticles 100 0.1209 0.1211 0.1212 7.63% ParticleContainer::Redistribute_impl() 104 0.08054 0.09517 0.1098 6.91% TestParticleContainer::checkAnswer 103 0.05403 0.05876 0.06349 4.00% ParticleCopyPlan::build 104 0.04655 0.04844 0.05033 3.17% testNeighborProcsCoarseToFine 1 5.242e-05 0.01735 0.03464 2.18% amrex::communicateParticlesStart 104 0.01871 0.0264 0.03408 2.15% amrex::computeNeighborProcs 102 0.02454 0.026 0.02747 1.73% ParticleCopyPlan::buildMPIStart 104 0.01018 0.0147 0.01921 1.21% amrex::communicateParticlesFinish 104 0.007612 0.01197 0.01633 1.03% ParticleCopyPlan::doHandShake 104 0.0007454 0.005649 0.01055 0.66% ParticleContainer::ReserveForRedistribute() 104 0.008067 0.008665 0.009262 0.58% InitParticles 1 0.003214 0.00374 0.004265 0.27% testRedistribute 1 0.002922 0.002994 0.003066 0.19% ParticleContainer::OK() 103 6.144e-05 7.189e-05 8.234e-05 0.01% Other 434 0.006975 0.008038 0.009102 0.57% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- testRedistribute 1 1.554 1.554 1.554 97.82% ParticleContainer::Redistribute_impl() 104 1.242 1.247 1.252 78.85% numParticlesOutOfRange() 411 0.3605 0.374 0.3876 24.40% amrex::unpackBuffer 104 0.2714 0.273 0.2747 17.29% Redistribute_partition 104 0.2615 0.2619 0.2623 16.51% amrex::unpackRemotes 104 0.2069 0.213 0.2191 13.80% TestParticleContainer::checkAnswer 103 0.174 0.1786 0.1831 11.53% TestParticleContainer::moveParticles 100 0.1209 0.1211 0.1212 7.63% ParticleContainer::OK() 103 0.1196 0.1198 0.12 7.55% ParticleCopyPlan::build 104 0.0961 0.09653 0.09695 6.10% testNeighborProcsCoarseToFine 1 9.584e-05 0.01739 0.03468 2.18% amrex::communicateParticlesStart 104 0.01871 0.0264 0.03408 2.15% amrex::computeNeighborProcs 102 0.02454 0.026 0.02747 1.73% ParticleCopyPlan::buildMPIStart 104 0.01996 0.02035 0.02074 1.31% InitParticles 1 0.01636 0.01637 0.01638 1.03% amrex::communicateParticlesFinish 104 0.007612 0.01197 0.01633 1.03% ParticleCopyPlan::doHandShake 104 0.0007454 0.005649 0.01055 0.66% ParticleContainer::ReserveForRedistribute() 104 0.008067 0.008665 0.009262 0.58% Other 434 0.007542 0.008707 0.009872 0.62% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.check_file(nvals = 1) :: [RedistributeMR_chk] [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] [TOP]::amr.plot_file(nvals = 1) :: [RedistributeMR_plt] Device Memory Usage: --------------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------------- ResizeRandomSeed 2 9162 KiB 9169 KiB 9175 KiB 9216 KiB 9216 KiB 9216 KiB ParticleContainer::ReserveForRedistribute() 360 1149 KiB 1157 KiB 1164 KiB 7088 KiB 7093 KiB 7098 KiB InitParticles 24 6258 KiB 6260 KiB 6262 KiB 7028 KiB 7028 KiB 7028 KiB ParticleContainer::Redistribute_impl() 224 80 KiB 84 KiB 88 KiB 6918 KiB 6921 KiB 6924 KiB amrex::packBuffer 208 199 KiB 200 KiB 202 KiB 6917 KiB 6920 KiB 6922 KiB Redistribute_partition 12146 78 KiB 78 KiB 79 KiB 1838 KiB 1839 KiB 1840 KiB ParticleCopyPlan::buildCopiesAtomicScatter 1218 8940 B 9008 B 9077 B 262 KiB 263 KiB 263 KiB testRedistribute 24 64 B 67 B 71 B 48 KiB 48 KiB 48 KiB numParticlesOutOfRange() 3684 5014 B 5016 B 5019 B 24 KiB 24 KiB 24 KiB DenseBins::buildGPU 40 3479 B 3479 B 3480 B 4608 B 4608 B 4608 B ParticleCopyPlan::build 1248 598 B 602 B 607 B 1280 B 1280 B 1280 B ParticleBufferMap::define 8 930 B 930 B 930 B 1024 B 1024 B 1024 B amrex::communicateParticlesStart 208 102 B 104 B 106 B 256 B 256 B 256 B --------------------------------------------------------------------------------------------------------------------------- Managed Memory Usage: --------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------- The_Managed_Arena::Initialize() 2 3 B 3 B 4 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------- Pinned Memory Usage: ---------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ---------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 2 5 B 6 B 8 B 8192 KiB 8192 KiB 8192 KiB ParticleContainer::Redistribute_impl() 436 134 KiB 138 KiB 142 KiB 6918 KiB 6920 KiB 6923 KiB amrex::communicateParticlesStart 206 52 KiB 57 KiB 62 KiB 6917 KiB 6920 KiB 6922 KiB InitParticles 300 6001 B 6714 B 7428 B 6233 KiB 6233 KiB 6233 KiB numParticlesOutOfRange() 3718 1423 B 1425 B 1427 B 1792 B 1792 B 1792 B amrex::unpackBuffer 30 925 B 926 B 927 B 1536 B 1536 B 1536 B Redistribute_partition 1244 473 B 473 B 474 B 768 B 768 B 768 B ParticleCopyPlan::build 208 116 B 117 B 118 B 256 B 256 B 256 B ParticleCopyPlan::buildMPIStart 206 112 B 112 B 113 B 256 B 256 B 256 B testRedistribute 24 0 B 0 B 0 B 256 B 256 B 256 B ---------------------------------------------------------------------------------------------------------------------- Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [7595 ... 7595] [The Arena] max space (MB) allocated spread across MPI: [41 ... 41] [The Arena] max space (MB) used spread across MPI: [31 ... 31] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [16 ... 16] [The Pinned Arena] max space (MB) used spread across MPI: [13 ... 13] AMReX (26.08-21-g3b31af42a8b8) finalized