Initializing AMReX (26.05-3-g4ceb814db7d7)... MPI initialized with 2 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.05-3-g4ceb814db7d7) initialized Running redistribute test About to initialize particles pass TinyProfiler total time across processes [min...avg...max]: 1.307 ... 1.307 ... 1.308 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- ParticleContainer::SortParticlesByBin() 101 0.3545 0.3545 0.3545 27.10% numParticlesOutOfRange() 614 0.1713 0.1825 0.1937 14.81% amrex::unpackBuffer 103 0.1276 0.1289 0.1302 9.96% Redistribute_partition 103 0.1245 0.1252 0.1259 9.62% DenseBins::buildGPU 203 0.1066 0.1099 0.1131 8.65% amrex::unpackRemotes 103 0.105 0.1062 0.1075 8.22% ParticleContainer::Redistribute_impl() 103 0.08444 0.0927 0.101 7.72% ParticleCopyPlan::build 103 0.05547 0.0556 0.05573 4.26% TestParticleContainer::moveParticles 100 0.04894 0.04898 0.04901 3.75% amrex::communicateParticlesStart 103 0.02365 0.0262 0.02876 2.20% TestParticleContainer::checkAnswer 103 0.01366 0.01847 0.02328 1.78% amrex::computeNeighborProcs 101 0.01946 0.02 0.02053 1.57% ParticleCopyPlan::buildMPIStart 103 0.01082 0.01409 0.01736 1.33% amrex::communicateParticlesFinish 103 0.005996 0.01043 0.01487 1.14% ParticleCopyPlan::doHandShake 103 0.00131 0.00487 0.00843 0.64% InitParticles 1 0.004581 0.004791 0.005 0.38% testRedistribute 1 0.0007472 0.0008655 0.0009839 0.08% ParticleContainer::OK() 103 3.061e-05 3.076e-05 3.091e-05 0.00% Other 521 0.002205 0.003102 0.003999 0.31% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- testRedistribute 1 1.307 1.307 1.308 100.00% ParticleContainer::Redistribute_impl() 103 0.6389 0.639 0.6391 48.86% ParticleContainer::SortParticlesByBin() 101 0.4604 0.4637 0.4669 35.70% numParticlesOutOfRange() 614 0.1713 0.1825 0.1937 14.81% amrex::unpackBuffer 103 0.1276 0.1289 0.1302 9.96% Redistribute_partition 103 0.1245 0.1252 0.1259 9.62% DenseBins::buildGPU 203 0.1066 0.1099 0.1131 8.65% amrex::unpackRemotes 103 0.105 0.1062 0.1075 8.22% TestParticleContainer::checkAnswer 103 0.09881 0.1004 0.102 7.80% ParticleCopyPlan::build 103 0.09407 0.09503 0.09598 7.34% ParticleContainer::OK() 103 0.07874 0.08194 0.08514 6.51% TestParticleContainer::moveParticles 100 0.04894 0.04898 0.04901 3.75% amrex::communicateParticlesStart 103 0.02365 0.0262 0.02876 2.20% amrex::computeNeighborProcs 101 0.01946 0.02 0.02053 1.57% ParticleCopyPlan::buildMPIStart 103 0.01867 0.01896 0.01925 1.47% amrex::communicateParticlesFinish 103 0.005996 0.01043 0.01487 1.14% InitParticles 1 0.009515 0.009519 0.009524 0.73% ParticleCopyPlan::doHandShake 103 0.00131 0.00487 0.00843 0.64% Other 521 0.002636 0.004278 0.00592 0.45% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.check_file(nvals = 1) :: [SortParticlesByCell_chk] [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] [TOP]::amr.plot_file(nvals = 1) :: [SortParticlesByCell_plt] Device Memory Usage: --------------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------------- ResizeRandomSeed 2 9169 KiB 9169 KiB 9169 KiB 9216 KiB 9216 KiB 9216 KiB ParticleContainer::ReserveForRedistribute() 72 63 KiB 65 KiB 68 KiB 8315 KiB 8331 KiB 8348 KiB InitParticles 48 5199 KiB 5199 KiB 5199 KiB 8331 KiB 8331 KiB 8331 KiB ParticleContainer::Redistribute_impl() 210 79 KiB 79 KiB 79 KiB 8184 KiB 8201 KiB 8217 KiB amrex::packBuffer 204 202 KiB 203 KiB 203 KiB 8184 KiB 8200 KiB 8217 KiB ParticleContainer::SortParticlesByBin() 1212 2337 KiB 2340 KiB 2343 KiB 2865 KiB 2869 KiB 2873 KiB Redistribute_partition 4054 57 KiB 58 KiB 58 KiB 1819 KiB 1823 KiB 1826 KiB DenseBins::buildGPU 426 594 KiB 594 KiB 594 KiB 653 KiB 653 KiB 653 KiB ParticleCopyPlan::buildCopiesAtomicScatter 406 7342 B 7375 B 7408 B 260 KiB 260 KiB 261 KiB testRedistribute 4 16 B 16 B 17 B 48 KiB 48 KiB 48 KiB numParticlesOutOfRange() 1228 2141 B 2163 B 2185 B 24 KiB 24 KiB 24 KiB ParticleCopyPlan::build 1236 414 B 417 B 420 B 1280 B 1280 B 1280 B ParticleBufferMap::define 8 936 B 936 B 936 B 1024 B 1024 B 1024 B amrex::communicateParticlesStart 206 62 B 63 B 64 B 256 B 256 B 256 B --------------------------------------------------------------------------------------------------------------------------- Managed Memory Usage: --------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------- The_Managed_Arena::Initialize() 2 5 B 5 B 5 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------- Pinned Memory Usage: ---------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ---------------------------------------------------------------------------------------------------------------------- ParticleContainer::Redistribute_impl() 416 105 KiB 107 KiB 109 KiB 8184 KiB 8200 KiB 8217 KiB amrex::communicateParticlesStart 204 45 KiB 52 KiB 58 KiB 8184 KiB 8200 KiB 8217 KiB The_Pinned_Arena::Initialize() 2 6 B 7 B 8 B 8192 KiB 8192 KiB 8192 KiB InitParticles 564 11 KiB 12 KiB 13 KiB 6884 KiB 6884 KiB 6884 KiB Redistribute_partition 420 924 B 924 B 924 B 1280 B 1280 B 1280 B numParticlesOutOfRange() 1248 943 B 943 B 944 B 1280 B 1280 B 1280 B amrex::unpackBuffer 12 7 B 7 B 7 B 1024 B 1024 B 1024 B ParticleCopyPlan::build 206 78 B 79 B 80 B 256 B 256 B 256 B ParticleCopyPlan::buildMPIStart 204 74 B 74 B 75 B 256 B 256 B 256 B testRedistribute 4 0 B 0 B 0 B 256 B 256 B 256 B ---------------------------------------------------------------------------------------------------------------------- Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [7591 ... 7591] [The Arena] max space (MB) allocated spread across MPI: [41 ... 41] [The Arena] max space (MB) used spread across MPI: [35 ... 35] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [24 ... 24] [The Pinned Arena] max space (MB) used spread across MPI: [16 ... 16] AMReX (26.05-3-g4ceb814db7d7) finalized