Initializing AMReX (26.11-18-g21e455c381db)... MPI initialized with 2 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.11-18-g21e455c381db) initialized Running redistribute test testNeighborProcsCoarseToFine: pass testAnisotropicRefRatioCtor: pass About to initialize particles pass TinyProfiler total time across processes [min...avg...max]: 0.219 ... 0.2195 ... 0.22 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- ParticleCopyPlan::build 103 0.05756 0.05759 0.05762 26.19% numParticlesOutOfRange() 410 0.02986 0.04019 0.05052 22.96% Redistribute_partition 103 0.02867 0.02876 0.02884 13.11% ParticleContainer::Redistribute_impl() 103 0.01976 0.02372 0.02767 12.58% amrex::communicateParticlesStart 103 0.01373 0.01546 0.01718 7.81% amrex::unpackBuffer 103 0.01223 0.01251 0.01279 5.81% amrex::unpackRemotes 103 1.449e-05 0.005806 0.0116 5.27% ParticleCopyPlan::doHandShake 103 0.00244 0.004985 0.007531 3.42% amrex::computeNeighborProcs 102 0.006645 0.006723 0.006802 3.09% TestParticleContainer::moveParticles 100 0.006564 0.006584 0.006604 3.00% TestParticleContainer::checkAnswer 103 0.003515 0.004914 0.006314 2.87% ParticleCopyPlan::buildMPIStart 103 0.002604 0.003831 0.005059 2.30% amrex::communicateParticlesFinish 103 0.000483 0.002122 0.003761 1.71% InitParticles 1 0.002596 0.002759 0.002921 1.33% testNeighborProcsCoarseToFine 1 2.159e-05 0.0005204 0.001019 0.46% amrex::packBuffer 103 0.0008682 0.0008789 0.0008896 0.40% DenseBins::buildGPU 1 0.0006259 0.0006331 0.0006402 0.29% testRedistribute 1 0.0003751 0.0004574 0.0005397 0.25% ParticleContainer::OK() 103 2.064e-05 2.185e-05 2.306e-05 0.01% Other 425 0.0009635 0.001051 0.001139 0.52% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- testRedistribute 1 0.2189 0.2189 0.2189 99.48% ParticleContainer::Redistribute_impl() 103 0.1896 0.1911 0.1926 87.53% ParticleCopyPlan::build 103 0.07195 0.07331 0.07467 33.94% numParticlesOutOfRange() 410 0.02986 0.04019 0.05052 22.96% Redistribute_partition 103 0.02867 0.02876 0.02884 13.11% TestParticleContainer::checkAnswer 103 0.01659 0.01799 0.01939 8.81% amrex::communicateParticlesStart 103 0.01373 0.01546 0.01718 7.81% ParticleContainer::OK() 103 0.01308 0.01308 0.01308 5.94% amrex::unpackBuffer 103 0.01223 0.01251 0.01279 5.81% amrex::unpackRemotes 103 1.449e-05 0.005806 0.0116 5.27% ParticleCopyPlan::buildMPIStart 103 0.007499 0.008817 0.01013 4.61% ParticleCopyPlan::doHandShake 103 0.00244 0.004985 0.007531 3.42% amrex::computeNeighborProcs 102 0.006645 0.006723 0.006802 3.09% InitParticles 1 0.006672 0.006675 0.006678 3.04% TestParticleContainer::moveParticles 100 0.006564 0.006584 0.006604 3.00% amrex::communicateParticlesFinish 103 0.000483 0.002122 0.003761 1.71% testNeighborProcsCoarseToFine 1 3.414e-05 0.000539 0.001044 0.47% amrex::packBuffer 103 0.0008682 0.0008789 0.0008896 0.40% DenseBins::buildGPU 1 0.0006259 0.0006331 0.0006402 0.29% Other 425 0.001383 0.001531 0.00168 0.76% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.check_file(nvals = 1) :: [RedistributeNonPeriodic_chk] [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] [TOP]::amr.plot_file(nvals = 1) :: [RedistributeNonPeriodic_plt] Device Memory Usage: --------------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------------- ResizeRandomSeed 2 8741 KiB 8744 KiB 8747 KiB 9216 KiB 9216 KiB 9216 KiB InitParticles 24 2799 KiB 2799 KiB 2799 KiB 6768 KiB 6768 KiB 6768 KiB amrex::packBuffer 62 6201 B 10 KiB 15 KiB 98 KiB 198 KiB 298 KiB ParticleContainer::Redistribute_impl() 37 824 B 4403 B 7982 B 216 KiB 216 KiB 216 KiB Redistribute_partition 1276 19 KiB 22 KiB 26 KiB 199 KiB 199 KiB 199 KiB testRedistribute 2 33 B 33 B 34 B 48 KiB 48 KiB 48 KiB ParticleCopyPlan::buildCopiesAtomicScatter 128 1853 B 2177 B 2502 B 25 KiB 25 KiB 25 KiB numParticlesOutOfRange() 388 1827 B 2035 B 2244 B 24 KiB 24 KiB 24 KiB DenseBins::buildGPU 12 766 B 766 B 767 B 2048 B 2048 B 2048 B ParticleCopyPlan::build 1236 380 B 388 B 397 B 1280 B 1280 B 1280 B ParticleBufferMap::define 8 613 B 613 B 614 B 1024 B 1024 B 1024 B ParticleContainer::ReserveForRedistribute() 568 160 B 165 B 171 B 1024 B 1024 B 1024 B amrex::communicateParticlesStart 206 34 B 35 B 36 B 256 B 256 B 256 B --------------------------------------------------------------------------------------------------------------------------- Managed Memory Usage: --------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------- The_Managed_Arena::Initialize() 2 34 B 37 B 41 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------- Pinned Memory Usage: ---------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ---------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 2 44 B 52 B 61 B 8192 KiB 8192 KiB 8192 KiB InitParticles 296 18 KiB 20 KiB 22 KiB 4168 KiB 4168 KiB 4168 KiB ParticleContainer::Redistribute_impl() 274 4791 B 6405 B 8020 B 99 KiB 198 KiB 298 KiB amrex::communicateParticlesStart 31 0 B 3231 B 6463 B 0 B 99 KiB 199 KiB Redistribute_partition 136 216 B 216 B 217 B 768 B 768 B 768 B numParticlesOutOfRange() 392 228 B 230 B 233 B 768 B 768 B 768 B TestParticleContainer::checkAnswer 284 76 B 76 B 76 B 512 B 512 B 512 B amrex::unpackBuffer 284 79 B 82 B 85 B 512 B 512 B 512 B ParticleCopyPlan::build 206 59 B 61 B 63 B 256 B 256 B 256 B ParticleCopyPlan::buildMPIStart 31 0 B 16 B 33 B 0 B 128 B 256 B testRedistribute 2 0 B 0 B 0 B 256 B 256 B 256 B ---------------------------------------------------------------------------------------------------------------------- Total GPU global memory (MB) spread across MPI: [7784 ... 7784] Free GPU global memory (MB) spread across MPI: [7458 ... 7458] [The Arena] max space (MB) allocated spread across MPI: [17 ... 17] [The Arena] max space (MB) used spread across MPI: [16 ... 16] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Pinned Arena] max space (MB) used spread across MPI: [4 ... 4] AMReX (26.11-18-g21e455c381db) finalized