Initializing AMReX (26.08-36-gf2cbba4afc9e)... MPI initialized with 2 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.08-36-gf2cbba4afc9e) initialized Running redistribute test testNeighborProcsCoarseToFine: pass About to initialize particles pass TinyProfiler total time across processes [min...avg...max]: 0.798 ... 0.7987 ... 0.7995 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- numParticlesOutOfRange() 410 0.1326 0.148 0.1633 20.43% amrex::unpackBuffer 103 0.1323 0.1341 0.136 17.01% amrex::unpackRemotes 103 0.1041 0.1104 0.1167 14.60% ParticleContainer::Redistribute_impl() 103 0.08458 0.09639 0.1082 13.53% Redistribute_partition 103 0.09286 0.09377 0.09469 11.84% ParticleCopyPlan::build 103 0.05777 0.05786 0.05796 7.25% TestParticleContainer::moveParticles 100 0.05045 0.05058 0.05072 6.34% amrex::communicateParticlesStart 103 0.02298 0.02706 0.03113 3.89% TestParticleContainer::checkAnswer 103 0.01394 0.01978 0.02561 3.20% amrex::computeNeighborProcs 102 0.02015 0.02092 0.0217 2.71% ParticleCopyPlan::buildMPIStart 103 0.0101 0.01459 0.01908 2.39% amrex::communicateParticlesFinish 103 0.004508 0.01068 0.01685 2.11% ParticleCopyPlan::doHandShake 103 0.0006937 0.005024 0.009354 1.17% InitParticles 1 0.004638 0.00483 0.005022 0.63% testRedistribute 1 0.0008562 0.0008601 0.0008641 0.11% ParticleContainer::OK() 103 2.993e-05 3.054e-05 3.115e-05 0.00% Other 523 0.002972 0.00386 0.004748 0.59% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- testRedistribute 1 0.7979 0.7979 0.7979 99.81% ParticleContainer::Redistribute_impl() 103 0.6722 0.6777 0.6832 85.45% numParticlesOutOfRange() 410 0.1326 0.148 0.1633 20.43% amrex::unpackBuffer 103 0.1323 0.1341 0.136 17.01% amrex::unpackRemotes 103 0.1041 0.1104 0.1167 14.60% ParticleCopyPlan::build 103 0.09811 0.09882 0.09953 12.45% Redistribute_partition 103 0.09286 0.09377 0.09469 11.84% TestParticleContainer::checkAnswer 103 0.05816 0.06396 0.06976 8.73% TestParticleContainer::moveParticles 100 0.05045 0.05058 0.05072 6.34% ParticleContainer::OK() 103 0.04415 0.04418 0.04422 5.53% amrex::communicateParticlesStart 103 0.02298 0.02706 0.03113 3.89% amrex::computeNeighborProcs 102 0.02015 0.02092 0.0217 2.71% ParticleCopyPlan::buildMPIStart 103 0.01945 0.01961 0.01977 2.47% amrex::communicateParticlesFinish 103 0.004508 0.01068 0.01685 2.11% InitParticles 1 0.009746 0.009752 0.009758 1.22% ParticleCopyPlan::doHandShake 103 0.0006937 0.005024 0.009354 1.17% Other 523 0.003499 0.004444 0.005389 0.67% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.check_file(nvals = 1) :: [Redistribute_chk] [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] [TOP]::amr.plot_file(nvals = 1) :: [Redistribute_plt] Device Memory Usage: --------------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------------- ResizeRandomSeed 2 9138 KiB 9139 KiB 9141 KiB 9216 KiB 9216 KiB 9216 KiB ParticleContainer::ReserveForRedistribute() 72 98 KiB 102 KiB 105 KiB 8313 KiB 8331 KiB 8349 KiB InitParticles 48 7027 KiB 7029 KiB 7032 KiB 8331 KiB 8331 KiB 8331 KiB ParticleContainer::Redistribute_impl() 210 126 KiB 126 KiB 126 KiB 8182 KiB 8201 KiB 8219 KiB amrex::packBuffer 204 319 KiB 320 KiB 321 KiB 8182 KiB 8200 KiB 8219 KiB Redistribute_partition 4054 90 KiB 90 KiB 90 KiB 1819 KiB 1822 KiB 1826 KiB ParticleCopyPlan::buildCopiesAtomicScatter 406 11 KiB 11 KiB 11 KiB 260 KiB 260 KiB 261 KiB testRedistribute 4 26 B 26 B 26 B 48 KiB 48 KiB 48 KiB numParticlesOutOfRange() 1228 3440 B 3453 B 3467 B 24 KiB 24 KiB 24 KiB DenseBins::buildGPU 12 1111 B 1111 B 1111 B 2048 B 2048 B 2048 B ParticleCopyPlan::build 1236 668 B 674 B 680 B 1280 B 1280 B 1280 B ParticleBufferMap::define 8 889 B 889 B 889 B 1024 B 1024 B 1024 B amrex::communicateParticlesStart 206 101 B 103 B 105 B 256 B 256 B 256 B --------------------------------------------------------------------------------------------------------------------------- Managed Memory Usage: --------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------- The_Managed_Arena::Initialize() 2 6 B 6 B 6 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------- Pinned Memory Usage: ---------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ---------------------------------------------------------------------------------------------------------------------- ParticleContainer::Redistribute_impl() 416 140 KiB 171 KiB 201 KiB 8182 KiB 8200 KiB 8219 KiB amrex::communicateParticlesStart 204 65 KiB 83 KiB 101 KiB 8182 KiB 8200 KiB 8219 KiB The_Pinned_Arena::Initialize() 2 9 B 11 B 13 B 8192 KiB 8192 KiB 8192 KiB InitParticles 564 18 KiB 19 KiB 20 KiB 6884 KiB 6884 KiB 6884 KiB Redistribute_partition 420 870 B 871 B 872 B 1280 B 1280 B 1280 B numParticlesOutOfRange() 1248 900 B 901 B 902 B 1280 B 1280 B 1280 B amrex::unpackBuffer 12 11 B 11 B 11 B 1024 B 1024 B 1024 B ParticleCopyPlan::build 206 127 B 128 B 129 B 256 B 256 B 256 B ParticleCopyPlan::buildMPIStart 204 121 B 121 B 121 B 256 B 256 B 256 B testRedistribute 4 0 B 0 B 0 B 256 B 256 B 256 B ---------------------------------------------------------------------------------------------------------------------- Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [7591 ... 7591] [The Arena] max space (MB) allocated spread across MPI: [41 ... 41] [The Arena] max space (MB) used spread across MPI: [35 ... 35] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [24 ... 24] [The Pinned Arena] max space (MB) used spread across MPI: [16 ... 16] AMReX (26.08-36-gf2cbba4afc9e) finalized