Initializing AMReX (26.09-7-g55dda725ff4d)... MPI initialized with 2 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.09-7-g55dda725ff4d) initialized Running redistribute test testNeighborProcsCoarseToFine: pass About to initialize particles pass TinyProfiler total time across processes [min...avg...max]: 1.312 ... 1.313 ... 1.314 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- ParticleContainer::SortParticlesByBin() 101 0.3551 0.3551 0.3551 27.03% numParticlesOutOfRange() 410 0.1636 0.183 0.2024 15.41% amrex::unpackBuffer 103 0.1276 0.1293 0.131 9.97% Redistribute_partition 103 0.1247 0.1256 0.1265 9.63% DenseBins::buildGPU 203 0.107 0.1111 0.1153 8.77% amrex::unpackRemotes 103 0.1007 0.1067 0.1126 8.57% ParticleContainer::Redistribute_impl() 103 0.08241 0.09367 0.1049 7.99% ParticleCopyPlan::build 103 0.05564 0.05582 0.05601 4.26% TestParticleContainer::moveParticles 100 0.04872 0.04887 0.04903 3.73% amrex::communicateParticlesStart 103 0.02242 0.0261 0.02978 2.27% TestParticleContainer::checkAnswer 103 0.01312 0.01929 0.02546 1.94% amrex::computeNeighborProcs 102 0.01948 0.02011 0.02073 1.58% ParticleCopyPlan::buildMPIStart 103 0.009891 0.01407 0.01824 1.39% amrex::communicateParticlesFinish 103 0.004707 0.0104 0.01609 1.22% ParticleCopyPlan::doHandShake 103 0.000365 0.004922 0.009478 0.72% InitParticles 1 0.004652 0.004862 0.005072 0.39% testRedistribute 1 0.0007649 0.0008867 0.001008 0.08% ParticleContainer::OK() 103 3.055e-05 3.124e-05 3.193e-05 0.00% Other 522 0.002421 0.003308 0.004195 0.32% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- testRedistribute 1 1.312 1.312 1.312 99.88% ParticleContainer::Redistribute_impl() 103 0.6844 0.6905 0.6966 53.02% ParticleContainer::SortParticlesByBin() 101 0.4614 0.4656 0.4697 35.75% numParticlesOutOfRange() 410 0.1636 0.183 0.2024 15.41% amrex::unpackBuffer 103 0.1276 0.1293 0.131 9.97% Redistribute_partition 103 0.1247 0.1256 0.1265 9.63% DenseBins::buildGPU 203 0.107 0.1111 0.1153 8.77% amrex::unpackRemotes 103 0.1007 0.1067 0.1126 8.57% TestParticleContainer::checkAnswer 103 0.09958 0.1016 0.1037 7.89% ParticleCopyPlan::build 103 0.09417 0.09535 0.09654 7.35% ParticleContainer::OK() 103 0.07821 0.08234 0.08646 6.58% TestParticleContainer::moveParticles 100 0.04872 0.04887 0.04903 3.73% amrex::communicateParticlesStart 103 0.02242 0.0261 0.02978 2.27% amrex::computeNeighborProcs 102 0.01948 0.02011 0.02073 1.58% ParticleCopyPlan::buildMPIStart 103 0.01861 0.01899 0.01937 1.47% amrex::communicateParticlesFinish 103 0.004707 0.0104 0.01609 1.22% InitParticles 1 0.009799 0.009801 0.009802 0.75% ParticleCopyPlan::doHandShake 103 0.000365 0.004922 0.009478 0.72% Other 522 0.003001 0.003907 0.004813 0.37% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.check_file(nvals = 1) :: [SortParticlesByCell_chk] [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] [TOP]::amr.plot_file(nvals = 1) :: [SortParticlesByCell_plt] Device Memory Usage: --------------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------------- ResizeRandomSeed 2 9167 KiB 9167 KiB 9167 KiB 9216 KiB 9216 KiB 9216 KiB ParticleContainer::ReserveForRedistribute() 72 63 KiB 66 KiB 68 KiB 8316 KiB 8331 KiB 8346 KiB InitParticles 48 5196 KiB 5197 KiB 5198 KiB 8331 KiB 8331 KiB 8331 KiB ParticleContainer::Redistribute_impl() 210 79 KiB 79 KiB 79 KiB 8186 KiB 8201 KiB 8216 KiB amrex::packBuffer 204 200 KiB 201 KiB 201 KiB 8185 KiB 8200 KiB 8215 KiB ParticleContainer::SortParticlesByBin() 1212 2334 KiB 2338 KiB 2342 KiB 2865 KiB 2869 KiB 2872 KiB Redistribute_partition 4054 57 KiB 57 KiB 58 KiB 1819 KiB 1823 KiB 1826 KiB DenseBins::buildGPU 426 594 KiB 594 KiB 594 KiB 653 KiB 653 KiB 653 KiB ParticleCopyPlan::buildCopiesAtomicScatter 406 7276 B 7314 B 7352 B 260 KiB 260 KiB 261 KiB testRedistribute 4 16 B 16 B 17 B 48 KiB 48 KiB 48 KiB numParticlesOutOfRange() 1228 2122 B 2157 B 2193 B 24 KiB 24 KiB 24 KiB ParticleCopyPlan::build 1236 412 B 416 B 420 B 1280 B 1280 B 1280 B ParticleBufferMap::define 8 935 B 935 B 936 B 1024 B 1024 B 1024 B amrex::communicateParticlesStart 206 62 B 63 B 65 B 256 B 256 B 256 B --------------------------------------------------------------------------------------------------------------------------- Managed Memory Usage: --------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------- The_Managed_Arena::Initialize() 2 3 B 3 B 4 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------- Pinned Memory Usage: ---------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ---------------------------------------------------------------------------------------------------------------------- ParticleContainer::Redistribute_impl() 416 87 KiB 106 KiB 125 KiB 8185 KiB 8200 KiB 8216 KiB amrex::communicateParticlesStart 204 41 KiB 52 KiB 63 KiB 8185 KiB 8200 KiB 8215 KiB The_Pinned_Arena::Initialize() 2 5 B 7 B 10 B 8192 KiB 8192 KiB 8192 KiB InitParticles 564 11 KiB 12 KiB 13 KiB 6884 KiB 6884 KiB 6884 KiB Redistribute_partition 420 923 B 923 B 924 B 1280 B 1280 B 1280 B numParticlesOutOfRange() 1248 941 B 943 B 945 B 1280 B 1280 B 1280 B amrex::unpackBuffer 12 7 B 7 B 7 B 1024 B 1024 B 1024 B ParticleCopyPlan::build 206 78 B 79 B 80 B 256 B 256 B 256 B ParticleCopyPlan::buildMPIStart 204 74 B 74 B 74 B 256 B 256 B 256 B testRedistribute 4 0 B 0 B 0 B 256 B 256 B 256 B ---------------------------------------------------------------------------------------------------------------------- Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [7591 ... 7591] [The Arena] max space (MB) allocated spread across MPI: [41 ... 41] [The Arena] max space (MB) used spread across MPI: [35 ... 35] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [24 ... 24] [The Pinned Arena] max space (MB) used spread across MPI: [16 ... 16] AMReX (26.09-7-g55dda725ff4d) finalized