Initializing AMReX (26.09-190-g541acefee8d0)... MPI initialized with 2 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.09-190-g541acefee8d0) initialized Running redistribute test testNeighborProcsCoarseToFine: pass About to initialize particles pass TinyProfiler total time across processes [min...avg...max]: 1.296 ... 1.304 ... 1.312 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- ParticleContainer::SortParticlesByBin() 101 0.3494 0.3496 0.3499 26.66% numParticlesOutOfRange() 410 0.1639 0.1795 0.195 14.86% amrex::unpackBuffer 103 0.1256 0.1272 0.1288 9.82% Redistribute_partition 103 0.1234 0.1235 0.1236 9.42% DenseBins::buildGPU 203 0.1051 0.109 0.1128 8.59% amrex::unpackRemotes 103 0.1015 0.1052 0.1089 8.30% ParticleContainer::Redistribute_impl() 103 0.08078 0.09372 0.1067 8.13% ParticleCopyPlan::build 103 0.05412 0.05445 0.05479 4.17% TestParticleContainer::moveParticles 100 0.04884 0.04889 0.04893 3.73% amrex::communicateParticlesStart 103 0.02206 0.02766 0.03327 2.53% TestParticleContainer::checkAnswer 103 0.01352 0.01903 0.02454 1.87% amrex::computeNeighborProcs 102 0.01937 0.0199 0.02043 1.56% ParticleCopyPlan::buildMPIStart 103 0.009985 0.01401 0.01804 1.37% amrex::communicateParticlesFinish 103 0.005144 0.01123 0.01731 1.32% testNeighborProcsCoarseToFine 1 2.52e-05 0.008074 0.01612 1.23% InitParticles 1 0.004591 0.004796 0.005002 0.38% testRedistribute 1 0.0007731 0.0009006 0.001028 0.08% ParticleContainer::OK() 103 3.515e-05 3.554e-05 3.593e-05 0.00% Other 624 0.003598 0.007689 0.01178 0.90% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- testRedistribute 1 1.296 1.296 1.296 98.77% ParticleContainer::Redistribute_impl() 103 0.6795 0.6847 0.6899 52.57% ParticleContainer::SortParticlesByBin() 101 0.4543 0.4579 0.4615 35.16% numParticlesOutOfRange() 410 0.1639 0.1795 0.195 14.86% amrex::unpackBuffer 103 0.1256 0.1272 0.1288 9.82% Redistribute_partition 103 0.1234 0.1235 0.1236 9.42% DenseBins::buildGPU 203 0.1051 0.109 0.1128 8.59% amrex::unpackRemotes 103 0.1015 0.1052 0.1089 8.30% TestParticleContainer::checkAnswer 103 0.09706 0.09905 0.101 7.70% ParticleCopyPlan::build 103 0.09372 0.09378 0.09384 7.15% ParticleContainer::OK() 103 0.07649 0.08001 0.08353 6.36% TestParticleContainer::moveParticles 100 0.04884 0.04889 0.04893 3.73% amrex::communicateParticlesStart 103 0.02206 0.02766 0.03327 2.53% amrex::computeNeighborProcs 102 0.01937 0.0199 0.02043 1.56% ParticleCopyPlan::buildMPIStart 103 0.01872 0.01895 0.01918 1.46% amrex::communicateParticlesFinish 103 0.005144 0.01123 0.01731 1.32% testNeighborProcsCoarseToFine 1 4.661e-05 0.008098 0.01615 1.23% InitParticles 1 0.009719 0.009724 0.009728 0.74% Other 624 0.004071 0.008251 0.01243 0.95% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.check_file(nvals = 1) :: [SortParticlesByCell_chk] [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] [TOP]::amr.plot_file(nvals = 1) :: [SortParticlesByCell_plt] Device Memory Usage: --------------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------------- ResizeRandomSeed 2 9163 KiB 9163 KiB 9163 KiB 9216 KiB 9216 KiB 9216 KiB ParticleContainer::ReserveForRedistribute() 72 62 KiB 66 KiB 69 KiB 8323 KiB 8331 KiB 8340 KiB InitParticles 48 5130 KiB 5130 KiB 5131 KiB 8331 KiB 8331 KiB 8331 KiB ParticleContainer::Redistribute_impl() 210 77 KiB 81 KiB 85 KiB 8192 KiB 8201 KiB 8209 KiB amrex::packBuffer 204 219 KiB 220 KiB 222 KiB 8192 KiB 8200 KiB 8209 KiB ParticleContainer::SortParticlesByBin() 1212 2304 KiB 2307 KiB 2311 KiB 2866 KiB 2869 KiB 2872 KiB Redistribute_partition 4054 61 KiB 61 KiB 62 KiB 1821 KiB 1822 KiB 1824 KiB DenseBins::buildGPU 426 588 KiB 588 KiB 588 KiB 653 KiB 653 KiB 653 KiB ParticleCopyPlan::buildCopiesAtomicScatter 406 7916 B 7944 B 7973 B 260 KiB 260 KiB 260 KiB testRedistribute 4 16 B 16 B 17 B 48 KiB 48 KiB 48 KiB numParticlesOutOfRange() 1228 2079 B 2116 B 2153 B 24 KiB 24 KiB 24 KiB ParticleCopyPlan::build 1236 412 B 415 B 418 B 1280 B 1280 B 1280 B ParticleBufferMap::define 8 926 B 926 B 926 B 1024 B 1024 B 1024 B amrex::communicateParticlesStart 206 61 B 63 B 65 B 256 B 256 B 256 B --------------------------------------------------------------------------------------------------------------------------- Managed Memory Usage: --------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------- The_Managed_Arena::Initialize() 2 4 B 4 B 4 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------- Pinned Memory Usage: ---------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ---------------------------------------------------------------------------------------------------------------------- ParticleContainer::Redistribute_impl() 416 103 KiB 115 KiB 127 KiB 8192 KiB 8200 KiB 8209 KiB amrex::communicateParticlesStart 204 43 KiB 52 KiB 61 KiB 8192 KiB 8200 KiB 8209 KiB The_Pinned_Arena::Initialize() 2 5 B 6 B 7 B 8192 KiB 8192 KiB 8192 KiB InitParticles 564 11 KiB 12 KiB 13 KiB 6884 KiB 6884 KiB 6884 KiB Redistribute_partition 420 911 B 911 B 912 B 1280 B 1280 B 1280 B numParticlesOutOfRange() 1248 930 B 930 B 931 B 1280 B 1280 B 1280 B amrex::unpackBuffer 12 7 B 7 B 8 B 1024 B 1024 B 1024 B ParticleCopyPlan::build 206 78 B 78 B 79 B 256 B 256 B 256 B ParticleCopyPlan::buildMPIStart 204 74 B 74 B 74 B 256 B 256 B 256 B testRedistribute 4 0 B 0 B 0 B 256 B 256 B 256 B ---------------------------------------------------------------------------------------------------------------------- Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [7591 ... 7591] [The Arena] max space (MB) allocated spread across MPI: [41 ... 41] [The Arena] max space (MB) used spread across MPI: [35 ... 35] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [32 ... 32] [The Pinned Arena] max space (MB) used spread across MPI: [16 ... 16] AMReX (26.09-190-g541acefee8d0) finalized