Initializing AMReX (26.05-55-g750b74d10a21)... MPI initialized with 2 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.05-55-g750b74d10a21) initialized Running redistribute test About to initialize particles pass TinyProfiler total time across processes [min...avg...max]: 0.7806 ... 0.7823 ... 0.784 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- numParticlesOutOfRange() 614 0.1321 0.1431 0.1541 19.65% amrex::unpackBuffer 103 0.1308 0.1317 0.1326 16.91% amrex::unpackRemotes 103 0.1048 0.1094 0.1139 14.53% ParticleContainer::Redistribute_impl() 103 0.08439 0.09531 0.1062 13.55% Redistribute_partition 103 0.09175 0.09242 0.09308 11.87% ParticleCopyPlan::build 103 0.05648 0.05649 0.0565 7.21% TestParticleContainer::moveParticles 100 0.04975 0.04983 0.04992 6.37% amrex::communicateParticlesStart 103 0.02057 0.02656 0.03255 4.15% amrex::computeNeighborProcs 101 0.02009 0.0207 0.02131 2.72% TestParticleContainer::checkAnswer 103 0.01192 0.01615 0.02037 2.60% ParticleCopyPlan::buildMPIStart 103 0.01094 0.01391 0.01688 2.15% amrex::communicateParticlesFinish 103 0.006985 0.01075 0.01452 1.85% ParticleCopyPlan::doHandShake 103 0.002095 0.005033 0.00797 1.02% InitParticles 1 0.004604 0.004807 0.005009 0.64% testRedistribute 1 0.0008351 0.0008629 0.0008907 0.11% ParticleContainer::OK() 103 3.396e-05 4.162e-05 4.928e-05 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 2.2e-06 3.14e-06 4.081e-06 0.00% Other 521 0.00338 0.005273 0.007166 0.91% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- testRedistribute 1 0.7806 0.7823 0.784 100.00% ParticleContainer::Redistribute_impl() 103 0.6187 0.6188 0.6188 78.92% numParticlesOutOfRange() 614 0.1321 0.1431 0.1541 19.65% amrex::unpackBuffer 103 0.1308 0.1317 0.1326 16.91% amrex::unpackRemotes 103 0.1048 0.1094 0.1139 14.53% ParticleCopyPlan::build 103 0.09611 0.09682 0.09753 12.44% Redistribute_partition 103 0.09175 0.09242 0.09308 11.87% TestParticleContainer::checkAnswer 103 0.05284 0.05704 0.06123 7.81% TestParticleContainer::moveParticles 100 0.04975 0.04983 0.04992 6.37% ParticleContainer::OK() 103 0.04086 0.04089 0.04092 5.22% amrex::communicateParticlesStart 103 0.02057 0.02656 0.03255 4.15% amrex::computeNeighborProcs 101 0.02009 0.0207 0.02131 2.72% ParticleCopyPlan::buildMPIStart 103 0.01891 0.01894 0.01898 2.42% amrex::communicateParticlesFinish 103 0.006985 0.01075 0.01452 1.85% InitParticles 1 0.009756 0.009759 0.009763 1.25% ParticleCopyPlan::doHandShake 103 0.002095 0.005033 0.00797 1.02% DistributionMapping::SFCProcessorMapDoIt() 1 9.313e-06 0.001688 0.003366 0.43% Other 521 0.00388 0.005825 0.00777 0.99% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.check_file(nvals = 1) :: [Redistribute_chk] [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] [TOP]::amr.plot_file(nvals = 1) :: [Redistribute_plt] Device Memory Usage: --------------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------------- ResizeRandomSeed 2 9143 KiB 9143 KiB 9143 KiB 9216 KiB 9216 KiB 9216 KiB ParticleContainer::ReserveForRedistribute() 72 101 KiB 104 KiB 108 KiB 8320 KiB 8331 KiB 8343 KiB InitParticles 48 6974 KiB 6975 KiB 6977 KiB 8331 KiB 8331 KiB 8331 KiB ParticleContainer::Redistribute_impl() 210 126 KiB 127 KiB 128 KiB 8188 KiB 8201 KiB 8213 KiB amrex::packBuffer 204 325 KiB 327 KiB 329 KiB 8188 KiB 8200 KiB 8213 KiB Redistribute_partition 4054 91 KiB 91 KiB 91 KiB 1820 KiB 1822 KiB 1825 KiB ParticleCopyPlan::buildCopiesAtomicScatter 406 11 KiB 11 KiB 11 KiB 260 KiB 260 KiB 260 KiB testRedistribute 4 26 B 26 B 27 B 48 KiB 48 KiB 48 KiB numParticlesOutOfRange() 1228 3309 B 3362 B 3416 B 24 KiB 24 KiB 24 KiB DenseBins::buildGPU 12 1103 B 1103 B 1104 B 2048 B 2048 B 2048 B ParticleCopyPlan::build 1236 671 B 675 B 679 B 1280 B 1280 B 1280 B ParticleBufferMap::define 8 883 B 883 B 883 B 1024 B 1024 B 1024 B amrex::communicateParticlesStart 206 101 B 103 B 106 B 256 B 256 B 256 B --------------------------------------------------------------------------------------------------------------------------- Managed Memory Usage: --------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------- The_Managed_Arena::Initialize() 2 6 B 6 B 7 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------- Pinned Memory Usage: ---------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ---------------------------------------------------------------------------------------------------------------------- ParticleContainer::Redistribute_impl() 416 160 KiB 172 KiB 185 KiB 8188 KiB 8200 KiB 8213 KiB amrex::communicateParticlesStart 204 74 KiB 84 KiB 95 KiB 8188 KiB 8200 KiB 8213 KiB The_Pinned_Arena::Initialize() 2 7 B 10 B 13 B 8192 KiB 8192 KiB 8192 KiB InitParticles 564 18 KiB 20 KiB 21 KiB 6884 KiB 6884 KiB 6884 KiB Redistribute_partition 420 864 B 864 B 865 B 1280 B 1280 B 1280 B numParticlesOutOfRange() 1248 892 B 894 B 896 B 1280 B 1280 B 1280 B amrex::unpackBuffer 12 12 B 12 B 12 B 1024 B 1024 B 1024 B ParticleCopyPlan::build 206 127 B 128 B 129 B 256 B 256 B 256 B ParticleCopyPlan::buildMPIStart 204 121 B 121 B 121 B 256 B 256 B 256 B testRedistribute 4 0 B 0 B 0 B 256 B 256 B 256 B ---------------------------------------------------------------------------------------------------------------------- Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [7591 ... 7591] [The Arena] max space (MB) allocated spread across MPI: [41 ... 41] [The Arena] max space (MB) used spread across MPI: [35 ... 35] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [24 ... 24] [The Pinned Arena] max space (MB) used spread across MPI: [16 ... 16] AMReX (26.05-55-g750b74d10a21) finalized