Initializing AMReX (26.06-5-g65db2e4e678a)... MPI initialized with 2 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.06-5-g65db2e4e678a) initialized Running redistribute test About to initialize particles pass TinyProfiler total time across processes [min...avg...max]: 0.797 ... 0.7987 ... 0.8004 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- numParticlesOutOfRange() 614 0.1347 0.1468 0.159 19.86% amrex::unpackBuffer 103 0.1316 0.1333 0.135 16.87% amrex::unpackRemotes 103 0.1066 0.11 0.1134 14.17% ParticleContainer::Redistribute_impl() 103 0.08504 0.09747 0.1099 13.73% Redistribute_partition 103 0.09239 0.0933 0.09421 11.77% ParticleCopyPlan::build 103 0.05751 0.05758 0.05765 7.20% TestParticleContainer::moveParticles 100 0.05041 0.05043 0.05046 6.30% amrex::communicateParticlesStart 103 0.02284 0.02826 0.03368 4.21% TestParticleContainer::checkAnswer 103 0.01428 0.01961 0.02495 3.12% amrex::computeNeighborProcs 101 0.02003 0.02081 0.02159 2.70% ParticleCopyPlan::buildMPIStart 103 0.01042 0.01446 0.0185 2.31% amrex::communicateParticlesFinish 103 0.005793 0.01105 0.0163 2.04% ParticleCopyPlan::doHandShake 103 0.0007646 0.005012 0.00926 1.16% InitParticles 1 0.004672 0.004875 0.005078 0.63% testRedistribute 1 0.0006818 0.0008261 0.0009703 0.12% ParticleContainer::OK() 103 2.52e-05 2.639e-05 2.758e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 2.161e-06 2.908e-06 3.654e-06 0.00% Other 521 0.003098 0.004854 0.00661 0.83% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- testRedistribute 1 0.797 0.7987 0.8004 100.00% ParticleContainer::Redistribute_impl() 103 0.6278 0.6278 0.6279 78.44% numParticlesOutOfRange() 614 0.1347 0.1468 0.159 19.86% amrex::unpackBuffer 103 0.1316 0.1333 0.135 16.87% amrex::unpackRemotes 103 0.1066 0.11 0.1134 14.17% ParticleCopyPlan::build 103 0.09727 0.09833 0.09939 12.42% Redistribute_partition 103 0.09239 0.0933 0.09421 11.77% TestParticleContainer::checkAnswer 103 0.05785 0.06316 0.06848 8.56% TestParticleContainer::moveParticles 100 0.05041 0.05043 0.05046 6.30% ParticleContainer::OK() 103 0.04354 0.04355 0.04357 5.44% amrex::communicateParticlesStart 103 0.02284 0.02826 0.03368 4.21% amrex::computeNeighborProcs 101 0.02003 0.02081 0.02159 2.70% ParticleCopyPlan::buildMPIStart 103 0.01927 0.01948 0.01968 2.46% amrex::communicateParticlesFinish 103 0.005793 0.01105 0.0163 2.04% InitParticles 1 0.009817 0.009819 0.00982 1.23% ParticleCopyPlan::doHandShake 103 0.0007646 0.005012 0.00926 1.16% DistributionMapping::SFCProcessorMapDoIt() 1 9.832e-06 0.001682 0.003354 0.42% Other 521 0.003601 0.005408 0.007214 0.90% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.check_file(nvals = 1) :: [Redistribute_chk] [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] [TOP]::amr.plot_file(nvals = 1) :: [Redistribute_plt] Device Memory Usage: --------------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------------- ResizeRandomSeed 2 9140 KiB 9141 KiB 9141 KiB 9216 KiB 9216 KiB 9216 KiB ParticleContainer::ReserveForRedistribute() 72 98 KiB 102 KiB 106 KiB 8328 KiB 8331 KiB 8335 KiB InitParticles 48 6991 KiB 6991 KiB 6991 KiB 8331 KiB 8331 KiB 8331 KiB ParticleContainer::Redistribute_impl() 210 122 KiB 126 KiB 130 KiB 8198 KiB 8201 KiB 8203 KiB amrex::packBuffer 204 345 KiB 346 KiB 347 KiB 8198 KiB 8200 KiB 8203 KiB Redistribute_partition 4054 96 KiB 96 KiB 96 KiB 1821 KiB 1823 KiB 1824 KiB ParticleCopyPlan::buildCopiesAtomicScatter 406 12 KiB 12 KiB 12 KiB 260 KiB 260 KiB 260 KiB testRedistribute 4 25 B 25 B 26 B 48 KiB 48 KiB 48 KiB numParticlesOutOfRange() 1228 3411 B 3423 B 3436 B 24 KiB 24 KiB 24 KiB DenseBins::buildGPU 12 1109 B 1109 B 1109 B 2048 B 2048 B 2048 B ParticleCopyPlan::build 1236 670 B 676 B 682 B 1280 B 1280 B 1280 B ParticleBufferMap::define 8 888 B 888 B 888 B 1024 B 1024 B 1024 B amrex::communicateParticlesStart 206 100 B 102 B 105 B 256 B 256 B 256 B --------------------------------------------------------------------------------------------------------------------------- Managed Memory Usage: --------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------- The_Managed_Arena::Initialize() 2 8 B 18 B 29 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------- Pinned Memory Usage: ---------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ---------------------------------------------------------------------------------------------------------------------- ParticleContainer::Redistribute_impl() 416 171 KiB 180 KiB 189 KiB 8198 KiB 8200 KiB 8203 KiB amrex::communicateParticlesStart 204 78 KiB 82 KiB 86 KiB 8198 KiB 8200 KiB 8203 KiB The_Pinned_Arena::Initialize() 2 6 B 11 B 16 B 8192 KiB 8192 KiB 8192 KiB InitParticles 564 18 KiB 20 KiB 21 KiB 6884 KiB 6884 KiB 6884 KiB Redistribute_partition 420 866 B 866 B 867 B 1280 B 1280 B 1280 B numParticlesOutOfRange() 1248 895 B 896 B 897 B 1280 B 1280 B 1280 B amrex::unpackBuffer 12 11 B 11 B 12 B 1024 B 1024 B 1024 B ParticleCopyPlan::build 206 127 B 128 B 130 B 256 B 256 B 256 B ParticleCopyPlan::buildMPIStart 204 121 B 121 B 121 B 256 B 256 B 256 B testRedistribute 4 0 B 0 B 0 B 256 B 256 B 256 B ---------------------------------------------------------------------------------------------------------------------- Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [7571 ... 7571] [The Arena] max space (MB) allocated spread across MPI: [49 ... 49] [The Arena] max space (MB) used spread across MPI: [35 ... 35] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [32 ... 32] [The Pinned Arena] max space (MB) used spread across MPI: [16 ... 16] AMReX (26.06-5-g65db2e4e678a) finalized