Initializing AMReX (26.11-5-g1d9bd90c3583)... MPI initialized with 2 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.11-5-g1d9bd90c3583) initialized Running redistribute test testNeighborProcsCoarseToFine: pass testAnisotropicRefRatioCtor: pass About to initialize particles pass TinyProfiler total time across processes [min...avg...max]: 1.291 ... 1.292 ... 1.294 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- ParticleContainer::SortParticlesByBin() 101 0.3497 0.3497 0.3497 27.02% numParticlesOutOfRange() 410 0.1676 0.1802 0.1928 14.90% amrex::unpackBuffer 103 0.1258 0.1269 0.128 9.89% Redistribute_partition 103 0.1229 0.1235 0.1241 9.59% DenseBins::buildGPU 203 0.1053 0.1082 0.1111 8.58% amrex::unpackRemotes 103 0.1016 0.1051 0.1085 8.39% ParticleContainer::Redistribute_impl() 103 0.08061 0.09194 0.1033 7.98% ParticleCopyPlan::build 103 0.05465 0.05465 0.05466 4.22% TestParticleContainer::moveParticles 100 0.04812 0.04823 0.04834 3.74% amrex::communicateParticlesStart 103 0.02017 0.02657 0.03298 2.55% TestParticleContainer::checkAnswer 103 0.01371 0.01833 0.02295 1.77% amrex::computeNeighborProcs 102 0.01923 0.01977 0.02032 1.57% ParticleCopyPlan::buildMPIStart 103 0.01116 0.01409 0.01703 1.32% amrex::communicateParticlesFinish 103 0.006476 0.01047 0.01446 1.12% ParticleCopyPlan::doHandShake 103 0.001743 0.004771 0.007799 0.60% InitParticles 1 0.004658 0.004855 0.005053 0.39% testRedistribute 1 0.0006762 0.000818 0.0009598 0.07% ParticleContainer::OK() 103 2.878e-05 2.953e-05 3.027e-05 0.00% Other 529 0.002458 0.004283 0.006108 0.47% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- testRedistribute 1 1.291 1.291 1.291 99.72% ParticleContainer::Redistribute_impl() 103 0.6758 0.6801 0.6843 52.88% ParticleContainer::SortParticlesByBin() 101 0.4543 0.4572 0.46 35.55% numParticlesOutOfRange() 410 0.1676 0.1802 0.1928 14.90% amrex::unpackBuffer 103 0.1258 0.1269 0.128 9.89% Redistribute_partition 103 0.1229 0.1235 0.1241 9.59% DenseBins::buildGPU 203 0.1053 0.1082 0.1111 8.58% amrex::unpackRemotes 103 0.1016 0.1051 0.1085 8.39% TestParticleContainer::checkAnswer 103 0.09758 0.09939 0.1012 7.82% ParticleCopyPlan::build 103 0.09313 0.09377 0.09442 7.30% ParticleContainer::OK() 103 0.07823 0.08106 0.08388 6.48% TestParticleContainer::moveParticles 100 0.04812 0.04823 0.04834 3.74% amrex::communicateParticlesStart 103 0.02017 0.02657 0.03298 2.55% amrex::computeNeighborProcs 102 0.01923 0.01977 0.02032 1.57% ParticleCopyPlan::buildMPIStart 103 0.01877 0.01887 0.01896 1.47% amrex::communicateParticlesFinish 103 0.006476 0.01047 0.01446 1.12% InitParticles 1 0.009694 0.009697 0.0097 0.75% ParticleCopyPlan::doHandShake 103 0.001743 0.004771 0.007799 0.60% Other 529 0.002986 0.004827 0.006668 0.52% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.check_file(nvals = 1) :: [SortParticlesByCell_chk] [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] [TOP]::amr.plot_file(nvals = 1) :: [SortParticlesByCell_plt] Device Memory Usage: --------------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------------- ResizeRandomSeed 2 9091 KiB 9092 KiB 9092 KiB 9216 KiB 9216 KiB 9216 KiB ParticleContainer::ReserveForRedistribute() 72 64 KiB 66 KiB 68 KiB 8320 KiB 8331 KiB 8342 KiB InitParticles 48 5081 KiB 5083 KiB 5085 KiB 8331 KiB 8331 KiB 8331 KiB ParticleContainer::Redistribute_impl() 210 78 KiB 78 KiB 79 KiB 8190 KiB 8201 KiB 8212 KiB amrex::packBuffer 204 204 KiB 205 KiB 207 KiB 8189 KiB 8200 KiB 8211 KiB ParticleContainer::SortParticlesByBin() 1212 2283 KiB 2286 KiB 2290 KiB 2866 KiB 2869 KiB 2872 KiB Redistribute_partition 4054 58 KiB 58 KiB 58 KiB 1820 KiB 1822 KiB 1825 KiB DenseBins::buildGPU 426 581 KiB 581 KiB 581 KiB 653 KiB 653 KiB 653 KiB ParticleCopyPlan::buildCopiesAtomicScatter 406 7408 B 7444 B 7481 B 260 KiB 260 KiB 260 KiB testRedistribute 4 16 B 16 B 17 B 48 KiB 48 KiB 48 KiB numParticlesOutOfRange() 1228 2094 B 2115 B 2136 B 24 KiB 24 KiB 24 KiB ParticleCopyPlan::build 1236 406 B 408 B 411 B 1280 B 1280 B 1280 B ParticleBufferMap::define 8 916 B 916 B 916 B 1024 B 1024 B 1024 B amrex::communicateParticlesStart 206 60 B 62 B 64 B 256 B 256 B 256 B --------------------------------------------------------------------------------------------------------------------------- Managed Memory Usage: --------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------- The_Managed_Arena::Initialize() 2 8 B 9 B 10 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------- Pinned Memory Usage: ---------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ---------------------------------------------------------------------------------------------------------------------- ParticleContainer::Redistribute_impl() 416 96 KiB 109 KiB 122 KiB 8189 KiB 8200 KiB 8212 KiB amrex::communicateParticlesStart 204 49 KiB 52 KiB 55 KiB 8189 KiB 8200 KiB 8211 KiB The_Pinned_Arena::Initialize() 2 10 B 12 B 15 B 8192 KiB 8192 KiB 8192 KiB InitParticles 564 11 KiB 12 KiB 13 KiB 6884 KiB 6884 KiB 6884 KiB Redistribute_partition 420 903 B 903 B 904 B 1280 B 1280 B 1280 B numParticlesOutOfRange() 1248 922 B 922 B 923 B 1280 B 1280 B 1280 B amrex::unpackBuffer 12 7 B 7 B 7 B 1024 B 1024 B 1024 B ParticleCopyPlan::build 206 77 B 77 B 78 B 256 B 256 B 256 B ParticleCopyPlan::buildMPIStart 204 73 B 73 B 73 B 256 B 256 B 256 B testRedistribute 4 0 B 0 B 0 B 256 B 256 B 256 B ---------------------------------------------------------------------------------------------------------------------- Total GPU global memory (MB) spread across MPI: [7784 ... 7784] Free GPU global memory (MB) spread across MPI: [7406 ... 7406] [The Arena] max space (MB) allocated spread across MPI: [41 ... 41] [The Arena] max space (MB) used spread across MPI: [35 ... 35] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [24 ... 24] [The Pinned Arena] max space (MB) used spread across MPI: [16 ... 16] AMReX (26.11-5-g1d9bd90c3583) finalized