Initializing AMReX (26.05-39-gbe2cc437644f)... MPI initialized with 2 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.05-39-gbe2cc437644f) initialized Running redistribute test About to initialize particles pass TinyProfiler total time across processes [min...avg...max]: 0.7897 ... 0.7934 ... 0.7971 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- numParticlesOutOfRange() 614 0.1348 0.1458 0.1569 19.69% amrex::unpackBuffer 103 0.1302 0.1317 0.1332 16.71% amrex::unpackRemotes 103 0.1064 0.1095 0.1126 14.13% ParticleContainer::Redistribute_impl() 103 0.08237 0.09607 0.1098 13.77% Redistribute_partition 103 0.09178 0.09275 0.09371 11.76% ParticleCopyPlan::build 103 0.05687 0.05714 0.05741 7.20% TestParticleContainer::moveParticles 100 0.04991 0.05002 0.05013 6.29% amrex::communicateParticlesStart 103 0.02113 0.02743 0.03373 4.23% TestParticleContainer::checkAnswer 103 0.01344 0.01926 0.02509 3.15% amrex::computeNeighborProcs 101 0.02006 0.02072 0.02137 2.68% ParticleCopyPlan::buildMPIStart 103 0.0104 0.01421 0.01803 2.26% amrex::communicateParticlesFinish 103 0.004941 0.01101 0.01708 2.14% ParticleCopyPlan::doHandShake 103 0.0008205 0.005034 0.009248 1.16% DistributionMapping::LeastUsedCPUs() 1 7.149e-06 0.003693 0.007378 0.93% InitParticles 1 0.004602 0.004831 0.00506 0.63% testRedistribute 1 0.0007409 0.0008535 0.0009661 0.12% ParticleContainer::OK() 103 2.865e-05 3.029e-05 3.194e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 2.871e-06 6.023e-06 9.176e-06 0.00% Other 520 0.002938 0.003266 0.003593 0.45% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- testRedistribute 1 0.7897 0.7934 0.7971 100.00% ParticleContainer::Redistribute_impl() 103 0.6221 0.6222 0.6223 78.07% numParticlesOutOfRange() 614 0.1348 0.1458 0.1569 19.69% amrex::unpackBuffer 103 0.1302 0.1317 0.1332 16.71% amrex::unpackRemotes 103 0.1064 0.1095 0.1126 14.13% ParticleCopyPlan::build 103 0.09628 0.0976 0.09891 12.41% Redistribute_partition 103 0.09178 0.09275 0.09371 11.76% TestParticleContainer::checkAnswer 103 0.05646 0.06225 0.06804 8.54% TestParticleContainer::moveParticles 100 0.04991 0.05002 0.05013 6.29% ParticleContainer::OK() 103 0.04295 0.04298 0.04302 5.40% amrex::communicateParticlesStart 103 0.02113 0.02743 0.03373 4.23% amrex::computeNeighborProcs 101 0.02006 0.02072 0.02137 2.68% ParticleCopyPlan::buildMPIStart 103 0.01885 0.01925 0.01965 2.46% amrex::communicateParticlesFinish 103 0.004941 0.01101 0.01708 2.14% InitParticles 1 0.009776 0.009781 0.009786 1.23% ParticleCopyPlan::doHandShake 103 0.0008205 0.005034 0.009248 1.16% DistributionMapping::SFCProcessorMapDoIt() 1 1.09e-05 0.0037 0.007388 0.93% DistributionMapping::LeastUsedCPUs() 1 7.149e-06 0.003693 0.007378 0.93% Other 520 0.003411 0.003816 0.004222 0.53% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.check_file(nvals = 1) :: [Redistribute_chk] [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] [TOP]::amr.plot_file(nvals = 1) :: [Redistribute_plt] Device Memory Usage: --------------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------------- ResizeRandomSeed 2 9144 KiB 9144 KiB 9144 KiB 9216 KiB 9216 KiB 9216 KiB ParticleContainer::ReserveForRedistribute() 72 93 KiB 103 KiB 113 KiB 8315 KiB 8331 KiB 8348 KiB InitParticles 48 6942 KiB 6943 KiB 6944 KiB 8331 KiB 8331 KiB 8331 KiB ParticleContainer::Redistribute_impl() 210 118 KiB 124 KiB 131 KiB 8184 KiB 8201 KiB 8217 KiB amrex::packBuffer 204 326 KiB 328 KiB 330 KiB 8184 KiB 8200 KiB 8216 KiB Redistribute_partition 4054 91 KiB 91 KiB 92 KiB 1819 KiB 1823 KiB 1826 KiB ParticleCopyPlan::buildCopiesAtomicScatter 406 11 KiB 11 KiB 11 KiB 260 KiB 260 KiB 261 KiB testRedistribute 4 25 B 26 B 27 B 48 KiB 48 KiB 48 KiB numParticlesOutOfRange() 1228 3346 B 3386 B 3426 B 24 KiB 24 KiB 24 KiB DenseBins::buildGPU 12 1099 B 1099 B 1099 B 2048 B 2048 B 2048 B ParticleCopyPlan::build 1236 663 B 669 B 675 B 1280 B 1280 B 1280 B ParticleBufferMap::define 8 879 B 879 B 880 B 1024 B 1024 B 1024 B amrex::communicateParticlesStart 206 99 B 102 B 105 B 256 B 256 B 256 B --------------------------------------------------------------------------------------------------------------------------- Managed Memory Usage: --------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------- The_Managed_Arena::Initialize() 2 5 B 7 B 10 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------- Pinned Memory Usage: ---------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ---------------------------------------------------------------------------------------------------------------------- ParticleContainer::Redistribute_impl() 416 140 KiB 175 KiB 211 KiB 8184 KiB 8200 KiB 8217 KiB amrex::communicateParticlesStart 204 74 KiB 88 KiB 102 KiB 8184 KiB 8200 KiB 8216 KiB The_Pinned_Arena::Initialize() 2 7 B 11 B 15 B 8192 KiB 8192 KiB 8192 KiB InitParticles 564 18 KiB 19 KiB 21 KiB 6884 KiB 6884 KiB 6884 KiB Redistribute_partition 420 860 B 860 B 861 B 1280 B 1280 B 1280 B numParticlesOutOfRange() 1248 888 B 889 B 891 B 1280 B 1280 B 1280 B amrex::unpackBuffer 12 11 B 11 B 12 B 1024 B 1024 B 1024 B ParticleCopyPlan::build 206 126 B 127 B 128 B 256 B 256 B 256 B ParticleCopyPlan::buildMPIStart 204 120 B 120 B 120 B 256 B 256 B 256 B testRedistribute 4 0 B 0 B 0 B 256 B 256 B 256 B ---------------------------------------------------------------------------------------------------------------------- Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [7591 ... 7591] [The Arena] max space (MB) allocated spread across MPI: [41 ... 41] [The Arena] max space (MB) used spread across MPI: [35 ... 35] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [24 ... 24] [The Pinned Arena] max space (MB) used spread across MPI: [16 ... 16] AMReX (26.05-39-gbe2cc437644f) finalized