Initializing AMReX (26.06-26-ge95d50b2b424)... MPI initialized with 2 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.06-26-ge95d50b2b424) initialized Running redistribute test About to initialize particles 2048 2048 pass TinyProfiler total time across processes [min...avg...max]: 0.8146 ... 0.8163 ... 0.818 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- numParticlesOutOfRange() 616 0.171 0.1764 0.1818 22.22% amrex::unpackBuffer 104 0.1478 0.1483 0.1487 18.17% Redistribute_partition 104 0.1202 0.1206 0.121 14.79% amrex::unpackRemotes 104 0.07875 0.08018 0.08161 9.98% ParticleContainer::Redistribute_impl() 104 0.05242 0.05638 0.06034 7.38% ParticleCopyPlan::build 104 0.05428 0.05508 0.05588 6.83% TestParticleContainer::moveParticles 100 0.05549 0.05549 0.0555 6.78% TestParticleContainer::checkAnswer 103 0.04671 0.05055 0.05439 6.65% amrex::communicateParticlesStart 104 0.01849 0.01895 0.01941 2.37% amrex::computeNeighborProcs 101 0.01733 0.0175 0.01766 2.16% ParticleCopyPlan::buildMPIStart 104 0.0116 0.01404 0.01649 2.02% ParticleCopyPlan::doHandShake 104 0.002012 0.005149 0.008286 1.01% amrex::communicateParticlesFinish 104 0.00363 0.005403 0.007176 0.88% DistributionMapping::LeastUsedCPUs() 3 2.821e-05 0.001746 0.003464 0.42% DenseBins::buildGPU 5 0.003038 0.003048 0.003058 0.37% testRedistribute 1 0.002511 0.002616 0.00272 0.33% InitParticles 1 0.0006339 0.0006854 0.0007368 0.09% ParticleContainer::OK() 103 2.576e-05 2.625e-05 2.674e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 3 3.508e-06 4.12e-06 4.732e-06 0.00% Other 527 0.003789 0.004202 0.004615 0.56% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- testRedistribute 1 0.8146 0.8163 0.818 100.00% ParticleContainer::Redistribute_impl() 104 0.5872 0.5873 0.5874 71.81% numParticlesOutOfRange() 616 0.171 0.1764 0.1818 22.22% amrex::unpackBuffer 104 0.1478 0.1483 0.1487 18.17% Redistribute_partition 104 0.1202 0.1206 0.121 14.79% TestParticleContainer::checkAnswer 103 0.1029 0.1067 0.1106 13.52% ParticleCopyPlan::build 104 0.09102 0.09237 0.09372 11.46% amrex::unpackRemotes 104 0.07875 0.08018 0.08161 9.98% ParticleContainer::OK() 103 0.05617 0.05617 0.05617 6.87% TestParticleContainer::moveParticles 100 0.05549 0.05549 0.0555 6.78% ParticleCopyPlan::buildMPIStart 104 0.0185 0.01919 0.01989 2.43% amrex::communicateParticlesStart 104 0.01849 0.01895 0.01941 2.37% amrex::computeNeighborProcs 101 0.01733 0.0175 0.01766 2.16% InitParticles 1 0.009391 0.009393 0.009394 1.15% ParticleCopyPlan::doHandShake 104 0.002012 0.005149 0.008286 1.01% amrex::communicateParticlesFinish 104 0.00363 0.005403 0.007176 0.88% DistributionMapping::SFCProcessorMapDoIt() 3 4.739e-05 0.001759 0.00347 0.42% DistributionMapping::LeastUsedCPUs() 3 2.821e-05 0.001746 0.003464 0.42% DenseBins::buildGPU 5 0.003038 0.003048 0.003058 0.37% Other 527 0.004348 0.004859 0.005371 0.66% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.check_file(nvals = 1) :: [RedistributeMR_2D_chk] [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] [TOP]::amr.plot_file(nvals = 1) :: [RedistributeMR_2D_plt] Device Memory Usage: --------------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------------- ResizeRandomSeed 2 9143 KiB 9143 KiB 9143 KiB 9216 KiB 9216 KiB 9216 KiB ParticleContainer::Redistribute_impl() 222 2818 B 2832 B 2846 B 145 KiB 145 KiB 145 KiB ParticleContainer::ReserveForRedistribute() 110 31 KiB 31 KiB 32 KiB 112 KiB 113 KiB 114 KiB InitParticles 12 95 KiB 95 KiB 95 KiB 110 KiB 110 KiB 110 KiB amrex::packBuffer 206 2182 B 2199 B 2217 B 102 KiB 102 KiB 102 KiB Redistribute_partition 5940 4003 B 4020 B 4037 B 49 KiB 49 KiB 49 KiB testRedistribute 24 107 B 114 B 121 B 48 KiB 48 KiB 48 KiB numParticlesOutOfRange() 1842 4160 B 4196 B 4233 B 24 KiB 24 KiB 24 KiB ParticleCopyPlan::buildCopiesAtomicScatter 592 359 B 361 B 364 B 4864 B 4864 B 4864 B DenseBins::buildGPU 40 3355 B 3356 B 3357 B 4608 B 4608 B 4608 B ParticleCopyPlan::build 1248 567 B 572 B 578 B 1280 B 1280 B 1280 B ParticleBufferMap::define 8 898 B 898 B 899 B 1024 B 1024 B 1024 B amrex::communicateParticlesStart 208 91 B 91 B 92 B 256 B 256 B 256 B --------------------------------------------------------------------------------------------------------------------------- Managed Memory Usage: --------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------- The_Managed_Arena::Initialize() 2 5 B 5 B 6 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------- Pinned Memory Usage: ---------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ---------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 2 7 B 9 B 12 B 8192 KiB 8192 KiB 8192 KiB InitParticles 80 60 B 69 B 78 B 147 KiB 147 KiB 147 KiB ParticleContainer::Redistribute_impl() 434 2111 B 2126 B 2142 B 103 KiB 103 KiB 103 KiB amrex::communicateParticlesStart 204 682 B 684 B 686 B 102 KiB 102 KiB 102 KiB numParticlesOutOfRange() 1858 709 B 709 B 709 B 1024 B 1024 B 1024 B amrex::unpackBuffer 14 447 B 447 B 447 B 768 B 768 B 768 B Redistribute_partition 622 237 B 237 B 237 B 512 B 512 B 512 B ParticleCopyPlan::build 208 107 B 108 B 109 B 256 B 256 B 256 B ParticleCopyPlan::buildMPIStart 204 100 B 100 B 100 B 256 B 256 B 256 B testRedistribute 24 0 B 0 B 0 B 256 B 256 B 256 B ---------------------------------------------------------------------------------------------------------------------- Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [7643 ... 7643] [The Arena] max space (MB) allocated spread across MPI: [17 ... 17] [The Arena] max space (MB) used spread across MPI: [9 ... 9] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Pinned Arena] max space (MB) used spread across MPI: [0 ... 0] AMReX (26.06-26-ge95d50b2b424) finalized