Initializing AMReX (26.04-83-g515ed5e0f061)... MPI initialized with 2 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.04-83-g515ed5e0f061) initialized Running redistribute test About to initialize particles 131072 131072 pass TinyProfiler total time across processes [min...avg...max]: 1.436 ... 1.437 ... 1.437 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- numParticlesOutOfRange() 616 0.3644 0.3732 0.3819 26.57% amrex::unpackBuffer 104 0.2719 0.2736 0.2753 19.15% amrex::unpackRemotes 104 0.2109 0.2129 0.2149 14.95% Redistribute_partition 104 0.1498 0.1508 0.1518 10.56% TestParticleContainer::moveParticles 100 0.121 0.1212 0.1213 8.44% ParticleContainer::RedistributeGPU() 104 0.07921 0.09351 0.1078 7.50% TestParticleContainer::checkAnswer 103 0.05301 0.05738 0.06174 4.30% ParticleCopyPlan::build 104 0.05276 0.05317 0.05357 3.73% amrex::communicateParticlesStart 104 0.01836 0.02585 0.03334 2.32% amrex::computeNeighborProcs 101 0.02486 0.02529 0.02572 1.79% ParticleCopyPlan::buildMPIStart 104 0.01014 0.01443 0.01871 1.30% amrex::communicateParticlesFinish 104 0.005992 0.009866 0.01374 0.96% ParticleCopyPlan::doHandShake 104 0.0004488 0.004983 0.009518 0.66% ParticleContainer::ReserveForRedistribute() 104 0.007481 0.008401 0.009322 0.65% InitParticles 1 0.003373 0.003551 0.003729 0.26% testRedistribute 1 0.002712 0.00281 0.002908 0.20% ParticleContainer::OK() 103 3.341e-05 3.638e-05 3.934e-05 0.00% Other 330 0.005008 0.005917 0.006827 0.47% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- testRedistribute 1 1.436 1.437 1.437 100.00% ParticleContainer::RedistributeGPU() 104 1.01 1.01 1.01 70.25% numParticlesOutOfRange() 616 0.3644 0.3732 0.3819 26.57% amrex::unpackBuffer 104 0.2719 0.2736 0.2753 19.15% amrex::unpackRemotes 104 0.2109 0.2129 0.2149 14.95% TestParticleContainer::checkAnswer 103 0.1721 0.1764 0.1807 12.57% Redistribute_partition 104 0.1498 0.1508 0.1518 10.56% TestParticleContainer::moveParticles 100 0.121 0.1212 0.1213 8.44% ParticleContainer::OK() 103 0.119 0.1191 0.1191 8.29% ParticleCopyPlan::build 104 0.09677 0.09786 0.09895 6.88% amrex::communicateParticlesStart 104 0.01836 0.02585 0.03334 2.32% amrex::computeNeighborProcs 101 0.02486 0.02529 0.02572 1.79% ParticleCopyPlan::buildMPIStart 104 0.01916 0.01941 0.01966 1.37% InitParticles 1 0.01535 0.01535 0.01535 1.07% amrex::communicateParticlesFinish 104 0.005992 0.009866 0.01374 0.96% ParticleCopyPlan::doHandShake 104 0.0004488 0.004983 0.009518 0.66% ParticleContainer::ReserveForRedistribute() 104 0.007481 0.008401 0.009322 0.65% Other 330 0.005563 0.007303 0.009044 0.63% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.check_file(nvals = 1) :: [RedistributeMR_chk] [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] [TOP]::amr.plot_file(nvals = 1) :: [RedistributeMR_plt] Device Memory Usage: --------------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------------- ResizeRandomSeed 2 9172 KiB 9172 KiB 9172 KiB 9216 KiB 9216 KiB 9216 KiB ParticleContainer::ReserveForRedistribute() 359 1167 KiB 1168 KiB 1169 KiB 7082 KiB 7089 KiB 7095 KiB InitParticles 24 6355 KiB 6356 KiB 6356 KiB 7028 KiB 7028 KiB 7028 KiB ParticleContainer::RedistributeGPU() 224 85 KiB 87 KiB 90 KiB 6920 KiB 6921 KiB 6922 KiB amrex::packBuffer 208 208 KiB 210 KiB 212 KiB 6919 KiB 6920 KiB 6921 KiB Redistribute_partition 10928 66 KiB 67 KiB 67 KiB 1578 KiB 1579 KiB 1579 KiB ParticleCopyPlan::build 2466 9 KiB 9 KiB 10 KiB 263 KiB 263 KiB 264 KiB testRedistribute 24 67 B 71 B 75 B 48 KiB 48 KiB 48 KiB numParticlesOutOfRange() 3684 5512 B 5534 B 5557 B 24 KiB 24 KiB 24 KiB DenseBins::buildGPU 40 3530 B 3530 B 3530 B 4608 B 4608 B 4608 B ParticleBufferMap::define 6 708 B 708 B 708 B 768 B 768 B 768 B amrex::communicateParticlesStart 208 112 B 114 B 116 B 256 B 256 B 256 B --------------------------------------------------------------------------------------------------------------------------- Managed Memory Usage: --------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------- The_Managed_Arena::Initialize() 2 3 B 3 B 4 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------- Pinned Memory Usage: -------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max -------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 2 4 B 6 B 9 B 8192 KiB 8192 KiB 8192 KiB ParticleContainer::RedistributeGPU() 436 130 KiB 142 KiB 154 KiB 6920 KiB 6920 KiB 6921 KiB amrex::communicateParticlesStart 206 48 KiB 57 KiB 65 KiB 6919 KiB 6919 KiB 6920 KiB InitParticles 300 7709 B 8220 B 8731 B 6233 KiB 6233 KiB 6233 KiB numParticlesOutOfRange() 3718 1449 B 1450 B 1452 B 1792 B 1792 B 1792 B amrex::unpackBuffer 30 939 B 939 B 939 B 1536 B 1536 B 1536 B Redistribute_partition 1244 484 B 484 B 485 B 768 B 768 B 768 B ParticleCopyPlan::build 208 127 B 128 B 129 B 256 B 256 B 256 B ParticleCopyPlan::buildMPIStart 206 123 B 123 B 123 B 256 B 256 B 256 B testRedistribute 24 0 B 0 B 0 B 256 B 256 B 256 B -------------------------------------------------------------------------------------------------------------------- Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [7595 ... 7595] [The Arena] max space (MB) allocated spread across MPI: [41 ... 41] [The Arena] max space (MB) used spread across MPI: [31 ... 31] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [16 ... 16] [The Pinned Arena] max space (MB) used spread across MPI: [13 ... 13] AMReX (26.04-83-g515ed5e0f061) finalized