Initializing AMReX (26.09-42-gab27bcd92650)... MPI initialized with 2 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.09-42-gab27bcd92650) initialized Running redistribute test testNeighborProcsCoarseToFine: pass About to initialize particles pass TinyProfiler total time across processes [min...avg...max]: 0.2405 ... 0.2412 ... 0.242 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- ParticleCopyPlan::build 103 0.06321 0.06324 0.06327 26.15% numParticlesOutOfRange() 410 0.04057 0.04523 0.04988 20.61% Redistribute_partition 103 0.03121 0.03143 0.03166 13.08% ParticleContainer::Redistribute_impl() 103 0.02671 0.02811 0.0295 12.19% amrex::communicateParticlesStart 103 0.01536 0.01733 0.01931 7.98% amrex::unpackBuffer 103 0.01368 0.01385 0.01402 5.80% amrex::unpackRemotes 103 1.26e-05 0.006536 0.01306 5.40% ParticleCopyPlan::doHandShake 103 0.001115 0.005484 0.009852 4.07% amrex::computeNeighborProcs 102 0.007264 0.007397 0.00753 3.11% TestParticleContainer::moveParticles 100 0.00719 0.007218 0.007246 2.99% ParticleCopyPlan::buildMPIStart 103 0.003617 0.004592 0.005566 2.30% TestParticleContainer::checkAnswer 103 0.002245 0.003401 0.004558 1.88% InitParticles 1 0.002663 0.002819 0.002974 1.23% testNeighborProcsCoarseToFine 1 2.262e-05 0.0007662 0.00151 0.62% amrex::communicateParticlesFinish 103 0.0004659 0.0006933 0.0009207 0.38% amrex::packBuffer 103 0.0008051 0.000829 0.0008528 0.35% DenseBins::buildGPU 1 0.0006916 0.0006992 0.0007068 0.29% testRedistribute 1 0.0004414 0.0005069 0.0005724 0.24% ParticleContainer::OK() 103 2.211e-05 2.265e-05 2.318e-05 0.01% Other 418 0.0008897 0.001072 0.001255 0.52% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- testRedistribute 1 0.2404 0.2404 0.2404 99.37% ParticleContainer::Redistribute_impl() 103 0.2106 0.2119 0.2131 88.08% ParticleCopyPlan::build 103 0.07732 0.08087 0.08443 34.89% numParticlesOutOfRange() 410 0.04057 0.04523 0.04988 20.61% Redistribute_partition 103 0.03121 0.03143 0.03166 13.08% amrex::communicateParticlesStart 103 0.01536 0.01733 0.01931 7.98% TestParticleContainer::checkAnswer 103 0.01687 0.01804 0.01921 7.94% ParticleContainer::OK() 103 0.01462 0.01464 0.01465 6.05% amrex::unpackBuffer 103 0.01368 0.01385 0.01402 5.80% ParticleCopyPlan::buildMPIStart 103 0.006682 0.01008 0.01347 5.57% amrex::unpackRemotes 103 1.26e-05 0.006536 0.01306 5.40% ParticleCopyPlan::doHandShake 103 0.001115 0.005484 0.009852 4.07% amrex::computeNeighborProcs 102 0.007264 0.007397 0.00753 3.11% TestParticleContainer::moveParticles 100 0.00719 0.007218 0.007246 2.99% InitParticles 1 0.007086 0.007089 0.007091 2.93% testNeighborProcsCoarseToFine 1 3.76e-05 0.0007854 0.001533 0.63% amrex::communicateParticlesFinish 103 0.0004659 0.0006933 0.0009207 0.38% amrex::packBuffer 103 0.0008051 0.000829 0.0008528 0.35% DenseBins::buildGPU 1 0.0006916 0.0006992 0.0007068 0.29% Other 418 0.001235 0.001574 0.001912 0.79% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.check_file(nvals = 1) :: [RedistributeNonPeriodic_chk] [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] [TOP]::amr.plot_file(nvals = 1) :: [RedistributeNonPeriodic_plt] Device Memory Usage: --------------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------------- ResizeRandomSeed 2 8497 KiB 8498 KiB 8498 KiB 9216 KiB 9216 KiB 9216 KiB InitParticles 24 2907 KiB 2910 KiB 2913 KiB 6768 KiB 6768 KiB 6768 KiB amrex::packBuffer 62 6947 B 11 KiB 15 KiB 98 KiB 198 KiB 298 KiB ParticleContainer::Redistribute_impl() 37 857 B 4982 B 9107 B 216 KiB 216 KiB 216 KiB Redistribute_partition 1276 20 KiB 24 KiB 28 KiB 199 KiB 199 KiB 199 KiB testRedistribute 2 34 B 34 B 34 B 48 KiB 48 KiB 48 KiB ParticleCopyPlan::buildCopiesAtomicScatter 128 1922 B 2334 B 2747 B 25 KiB 25 KiB 25 KiB numParticlesOutOfRange() 388 1916 B 2189 B 2462 B 24 KiB 24 KiB 24 KiB DenseBins::buildGPU 12 794 B 794 B 795 B 2048 B 2048 B 2048 B ParticleCopyPlan::build 1236 394 B 409 B 424 B 1280 B 1280 B 1280 B ParticleBufferMap::define 8 636 B 636 B 636 B 1024 B 1024 B 1024 B ParticleContainer::ReserveForRedistribute() 568 163 B 170 B 177 B 1024 B 1024 B 1024 B amrex::communicateParticlesStart 206 36 B 37 B 38 B 256 B 256 B 256 B --------------------------------------------------------------------------------------------------------------------------- Managed Memory Usage: --------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------- The_Managed_Arena::Initialize() 2 12 B 12 B 13 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------- Pinned Memory Usage: ---------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ---------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 2 30 B 34 B 38 B 8192 KiB 8192 KiB 8192 KiB InitParticles 296 18 KiB 19 KiB 21 KiB 4168 KiB 4168 KiB 4168 KiB ParticleContainer::Redistribute_impl() 274 5036 B 6219 B 7402 B 99 KiB 198 KiB 298 KiB amrex::communicateParticlesStart 31 0 B 3278 B 6556 B 0 B 99 KiB 199 KiB Redistribute_partition 136 225 B 225 B 226 B 768 B 768 B 768 B numParticlesOutOfRange() 392 238 B 240 B 243 B 768 B 768 B 768 B TestParticleContainer::checkAnswer 284 78 B 78 B 78 B 512 B 512 B 512 B amrex::unpackBuffer 284 81 B 84 B 88 B 512 B 512 B 512 B ParticleCopyPlan::build 206 62 B 65 B 68 B 256 B 256 B 256 B ParticleCopyPlan::buildMPIStart 31 0 B 17 B 35 B 0 B 128 B 256 B testRedistribute 2 0 B 0 B 0 B 256 B 256 B 256 B ---------------------------------------------------------------------------------------------------------------------- Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [7643 ... 7643] [The Arena] max space (MB) allocated spread across MPI: [17 ... 17] [The Arena] max space (MB) used spread across MPI: [16 ... 16] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Pinned Arena] max space (MB) used spread across MPI: [4 ... 4] AMReX (26.09-42-gab27bcd92650) finalized