Initializing AMReX (26.04-96-g21b2deea3233)... MPI initialized with 2 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.04-96-g21b2deea3233) initialized Running redistribute test About to initialize particles step 0 step 1 step 2 step 3 step 4 step 5 step 6 step 7 step 8 step 9 step 10 step 11 step 12 step 13 step 14 step 15 step 16 step 17 step 18 step 19 step 20 step 21 step 22 step 23 step 24 step 25 step 26 step 27 step 28 step 29 step 30 step 31 step 32 step 33 step 34 step 35 step 36 step 37 step 38 step 39 step 40 step 41 step 42 step 43 step 44 step 45 step 46 step 47 step 48 step 49 step 50 step 51 step 52 step 53 step 54 step 55 step 56 step 57 step 58 step 59 step 60 step 61 step 62 step 63 step 64 step 65 step 66 step 67 step 68 step 69 step 70 step 71 step 72 step 73 step 74 step 75 step 76 step 77 step 78 step 79 step 80 step 81 step 82 step 83 step 84 step 85 step 86 step 87 step 88 step 89 step 90 step 91 step 92 step 93 step 94 step 95 step 96 step 97 step 98 step 99 131072 131072 pass TinyProfiler total time across processes [min...avg...max]: 1.107 ... 1.109 ... 1.111 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- amrex::unpackBuffer 103 0.3393 0.3396 0.34 30.59% amrex::unpackRemotes 103 0.3164 0.3194 0.3225 29.02% numParticlesOutOfRange() 614 0.1237 0.132 0.1403 12.63% ParticleContainer::RedistributeGPU() 103 0.06224 0.06824 0.07424 6.68% ParticleCopyPlan::build 103 0.05693 0.05752 0.05812 5.23% Redistribute_partition 103 0.04574 0.04705 0.04837 4.35% TestParticleContainer::moveParticles 100 0.04365 0.04406 0.04447 4.00% amrex::communicateParticlesStart 103 0.01974 0.02213 0.02453 2.21% amrex::computeNeighborProcs 101 0.02234 0.02297 0.02359 2.12% TestParticleContainer::checkAnswer 103 0.0104 0.01486 0.01931 1.74% ParticleCopyPlan::buildMPIStart 103 0.01103 0.01399 0.01696 1.53% amrex::communicateParticlesFinish 103 0.005748 0.00894 0.01213 1.09% ParticleCopyPlan::doHandShake 103 0.001913 0.005174 0.008436 0.76% InitParticles 1 0.006256 0.006453 0.006651 0.60% testRedistribute 1 0.001071 0.001467 0.001862 0.17% ParticleContainer::OK() 103 3.201e-05 3.875e-05 4.549e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 2.033e-06 2.774e-06 3.514e-06 0.00% Other 418 0.002864 0.005063 0.007262 0.65% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- testRedistribute 1 1.107 1.109 1.111 100.00% ParticleContainer::RedistributeGPU() 103 0.9543 0.9544 0.9545 85.90% amrex::unpackBuffer 103 0.3393 0.3396 0.34 30.59% amrex::unpackRemotes 103 0.3164 0.3194 0.3225 29.02% numParticlesOutOfRange() 614 0.1237 0.132 0.1403 12.63% ParticleCopyPlan::build 103 0.09813 0.09965 0.1012 9.11% TestParticleContainer::checkAnswer 103 0.04981 0.05426 0.0587 5.28% Redistribute_partition 103 0.04574 0.04705 0.04837 4.35% TestParticleContainer::moveParticles 100 0.04365 0.04406 0.04447 4.00% ParticleContainer::OK() 103 0.03939 0.0394 0.03941 3.55% amrex::communicateParticlesStart 103 0.01974 0.02213 0.02453 2.21% amrex::computeNeighborProcs 101 0.02234 0.02297 0.02359 2.12% ParticleCopyPlan::buildMPIStart 103 0.01887 0.01917 0.01946 1.75% amrex::communicateParticlesFinish 103 0.005748 0.00894 0.01213 1.09% InitParticles 1 0.0113 0.0113 0.0113 1.02% ParticleCopyPlan::doHandShake 103 0.001913 0.005174 0.008436 0.76% DistributionMapping::SFCProcessorMapDoIt() 1 9.028e-06 0.002148 0.004287 0.39% Other 418 0.003342 0.005581 0.007819 0.70% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.check_file(nvals = 1) :: [RedistributeSOA_chk] [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] [TOP]::amr.plot_file(nvals = 1) :: [RedistributeSOA_plt] Device Memory Usage: --------------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------------------- ResizeRandomSeed 2 9161 KiB 9161 KiB 9161 KiB 9216 KiB 9216 KiB 9216 KiB ParticleContainer::ReserveForRedistribute() 126 37 KiB 37 KiB 38 KiB 7022 KiB 7033 KiB 7044 KiB InitParticles 84 6272 KiB 6272 KiB 6272 KiB 7030 KiB 7030 KiB 7030 KiB ParticleContainer::RedistributeGPU() 210 90 KiB 90 KiB 90 KiB 6911 KiB 6920 KiB 6929 KiB amrex::packBuffer 204 192 KiB 193 KiB 194 KiB 6911 KiB 6920 KiB 6928 KiB Redistribute_partition 3648 55 KiB 55 KiB 55 KiB 1560 KiB 1562 KiB 1565 KiB ParticleCopyPlan::build 1642 9490 B 9529 B 9568 B 261 KiB 261 KiB 262 KiB testRedistribute 6 17 B 19 B 22 B 48 KiB 48 KiB 48 KiB numParticlesOutOfRange() 1228 2265 B 2294 B 2324 B 24 KiB 24 KiB 24 KiB DenseBins::buildGPU 12 1150 B 1150 B 1150 B 2048 B 2048 B 2048 B ParticleBufferMap::define 6 690 B 690 B 690 B 768 B 768 B 768 B amrex::communicateParticlesStart 206 157 B 158 B 159 B 256 B 256 B 256 B --------------------------------------------------------------------------------------------------------------------------- Managed Memory Usage: --------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------- The_Managed_Arena::Initialize() 2 4 B 4 B 5 B 8192 KiB 8192 KiB 8192 KiB --------------------------------------------------------------------------------------------------------------- Pinned Memory Usage: -------------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max -------------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 2 6 B 7 B 9 B 8192 KiB 8192 KiB 8192 KiB ParticleContainer::RedistributeGPU() 416 165 KiB 166 KiB 167 KiB 6911 KiB 6920 KiB 6929 KiB amrex::communicateParticlesStart 204 79 KiB 80 KiB 81 KiB 6911 KiB 6919 KiB 6928 KiB InitParticles 1132 14 KiB 15 KiB 15 KiB 3990 KiB 3990 KiB 3990 KiB Redistribute_partition 420 918 B 918 B 919 B 1280 B 1280 B 1280 B numParticlesOutOfRange() 1248 937 B 937 B 937 B 1280 B 1280 B 1280 B amrex::unpackBuffer 12 5 B 5 B 5 B 1024 B 1024 B 1024 B ParticleCopyPlan::build 206 173 B 173 B 174 B 256 B 256 B 256 B ParticleCopyPlan::buildMPIStart 204 168 B 168 B 168 B 256 B 256 B 256 B testRedistribute 6 0 B 0 B 0 B 256 B 256 B 256 B -------------------------------------------------------------------------------------------------------------------- Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [7611 ... 7611] [The Arena] max space (MB) allocated spread across MPI: [33 ... 33] [The Arena] max space (MB) used spread across MPI: [31 ... 31] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [16 ... 16] [The Pinned Arena] max space (MB) used spread across MPI: [13 ... 13] AMReX (26.04-96-g21b2deea3233) finalized