Initializing AMReX (26.09-175-gf2e8bf0a946a)... MPI initialized with 4 MPI processes MPI initialized with thread support level 0 AMReX (26.09-175-gf2e8bf0a946a) initialized ##### GEOMETRY PROPERTIES ##### ##### n_cell: 64 64 18 ##### prob_lo: -1.6e-08 -1.6e-08 0 ##### prob_hi: 1.6e-08 1.6e-08 9e-09 ##### max_grid_size: 32 32 18 ##### blocking_factor: 8 8 8 ##### is_periodic: 1 1 0 ##### coord_sys: 0 ##### embedded_boundary_flag: 0 ##### per per dir(0.0) ##### per per dir(0.0) contains_SC = 0 ================================== P is initialized for a 3D problem. ================================== ========= Advance Steps ========== MLMG: Initial rhs = 5265673.62 MLMG: Initial residual (resid0) = 5265673.62 MLMG: Final Iter. 7 resid, resid/bnorm = 0.000287506351, 5.460010851e-11 MLMG: Timers: Solve = 0.037980616 Iter = 0.035786885 Bottom = 0.02001987 Steady state check : (phi(t) - phi(t-1)).norm0() = 1 Advanced step 1 in 0.051246304 seconds MLMG: Initial rhs = 3478213.744 MLMG: Initial residual (resid0) = 3478213.744 MLMG: Final Iter. 7 resid, resid/bnorm = 0.0002527355682, 7.266246034e-11 MLMG: Timers: Solve = 0.023168684 Iter = 0.022495023 Bottom = 0.012212411 Steady state check : (phi(t) - phi(t-1)).norm0() = 0.3774210014 Advanced step 2 in 0.03461923 seconds MLMG: Initial rhs = 2592731.352 MLMG: Initial residual (resid0) = 2592731.352 MLMG: Final Iter. 7 resid, resid/bnorm = 0.0002223741612, 8.576830032e-11 MLMG: Timers: Solve = 0.023042493 Iter = 0.022381865 Bottom = 0.01265401 Steady state check : (phi(t) - phi(t-1)).norm0() = 0.303720913 Advanced step 3 in 0.034501146 seconds High-water FAB megabyte spread across MPI nodes: [12 ... 12] Current FAB megabyte spread across MPI nodes: [10 ... 10] Total run time 0.144624281 seconds TinyProfiler total time across processes [min...avg...max]: 0.1449 ... 0.1468 ... 0.1487 -------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % -------------------------------------------------------------------------------------------- MLABecLaplacian::Fsmooth() 168 0.01734 0.01855 0.02176 14.63% FillBoundary_finish() 1132 0.006515 0.01395 0.01699 11.43% Calculate_Grad() 3 0.01296 0.01297 0.013 8.74% main() 1 0.007771 0.00976 0.01212 8.15% MLABecLaplacian::Fapply() 957 0.008318 0.008948 0.0104 7.00% FillBoundary_nowait() 1132 0.007073 0.008504 0.01015 6.82% MLCGSolver::ParallelAllReduce 2305 0.004075 0.00819 0.009951 6.69% VisMF::Write(FabArray) 2 0.003786 0.006474 0.009295 6.25% ComputePhi_Rho() 3 0.005836 0.007417 0.008493 5.71% Calculate_Landau() 3 0.007876 0.007978 0.008035 5.40% amrex::Dot() 1824 0.005657 0.005843 0.006136 4.13% MLABecLaplacian::normalize() 933 0.003635 0.003925 0.00467 3.14% MLCellLinOp::applyBC() 1125 0.003719 0.003987 0.004561 3.07% FabArray::norminf() 966 0.003598 0.003674 0.003797 2.55% DistributionMapping::LeastUsedCPUs() 1 1.477e-05 0.001866 0.003774 2.54% ComputeEfromPhi() 6 0.002947 0.003031 0.003156 2.12% WritePlotfile() 2 0.002424 0.002859 0.003074 2.07% WriteMultiLevelPlotfile() 2 0.0004328 0.001181 0.002687 1.81% FabArray::setVal() 160 0.00172 0.002123 0.002275 1.53% amrex::Copy() 123 0.001655 0.00183 0.001921 1.29% MLCGSolver::bicgstab 21 0.001497 0.001622 0.001781 1.20% MLMG::addInterpCorrection() 21 0.001146 0.001266 0.001519 1.02% FabArray::Saxpy_Saxpy() 460 0.001153 0.001236 0.00142 0.95% FabArray::Saypy_Saxpy() 452 0.001 0.001073 0.001245 0.84% FabArray::Saxpy_Xpay() 439 0.0008728 0.000927 0.001064 0.72% amrex::average_down 24 0.0007969 0.0008849 0.001019 0.69% CalculateTDGL_RHS() 3 0.0008702 0.0009092 0.0009948 0.67% FabArray::LinComb() 12 0.0007547 0.0007644 0.0007817 0.53% FabArray::Xpay() 45 0.0007428 0.0007541 0.0007629 0.51% Calculate_Elec() 3 0.0004925 0.0006079 0.0007018 0.47% MLABecLaplacian::define() 1 0.0003899 0.0004173 0.0004938 0.33% MLMG::ResNormInf() 24 0.0001274 0.0003282 0.0004447 0.30% MLCellLinOp::apply() 957 0.0003621 0.0003955 0.0004316 0.29% FabArray::FillBoundary() 1132 0.0003464 0.0003694 0.0004264 0.29% amrex::Add() 21 0.0003648 0.000368 0.0003732 0.25% average_down_faces 9 0.0002704 0.0002793 0.0002976 0.20% FabArrayBase::getFB() 1132 0.0001965 0.0002131 0.0002428 0.16% MLCellLinOp::defineAuxData() 1 0.000101 0.000135 0.0002254 0.15% MLMG::solve() 3 0.0001137 0.0001449 0.0002141 0.14% MLMG::prepareForSolve() 3 0.0001082 0.0001185 0.0001279 0.09% MLCellLinOp::smooth() 63 7.386e-05 7.857e-05 8.285e-05 0.06% MLMG::actualBottomSolve() 21 3.634e-05 4.022e-05 4.436e-05 0.03% MLMG::oneIter() 21 1.939e-05 2.198e-05 2.403e-05 0.02% MLMG::mgVcycle_down::0 21 2.06e-05 2.189e-05 2.393e-05 0.02% MLMG::mgVcycle() 21 2.065e-05 2.191e-05 2.319e-05 0.02% MLCellLinOp::solutionResidual() 24 1.873e-05 2.072e-05 2.249e-05 0.02% MLCellLinOp::correctionResidual() 21 1.581e-05 1.792e-05 2.082e-05 0.01% MLMG::mgVcycle_up::0 21 1.338e-05 1.566e-05 1.9e-05 0.01% MLABecLaplacian::averageDownCoeffs() 3 7.593e-06 1.156e-05 1.602e-05 0.01% MLMG::computeResidual() 21 1.082e-05 1.336e-05 1.577e-05 0.01% MLMG:computeResOfCorrection() 21 1.223e-05 1.337e-05 1.446e-05 0.01% MLCellLinOp::defineBC() 1 7.522e-06 1.011e-05 1.407e-05 0.01% MLMG::mgVcycle_bottom 21 9.788e-06 1.112e-05 1.231e-05 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 2.88e-06 3.962e-06 5.873e-06 0.00% MLMG::computeMLResidual() 3 3.29e-06 4.077e-06 4.969e-06 0.00% Other 77 0.0003303 0.0004344 0.0006955 0.47% -------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % -------------------------------------------------------------------------------------------- main() 1 0.1447 0.1447 0.1448 97.35% ComputePhi_Rho() 3 0.09063 0.0918 0.09246 62.18% MLMG::solve() 3 0.08268 0.0838 0.08422 56.64% MLMG::oneIter() 21 0.07693 0.0771 0.07754 52.15% MLMG::mgVcycle() 21 0.07653 0.07671 0.07715 51.89% MLMG::mgVcycle_bottom 21 0.04436 0.04464 0.04488 30.18% MLMG::actualBottomSolve() 21 0.04435 0.04463 0.04487 30.17% MLCGSolver::bicgstab 21 0.04424 0.04453 0.04476 30.10% MLCellLinOp::smooth() 63 0.02675 0.02703 0.02767 18.61% MLCellLinOp::apply() 957 0.02489 0.02513 0.02557 17.20% MLCellLinOp::applyBC() 1125 0.02056 0.02418 0.02554 17.18% FabArray::FillBoundary() 1132 0.01739 0.02308 0.02527 16.99% MLABecLaplacian::Fsmooth() 168 0.01734 0.01855 0.02176 14.63% MLMG::mgVcycle_down::0 21 0.0165 0.01678 0.01707 11.48% FillBoundary_finish() 1132 0.006515 0.01395 0.01699 11.43% MLMG::mgVcycle_up::0 21 0.01509 0.01527 0.01569 10.55% WritePlotfile() 2 0.01076 0.01176 0.01421 9.56% Calculate_Grad() 3 0.01296 0.01297 0.013 8.74% MLCGSolver::ParallelAllReduce 2305 0.007189 0.01115 0.01284 8.64% WriteMultiLevelPlotfile() 2 0.006474 0.00771 0.01057 7.11% FillBoundary_nowait() 1132 0.007334 0.008767 0.01044 7.02% MLABecLaplacian::Fapply() 957 0.008318 0.008948 0.0104 7.00% VisMF::Write(FabArray) 2 0.003786 0.006474 0.009295 6.25% Calculate_Landau() 3 0.007876 0.007978 0.008035 5.40% amrex::Dot() 1824 0.005657 0.005843 0.006136 4.13% MLCellLinOp::solutionResidual() 24 0.003234 0.004601 0.005102 3.43% MLABecLaplacian::normalize() 933 0.003635 0.003925 0.00467 3.14% FabArray::norminf() 966 0.003598 0.003674 0.003797 2.55% DistributionMapping::SFCProcessorMapDoIt() 1 1.858e-05 0.001871 0.003782 2.54% DistributionMapping::LeastUsedCPUs() 1 1.477e-05 0.001866 0.003774 2.54% ComputeEfromPhi() 6 0.002947 0.003031 0.003156 2.12% MLMG:computeResOfCorrection() 21 0.002397 0.002691 0.00286 1.92% MLCellLinOp::correctionResidual() 21 0.002382 0.002678 0.002846 1.91% MLMG::computeResidual() 21 0.002468 0.002707 0.002806 1.89% MLMG::computeMLResidual() 3 0.000787 0.001912 0.002314 1.56% FabArray::setVal() 160 0.00172 0.002123 0.002275 1.53% amrex::Copy() 123 0.001655 0.00183 0.001921 1.29% MLMG::addInterpCorrection() 21 0.001146 0.001266 0.001519 1.02% FabArray::Saxpy_Saxpy() 460 0.001153 0.001236 0.00142 0.95% CalculateTDGL_RHS() 3 0.001225 0.001269 0.001357 0.91% FabArray::Saypy_Saxpy() 452 0.001 0.001073 0.001245 0.84% MLABecLaplacian::define() 1 0.0007447 0.0008342 0.001094 0.74% FabArray::Saxpy_Xpay() 439 0.0008728 0.000927 0.001064 0.72% MLMG::prepareForSolve() 3 0.0009774 0.0009952 0.001024 0.69% amrex::average_down 24 0.0007969 0.0008849 0.001019 0.69% MLMG::ResNormInf() 24 0.0006723 0.0008612 0.0009704 0.65% FabArray::LinComb() 12 0.0007547 0.0007644 0.0007817 0.53% FabArray::Xpay() 45 0.0007428 0.0007541 0.0007629 0.51% Calculate_Elec() 3 0.0004925 0.0006079 0.0007018 0.47% MLABecLaplacian::averageDownCoeffs() 3 0.0004096 0.000426 0.0004655 0.31% amrex::Add() 21 0.0003648 0.000368 0.0003732 0.25% MLCellLinOp::defineAuxData() 1 0.0001594 0.0001977 0.0003088 0.21% average_down_faces 9 0.0002704 0.0002793 0.0002976 0.20% FabArrayBase::getFB() 1132 0.0002437 0.0002636 0.0002976 0.20% MLCellLinOp::defineBC() 1 0.0001533 0.0001793 0.0002476 0.17% Other 77 0.0007525 0.0008961 0.001252 0.84% -------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.check_file(nvals = 1) :: [3D_MFIM_chk] [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] [TOP]::amr.plot_file(nvals = 1) :: [3D_MFIM_plt] Async Memory Usage: ---------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ---------------------------------------------------------------------------------------------------- MLCGSolver::bicgstab 420 30 KiB 30 KiB 30 KiB 109 KiB 109 KiB 109 KiB ---------------------------------------------------------------------------------------------------- Pinned Memory Usage: -------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max -------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 4 108 B 136 B 154 B 8192 KiB 8192 KiB 8192 KiB Unprofiled 48 0 B 0 B 0 B 256 B 256 B 256 B -------------------------------------------------------------------------------------------------------------- Cpu Memory Usage: ------------------------------------------------------------------------------------------------------------ Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max ------------------------------------------------------------------------------------------------------------ main() 220 7918 KiB 7971 KiB 8047 KiB 9260 KiB 9260 KiB 9260 KiB WritePlotfile() 8 171 KiB 186 KiB 221 KiB 2592 KiB 2592 KiB 2592 KiB MLMG::prepareForSolve() 32 654 KiB 662 KiB 669 KiB 857 KiB 857 KiB 857 KiB MLABecLaplacian::define() 32 565 KiB 568 KiB 573 KiB 669 KiB 669 KiB 669 KiB ComputePhi_Rho() 72 6725 B 7145 B 8103 B 576 KiB 576 KiB 576 KiB MLCGSolver::bicgstab 420 30 KiB 30 KiB 30 KiB 110 KiB 110 KiB 110 KiB BndryData::define() 48 89 KiB 89 KiB 90 KiB 105 KiB 105 KiB 105 KiB MLCellLinOp::defineAuxData() 96 55 KiB 55 KiB 55 KiB 65 KiB 65 KiB 65 KiB FillBoundary_nowait() 9056 2032 B 3562 B 4110 B 37 KiB 37 KiB 37 KiB MLCellLinOp::applyBC() 4500 4 B 4 B 5 B 256 B 256 B 256 B ------------------------------------------------------------------------------------------------------------ AMReX (26.09-175-gf2e8bf0a946a) finalized