Initializing AMReX (26.10-64-g334d08c6b02e)... MPI initialized with 4 MPI processes MPI initialized with thread support level 0 AMReX (26.10-64-g334d08c6b02e) initialized MLMG: # of AMR levels: 4 # of MG levels on the coarsest AMR level: 5 MLMG: Initial rhs = 0.015625 MLMG: Initial residual (resid0) = 0.015625 MLMG: Iteration 1 Fine resid/bnorm = 1.238821899 MLMG: Iteration 2 Fine resid/bnorm = 0.1693373502 MLMG: Iteration 3 Fine resid/bnorm = 0.08649415203 MLMG: Iteration 4 Fine resid/bnorm = 0.04942034115 MLMG: Iteration 5 Fine resid/bnorm = 0.02973674805 MLMG: Iteration 6 Fine resid/bnorm = 0.01865023334 MLMG: Iteration 7 Fine resid/bnorm = 0.0120555114 MLMG: Iteration 8 Fine resid/bnorm = 0.008046893956 MLMG: Iteration 9 Fine resid/bnorm = 0.005531276052 MLMG: Iteration 10 Fine resid/bnorm = 0.003896953582 MLMG: Iteration 11 Fine resid/bnorm = 0.002799675087 MLMG: Iteration 12 Fine resid/bnorm = 0.002041586617 MLMG: Iteration 13 Fine resid/bnorm = 0.001505496766 MLMG: Iteration 14 Fine resid/bnorm = 0.001119492459 MLMG: Iteration 15 Fine resid/bnorm = 0.0008377744089 MLMG: Iteration 16 Fine resid/bnorm = 0.000630114635 MLMG: Iteration 17 Fine resid/bnorm = 0.0004759227886 MLMG: Iteration 18 Fine resid/bnorm = 0.0003608032566 MLMG: Iteration 19 Fine resid/bnorm = 0.0002744861704 MLMG: Iteration 20 Fine resid/bnorm = 0.0002095347736 MLMG: Iteration 21 Fine resid/bnorm = 0.0001605055731 MLMG: Iteration 22 Fine resid/bnorm = 0.0001233843941 MLMG: Iteration 23 Fine resid/bnorm = 9.519548621e-05 MLMG: Iteration 24 Fine resid/bnorm = 7.372414984e-05 MLMG: Iteration 25 Fine resid/bnorm = 5.731782585e-05 MLMG: Iteration 26 Fine resid/bnorm = 4.50311054e-05 MLMG: Iteration 27 Fine resid/bnorm = 3.669653961e-05 MLMG: Iteration 28 Fine resid/bnorm = 3.00558022e-05 MLMG: Iteration 29 Fine resid/bnorm = 2.473022323e-05 MLMG: Iteration 30 Fine resid/bnorm = 2.091044735e-05 MLMG: Iteration 31 Fine resid/bnorm = 1.77333568e-05 MLMG: Iteration 32 Fine resid/bnorm = 1.503953536e-05 MLMG: Iteration 33 Fine resid/bnorm = 1.275789691e-05 MLMG: Iteration 34 Fine resid/bnorm = 1.082655217e-05 MLMG: Iteration 35 Fine resid/bnorm = 9.192546713e-06 MLMG: Iteration 36 Fine resid/bnorm = 7.80983828e-06 MLMG: Iteration 37 Fine resid/bnorm = 6.639660569e-06 MLMG: Iteration 38 Fine resid/bnorm = 5.649315426e-06 MLMG: Iteration 39 Fine resid/bnorm = 4.810513929e-06 MLMG: Iteration 40 Fine resid/bnorm = 4.099696525e-06 MLMG: Iteration 41 Fine resid/bnorm = 3.496927093e-06 MLMG: Iteration 42 Fine resid/bnorm = 2.985383617e-06 MLMG: Iteration 43 Fine resid/bnorm = 2.551023499e-06 MLMG: Iteration 44 Fine resid/bnorm = 2.181870514e-06 MLMG: Iteration 45 Fine resid/bnorm = 1.867709216e-06 MLMG: Iteration 46 Fine resid/bnorm = 1.600186806e-06 MLMG: Iteration 47 Fine resid/bnorm = 1.372158295e-06 MLMG: Iteration 48 Fine resid/bnorm = 1.177686499e-06 MLMG: Iteration 49 Fine resid/bnorm = 1.011678251e-06 MLMG: Iteration 50 Fine resid/bnorm = 8.697679732e-07 MLMG: Iteration 51 Fine resid/bnorm = 7.483031368e-07 MLMG: Iteration 52 Fine resid/bnorm = 6.443733582e-07 MLMG: Iteration 53 Fine resid/bnorm = 5.552283255e-07 MLMG: Iteration 53 Crse resid/bnorm = 1.096600331e-06 MLMG: Iteration 54 Fine resid/bnorm = 4.788453225e-07 MLMG: Iteration 54 Crse resid/bnorm = 9.475207058e-07 MLMG: Iteration 55 Fine resid/bnorm = 4.133034963e-07 MLMG: Iteration 55 Crse resid/bnorm = 8.19251968e-07 MLMG: Iteration 56 Fine resid/bnorm = 3.57045792e-07 MLMG: Iteration 56 Crse resid/bnorm = 7.088039617e-07 MLMG: Iteration 57 Fine resid/bnorm = 3.086170182e-07 MLMG: Iteration 57 Crse resid/bnorm = 6.136302226e-07 MLMG: Final Iter. 57 resid, resid/bnorm = 9.587972228e-09, 6.136302226e-07 MLMG: Timers: Solve = 188.6881313 Iter = 188.4604368 Bottom = 0.012780029 TinyProfiler total time across processes [min...avg...max]: 188.8 ... 188.8 ... 188.8 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- MCNodalLinOp::Fapply() 11516 91.07 92.87 95.99 50.85% MCNodalLinOp::Fsmooth() 4332 22.59 22.85 23.06 12.21% amrex::Copy() 18119 13.87 15.03 15.77 8.35% FillBoundary_nowait() 22993 12.03 12.12 12.22 6.48% MultiFab::Multiply() 8664 9.073 9.593 9.942 5.27% MultiFab::Subtract() 8664 9.259 9.415 9.587 5.08% FabArray::setVal() 16532 7.766 7.849 7.93 4.20% FabArray::ParallelCopy_finish() 1101 1.468 5.15 6.846 3.63% FillBoundary_finish() 22993 2.92 3.803 5.218 2.76% FabArray::Xpay() 2641 3.222 3.294 3.356 1.78% MLMG::interpCorrection_1 171 2.558 2.6 2.703 1.43% amrex::Add() 1026 1.618 1.627 1.644 0.87% MCNodalLinOp::interpolation() 912 0.8688 0.8823 0.9016 0.48% MCNodalLinOp::reflux() 189 0.6449 0.667 0.6947 0.37% MCNodalLinOp::restriction() 912 0.3448 0.3563 0.3676 0.19% FabArray::FillBoundary() 16420 0.02036 0.02139 0.02365 0.01% MLMG::oneIter() 57 0.008136 0.008563 0.00896 0.00% MCNodalLinOp::applyBC() 7031 0.007355 0.007645 0.008394 0.00% MLMG:computeResOfCorrection() 2052 0.006882 0.007065 0.007409 0.00% FAbArray::OverrideSync() 6573 0.004987 0.005469 0.006125 0.00% OverrideSync_nowait() 6573 0.003821 0.004266 0.004596 0.00% OverrideSync_finish() 6573 0.00358 0.003993 0.004191 0.00% MLMG::mgVcycle_down::0 399 0.002998 0.003187 0.003515 0.00% MLMG::solve() 1 0.001026 0.002406 0.003471 0.00% MLMG::computeResWithCrseSolFineCor() 171 0.002903 0.003051 0.003338 0.00% MLMG::mgVcycle_up::0 399 0.002611 0.002691 0.002912 0.00% MLMG::computeResWithCrseCorFineCor() 171 0.002225 0.002373 0.002503 0.00% FabArray::ParallelCopy() 1101 0.001521 0.001626 0.001808 0.00% MLMG::mgVcycle_bottom 570 0.001517 0.001594 0.001737 0.00% MLMG::mgVcycle() 570 0.001541 0.001644 0.001726 0.00% MLMG::addInterpCorrection() 912 0.001209 0.001323 0.001464 0.00% MLMG::miniCycle() 342 0.001031 0.00109 0.001147 0.00% MLMG::computeResidual() 57 0.0006685 0.0006822 0.0007055 0.00% MLMG::mgFcycle() 57 0.0004207 0.0004839 0.0005773 0.00% Other 29560 0.5193 0.5501 0.5984 0.32% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- MLMG::solve() 1 188.7 188.7 188.7 99.96% MLMG::oneIter() 57 183.1 183.1 183.1 96.99% MLMG::mgVcycle() 570 157.6 159.1 162.4 86.03% MLMG::miniCycle() 342 157.5 158.8 162.4 86.02% MCNodalLinOp::Fsmooth() 4332 128.1 129.3 132 69.91% MCNodalLinOp::Fapply() 11516 96.21 98.1 101.2 53.62% MLMG::mgVcycle_up::0 399 75.99 76.69 78.29 41.47% MLMG::mgVcycle_down::0 399 75.21 75.91 77.58 41.10% MLMG:computeResOfCorrection() 2052 23.06 23.36 23.89 12.66% amrex::Copy() 18119 13.87 15.03 15.77 8.35% FabArray::FillBoundary() 16420 13.89 14.63 15.68 8.31% FillBoundary_nowait() 22993 12.06 12.15 12.25 6.49% MLMG::computeResWithCrseSolFineCor() 171 8.232 8.965 10.88 5.76% MultiFab::Multiply() 8664 9.073 9.593 9.942 5.27% MultiFab::Subtract() 8664 9.259 9.415 9.587 5.08% MLMG::interpCorrection_1 171 4.133 7.064 9.355 4.96% FabArray::setVal() 16532 7.766 7.849 7.93 4.20% FabArray::ParallelCopy() 1101 1.56 5.237 6.929 3.67% FabArray::ParallelCopy_finish() 1101 1.468 5.15 6.846 3.63% MCNodalLinOp::applyBC() 7031 6.498 6.647 6.767 3.58% MLMG::mgVcycle_bottom 570 6.343 6.403 6.512 3.45% MLMG::computeResWithCrseCorFineCor() 171 6.062 6.145 6.276 3.32% FillBoundary_finish() 22993 2.92 3.803 5.218 2.76% MLMG::computeResidual() 57 4.878 4.887 4.894 2.59% MCNodalLinOp::reflux() 189 1.276 1.916 3.775 2.00% FabArray::Xpay() 2641 3.222 3.294 3.356 1.78% MLMG::addInterpCorrection() 912 1.789 1.806 1.836 0.97% MCNodalLinOp::interpolation() 912 1.787 1.805 1.835 0.97% amrex::Add() 1026 1.618 1.627 1.644 0.87% FAbArray::OverrideSync() 6573 1.215 1.36 1.632 0.86% MCNodalLinOp::restriction() 912 1.458 1.493 1.51 0.80% MLMG::mgFcycle() 57 0.02757 0.3491 1.309 0.69% OverrideSync_finish() 6573 0.5834 0.6694 0.8715 0.46% OverrideSync_nowait() 6573 0.6262 0.6856 0.7547 0.40% Other 29560 0.9224 1.043 1.327 0.70% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.check_file(nvals = 1) :: [MLMG_MC_chk] [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] [TOP]::amr.plot_file(nvals = 1) :: [MLMG_MC_plt] Async Memory Usage: -------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max -------------------------------------------------------------------------------------------------------- MLMG::interpCorrection_1 4161 16 KiB 19 KiB 21 KiB 1228 KiB 1228 KiB 1228 KiB MLMG::oneIter() 4161 44 B 52 B 72 B 182 KiB 182 KiB 182 KiB amrex::average_down 73 0 B 1 B 4 B 182 KiB 182 KiB 182 KiB MLCGSolver::bicgstab 1425 0 B 0 B 1 B 0 B 6860 B 26 KiB -------------------------------------------------------------------------------------------------------- Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 4 0 B 0 B 0 B 8192 KiB 8192 KiB 8192 KiB MCNodalLinOp::Fapply() 46064 123 B 125 B 130 B 256 B 256 B 256 B MCNodalLinOp::prepareForSolve() 44 0 B 0 B 0 B 256 B 256 B 256 B --------------------------------------------------------------------------------------------------------------- Cpu Memory Usage: --------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------- MLMG::prepareForSolve() 540 88 MiB 91 MiB 94 MiB 88 MiB 91 MiB 94 MiB MCNodalLinOp::Fsmooth() 156636 28 MiB 28 MiB 28 MiB 50 MiB 50 MiB 50 MiB Unprofiled 148 37 MiB 38 MiB 39 MiB 37 MiB 38 MiB 39 MiB MCNodalLinOp::~Operator() 332 25 MiB 25 MiB 26 MiB 25 MiB 25 MiB 26 MiB WriteMultiLevelPlotfile() 74 732 B 767 B 812 B 8988 KiB 8988 KiB 8988 KiB FillBoundary_nowait() 50582 229 KiB 238 KiB 252 KiB 3454 KiB 3454 KiB 3454 KiB FabArray::ParallelCopy_nowait() 5138 1269 B 4459 B 6569 B 2145 KiB 2145 KiB 2145 KiB MCNodalLinOp::reflux() 13797 8993 B 9326 B 9486 B 1796 KiB 1796 KiB 1796 KiB MLMG::interpCorrection_1 4161 16 KiB 19 KiB 21 KiB 1232 KiB 1232 KiB 1232 KiB MCNodalLinOp::interpolation() 8892 2600 B 2647 B 2728 B 561 KiB 561 KiB 561 KiB MLMG::oneIter() 4161 45 B 52 B 73 B 184 KiB 184 KiB 184 KiB amrex::average_down 73 0 B 1 B 4 B 184 KiB 184 KiB 184 KiB MCNodalLinOp::buildMasks() 5 0 B 64 B 256 B 153 KiB 153 KiB 153 KiB OwnerMask() 2 0 B 35 KiB 140 KiB 0 B 35 KiB 140 KiB MLCGSolver::bicgstab 1425 0 B 0 B 1 B 0 B 7040 B 27 KiB --------------------------------------------------------------------------------------------------------------- AMReX (26.10-64-g334d08c6b02e) finalized