Initializing AMReX (26.04-100-g9aaff4128aa5)... MPI initialized with 4 MPI processes MPI initialized with thread support level 0 AMReX (26.04-100-g9aaff4128aa5) initialized MLMG: # of AMR levels: 4 # of MG levels on the coarsest AMR level: 5 MLMG: Initial rhs = 0.015625 MLMG: Initial residual (resid0) = 0.015625 MLMG: Iteration 1 Fine resid/bnorm = 1.238821899 MLMG: Iteration 2 Fine resid/bnorm = 0.1693373502 MLMG: Iteration 3 Fine resid/bnorm = 0.08649415203 MLMG: Iteration 4 Fine resid/bnorm = 0.04942034115 MLMG: Iteration 5 Fine resid/bnorm = 0.02973674805 MLMG: Iteration 6 Fine resid/bnorm = 0.01865023334 MLMG: Iteration 7 Fine resid/bnorm = 0.0120555114 MLMG: Iteration 8 Fine resid/bnorm = 0.008046893956 MLMG: Iteration 9 Fine resid/bnorm = 0.005531276052 MLMG: Iteration 10 Fine resid/bnorm = 0.003896953582 MLMG: Iteration 11 Fine resid/bnorm = 0.002799675087 MLMG: Iteration 12 Fine resid/bnorm = 0.002041586617 MLMG: Iteration 13 Fine resid/bnorm = 0.001505496766 MLMG: Iteration 14 Fine resid/bnorm = 0.001119492459 MLMG: Iteration 15 Fine resid/bnorm = 0.0008377744089 MLMG: Iteration 16 Fine resid/bnorm = 0.000630114635 MLMG: Iteration 17 Fine resid/bnorm = 0.0004759227886 MLMG: Iteration 18 Fine resid/bnorm = 0.0003608032566 MLMG: Iteration 19 Fine resid/bnorm = 0.0002744861704 MLMG: Iteration 20 Fine resid/bnorm = 0.0002095347736 MLMG: Iteration 21 Fine resid/bnorm = 0.0001605055731 MLMG: Iteration 22 Fine resid/bnorm = 0.0001233843941 MLMG: Iteration 23 Fine resid/bnorm = 9.519548621e-05 MLMG: Iteration 24 Fine resid/bnorm = 7.372414984e-05 MLMG: Iteration 25 Fine resid/bnorm = 5.731782585e-05 MLMG: Iteration 26 Fine resid/bnorm = 4.50311054e-05 MLMG: Iteration 27 Fine resid/bnorm = 3.669653961e-05 MLMG: Iteration 28 Fine resid/bnorm = 3.00558022e-05 MLMG: Iteration 29 Fine resid/bnorm = 2.473022323e-05 MLMG: Iteration 30 Fine resid/bnorm = 2.091044735e-05 MLMG: Iteration 31 Fine resid/bnorm = 1.77333568e-05 MLMG: Iteration 32 Fine resid/bnorm = 1.503953536e-05 MLMG: Iteration 33 Fine resid/bnorm = 1.275789691e-05 MLMG: Iteration 34 Fine resid/bnorm = 1.082655217e-05 MLMG: Iteration 35 Fine resid/bnorm = 9.192546713e-06 MLMG: Iteration 36 Fine resid/bnorm = 7.80983828e-06 MLMG: Iteration 37 Fine resid/bnorm = 6.639660569e-06 MLMG: Iteration 38 Fine resid/bnorm = 5.649315426e-06 MLMG: Iteration 39 Fine resid/bnorm = 4.810513929e-06 MLMG: Iteration 40 Fine resid/bnorm = 4.099696525e-06 MLMG: Iteration 41 Fine resid/bnorm = 3.496927093e-06 MLMG: Iteration 42 Fine resid/bnorm = 2.985383617e-06 MLMG: Iteration 43 Fine resid/bnorm = 2.551023499e-06 MLMG: Iteration 44 Fine resid/bnorm = 2.181870514e-06 MLMG: Iteration 45 Fine resid/bnorm = 1.867709216e-06 MLMG: Iteration 46 Fine resid/bnorm = 1.600186806e-06 MLMG: Iteration 47 Fine resid/bnorm = 1.372158295e-06 MLMG: Iteration 48 Fine resid/bnorm = 1.177686499e-06 MLMG: Iteration 49 Fine resid/bnorm = 1.011678251e-06 MLMG: Iteration 50 Fine resid/bnorm = 8.697679732e-07 MLMG: Iteration 51 Fine resid/bnorm = 7.483031368e-07 MLMG: Iteration 52 Fine resid/bnorm = 6.443733582e-07 MLMG: Iteration 53 Fine resid/bnorm = 5.552283255e-07 MLMG: Iteration 53 Crse resid/bnorm = 1.096600331e-06 MLMG: Iteration 54 Fine resid/bnorm = 4.788453225e-07 MLMG: Iteration 54 Crse resid/bnorm = 9.475207058e-07 MLMG: Iteration 55 Fine resid/bnorm = 4.133034963e-07 MLMG: Iteration 55 Crse resid/bnorm = 8.19251968e-07 MLMG: Iteration 56 Fine resid/bnorm = 3.57045792e-07 MLMG: Iteration 56 Crse resid/bnorm = 7.088039617e-07 MLMG: Iteration 57 Fine resid/bnorm = 3.086170182e-07 MLMG: Iteration 57 Crse resid/bnorm = 6.136302226e-07 MLMG: Final Iter. 57 resid, resid/bnorm = 9.587972228e-09, 6.136302226e-07 MLMG: Timers: Solve = 191.3392203 Iter = 191.1145942 Bottom = 0.013483176 TinyProfiler total time across processes [min...avg...max]: 191.4 ... 191.4 ... 191.4 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- MCNodalLinOp::Fapply() 11516 93.17 94.87 98.71 51.57% MCNodalLinOp::Fsmooth() 4332 21.58 22.22 22.99 12.01% amrex::Copy() 18119 14 14.36 14.99 7.83% FillBoundary_nowait() 22993 11.39 11.55 11.71 6.12% MultiFab::Multiply() 8664 8.839 9.07 9.309 4.86% MultiFab::Subtract() 8664 8.725 8.93 9.042 4.72% FillBoundary_finish() 22993 5.852 7.683 9.003 4.70% FabArray::setVal() 16532 7.513 7.559 7.604 3.97% FabArray::ParallelCopy_finish() 1101 1.555 5.377 7.127 3.72% FabArray::Xpay() 2641 2.843 3 3.127 1.63% MLMG::interpCorrection_1 171 2.597 2.688 2.832 1.48% amrex::Add() 1026 1.576 1.589 1.602 0.84% MCNodalLinOp::interpolation() 912 0.8961 0.9141 0.9406 0.49% MCNodalLinOp::reflux() 189 0.647 0.6783 0.6929 0.36% MCNodalLinOp::restriction() 912 0.3318 0.3523 0.3763 0.20% FabArray::FillBoundary() 16420 0.01845 0.01986 0.02144 0.01% MLMG::oneIter() 57 0.006943 0.008549 0.01003 0.01% MCNodalLinOp::applyBC() 7031 0.00718 0.007652 0.008195 0.00% MLMG:computeResOfCorrection() 2052 0.006662 0.00727 0.007558 0.00% FAbArray::OverrideSync() 6573 0.005079 0.005571 0.006109 0.00% OverrideSync_nowait() 6573 0.004217 0.00475 0.005236 0.00% OverrideSync_finish() 6573 0.003925 0.004095 0.004316 0.00% MLMG::solve() 1 0.0009656 0.002583 0.003667 0.00% MLMG::mgVcycle_down::0 399 0.003008 0.0032 0.003461 0.00% MLMG::computeResWithCrseSolFineCor() 171 0.002888 0.002955 0.003063 0.00% MLMG::mgVcycle_up::0 399 0.002415 0.002633 0.00293 0.00% MLMG::computeResWithCrseCorFineCor() 171 0.002142 0.002185 0.002243 0.00% MLMG::mgVcycle() 570 0.001497 0.001644 0.001836 0.00% FabArray::ParallelCopy() 1101 0.001431 0.001605 0.001715 0.00% MLMG::mgVcycle_bottom 570 0.001485 0.001588 0.001677 0.00% MLMG::addInterpCorrection() 912 0.001318 0.001387 0.001483 0.00% MLMG::miniCycle() 342 0.00092 0.00102 0.001172 0.00% MLMG::computeResidual() 57 0.0006645 0.0006953 0.0007458 0.00% MLMG::mgFcycle() 57 0.000437 0.0005085 0.0006509 0.00% Other 29639 0.396 0.4642 0.5278 0.28% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- MLMG::solve() 1 191.3 191.3 191.3 99.96% MLMG::oneIter() 57 185.7 185.7 185.7 97.02% MLMG::mgVcycle() 570 159.4 161 164.4 85.89% MLMG::miniCycle() 342 159.4 160.7 164.4 85.88% MCNodalLinOp::Fsmooth() 4332 129.4 130.7 133.5 69.73% MCNodalLinOp::Fapply() 11516 98.27 99.87 103.6 54.11% MLMG::mgVcycle_up::0 399 76.99 77.72 79.4 41.48% MLMG::mgVcycle_down::0 399 75.98 76.75 78.45 40.98% MLMG:computeResOfCorrection() 2052 23.54 23.79 24.3 12.70% FabArray::FillBoundary() 16420 16.21 17.87 18.97 9.91% amrex::Copy() 18119 14 14.36 14.99 7.83% FillBoundary_nowait() 22993 11.42 11.58 11.73 6.13% MLMG::computeResWithCrseSolFineCor() 171 8.494 9.283 11.34 5.92% MLMG::interpCorrection_1 171 4.325 7.313 9.708 5.07% MultiFab::Multiply() 8664 8.839 9.07 9.309 4.86% MultiFab::Subtract() 8664 8.725 8.93 9.042 4.72% FillBoundary_finish() 22993 5.852 7.683 9.003 4.70% FabArray::setVal() 16532 7.513 7.559 7.604 3.97% FabArray::ParallelCopy() 1101 1.652 5.468 7.216 3.77% FabArray::ParallelCopy_finish() 1101 1.555 5.377 7.127 3.72% MCNodalLinOp::applyBC() 7031 6.63 6.708 6.759 3.53% MLMG::mgVcycle_bottom 570 6.371 6.422 6.533 3.41% MLMG::computeResWithCrseCorFineCor() 171 6.229 6.326 6.49 3.39% MLMG::computeResidual() 57 4.997 5.018 5.054 2.64% MCNodalLinOp::reflux() 189 1.303 1.991 4.008 2.09% FabArray::Xpay() 2641 2.843 3 3.127 1.63% MLMG::addInterpCorrection() 912 1.823 1.843 1.876 0.98% MCNodalLinOp::interpolation() 912 1.821 1.841 1.875 0.98% amrex::Add() 1026 1.576 1.589 1.602 0.84% MCNodalLinOp::restriction() 912 1.446 1.524 1.598 0.83% FAbArray::OverrideSync() 6573 1.388 1.428 1.49 0.78% MLMG::mgFcycle() 57 0.02826 0.3645 1.369 0.71% OverrideSync_nowait() 6573 0.6961 0.7394 0.7834 0.41% OverrideSync_finish() 6573 0.6423 0.6834 0.7114 0.37% Other 29639 0.9713 1.169 1.502 0.78% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.check_file(nvals = 1) :: [MLMG_MC_chk] [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] [TOP]::amr.plot_file(nvals = 1) :: [MLMG_MC_plt] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 4 0 B 0 B 0 B 8192 KiB 8192 KiB 8192 KiB MCNodalLinOp::Fapply() 46064 124 B 126 B 131 B 256 B 256 B 256 B MCNodalLinOp::prepareForSolve() 44 0 B 0 B 0 B 256 B 256 B 256 B --------------------------------------------------------------------------------------------------------------- Cpu Memory Usage: --------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------- MLMG::prepareForSolve() 540 88 MiB 91 MiB 94 MiB 88 MiB 91 MiB 94 MiB MCNodalLinOp::Fsmooth() 156636 28 MiB 28 MiB 28 MiB 50 MiB 50 MiB 50 MiB Unprofiled 148 37 MiB 38 MiB 39 MiB 37 MiB 38 MiB 39 MiB MCNodalLinOp::~Operator() 332 25 MiB 25 MiB 26 MiB 25 MiB 25 MiB 26 MiB WriteMultiLevelPlotfile() 74 722 B 759 B 806 B 8988 KiB 8988 KiB 8988 KiB FillBoundary_nowait() 50582 259 KiB 285 KiB 302 KiB 3454 KiB 3454 KiB 3454 KiB FabArray::ParallelCopy_nowait() 5138 1297 B 4558 B 6709 B 2145 KiB 2145 KiB 2145 KiB MCNodalLinOp::reflux() 13797 9571 B 9624 B 9718 B 1796 KiB 1796 KiB 1796 KiB MLMG::interpCorrection_1 4161 16 KiB 19 KiB 21 KiB 1232 KiB 1232 KiB 1232 KiB MCNodalLinOp::interpolation() 8892 2656 B 2703 B 2804 B 561 KiB 561 KiB 561 KiB MLMG::oneIter() 4161 41 B 52 B 65 B 184 KiB 184 KiB 184 KiB amrex::average_down 73 0 B 2 B 6 B 184 KiB 184 KiB 184 KiB MCNodalLinOp::buildMasks() 5 0 B 64 B 256 B 153 KiB 153 KiB 153 KiB OwnerMask() 2 0 B 35 KiB 140 KiB 0 B 35 KiB 140 KiB MLCGSolver::bicgstab 1425 0 B 0 B 1 B 0 B 7040 B 27 KiB --------------------------------------------------------------------------------------------------------------- AMReX (26.04-100-g9aaff4128aa5) finalized