Initializing AMReX (26.05-38-g728cddf4f1c2)... MPI initialized with 4 MPI processes MPI initialized with thread support level 0 AMReX (26.05-38-g728cddf4f1c2) initialized MLMG: # of AMR levels: 4 # of MG levels on the coarsest AMR level: 5 MLMG: Initial rhs = 0.015625 MLMG: Initial residual (resid0) = 0.015625 MLMG: Iteration 1 Fine resid/bnorm = 1.238821899 MLMG: Iteration 2 Fine resid/bnorm = 0.1693373502 MLMG: Iteration 3 Fine resid/bnorm = 0.08649415203 MLMG: Iteration 4 Fine resid/bnorm = 0.04942034115 MLMG: Iteration 5 Fine resid/bnorm = 0.02973674805 MLMG: Iteration 6 Fine resid/bnorm = 0.01865023334 MLMG: Iteration 7 Fine resid/bnorm = 0.0120555114 MLMG: Iteration 8 Fine resid/bnorm = 0.008046893956 MLMG: Iteration 9 Fine resid/bnorm = 0.005531276052 MLMG: Iteration 10 Fine resid/bnorm = 0.003896953582 MLMG: Iteration 11 Fine resid/bnorm = 0.002799675087 MLMG: Iteration 12 Fine resid/bnorm = 0.002041586617 MLMG: Iteration 13 Fine resid/bnorm = 0.001505496766 MLMG: Iteration 14 Fine resid/bnorm = 0.001119492459 MLMG: Iteration 15 Fine resid/bnorm = 0.0008377744089 MLMG: Iteration 16 Fine resid/bnorm = 0.000630114635 MLMG: Iteration 17 Fine resid/bnorm = 0.0004759227886 MLMG: Iteration 18 Fine resid/bnorm = 0.0003608032566 MLMG: Iteration 19 Fine resid/bnorm = 0.0002744861704 MLMG: Iteration 20 Fine resid/bnorm = 0.0002095347736 MLMG: Iteration 21 Fine resid/bnorm = 0.0001605055731 MLMG: Iteration 22 Fine resid/bnorm = 0.0001233843941 MLMG: Iteration 23 Fine resid/bnorm = 9.519548621e-05 MLMG: Iteration 24 Fine resid/bnorm = 7.372414984e-05 MLMG: Iteration 25 Fine resid/bnorm = 5.731782585e-05 MLMG: Iteration 26 Fine resid/bnorm = 4.50311054e-05 MLMG: Iteration 27 Fine resid/bnorm = 3.669653961e-05 MLMG: Iteration 28 Fine resid/bnorm = 3.00558022e-05 MLMG: Iteration 29 Fine resid/bnorm = 2.473022323e-05 MLMG: Iteration 30 Fine resid/bnorm = 2.091044735e-05 MLMG: Iteration 31 Fine resid/bnorm = 1.77333568e-05 MLMG: Iteration 32 Fine resid/bnorm = 1.503953536e-05 MLMG: Iteration 33 Fine resid/bnorm = 1.275789691e-05 MLMG: Iteration 34 Fine resid/bnorm = 1.082655217e-05 MLMG: Iteration 35 Fine resid/bnorm = 9.192546713e-06 MLMG: Iteration 36 Fine resid/bnorm = 7.80983828e-06 MLMG: Iteration 37 Fine resid/bnorm = 6.639660569e-06 MLMG: Iteration 38 Fine resid/bnorm = 5.649315426e-06 MLMG: Iteration 39 Fine resid/bnorm = 4.810513929e-06 MLMG: Iteration 40 Fine resid/bnorm = 4.099696525e-06 MLMG: Iteration 41 Fine resid/bnorm = 3.496927093e-06 MLMG: Iteration 42 Fine resid/bnorm = 2.985383617e-06 MLMG: Iteration 43 Fine resid/bnorm = 2.551023499e-06 MLMG: Iteration 44 Fine resid/bnorm = 2.181870514e-06 MLMG: Iteration 45 Fine resid/bnorm = 1.867709216e-06 MLMG: Iteration 46 Fine resid/bnorm = 1.600186806e-06 MLMG: Iteration 47 Fine resid/bnorm = 1.372158295e-06 MLMG: Iteration 48 Fine resid/bnorm = 1.177686499e-06 MLMG: Iteration 49 Fine resid/bnorm = 1.011678251e-06 MLMG: Iteration 50 Fine resid/bnorm = 8.697679732e-07 MLMG: Iteration 51 Fine resid/bnorm = 7.483031368e-07 MLMG: Iteration 52 Fine resid/bnorm = 6.443733582e-07 MLMG: Iteration 53 Fine resid/bnorm = 5.552283255e-07 MLMG: Iteration 53 Crse resid/bnorm = 1.096600331e-06 MLMG: Iteration 54 Fine resid/bnorm = 4.788453225e-07 MLMG: Iteration 54 Crse resid/bnorm = 9.475207058e-07 MLMG: Iteration 55 Fine resid/bnorm = 4.133034963e-07 MLMG: Iteration 55 Crse resid/bnorm = 8.19251968e-07 MLMG: Iteration 56 Fine resid/bnorm = 3.57045792e-07 MLMG: Iteration 56 Crse resid/bnorm = 7.088039617e-07 MLMG: Iteration 57 Fine resid/bnorm = 3.086170182e-07 MLMG: Iteration 57 Crse resid/bnorm = 6.136302226e-07 MLMG: Final Iter. 57 resid, resid/bnorm = 9.587972228e-09, 6.136302226e-07 MLMG: Timers: Solve = 188.0107867 Iter = 187.7859388 Bottom = 0.0119861 TinyProfiler total time across processes [min...avg...max]: 188.1 ... 188.1 ... 188.1 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- MCNodalLinOp::Fapply() 11516 91.21 92.92 96.03 51.05% MCNodalLinOp::Fsmooth() 4332 22.44 22.57 22.87 12.16% amrex::Copy() 18119 13.23 14.78 15.74 8.37% FillBoundary_nowait() 22993 11.53 11.64 11.79 6.27% MultiFab::Multiply() 8664 8.418 9.45 10.01 5.32% MultiFab::Subtract() 8664 9.206 9.427 9.717 5.17% FabArray::setVal() 16532 7.655 7.856 8.05 4.28% FabArray::ParallelCopy_finish() 1101 1.432 5.142 6.852 3.64% FillBoundary_finish() 22993 2.772 4.207 6.718 3.57% FabArray::Xpay() 2641 3.098 3.335 3.486 1.85% MLMG::interpCorrection_1 171 2.544 2.592 2.697 1.43% amrex::Add() 1026 1.593 1.64 1.669 0.89% MCNodalLinOp::interpolation() 912 0.9182 0.9362 0.9585 0.51% MCNodalLinOp::reflux() 189 0.6578 0.6795 0.7057 0.38% MCNodalLinOp::restriction() 912 0.3205 0.352 0.3878 0.21% FabArray::FillBoundary() 16420 0.01837 0.01986 0.02171 0.01% MLMG::oneIter() 57 0.006891 0.007907 0.008712 0.00% MCNodalLinOp::applyBC() 7031 0.006899 0.007484 0.008684 0.00% MLMG:computeResOfCorrection() 2052 0.006383 0.006799 0.006995 0.00% FAbArray::OverrideSync() 6573 0.00465 0.005273 0.005775 0.00% OverrideSync_nowait() 6573 0.003849 0.004454 0.005553 0.00% OverrideSync_finish() 6573 0.003408 0.00379 0.004321 0.00% MLMG::solve() 1 0.0009959 0.002492 0.00355 0.00% MLMG::mgVcycle_down::0 399 0.002975 0.003126 0.003334 0.00% MLMG::computeResWithCrseSolFineCor() 171 0.002825 0.002944 0.00305 0.00% MLMG::mgVcycle_up::0 399 0.002265 0.002601 0.002899 0.00% MLMG::computeResWithCrseCorFineCor() 171 0.002219 0.002365 0.002639 0.00% FabArray::ParallelCopy() 1101 0.001341 0.001523 0.001783 0.00% MLMG::mgVcycle_bottom 570 0.001307 0.001562 0.001721 0.00% MLMG::mgVcycle() 570 0.001328 0.001544 0.001676 0.00% MLMG::addInterpCorrection() 912 0.001183 0.001295 0.001383 0.00% MLMG::miniCycle() 342 0.0009073 0.00105 0.001132 0.00% MLMG::computeResidual() 57 0.0006471 0.0007153 0.0007943 0.00% MLMG::mgFcycle() 57 0.0003809 0.0004575 0.0005631 0.00% Other 29639 0.3624 0.4645 0.5491 0.29% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- MLMG::solve() 1 188 188 188 99.95% MLMG::oneIter() 57 182.5 182.5 182.5 97.04% MLMG::mgVcycle() 570 157 158.5 161.8 86.04% MLMG::miniCycle() 342 156.9 158.2 161.8 86.03% MCNodalLinOp::Fsmooth() 4332 127.5 128.8 131.4 69.83% MCNodalLinOp::Fapply() 11516 96.6 98.11 101 53.70% MLMG::mgVcycle_up::0 399 75.47 76.19 77.86 41.40% MLMG::mgVcycle_down::0 399 75.01 75.78 77.39 41.14% MLMG:computeResOfCorrection() 2052 22.97 23.33 23.99 12.76% FabArray::FillBoundary() 16420 13.52 14.48 16.4 8.72% amrex::Copy() 18119 13.23 14.78 15.74 8.37% FillBoundary_nowait() 22993 11.56 11.66 11.82 6.28% MLMG::computeResWithCrseSolFineCor() 171 8.219 8.976 10.94 5.82% MultiFab::Multiply() 8664 8.418 9.45 10.01 5.32% MultiFab::Subtract() 8664 9.206 9.427 9.717 5.17% MLMG::interpCorrection_1 171 4.125 7.061 9.37 4.98% FabArray::setVal() 16532 7.655 7.856 8.05 4.28% FabArray::ParallelCopy() 1101 1.525 5.23 6.938 3.69% FabArray::ParallelCopy_finish() 1101 1.432 5.142 6.852 3.64% FillBoundary_finish() 22993 2.772 4.207 6.718 3.57% MLMG::mgVcycle_bottom 570 6.426 6.464 6.567 3.49% MCNodalLinOp::applyBC() 7031 6.388 6.46 6.518 3.47% MLMG::computeResWithCrseCorFineCor() 171 6.034 6.129 6.316 3.36% MLMG::computeResidual() 57 4.832 4.871 4.945 2.63% MCNodalLinOp::reflux() 189 1.25 1.915 3.836 2.04% FabArray::Xpay() 2641 3.098 3.335 3.486 1.85% FAbArray::OverrideSync() 6573 0.9829 1.426 1.925 1.02% MLMG::addInterpCorrection() 912 1.815 1.839 1.878 1.00% MCNodalLinOp::interpolation() 912 1.813 1.838 1.877 1.00% amrex::Add() 1026 1.593 1.64 1.669 0.89% MCNodalLinOp::restriction() 912 1.354 1.484 1.633 0.87% MLMG::mgFcycle() 57 0.02424 0.3462 1.305 0.69% OverrideSync_finish() 6573 0.3262 0.7028 1.096 0.58% OverrideSync_nowait() 6573 0.6319 0.7182 0.823 0.44% Other 29639 0.9016 1.166 1.532 0.81% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::amr.check_file(nvals = 1) :: [MLMG_MC_chk] [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] [TOP]::amr.plot_file(nvals = 1) :: [MLMG_MC_plt] Pinned Memory Usage: --------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------- The_Pinned_Arena::Initialize() 4 0 B 0 B 0 B 8192 KiB 8192 KiB 8192 KiB MCNodalLinOp::Fapply() 46064 124 B 125 B 130 B 256 B 256 B 256 B MCNodalLinOp::prepareForSolve() 44 0 B 0 B 0 B 256 B 256 B 256 B --------------------------------------------------------------------------------------------------------------- Cpu Memory Usage: --------------------------------------------------------------------------------------------------------------- Name Nalloc AvgMem min AvgMem avg AvgMem max MaxMem min MaxMem avg MaxMem max --------------------------------------------------------------------------------------------------------------- MLMG::prepareForSolve() 540 88 MiB 91 MiB 94 MiB 88 MiB 91 MiB 94 MiB MCNodalLinOp::Fsmooth() 156636 28 MiB 28 MiB 28 MiB 50 MiB 50 MiB 50 MiB Unprofiled 148 37 MiB 38 MiB 39 MiB 37 MiB 38 MiB 39 MiB MCNodalLinOp::~Operator() 332 25 MiB 25 MiB 26 MiB 25 MiB 25 MiB 26 MiB WriteMultiLevelPlotfile() 74 738 B 773 B 818 B 8988 KiB 8988 KiB 8988 KiB FillBoundary_nowait() 50582 220 KiB 236 KiB 268 KiB 3454 KiB 3454 KiB 3454 KiB FabArray::ParallelCopy_nowait() 5138 1268 B 4483 B 6608 B 2145 KiB 2145 KiB 2145 KiB MCNodalLinOp::reflux() 13797 9150 B 9284 B 9380 B 1796 KiB 1796 KiB 1796 KiB MLMG::interpCorrection_1 4161 16 KiB 19 KiB 21 KiB 1232 KiB 1232 KiB 1232 KiB MCNodalLinOp::interpolation() 8892 2762 B 2812 B 2898 B 561 KiB 561 KiB 561 KiB MLMG::oneIter() 4161 36 B 47 B 59 B 184 KiB 184 KiB 184 KiB amrex::average_down 73 0 B 1 B 6 B 184 KiB 184 KiB 184 KiB MCNodalLinOp::buildMasks() 5 0 B 64 B 256 B 153 KiB 153 KiB 153 KiB OwnerMask() 2 0 B 35 KiB 140 KiB 0 B 35 KiB 140 KiB MLCGSolver::bicgstab 1425 0 B 0 B 1 B 0 B 7040 B 27 KiB --------------------------------------------------------------------------------------------------------------- AMReX (26.05-38-g728cddf4f1c2) finalized