Initializing AMReX (26.10-76-g347a3a2d2675)... MPI initialized with 4 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.10-76-g347a3a2d2675) initialized Successfully read inputs file ... REMORA git hash: v1.7-201-gfd71b79b AMReX git hash: 26.10-76-g347a3a2d26 WARNING: subcycling refined levels in time is EXPERIMENTAL. Multi-level answers are not yet considered production quality; check them against a single-level run before relying on them. remora.do_substep = 0 selects the older lockstep driver instead. [REMORA] Active E-P source: bulk evap-rain diagnostic. Refinement ratio at level 0 set to be 3 3 1 Creating new distribution map on level: 0 Making level 0 from scratch GRIDS AT LEVEL 0 ARE (BoxArray maxbox(4) m_ref->m_hash_sig(0) ((0,0,0) (4,4,3) (0,0,0)) ((5,0,0) (9,4,3) (0,0,0)) ((0,5,0) (4,9,3) (0,0,0)) ((5,5,0) (9,9,3) (0,0,0)) ) Reading high resolution bathymetry and grid data Loading high resolution bathymetry from NetCDF file hires_grd.nc Loading high resolution grid variables from NetCDF file hires_grd.nc Done reading in high resolution bathymetry and grid data Reading high resolution initial data Loading initial solution data from NetCDF file hires_ini.nc Loading initial sea surface height from NetCDF file hires_ini.nc Done reading in high resolution initial data Writing plotfile IdealMiniGrid_synth_hires-restart_plt00000 TIME = 0 KIN. ENG. = 1941079.06513775 VOLUME = 9522606688.29065 MAX. VEL. = 0.0509512910885042 Using cfl = 0.8 advective limit at level 0: 9045.579144 gravity wave limit at level 0: 41.5920109 (ndtfast = 10) Slow dt at level 0 would be: 41.5920109 Fixed dt at level 0 is: 10 Coarse STEP 1 starts ... Using cfl = 0.8 advective limit at level 0: 9045.579144 gravity wave limit at level 0: 41.5920109 (ndtfast = 10) Slow dt at level 0 would be: 41.5920109 Fixed dt at level 0 is: 10 Timestep hierarchy (remora.do_substep = 1, remora.ndtfast = 10, nfast = 15) ================== Level Ref ratio Substeps Fast steps Slow dt Fast dt per lev-1 per lev-0 (s) (s) 0 --- 1 10 10.0000 1.0000 [Level 0 step 1] ADVANCE from time = 0 to 10 with dt = 10 [Level 0 step 1] Advanced 400 cells Coarse STEP 1 ends. TIME = 10 DT = 10 Timestep time = 0.358908184 seconds. TIME = 10 KIN. ENG. = 1998786.81941636 VOLUME = 9522564742.37573 MAX. VEL. = 0.0509910163028722 Coarse STEP 2 starts ... Using cfl = 0.8 advective limit at level 0: 5485.075311 gravity wave limit at level 0: 41.5920109 (ndtfast = 10) Slow dt at level 0 would be: 41.5920109 Fixed dt at level 0 is: 10 [Level 0 step 2] ADVANCE from time = 10 to 20 with dt = 10 [Level 0 step 2] Advanced 400 cells Coarse STEP 2 ends. TIME = 20 DT = 10 Timestep time = 0.355017542 seconds. TIME = 20 KIN. ENG. = 2174635.33207924 VOLUME = 9522443041.86254 MAX. VEL. = 0.051359847460658 Coarse STEP 3 starts ... Using cfl = 0.8 advective limit at level 0: 6771.375848 gravity wave limit at level 0: 41.5920109 (ndtfast = 10) Slow dt at level 0 would be: 41.5920109 Fixed dt at level 0 is: 10 [Level 0 step 3] ADVANCE from time = 20 to 30 with dt = 10 [Level 0 step 3] Advanced 400 cells Coarse STEP 3 ends. TIME = 30 DT = 10 Timestep time = 0.363419119 seconds. TIME = 30 KIN. ENG. = 2447317.05942596 VOLUME = 9522258587.79573 MAX. VEL. = 0.0546662394708149 Coarse STEP 4 starts ... Using cfl = 0.8 advective limit at level 0: 4673.075423 gravity wave limit at level 0: 41.5920109 (ndtfast = 10) Slow dt at level 0 would be: 41.5920109 Fixed dt at level 0 is: 10 [Level 0 step 4] ADVANCE from time = 30 to 40 with dt = 10 [Level 0 step 4] Advanced 400 cells Coarse STEP 4 ends. TIME = 40 DT = 10 Timestep time = 0.354690443 seconds. TIME = 40 KIN. ENG. = 2736608.6225962 VOLUME = 9522058953.84914 MAX. VEL. = 0.0593504995901839 Coarse STEP 5 starts ... Using cfl = 0.8 advective limit at level 0: 4746.797247 gravity wave limit at level 0: 41.5920109 (ndtfast = 10) Slow dt at level 0 would be: 41.5920109 Fixed dt at level 0 is: 10 [Level 0 step 5] ADVANCE from time = 40 to 50 with dt = 10 [Level 0 step 5] Advanced 400 cells Coarse STEP 5 ends. TIME = 50 DT = 10 Timestep time = 0.363355515 seconds. TIME = 50 KIN. ENG. = 3028667.35422309 VOLUME = 9521896915.7594 MAX. VEL. = 0.0623788109609342 Coarse STEP 6 starts ... Using cfl = 0.8 advective limit at level 0: 6908.048702 gravity wave limit at level 0: 41.5920109 (ndtfast = 10) Slow dt at level 0 would be: 41.5920109 Fixed dt at level 0 is: 10 [Level 0 step 6] ADVANCE from time = 50 to 60 with dt = 10 [Level 0 step 6] Advanced 400 cells Coarse STEP 6 ends. TIME = 60 DT = 10 Timestep time = 0.354780647 seconds. TIME = 60 KIN. ENG. = 3388607.05760041 VOLUME = 9521814847.45625 MAX. VEL. = 0.065839159139748 Coarse STEP 7 starts ... Using cfl = 0.8 advective limit at level 0: 6186.500823 gravity wave limit at level 0: 41.5920109 (ndtfast = 10) Slow dt at level 0 would be: 41.5920109 Fixed dt at level 0 is: 10 [Level 0 step 7] ADVANCE from time = 60 to 70 with dt = 10 [Level 0 step 7] Advanced 400 cells Coarse STEP 7 ends. TIME = 70 DT = 10 Timestep time = 0.363347066 seconds. TIME = 70 KIN. ENG. = 3860191.89347686 VOLUME = 9521841029.58328 MAX. VEL. = 0.0697075389283488 Coarse STEP 8 starts ... Using cfl = 0.8 advective limit at level 0: 4334.648808 gravity wave limit at level 0: 41.5920109 (ndtfast = 10) Slow dt at level 0 would be: 41.5920109 Fixed dt at level 0 is: 10 [Level 0 step 8] ADVANCE from time = 70 to 80 with dt = 10 [Level 0 step 8] Advanced 400 cells Coarse STEP 8 ends. TIME = 80 DT = 10 Timestep time = 0.35475951 seconds. TIME = 80 KIN. ENG. = 4480250.43878997 VOLUME = 9521980074.43116 MAX. VEL. = 0.0718148821004966 Coarse STEP 9 starts ... Using cfl = 0.8 advective limit at level 0: 4604.347437 gravity wave limit at level 0: 41.5920109 (ndtfast = 10) Slow dt at level 0 would be: 41.5920109 Fixed dt at level 0 is: 10 [Level 0 step 9] ADVANCE from time = 80 to 90 with dt = 10 [Level 0 step 9] Advanced 400 cells Coarse STEP 9 ends. TIME = 90 DT = 10 Timestep time = 0.363231327 seconds. TIME = 90 KIN. ENG. = 5321988.71039935 VOLUME = 9522207820.41252 MAX. VEL. = 0.0746428618043657 Coarse STEP 10 starts ... Using cfl = 0.8 advective limit at level 0: 5114.545427 gravity wave limit at level 0: 41.5920109 (ndtfast = 10) Slow dt at level 0 would be: 41.5920109 Fixed dt at level 0 is: 10 [Level 0 step 10] ADVANCE from time = 90 to 100 with dt = 10 [Level 0 step 10] Advanced 400 cells Coarse STEP 10 ends. TIME = 100 DT = 10 Timestep time = 0.354745317 seconds. TIME = 100 KIN. ENG. = 6429221.96546877 VOLUME = 9522478036.62041 MAX. VEL. = 0.0774619244924532 Writing plotfile IdealMiniGrid_synth_hires-restart_plt00010 Total Time: 3.981140677 Unused ParmParse Variables: [TOP]::amr.check_int(nvals = 1) :: [5] [TOP]::amr.checkpoint_files_output(nvals = 1) :: [1] Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [3315 ... 4339] [The Arena] max space (MB) allocated spread across MPI: [1024 ... 1024] [The Arena] max space (MB) used spread across MPI: [9 ... 9] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Pinned Arena] max space (MB) used spread across MPI: [0 ... 0] AMReX (26.10-76-g347a3a2d2675) finalized Initializing AMReX (26.10-76-g347a3a2d2675)... MPI initialized with 4 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.10-76-g347a3a2d2675) initialized Successfully read inputs file ... REMORA git hash: v1.7-201-gfd71b79b AMReX git hash: 26.10-76-g347a3a2d26 WARNING: subcycling refined levels in time is EXPERIMENTAL. Multi-level answers are not yet considered production quality; check them against a single-level run before relying on them. remora.do_substep = 0 selects the older lockstep driver instead. [REMORA] Active E-P source: bulk evap-rain diagnostic. Refinement ratio at level 0 set to be 3 3 1 Creating new distribution map on level: 0 Making level 0 from scratch GRIDS AT LEVEL 0 ARE (BoxArray maxbox(4) m_ref->m_hash_sig(0) ((0,0,0) (4,4,3) (0,0,0)) ((5,0,0) (9,4,3) (0,0,0)) ((0,5,0) (4,9,3) (0,0,0)) ((5,5,0) (9,9,3) (0,0,0)) ) Reading high resolution bathymetry and grid data Loading high resolution bathymetry from NetCDF file hires_grd.nc Loading high resolution grid variables from NetCDF file hires_grd.nc Done reading in high resolution bathymetry and grid data Reading high resolution initial data Loading initial solution data from NetCDF file hires_ini.nc Loading initial sea surface height from NetCDF file hires_ini.nc Done reading in high resolution initial data Writing plotfile IdealMiniGrid_synth_hires-restart_plt00000 TIME = 0 KIN. ENG. = 1941079.06513775 VOLUME = 9522606688.29065 MAX. VEL. = 0.0509512910885042 Using cfl = 0.8 advective limit at level 0: 9045.579144 gravity wave limit at level 0: 41.5920109 (ndtfast = 10) Slow dt at level 0 would be: 41.5920109 Fixed dt at level 0 is: 10 Coarse STEP 1 starts ... Using cfl = 0.8 advective limit at level 0: 9045.579144 gravity wave limit at level 0: 41.5920109 (ndtfast = 10) Slow dt at level 0 would be: 41.5920109 Fixed dt at level 0 is: 10 Timestep hierarchy (remora.do_substep = 1, remora.ndtfast = 10, nfast = 15) ================== Level Ref ratio Substeps Fast steps Slow dt Fast dt per lev-1 per lev-0 (s) (s) 0 --- 1 10 10.0000 1.0000 [Level 0 step 1] ADVANCE from time = 0 to 10 with dt = 10 [Level 0 step 1] Advanced 400 cells Coarse STEP 1 ends. TIME = 10 DT = 10 Timestep time = 0.358925616 seconds. TIME = 10 KIN. ENG. = 1998786.81941636 VOLUME = 9522564742.37573 MAX. VEL. = 0.0509910163028722 Coarse STEP 2 starts ... Using cfl = 0.8 advective limit at level 0: 5485.075311 gravity wave limit at level 0: 41.5920109 (ndtfast = 10) Slow dt at level 0 would be: 41.5920109 Fixed dt at level 0 is: 10 [Level 0 step 2] ADVANCE from time = 10 to 20 with dt = 10 [Level 0 step 2] Advanced 400 cells Coarse STEP 2 ends. TIME = 20 DT = 10 Timestep time = 0.354667924 seconds. TIME = 20 KIN. ENG. = 2174635.33207924 VOLUME = 9522443041.86254 MAX. VEL. = 0.051359847460658 Coarse STEP 3 starts ... Using cfl = 0.8 advective limit at level 0: 6771.375848 gravity wave limit at level 0: 41.5920109 (ndtfast = 10) Slow dt at level 0 would be: 41.5920109 Fixed dt at level 0 is: 10 [Level 0 step 3] ADVANCE from time = 20 to 30 with dt = 10 [Level 0 step 3] Advanced 400 cells Coarse STEP 3 ends. TIME = 30 DT = 10 Timestep time = 0.363394646 seconds. TIME = 30 KIN. ENG. = 2447317.05942596 VOLUME = 9522258587.79573 MAX. VEL. = 0.0546662394708149 Coarse STEP 4 starts ... Using cfl = 0.8 advective limit at level 0: 4673.075423 gravity wave limit at level 0: 41.5920109 (ndtfast = 10) Slow dt at level 0 would be: 41.5920109 Fixed dt at level 0 is: 10 [Level 0 step 4] ADVANCE from time = 30 to 40 with dt = 10 [Level 0 step 4] Advanced 400 cells Coarse STEP 4 ends. TIME = 40 DT = 10 Timestep time = 0.354588011 seconds. TIME = 40 KIN. ENG. = 2736608.6225962 VOLUME = 9522058953.84914 MAX. VEL. = 0.0593504995901839 Coarse STEP 5 starts ... Using cfl = 0.8 advective limit at level 0: 4746.797247 gravity wave limit at level 0: 41.5920109 (ndtfast = 10) Slow dt at level 0 would be: 41.5920109 Fixed dt at level 0 is: 10 [Level 0 step 5] ADVANCE from time = 40 to 50 with dt = 10 [Level 0 step 5] Advanced 400 cells Coarse STEP 5 ends. TIME = 50 DT = 10 Timestep time = 0.363184191 seconds. TIME = 50 KIN. ENG. = 3028667.35422309 VOLUME = 9521896915.7594 MAX. VEL. = 0.0623788109609342 Coarse STEP 6 starts ... Using cfl = 0.8 advective limit at level 0: 6908.048702 gravity wave limit at level 0: 41.5920109 (ndtfast = 10) Slow dt at level 0 would be: 41.5920109 Fixed dt at level 0 is: 10 [Level 0 step 6] ADVANCE from time = 50 to 60 with dt = 10 [Level 0 step 6] Advanced 400 cells Coarse STEP 6 ends. TIME = 60 DT = 10 Timestep time = 0.35465999 seconds. TIME = 60 KIN. ENG. = 3388607.05760041 VOLUME = 9521814847.45625 MAX. VEL. = 0.065839159139748 Coarse STEP 7 starts ... Using cfl = 0.8 advective limit at level 0: 6186.500823 gravity wave limit at level 0: 41.5920109 (ndtfast = 10) Slow dt at level 0 would be: 41.5920109 Fixed dt at level 0 is: 10 [Level 0 step 7] ADVANCE from time = 60 to 70 with dt = 10 [Level 0 step 7] Advanced 400 cells Coarse STEP 7 ends. TIME = 70 DT = 10 Timestep time = 0.363179897 seconds. TIME = 70 KIN. ENG. = 3860191.89347686 VOLUME = 9521841029.58328 MAX. VEL. = 0.0697075389283488 Coarse STEP 8 starts ... Using cfl = 0.8 advective limit at level 0: 4334.648808 gravity wave limit at level 0: 41.5920109 (ndtfast = 10) Slow dt at level 0 would be: 41.5920109 Fixed dt at level 0 is: 10 [Level 0 step 8] ADVANCE from time = 70 to 80 with dt = 10 [Level 0 step 8] Advanced 400 cells Coarse STEP 8 ends. TIME = 80 DT = 10 Timestep time = 0.354399305 seconds. TIME = 80 KIN. ENG. = 4480250.43878997 VOLUME = 9521980074.43116 MAX. VEL. = 0.0718148821004966 Coarse STEP 9 starts ... Using cfl = 0.8 advective limit at level 0: 4604.347437 gravity wave limit at level 0: 41.5920109 (ndtfast = 10) Slow dt at level 0 would be: 41.5920109 Fixed dt at level 0 is: 10 [Level 0 step 9] ADVANCE from time = 80 to 90 with dt = 10 [Level 0 step 9] Advanced 400 cells Coarse STEP 9 ends. TIME = 90 DT = 10 Timestep time = 0.363102417 seconds. TIME = 90 KIN. ENG. = 5321988.71039935 VOLUME = 9522207820.41252 MAX. VEL. = 0.0746428618043657 Coarse STEP 10 starts ... Using cfl = 0.8 advective limit at level 0: 5114.545427 gravity wave limit at level 0: 41.5920109 (ndtfast = 10) Slow dt at level 0 would be: 41.5920109 Fixed dt at level 0 is: 10 [Level 0 step 10] ADVANCE from time = 90 to 100 with dt = 10 [Level 0 step 10] Advanced 400 cells Coarse STEP 10 ends. TIME = 100 DT = 10 Timestep time = 0.354551006 seconds. TIME = 100 KIN. ENG. = 6429221.96546877 VOLUME = 9522478036.62041 MAX. VEL. = 0.0774619244924532 Writing plotfile IdealMiniGrid_synth_hires-restart_plt00010 Total Time: 3.951451117 Unused ParmParse Variables: [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] [TOP]::amr.restart(nvals = 1) :: [IdealMiniGrid_synth_hires-restart_chk00005] Total GPU global memory (MB) spread across MPI: [7965 ... 7965] Free GPU global memory (MB) spread across MPI: [3315 ... 4339] [The Arena] max space (MB) allocated spread across MPI: [1024 ... 1024] [The Arena] max space (MB) used spread across MPI: [9 ... 9] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Pinned Arena] max space (MB) used spread across MPI: [0 ... 0] AMReX (26.10-76-g347a3a2d2675) finalized