Initializing AMReX (26.11-70-gbf732d66d082)... MPI initialized with 4 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.11-70-gbf732d66d082) initialized REMORA git hash: v1.7-333-g16cea08b AMReX git hash: 26.11-70-gbf732d66d0 [REMORA] Active E-P source: bulk evap-rain diagnostic. remora.drop_dry_boxes: built with particles, so no level-0 box is dropped. Making level 0 from scratch GRIDS AT LEVEL 0 ARE (BoxArray maxbox(4) m_ref->m_hash_sig(0) ((0,0,0) (4,7,19) (0,0,0)) ((5,0,0) (9,7,19) (0,0,0)) ((0,8,0) (4,15,19) (0,0,0)) ((5,8,0) (9,15,19) (0,0,0)) ) Calling init_clim_nudg_coeff_from_netcdf Loading nudging coefficients from NetCDF file idmini_nudge_v2_classic64.nc Climatology weights loaded from netcdf file Loading ubar from NetCDF file(s) Time variable 'ocean_time' in idmini_clm_v2_time_classic64.nc has units 'days' with no reference date; taking its times as days since the remora.time_ref reference date 2020-01-01 00:00:00 Loading vbar from NetCDF file(s) Time variable 'ocean_time' in idmini_clm_v2_time_classic64.nc has units 'days' with no reference date; taking its times as days since the remora.time_ref reference date 2020-01-01 00:00:00 Loading u from NetCDF file(s) Time variable 'ocean_time' in idmini_clm_v2_time_classic64.nc has units 'days' with no reference date; taking its times as days since the remora.time_ref reference date 2020-01-01 00:00:00 Loading v from NetCDF file(s) Time variable 'ocean_time' in idmini_clm_v2_time_classic64.nc has units 'days' with no reference date; taking its times as days since the remora.time_ref reference date 2020-01-01 00:00:00 Loading temp from NetCDF file(s) Time variable 'ocean_time' in idmini_clm_v2_time_classic64.nc has units 'days' with no reference date; taking its times as days since the remora.time_ref reference date 2020-01-01 00:00:00 Loading salt from NetCDF file(s) Time variable 'ocean_time' in idmini_clm_v2_time_classic64.nc has units 'days' with no reference date; taking its times as days since the remora.time_ref reference date 2020-01-01 00:00:00 Calling init_bdry_from_netcdf at level 0 Time variable 'ocean_time' in idmini_bry_v2_classic64.nc counts days since 2020-01-01 00:00:00, the remora.time_ref reference date Time variable 'ocean_time' in idmini_bry_v2_classic64.nc counts days since 2020-01-01 00:00:00, the remora.time_ref reference date Time variable 'ocean_time' in idmini_bry_v2_classic64.nc counts days since 2020-01-01 00:00:00, the remora.time_ref reference date Time variable 'ocean_time' in idmini_bry_v2_classic64.nc counts days since 2020-01-01 00:00:00, the remora.time_ref reference date Time variable 'ocean_time' in idmini_bry_v2_classic64.nc counts days since 2020-01-01 00:00:00, the remora.time_ref reference date Time variable 'ocean_time' in idmini_bry_v2_classic64.nc counts days since 2020-01-01 00:00:00, the remora.time_ref reference date Time variable 'ocean_time' in idmini_bry_v2_classic64.nc counts days since 2020-01-01 00:00:00, the remora.time_ref reference date Boundary data loaded from netcdf file Calling init_bathymetry_from_netcdf Loading initial bathymetry from NetCDF file idmini_grd_v1_classic64.nc Bathymetry loaded from netcdf file Calling init_grid_vars_from_netcdf Loading grid variables from NetCDF file idmini_grd_v1_classic64.nc Loading spherical psi coordinates from NetCDF file idmini_grd_v1_classic64.nc Loading spherical rho coordinates from NetCDF file idmini_grd_v1_classic64.nc Loading grid rotation angle from NetCDF file idmini_grd_v1_classic64.nc Grid variables loaded from netcdf file Loading grid variables from NetCDF file idmini_grd_v1_classic64.nc Loading spherical psi coordinates from NetCDF file idmini_grd_v1_classic64.nc Loading spherical rho coordinates from NetCDF file idmini_grd_v1_classic64.nc Loading grid rotation angle from NetCDF file idmini_grd_v1_classic64.nc Calling init_masks_from_netcdf level 0 Loading masks from NetCDF file idmini_grd_v1_classic64.nc Masks loaded from netcdf file Calling init_zeta_from_netcdf on level 0 Loading initial sea surface height from NetCDF file idmini_ini_v2_classic64.nc Sea surface height loaded from netcdf file Calling init_data_from_netcdf Loading initial solution data from NetCDF file idmini_ini_v2_classic64.nc Initial data loaded from netcdf file Calling init_coriolis_from_netcdf Loading initial coriolis from NetCDF file idmini_grd_v1_classic64.nc Coriolis loaded from netcdf file Writing plotfile IdealMiniGridClim-restart_plt00000 Coarse STEP 1 starts ... Reading in u at time index 1 from idmini_clm_v2_time_classic64.nc Reading in u at time index 0 from idmini_clm_v2_time_classic64.nc Reading in v at time index 1 from idmini_clm_v2_time_classic64.nc Reading in v at time index 0 from idmini_clm_v2_time_classic64.nc Reading in ubar at time index 1 from idmini_clm_v2_time_classic64.nc Reading in ubar at time index 0 from idmini_clm_v2_time_classic64.nc Reading in vbar at time index 1 from idmini_clm_v2_time_classic64.nc Reading in vbar at time index 0 from idmini_clm_v2_time_classic64.nc Reading in temp at time index 1 from idmini_clm_v2_time_classic64.nc Reading in temp at time index 0 from idmini_clm_v2_time_classic64.nc Reading in salt at time index 1 from idmini_clm_v2_time_classic64.nc Reading in salt at time index 0 from idmini_clm_v2_time_classic64.nc Coarse STEP 1 ends. TIME = 2000 DT = 2000 Coarse STEP 2 starts ... Coarse STEP 2 ends. TIME = 4000 DT = 2000 Coarse STEP 3 starts ... Coarse STEP 3 ends. TIME = 6000 DT = 2000 Coarse STEP 4 starts ... Coarse STEP 4 ends. TIME = 8000 DT = 2000 Coarse STEP 5 starts ... Coarse STEP 5 ends. TIME = 10000 DT = 2000 Coarse STEP 6 starts ... Coarse STEP 6 ends. TIME = 12000 DT = 2000 Coarse STEP 7 starts ... Coarse STEP 7 ends. TIME = 14000 DT = 2000 Coarse STEP 8 starts ... Coarse STEP 8 ends. TIME = 16000 DT = 2000 Coarse STEP 9 starts ... Coarse STEP 9 ends. TIME = 18000 DT = 2000 Coarse STEP 10 starts ... Coarse STEP 10 ends. TIME = 20000 DT = 2000 Writing plotfile IdealMiniGridClim-restart_plt00010 Unused ParmParse Variables: [TOP]::amr.check_int(nvals = 1) :: [5] [TOP]::amr.checkpoint_files_output(nvals = 1) :: [1] [TOP]::remora.bc.scalar.type(nvals = 4) :: [outflow, outflow, outflow, outflow] Total GPU global memory (MB) spread across MPI: [7784 ... 7784] Free GPU global memory (MB) spread across MPI: [3126 ... 3126] [The Arena] max space (MB) allocated spread across MPI: [1024 ... 1024] [The Arena] max space (MB) used spread across MPI: [10 ... 10] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Pinned Arena] max space (MB) used spread across MPI: [0 ... 0] AMReX (26.11-70-gbf732d66d082) finalized Initializing AMReX (26.11-70-gbf732d66d082)... MPI initialized with 4 MPI processes MPI initialized with thread support level 0 Initializing CUDA... CUDA initialized with 1 device. AMReX (26.11-70-gbf732d66d082) initialized REMORA git hash: v1.7-333-g16cea08b AMReX git hash: 26.11-70-gbf732d66d0 [REMORA] Active E-P source: bulk evap-rain diagnostic. remora.drop_dry_boxes: built with particles, so no level-0 box is dropped. Making level 0 from scratch GRIDS AT LEVEL 0 ARE (BoxArray maxbox(4) m_ref->m_hash_sig(0) ((0,0,0) (4,7,19) (0,0,0)) ((5,0,0) (9,7,19) (0,0,0)) ((0,8,0) (4,15,19) (0,0,0)) ((5,8,0) (9,15,19) (0,0,0)) ) Calling init_clim_nudg_coeff_from_netcdf Loading nudging coefficients from NetCDF file idmini_nudge_v2_classic64.nc Climatology weights loaded from netcdf file Loading ubar from NetCDF file(s) Time variable 'ocean_time' in idmini_clm_v2_time_classic64.nc has units 'days' with no reference date; taking its times as days since the remora.time_ref reference date 2020-01-01 00:00:00 Loading vbar from NetCDF file(s) Time variable 'ocean_time' in idmini_clm_v2_time_classic64.nc has units 'days' with no reference date; taking its times as days since the remora.time_ref reference date 2020-01-01 00:00:00 Loading u from NetCDF file(s) Time variable 'ocean_time' in idmini_clm_v2_time_classic64.nc has units 'days' with no reference date; taking its times as days since the remora.time_ref reference date 2020-01-01 00:00:00 Loading v from NetCDF file(s) Time variable 'ocean_time' in idmini_clm_v2_time_classic64.nc has units 'days' with no reference date; taking its times as days since the remora.time_ref reference date 2020-01-01 00:00:00 Loading temp from NetCDF file(s) Time variable 'ocean_time' in idmini_clm_v2_time_classic64.nc has units 'days' with no reference date; taking its times as days since the remora.time_ref reference date 2020-01-01 00:00:00 Loading salt from NetCDF file(s) Time variable 'ocean_time' in idmini_clm_v2_time_classic64.nc has units 'days' with no reference date; taking its times as days since the remora.time_ref reference date 2020-01-01 00:00:00 Calling init_bdry_from_netcdf at level 0 Time variable 'ocean_time' in idmini_bry_v2_classic64.nc counts days since 2020-01-01 00:00:00, the remora.time_ref reference date Time variable 'ocean_time' in idmini_bry_v2_classic64.nc counts days since 2020-01-01 00:00:00, the remora.time_ref reference date Time variable 'ocean_time' in idmini_bry_v2_classic64.nc counts days since 2020-01-01 00:00:00, the remora.time_ref reference date Time variable 'ocean_time' in idmini_bry_v2_classic64.nc counts days since 2020-01-01 00:00:00, the remora.time_ref reference date Time variable 'ocean_time' in idmini_bry_v2_classic64.nc counts days since 2020-01-01 00:00:00, the remora.time_ref reference date Time variable 'ocean_time' in idmini_bry_v2_classic64.nc counts days since 2020-01-01 00:00:00, the remora.time_ref reference date Time variable 'ocean_time' in idmini_bry_v2_classic64.nc counts days since 2020-01-01 00:00:00, the remora.time_ref reference date Boundary data loaded from netcdf file Calling init_bathymetry_from_netcdf Loading initial bathymetry from NetCDF file idmini_grd_v1_classic64.nc Bathymetry loaded from netcdf file Calling init_grid_vars_from_netcdf Loading grid variables from NetCDF file idmini_grd_v1_classic64.nc Loading spherical psi coordinates from NetCDF file idmini_grd_v1_classic64.nc Loading spherical rho coordinates from NetCDF file idmini_grd_v1_classic64.nc Loading grid rotation angle from NetCDF file idmini_grd_v1_classic64.nc Grid variables loaded from netcdf file Loading grid variables from NetCDF file idmini_grd_v1_classic64.nc Loading spherical psi coordinates from NetCDF file idmini_grd_v1_classic64.nc Loading spherical rho coordinates from NetCDF file idmini_grd_v1_classic64.nc Loading grid rotation angle from NetCDF file idmini_grd_v1_classic64.nc Calling init_masks_from_netcdf level 0 Loading masks from NetCDF file idmini_grd_v1_classic64.nc Masks loaded from netcdf file Calling init_zeta_from_netcdf on level 0 Loading initial sea surface height from NetCDF file idmini_ini_v2_classic64.nc Sea surface height loaded from netcdf file Calling init_data_from_netcdf Loading initial solution data from NetCDF file idmini_ini_v2_classic64.nc Initial data loaded from netcdf file Calling init_coriolis_from_netcdf Loading initial coriolis from NetCDF file idmini_grd_v1_classic64.nc Coriolis loaded from netcdf file Writing plotfile IdealMiniGridClim-restart_plt00000 Coarse STEP 1 starts ... Reading in u at time index 1 from idmini_clm_v2_time_classic64.nc Reading in u at time index 0 from idmini_clm_v2_time_classic64.nc Reading in v at time index 1 from idmini_clm_v2_time_classic64.nc Reading in v at time index 0 from idmini_clm_v2_time_classic64.nc Reading in ubar at time index 1 from idmini_clm_v2_time_classic64.nc Reading in ubar at time index 0 from idmini_clm_v2_time_classic64.nc Reading in vbar at time index 1 from idmini_clm_v2_time_classic64.nc Reading in vbar at time index 0 from idmini_clm_v2_time_classic64.nc Reading in temp at time index 1 from idmini_clm_v2_time_classic64.nc Reading in temp at time index 0 from idmini_clm_v2_time_classic64.nc Reading in salt at time index 1 from idmini_clm_v2_time_classic64.nc Reading in salt at time index 0 from idmini_clm_v2_time_classic64.nc Coarse STEP 1 ends. TIME = 2000 DT = 2000 Coarse STEP 2 starts ... Coarse STEP 2 ends. TIME = 4000 DT = 2000 Coarse STEP 3 starts ... Coarse STEP 3 ends. TIME = 6000 DT = 2000 Coarse STEP 4 starts ... Coarse STEP 4 ends. TIME = 8000 DT = 2000 Coarse STEP 5 starts ... Coarse STEP 5 ends. TIME = 10000 DT = 2000 Coarse STEP 6 starts ... Coarse STEP 6 ends. TIME = 12000 DT = 2000 Coarse STEP 7 starts ... Coarse STEP 7 ends. TIME = 14000 DT = 2000 Coarse STEP 8 starts ... Coarse STEP 8 ends. TIME = 16000 DT = 2000 Coarse STEP 9 starts ... Coarse STEP 9 ends. TIME = 18000 DT = 2000 Coarse STEP 10 starts ... Coarse STEP 10 ends. TIME = 20000 DT = 2000 Writing plotfile IdealMiniGridClim-restart_plt00010 Unused ParmParse Variables: [TOP]::amr.checkpoint_files_output(nvals = 1) :: [0] [TOP]::amr.restart(nvals = 1) :: [IdealMiniGridClim-restart_chk00005] [TOP]::remora.bc.scalar.type(nvals = 4) :: [outflow, outflow, outflow, outflow] Total GPU global memory (MB) spread across MPI: [7784 ... 7784] Free GPU global memory (MB) spread across MPI: [3126 ... 3126] [The Arena] max space (MB) allocated spread across MPI: [1024 ... 1024] [The Arena] max space (MB) used spread across MPI: [10 ... 10] [The Managed Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Managed Arena] max space (MB) used spread across MPI: [0 ... 0] [The Pinned Arena] max space (MB) allocated spread across MPI: [8 ... 8] [The Pinned Arena] max space (MB) used spread across MPI: [0 ... 0] AMReX (26.11-70-gbf732d66d082) finalized