Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update analysis jobs to use COMIN/COMOUT #3034

Draft
wants to merge 22 commits into
base: develop
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
22 commits
Select commit Hold shift + click to select a range
de7ac3a
modified JGLOBAL_ATMOS_ANALYSIS
AntonMFernando-NOAA Oct 24, 2024
577145d
modify JGLOBAL_ATM_ANALYSIS_INITIALIZE
AntonMFernando-NOAA Oct 24, 2024
dab0064
modifed scripts\exglobal_atmos_analysis.sh
AntonMFernando-NOAA Oct 24, 2024
880d95e
Merge branch 'NOAA-EMC:develop' into feature/COM_IN_OUT
AntonMFernando-NOAA Oct 24, 2024
0ac52ad
Merge branch 'NOAA-EMC:develop' into feature/COM_IN_OUT
AntonMFernando-NOAA Oct 25, 2024
89fb14c
Merge branch 'NOAA-EMC:develop' into feature/COM_IN_OUT
AntonMFernando-NOAA Oct 29, 2024
db2274c
Merge branch 'NOAA-EMC:develop' into feature/COM_IN_OUT
AntonMFernando-NOAA Oct 30, 2024
ebb21e4
Merge branch 'NOAA-EMC:develop' into feature/COM_IN_OUT
AntonMFernando-NOAA Oct 31, 2024
09e289b
Merge branch 'NOAA-EMC:develop' into feature/COM_IN_OUT
AntonMFernando-NOAA Nov 1, 2024
cc75949
Merge branch 'NOAA-EMC:develop' into feature/COM_IN_OUT
AntonMFernando-NOAA Nov 2, 2024
e61b8c8
modified JGLOBAL_ATMENS_ANALYSIS_FINALIZE variable
AntonMFernando-NOAA Nov 5, 2024
1d0c4ad
discard changes COM_ATMOS_HISTORY_ENS_PREV
AntonMFernando-NOAA Nov 5, 2024
3ca6a04
modify jobs\JGLOBAL_ATM_ANALYSIS_INITIALIZE
AntonMFernando-NOAA Nov 5, 2024
ddafea7
modified jobs\JGDAS_ENKF_SELECT_OBS
AntonMFernando-NOAA Nov 5, 2024
2fb13a4
modified jobs\JGDAS_ENKF_SELECT_OBS
AntonMFernando-NOAA Nov 5, 2024
e7487c1
Merge branch 'NOAA-EMC:develop' into feature/COM_IN_OUT
AntonMFernando-NOAA Nov 9, 2024
697cb82
Merge branch 'NOAA-EMC:develop' into feature/COM_IN_OUT
AntonMFernando-NOAA Nov 12, 2024
cca6c47
Merge branch 'NOAA-EMC:develop' into feature/COM_IN_OUT
AntonMFernando-NOAA Nov 13, 2024
0f7c3b6
Merge branch 'NOAA-EMC:develop' into feature/COM_IN_OUT
AntonMFernando-NOAA Nov 14, 2024
9b8ab32
Merge branch 'NOAA-EMC:develop' into feature/COM_IN_OUT
AntonMFernando-NOAA Nov 19, 2024
53da5a5
Merge branch 'NOAA-EMC:develop' into feature/COM_IN_OUT
AntonMFernando-NOAA Nov 19, 2024
d7b156b
Merge branch 'develop' into feature/COM_IN_OUT
AntonMFernando-NOAA Dec 1, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions jobs/JGLOBAL_ATMENS_ANALYSIS_FINALIZE
Original file line number Diff line number Diff line change
Expand Up @@ -16,9 +16,9 @@ GDUMP_ENS="enkf${GDUMP}"
##############################################
# Generate COM variable from template
MEMDIR='ensstat' RUN=${GDUMP_ENS} YMD=${PDY} HH=${cyc} declare_from_tmpl -rx \
COM_ATMOS_ANALYSIS_ENS:COM_ATMOS_ANALYSIS_TMPL
COMOUT_ATMOS_ANALYSIS_ENS:COM_ATMOS_ANALYSIS_TMPL

mkdir -m 755 -p "${COM_ATMOS_ANALYSIS_ENS}"
mkdir -m 755 -p "${COMOUT_ATMOS_ANALYSIS_ENS}"

###############################################################
# Run relevant script
Expand Down
6 changes: 3 additions & 3 deletions ush/python/pygfs/task/atmens_analysis.py
Original file line number Diff line number Diff line change
Expand Up @@ -206,7 +206,7 @@ def finalize(self) -> None:

# ---- tar up diags
# path of output tar statfile
atmensstat = os.path.join(self.task_config.COM_ATMOS_ANALYSIS_ENS, f"{self.task_config.APREFIX}atmensstat")
atmensstat = os.path.join(self.task_config.COMOUT_ATMOS_ANALYSIS_ENS, f"{self.task_config.APREFIX}atmensstat")

# get list of diag files to put in tarball
diags = glob.glob(os.path.join(self.task_config.DATA, 'diags', 'diag*nc'))
Expand All @@ -231,10 +231,10 @@ def finalize(self) -> None:

# copy full YAML from executable to ROTDIR
for src in yamls:
logger.info(f"Copying {src} to {self.task_config.COM_ATMOS_ANALYSIS_ENS}")
logger.info(f"Copying {src} to {self.task_config.COMOUT_ATMOS_ANALYSIS_ENS}")
yaml_base = os.path.splitext(os.path.basename(src))[0]
dest_yaml_name = f"{self.task_config.RUN}.t{self.task_config.cyc:02d}z.{yaml_base}.yaml"
dest = os.path.join(self.task_config.COM_ATMOS_ANALYSIS_ENS, dest_yaml_name)
dest = os.path.join(self.task_config.COMOUT_ATMOS_ANALYSIS_ENS, dest_yaml_name)
logger.debug(f"Copying {src} to {dest}")
yaml_copy = {
'copy': [[src, dest]]
Expand Down