Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update JGDAS ENKF SELECT OBS JGLOBAL_ATMOS_ANALYSIS and JGLOBAL_ATMOS_ANALYSIS_CALC jobs #3092

Open
wants to merge 19 commits into
base: develop
Choose a base branch
from

Conversation

mingshichen-noaa
Copy link
Contributor

@mingshichen-noaa mingshichen-noaa commented Nov 12, 2024

Description

NCO has requested that each COM variable specify whether it is an input or an output. This completes that process for the global jgdas enkf select obs job and relevant .JGLOBAL_ATMOS_ANALYSIS and JGLOBAL_ATMOS_ANALYSIS_CALC jobs.

Refs #2451

Type of change

  • Maintenance (code refactor, clean-up, new CI test, etc.)

Change characteristics

  • Is this a breaking change (a change in existing functionality)? NO
  • Does this change require a documentation update? NO

How has this been tested?

  • Clone and build on RDHPCS
  • Cycled tests on Hercules
  • Forecast-only tests on Hercules

Checklist

  • Any dependent changes have been merged and published
  • My code follows the style guidelines of this project
  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas
  • My changes generate no new warnings
  • New and existing tests pass with my changes
  • I have made corresponding changes to the documentation if necessary

jobs/JGDAS_ENKF_SELECT_OBS Fixed Show resolved Hide resolved
Copy link
Contributor

@aerorahul aerorahul left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks good. I am no longer familiar w/ the IN and OUT of EnKF related data, so would appreciate a review from @CatherineThomas-NOAA @RussTreadon-NOAA

Copy link
Member

@KateFriedman-NOAA KateFriedman-NOAA left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good! Please resolve the shellcheck warning in jobs/JGDAS_ENKF_SELECT_OBS and then I can approve.

@TerrenceMcGuinness-NOAA TerrenceMcGuinness-NOAA removed the CI/CD Issue related to CI/CD label Nov 13, 2024
aerorahul
aerorahul previously approved these changes Nov 13, 2024
Copy link
Contributor

@aerorahul aerorahul left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks good to me.

Copy link
Member

@KateFriedman-NOAA KateFriedman-NOAA left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, thanks @mingshichen-noaa !

@WalterKolczynski-NOAA WalterKolczynski-NOAA added the CI-Hera-Ready **CM use only** PR is ready for CI testing on Hera label Nov 15, 2024
@emcbot emcbot removed the CI-Hera-Ready **CM use only** PR is ready for CI testing on Hera label Nov 15, 2024
@mingshichen-noaa
Copy link
Contributor Author

@aerorahul @WalterKolczynski-NOAA @KateFriedman-NOAA
Since JGDAS_ENKF_SELECT_OBS job is associated with JGLOBAL_ATMOS_ANALYSIS and JGLOBAL_ATMOS_ANALYSIS_CALC jobs, I have made changing the original COM_* variables into the corresponding COMIN_* or COMOUT_* variables. Please review the adding commits. Thanks in advance.

Copy link
Member

@KateFriedman-NOAA KateFriedman-NOAA left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good for the most part. Left one comment to resolve before approving. Thanks!

scripts/exglobal_atmos_analysis.sh Outdated Show resolved Hide resolved
@KateFriedman-NOAA
Copy link
Member

@mingshichen-noaa Since this PR now also includes COM updates for the analysis job, please update the PR title and description to reflect the file changeset. Thanks!

@mingshichen-noaa mingshichen-noaa changed the title Update JGDAS ENKF SELECT OBS job Update JGDAS ENKF SELECT OBS JGLOBAL_ATMOS_ANALYSIS and JGLOBAL_ATMOS_ANALYSIS_CALC jobs Nov 21, 2024
Copy link
Member

@KateFriedman-NOAA KateFriedman-NOAA left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

COM updates look good, thanks @mingshichen-noaa ! Approve pending successful completion of CI testing.

@mingshichen-noaa
Copy link
Contributor Author

@aerorahul @KateFriedman-NOAA @AntonMFernando-NOAA
Just now I checked COM to COMIN/COMOUT Tracker and found Anton planned to work on the two jobs ( JGLOBAL_ATMOS_ANALYSIS and JGLOBAL_ATMOS_ANALYSIS_CALC). Could you tell me how I should handle this case?

@KateFriedman-NOAA
Copy link
Member

@aerorahul @KateFriedman-NOAA @AntonMFernando-NOAA Just now I checked COM to COMIN/COMOUT Tracker and found Anton planned to work on the two jobs ( JGLOBAL_ATMOS_ANALYSIS and JGLOBAL_ATMOS_ANALYSIS_CALC). Could you tell me how I should handle this case?

@mingshichen-noaa Thanks for checking on this! Since the change for the eobs job requires companion updates to the analysis/analysis_calc jobs at the same time then it was necessary to submit the changes together. Hopefully @AntonMFernando-NOAA hasn't already done much work on those job scripts. :)

In the future, I suggest checking the spreadsheet sooner if you think you need to update other job scripts at the same time. If someone else has already assigned themself to that job then you should reach out to them to say you can take care of it within your work or collaborate with the other developer if they have already begun making changes. Hope that helps!

@KateFriedman-NOAA
Copy link
Member

@mingshichen-noaa please update the COM update tracking spreadsheet to reflect the analysis/analysis_calc job updates, thanks!

@mingshichen-noaa
Copy link
Contributor Author

@KateFriedman-NOAA
Thank you for your prompt reply and suggestion.

@mingshichen-noaa
Copy link
Contributor Author

@KateFriedman-NOAA @AntonMFernando-NOAA
I have updated https://docs.google.com/spreadsheets/d/1S4deVHNEgSR_6-q2lDOaXq4kW-4SmxurxH-q5iPVd6o/edit?pli=1&gid=0#gid=0 about

<style type="text/css"></style> JGLOBAL_ATMOS_ANALYSIS | Mingshi | 3092 | Yes |   -- | -- | -- | -- | -- JGLOBAL_ATMOS_ANALYSIS_CALC | Mingshi | 3092 | Yes |  

@mingshichen-noaa
Copy link
Contributor Author

@KateFriedman-NOAA
After I updated the title and description of the PR (#3092), I tried to update the branch. But attempt failed and got the information: "Head branch was modified. Review and try the merge again." Could you tell me how to figure it out? Thanks in advance.

@WalterKolczynski-NOAA WalterKolczynski-NOAA removed the CI-Hera-Failed **Bot use only** CI testing on Hera for this PR has failed label Nov 26, 2024
@KateFriedman-NOAA
Copy link
Member

@KateFriedman-NOAA After I updated the title and description of the PR (#3092), I tried to update the branch. But attempt failed and got the information: "Head branch was modified. Review and try the merge again." Could you tell me how to figure it out? Thanks in advance.

Did you figure it out @mingshichen-noaa ? I see pushes from develop into your PR branch.

@mingshichen-noaa
Copy link
Contributor Author

@KateFriedman-NOAA
I have figured it out. Thanks.

[[ -d "${COM_ATMOS_ANALYSIS}" ]] || mkdir -p "${COM_ATMOS_ANALYSIS}"
[[ -d "${COM_ATMOS_RESTART}" ]] || mkdir -p "${COM_ATMOS_RESTART}"
[[ -d "${COMOUT_ATMOS_ANALYSIS}" ]] || mkdir -p "${COMOUT_ATMOS_ANALYSIS}"
[[ -d "${COMIN_ATMOS_RESTART}" ]] || mkdir -p "${COMIN_ATMOS_RESTART}"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Shouldn't be creating an input directory.

Suggested change
[[ -d "${COMIN_ATMOS_RESTART}" ]] || mkdir -p "${COMIN_ATMOS_RESTART}"

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants