Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add goodness distance calculation for performance diagram #86

Open
11 of 22 tasks
jvigh opened this issue Apr 21, 2021 · 0 comments
Open
11 of 22 tasks

Add goodness distance calculation for performance diagram #86

jvigh opened this issue Apr 21, 2021 · 0 comments

Comments

@jvigh
Copy link

jvigh commented Apr 21, 2021

Add goodness distance calculation for performance diagram

The goal of this issue is to compute the Euclidean distance between the location of a particular set of probabilistic forecasts and the upper right-hand corner of the performance diagram. As long as the bias is within a range that is acceptable to the sponsor, this Euclidean distance represents a key aspect of the "goodness" of the forecast (high POD and high CSI/low FAR). These distances should be saved to output for later use in other performance evaluation tools such as scorecards. For additional background, see: https://docs.google.com/presentation/d/1cbPaF75E441OW_1LVahJUox6UrjlhPheEbjLfI9GOiI/edit#slide=id.p

Acceptance Testing

Prioritized in the following order (high to low):

  • RI evaluation data from Jonathan’s HFIP-PREDICT project (GRIP, FHLO, etc.)
  • TC genesis evaluation data from Dan Halperin’s TC genesis project (ask John Halley Gotway)
  • RI data from Paul’s Ensemble RI project (lots of ensemble data)
  • JTWC forecast and model data (1997-2021)

Describe tests required for new functionality.

Time Estimate

1 days

Sub-Issues

Consider breaking the new feature down into sub-issues.

  • Add a checkbox for each sub-issue here.

Relevant Deadlines

Tara and Jonathan need to have a recorded presentation with results by April 30.
If we get it done by May 28, it could go into RC1.

Funding Source

Use account key 2785041 (NOAA Hur Supp 1A-3-5 METplus) for time spent on this development.

Define the Metadata

Assignee

  • Select engineer(s) or no engineer required
  • Select scientist(s) or no scientist required

Labels

  • Select component(s)
  • Select priority
  • Select requestor(s)

Projects and Milestone

  • Review projects and select relevant Repository and Organization ones or add "alert:NEED PROJECT ASSIGNMENT" label
  • Select milestone to next major version milestone or "Future Versions"

Define Related Issue(s)

Consider the impact to the other METplus components.

New Feature Checklist

See the METplus Workflow for details.

  • Complete the issue definition above, including the Time Estimate and Funding source.
  • Fork this repository or create a branch of develop.
    Branch name: feature_<Issue Number>_<Description>
  • Complete the development and test your changes.
  • Add/update log messages for easier debugging.
  • Add/update unit tests.
  • Add/update documentation.
  • Push local changes to GitHub.
  • Submit a pull request to merge into develop.
    Pull request: feature <Issue Number> <Description>
  • Define the pull request metadata, as permissions allow.
    Select: Reviewer(s), Project(s), Milestone, and Linked issues
  • Iterate until the reviewer(s) accept and merge your changes.
  • Delete your fork or branch.
  • Close this issue.
@jvigh jvigh added the type: new feature Make it do something new label Apr 21, 2021
@jvigh jvigh changed the title feature/add_goodness_distance_calculation_for_performance_diagram feature/86_add_goodness_distance_calculation_for_performance_diagram Apr 21, 2021
@jvigh jvigh self-assigned this Apr 22, 2021
@jvigh jvigh added this to the METcalcpy-1.0 milestone Apr 22, 2021
@jvigh jvigh changed the title feature/86_add_goodness_distance_calculation_for_performance_diagram feature_86_add_goodness_distance_calculation_for_performance_diagram Apr 22, 2021
@jvigh jvigh changed the title feature_86_add_goodness_distance_calculation_for_performance_diagram Add goodness distance calculation for performance diagram Apr 22, 2021
@bikegeek bikegeek modified the milestones: METcalcpy-1.0, METcalcpy-1.1 May 12, 2021
@TaraJensen TaraJensen assigned hankenstein2 and unassigned bikegeek Jul 15, 2021
@TaraJensen TaraJensen removed the reporting: HSUP 1-3a Hurricane Supplemental Project 1-3a label Oct 3, 2021
@bikegeek bikegeek removed this from the METcalcpy-1.1 milestone Mar 1, 2023
@bikegeek bikegeek added this to the METcalcpy 2.1.0-beta2 milestone Mar 1, 2023
@JohnHalleyGotway JohnHalleyGotway modified the milestones: METcalcpy 2.1.0-beta2, METcalcpy 2.1.0 Mar 7, 2023
@hankenstein2 hankenstein2 removed their assignment May 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
No open projects
Status: 📋 Backlog
Development

No branches or pull requests

5 participants