DM-45576: Start a nightly cronjob to post a brief summary #3
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
hsinfang
force-pushed
the
tickets/DM-45576
branch
2 times, most recently
from
2476bcc
to
e0468ea
Compare
Switch as this is just to get raw-image metadata.
hsinfang
force-pushed
the
tickets/DM-45576
branch
5 times, most recently
from
4be20b9
to
b5226fb
Compare
hsinfang
force-pushed
the
tickets/DM-45576
branch
3 times, most recently
from
b0a4741
to
ab85d84
Compare
ctslater
approved these changes
Sep 5, 2024
| output_lines.append(f" - {counts} to be investigated.") | ||
|
|
||
| output_lines.append( | ||
| f"<https://usdf-rsp-dev.slac.stanford.edu/times-square/github/lsst-sqre/times-square-usdf/prompt-processing/groups?date={day_obs}&instrument=LATISS&survey={survey}&mode=DEBUG&ts_hide_code=1|Timing plots>" |
There was a problem hiding this comment.
In that Times Square notebook, written before we started making this reporting tool, I wanted a "report" mode versus a "debug" mode. The former is brief and meant for people who don't care about PP internals. The latter has a lot more details which the PP team can use to know what might have gone wrong. Now we have this reporting tool, I probably can go back and think again whether it makes sense.
hsinfang
force-pushed
the
tickets/DM-45576
branch
2 times, most recently
from
1141fb5
to
19caa35
Compare
Started at w_2024_32
The number for single-frame-only processing as calculated here can become wrong as the implementations change, but useful for the time being. Using the existence of initial_pvi as the ProcessCcd success is confusing because calibrateImage can fail after generating initial_pvi. Using the last product of calibrateImage is not ideal either, but a little closer. Send message only if there are on-sky exposures. can_see_sky started to be a useable criteria starting w_2024_33. Using can_see_sky or science_program typically give the same results.
The name change happened on 2024-09-04
hsinfang
force-pushed
the
tickets/DM-45576
branch
from
19caa35
to
99afb23
Compare
Starting w_2024_37, the new Butler query system becomes public. Using explain=False so not to raise EmptyQueryResultError.
Now we also process some test surveys, constrain this report to the science survey only.
hsinfang
force-pushed
the
tickets/DM-45576
branch
from
ad69887
to
e6ed052
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.