-
Notifications
You must be signed in to change notification settings - Fork 3
Thrust C: Cyberinfrastructure Services
Henri Casanova edited this page Mar 8, 2022
·
11 revisions
-
C.1. Batch Schedulers [DONE]
- Maybe add a question where you don't know the runtime characteristics (2+20/n hours) of your problem and have to figure them out.
- Batch Scheduling: Perhaps add a last tab where jobs don't ask for exactly what they need time-wise?
- Conservative vs. non-conservative backfilling
-
C.2. Google Cloud Functions
- Scenario: some streaming service to do something?
- Scenario: a data-science/AI/visualization service? Real-time video analysis...
- Run the model, but also visualize it, and data flows from one to another
- Register a few functions, some are cheap, some are expensive, some require a lot of data, some not
- Perhaps a few dependencies as in Google Workflow?
- Provision instances with min-max values
- Deal with $ charging
- basically pick min-max values and try to optimize time/$
- Key issue: how to make it "real" without re-implementing the whole thing
- Perhaps show some Python code with different ways of implementing the functions/workflow?