Skip to content

Thrust C: Cyberinfrastructure Services

Henri Casanova edited this page Mar 8, 2022 · 11 revisions

List of MODULES

  • C.1. Batch Schedulers [DONE]

    • Maybe add a question where you don't know the runtime characteristics (2+20/n hours) of your problem and have to figure them out.
    • Batch Scheduling: Perhaps add a last tab where jobs don't ask for exactly what they need time-wise?
    • Conservative vs. non-conservative backfilling
  • C.2. Google Cloud Functions

    • Scenario: some streaming service to do something?
    • Scenario: a data-science/AI/visualization service? Real-time video analysis...
      • Run the model, but also visualize it, and data flows from one to another
    • Register a few functions, some are cheap, some are expensive, some require a lot of data, some not
    • Perhaps a few dependencies as in Google Workflow?
    • Provision instances with min-max values
    • Deal with $ charging
    • basically pick min-max values and try to optimize time/$
    • Key issue: how to make it "real" without re-implementing the whole thing
      • Perhaps show some Python code with different ways of implementing the functions/workflow?