Skip to content

Latest commit

 

History

History
28 lines (26 loc) · 1.35 KB

README.md

File metadata and controls

28 lines (26 loc) · 1.35 KB
Raw

electron

This repository primarily consists of a Storm topology that can be used to acquire and store streaming, real-time physiologic monitoring data. The repository also includes code to generate random data for development and testing purposes, as well as a Zeppelin notebook with an example analytic application.

Instructions

  • Launch baikal-devenv through docker-compose (tested against tag v2.6.0.3)
git clone git@github.com:ComputationalHealth/baikal-devenv.git
cd baikal-devenv/compose
docker-compose up -d --build
  • Run HDFS startup.sh config script
docker exec hadoop-namenode /bin/bash startup.sh
  • Load Jupyter in browser, upload demo files
    • Run ZookeeperConfig.ipynb cells (this creates the node for Storm to store Kafka offsets)
  • Copy and load topology
    • Download or build shaded electron jar, then:
docker cp electron-1.0.0-shaded.jar supervisor:/
docker exec supervisor storm jar /electron-1.0.0-shaded.jar org.yale.comphealth.electron.topology.ConsumeSignalTopology
  • Load Zeppelin (port 9001)
    • Add Avro dependency/artifact to Spark interpreter: com.databricks:spark-avro_2.11:4.0.0
    • Import notebook from analytics/ElectronAnalytics.json