Demo for Running Spark Application on Kubernetes. Performs simple text analysis on CSV file. Reads and writes to an Azure Blob.
edu.harvard.codeone2018.sparkk8sdemo.MySparkLauncher
-Dmaster="k8s://{your kubernetes url}"
-DreadFileURI="wasb://code-one-2018@consilience2.blob.core.windows.net/wine_reviews500.csv"
-DdemoImage="registry.hub.docker.com/ellenkraffmiller/text-analysis:latest"
-DstorageKey="{azure storage account key}"
Quicktime movie of auto-scaling the SparkPI application on Kubernetes included in our presentation is here: https://youtu.be/_Y4_bWHAmPc