How to submit Spark jobs to EMR cluster from Airflow
StartDataEngineering StartDataEngineering
4.49K subscribers
12,283 views
269

 Published On Oct 25, 2020

In this video we go over the steps on how to create a temporary EMR cluster, submit jobs to it, wait for the jobs to complete and terminate the cluster, the Airflow-way.

Blog: https://www.startdataengineering.com/...

show more

Share/Embed