Introducing Amazon EMR on EKS job submission with Spark Operator and spark-submit
AWS Big Data
JUNE 6, 2023
In the following code, replace the EKS endpoint as well as the S3 bucket then run the script: /bin/spark-submit --class ValueZones --master k8s://EKS-ENDPOINT --conf spark.kubernetes.namespace=data-team-a --conf spark.kubernetes.container.image=608033475327.dkr.ecr.us-west-1.amazonaws.com/spark/emr-6.10.0:latest impl: org.apache.hadoop.fs.s3.EMRFSDelegate
Let's personalize your content