Customizing Spark Operator
Customizing Spark Operator
To customize the operator, you can follow the steps below:
- Compile Spark distribution with Kubernetes support as per Spark documentation.
- Create docker images to be used for Spark with docker-image tool.
- Create a new operator image based on the above image. You need to modify the
FROM
tag in the Dockerfile with your Spark image. - Build and push your operator image built above.
- Deploy the new image by modifying the /manifest/spark-operator-install/spark-operator.yaml file and specifying your operator image.
Feedback
Was this page helpful?
Glad to hear it! Please tell us how we can improve.
Sorry to hear that. Please tell us how we can improve.
Last modified June 22, 2024: Add docs for spark-operator (#3767) (b622672)