Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
kubernetes local should work with in process launcher (#601)
## Upstream SPARK-XXXXX ticket and PR link (if not applicable, explain) local kubernetes submission is not submitted upstream yet ## What changes were proposed in this pull request? In process launcher clobbers spark configuration with launcher port and secret overrides, resulting the local spark submit on the driver to connect to the port used by the cluster mode spark submit process. Spark drivers in k8s are hard coded to run spark-submit, so spark launcher overrides are inapplicable to them. Excluding the configurations from the config map properly signals the local backend to not try to connect to a launcher server
- Loading branch information