Fix Helm chart build issues and version consistency

- Correct Chart version from 2.4.0 to 2.3.0 to match VERSION file
- Fix version inconsistencies in spark-pi-kerberos.yaml example
- Update serviceAccount name in Kerberos example to use proper Helm chart service account
- Regenerate Helm chart README.md with updated version and Kerberos documentation
- Document JavaOptions interaction with Kerberos configuration

Signed-off-by: Jose Soto <[email protected]>
Signed-off-by: josecsotomorales <[email protected]>

Author: josecsotomorales

charts/spark-operator-chart/Chart.yaml

@@ -20,9 +20,9 @@ name: spark-operator
 
 description: A Helm chart for Spark on Kubernetes operator.
 
-version: 2.4.0
+version: 2.3.0
 
-appVersion: 2.4.0
+appVersion: 2.3.0
 
 keywords:
 - apache spark

charts/spark-operator-chart/README.md

@@ -1,6 +1,6 @@
 # spark-operator
 
-![Version: 2.4.0](https://img.shields.io/badge/Version-2.4.0-informational?style=flat-square) ![AppVersion: 2.4.0](https://img.shields.io/badge/AppVersion-2.4.0-informational?style=flat-square)
+![Version: 2.3.0](https://img.shields.io/badge/Version-2.3.0-informational?style=flat-square) ![AppVersion: 2.3.0](https://img.shields.io/badge/AppVersion-2.3.0-informational?style=flat-square)
 
 A Helm chart for Spark on Kubernetes operator.
 
@@ -173,7 +173,7 @@ See [helm uninstall](https://helm.sh/docs/helm/helm_uninstall) for command docum
 | spark.serviceAccount.automountServiceAccountToken | bool | `true` | Auto-mount service account token to the spark applications pods. |
 | spark.rbac.create | bool | `true` | Specifies whether to create RBAC resources for spark applications. |
 | spark.rbac.annotations | object | `{}` | Optional annotations for the spark application RBAC resources. |
-| spark.kerberos.enabled | bool | `false` | Enable Kerberos authentication support for Spark applications. |
+| spark.kerberos.enable | bool | `false` | Enable Kerberos authentication support for Spark applications. |
 | spark.kerberos.defaultPrincipal | string | `""` | Default Kerberos principal for authentication (can be overridden per application). Example: [email protected] |
 | spark.kerberos.defaultRealm | string | `""` | Default Kerberos realm (can be overridden per application). Example: EXAMPLE.COM |
 | spark.kerberos.defaultKDC | string | `""` | Default Kerberos KDC address (can be overridden per application). Example: kdc.example.com:88 |

docs/kerberos-support.md

@@ -150,6 +150,39 @@ spark.driver.extraJavaOptions=-Djava.security.krb5.conf=<config-path>
 spark.executor.extraJavaOptions=-Djava.security.krb5.conf=<config-path>
 ```
 
+### Integration with Existing Spark Configuration
+
+**JavaOptions Interaction:**
+When using Kerberos configuration, the operator automatically adds Kerberos-related JVM options to `spark.driver.extraJavaOptions` and `spark.executor.extraJavaOptions`. 
+
+⚠️ **Important**: If you specify `javaOptions` in your driver or executor specification, those options will **completely override** the Kerberos JVM options, potentially breaking Kerberos authentication. To use both Kerberos and custom JVM options, you have two options:
+
+**Option 1: Use sparkConf instead of javaOptions (Recommended)**
+```yaml
+spec:
+  sparkConf:
+    # Your custom JVM options - will be merged with Kerberos options
+    "spark.driver.extraJavaOptions": "-XX:+UseG1GC -Xms1g"
+    "spark.executor.extraJavaOptions": "-XX:+UseG1GC -Xms512m"
+  kerberos:
+    # Kerberos configuration
+```
+
+**Option 2: Include Kerberos options in your javaOptions**
+```yaml
+spec:
+  driver:
+    # Include both your options AND the Kerberos krb5.conf option
+    javaOptions: "-XX:+UseG1GC -Xms1g -Djava.security.krb5.conf=/etc/krb5-config/krb5.conf"
+  executor:
+    javaOptions: "-XX:+UseG1GC -Xms512m -Djava.security.krb5.conf=/etc/krb5-config/krb5.conf"
+  kerberos:
+    # Other Kerberos configuration
+```
+
+**SparkConf Interaction:**
+If you manually specify `spark.driver.extraJavaOptions` or `spark.executor.extraJavaOptions` in your `sparkConf`, the operator will **append** the Kerberos JVM options to those values, ensuring both your custom options and Kerberos authentication work together.
+
 ### Credential Renewal Strategies
 
 **Keytab-based Renewal (Recommended)**:

examples/spark-pi-kerberos.yaml

@@ -85,8 +85,8 @@ spec:
     coreLimit: "1200m"
     memory: "512m"
     labels:
-      version: 3.5.3
-    serviceAccount: spark
+      version: 4.0.0
+    serviceAccount: spark-operator-spark
     # Mount Kerberos keytab as secret
     secrets:
       - name: "spark-kerberos-keytab"
@@ -105,7 +105,7 @@ spec:
     instances: 1
     memory: "512m"
     labels:
-      version: 3.5.3
+      version: 4.0.0
     # Mount Kerberos keytab as secret
     secrets:
       - name: "spark-kerberos-keytab"
@@ -117,4 +117,4 @@ spec:
     # Set environment variables for Kerberos
     env:
       - name: "KRB5_CONFIG"
-        value: "/etc/kerberos/conf/krb5.conf"
+        value: "/etc/kerberos/conf/krb5.conf"