Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 2 additions & 3 deletions content/reports/251003-contributors.md
Original file line number Diff line number Diff line change
@@ -1,13 +1,12 @@
---
type: contributors
description: |
Investigation of changes in Spark behaviour between TDP1 and TDP2
tdp-lib: a problem between Spark and YARN has been detected
---

# Notes from October 3rd, 2025

Iceberg tables created with Hive and Spark do not have the same default properties. For example, with the following properties:
table-override.external.table.purge and table-override.iceberg.orc.files.only.
In the tdp-lib YARN wants to create a symbolic link to the Spark3 JAR, but it cannot because Spark3 is deployed after YARN.

## Pull Requests

Expand Down
26 changes: 26 additions & 0 deletions content/reports/251024-contributors.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,26 @@
---
type: contributors
description: |
Accessing the spark ui through the resourceManager proxy requires double kerberos authentication when displaying an html file
---

# Notes from October 17th, 2025

Accessing the spark ui through the resourceManager proxy requires double kerberos authentication when displaying an html file.

## Pull Requests

Weekly review of open PRs (in chronological order):

- [tdp-observability#146](https://github.com/TOSIT-IO/tdp-observability/pull/146): status of "feat: do not send stats" PR Merged.
- [tdp-observability#147](https://github.com/TOSIT-IO/tdp-observability/pull/147): status of "fix: hide passwords in ansible logs" PR Merged.
- [tdp-observability#148](https://github.com/TOSIT-IO/tdp-observability/pull/148): status of "feat(playbooks): added start, restart and stop meta" PR Merged.
- [tdp-collection#988](https://github.com/TOSIT-IO/tdp-collection/pull/988): status of "correctly configure jhs and spark_hs in ha mode" Ongoing Investigations.
- [tdp-collection-extras#235](https://github.com/TOSIT-IO/tdp-collection-extras/pull/235): status of "feat(hue): add jhs and spark_hs in ha mode in hue" Ongoing Investigations.
- [tdp-collection-extras#237](https://github.com/TOSIT-IO/tdp-collection-extras/pull/237): status of "fix(hue): remove access_fqdn for phoenix_queryserver in commentary" PR Merged.
- [tdp-collection-extras#238](https://github.com/TOSIT-IO/tdp-collection-extras/pull/238): status of "fix: hide passwords in ansible logs" PR Merged.
- [tdp-lib#677](https://github.com/TOSIT-IO/tdp-lib/pull/677): status of "feat(deployment_model): added the option to plan a dag with components from only one host" PR Merged.

## Open Topics

Accessing the spark ui through the resourceManager proxy requires double kerberos authentication when displaying an html file. An investigation is underway.