Skip to content

Conversation

@salamonpavel
Copy link
Collaborator

@salamonpavel salamonpavel commented Oct 6, 2025

Fixes issues resulting in producing empty jars.
Closes #124

@github-actions
Copy link

github-actions bot commented Oct 6, 2025

JaCoCo code coverage report - scala:2.11 - spark:2.4

There is no coverage information present for the Files changed

@github-actions
Copy link

github-actions bot commented Oct 6, 2025

JaCoCo code coverage report - scala:2.12 - spark:3.3

There is no coverage information present for the Files changed


override val directorySuffix = if (sparkVersion.startsWith("2")) s"-spark${sparkVersionMinor}" else "-spark3"

override val idSuffix: String =
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

please let's try to document these decisions - why it's needed. It's impossible to know from the code itself and these are bigger changes to the build

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yup, added some comments

Copy link
Contributor

@benedeki benedeki left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would just return to the previous version, only extend the version list and have one common dir for SPark 3.x

@benedeki
Copy link
Contributor

benedeki commented Oct 6, 2025

Also no connected issue again. 😔

@salamonpavel
Copy link
Collaborator Author

salamonpavel commented Oct 6, 2025

I would just return to the previous version, only extend the version list and have one common dir for SPark 3.x

I don't understand. Please explain in more detail because I cannot simply use the previous version, it wouldn't work. The changes I introduced were necessary, I wouldn't have introduced them otherwise.

@salamonpavel
Copy link
Collaborator Author

salamonpavel commented Oct 6, 2025

Also no connected issue again. 😔

Added the related bug ticket reference.

@salamonpavel
Copy link
Collaborator Author

I would just return to the previous version, only extend the version list and have one common dir for SPark 3.x

I don't understand. Please explain in more detail because I cannot simply use the previous version, it wouldn't work. The changes I introduced were necessary, I wouldn't have introduced them otherwise.

What I would rather suggest is to have also only one folder for Spark2 versions, that would simplify the build definition.

@salamonpavel
Copy link
Collaborator Author

Discussions above resolved on call.

Copy link
Contributor

@benedeki benedeki left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Seems to work, that's the goal.

@salamonpavel salamonpavel merged commit 97a4c3b into master Oct 7, 2025
3 checks passed
@salamonpavel salamonpavel deleted the bugfix/missing-sources branch October 7, 2025 11:56
import sbt.VirtualAxis._
import sbt.internal.ProjectMatrix
import sbtprojectmatrix.ProjectMatrixKeys._
import Dependencies._
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is duplicity, it's already here above

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Fix build problem in 0.6.2

4 participants