Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUILD] Upgrade RoaringBitmap to 1.3.19 #49710

Draft
wants to merge 4 commits into
base: master
Choose a base branch
from

Conversation

LuciferYang
Copy link
Contributor

What changes were proposed in this pull request?

Why are the changes needed?

Does this PR introduce any user-facing change?

How was this patch tested?

Was this patch authored or co-authored using generative AI tooling?

@LuciferYang LuciferYang marked this pull request as draft January 28, 2025 11:24
@@ -356,6 +356,17 @@
<enabled>false</enabled>
</snapshots>
</repository>
<repository>
Copy link
Contributor Author

@LuciferYang LuciferYang Jan 28, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The new version of RoaringBitmap requires configuring additional repositories:

image

The second method requires additional configuration of a GitHub token, so Method One was chosen here.

@github-actions github-actions bot added the INFRA label Jan 28, 2025
@@ -25,7 +25,7 @@ on:
java:
required: false
type: string
default: 17
default: 21
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

will revert after test

@LuciferYang
Copy link
Contributor Author

Here is a discussion about republishing to Maven Central:

but it seems unclear when it will be republished to Maven Central instead of just JitPack and GitHub packages.

We also have the option to wait for the republish of RoaringBitmap on Maven Central before proceeding with the upgrade.

@@ -136,8 +136,8 @@
<artifactId>tink</artifactId>
</dependency>
<dependency>
<groupId>org.roaringbitmap</groupId>
<artifactId>RoaringBitmap</artifactId>
<groupId>com.github.RoaringBitmap.RoaringBitmap</groupId>
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh, interesting.

@@ -277,6 +277,7 @@ object SparkBuild extends PomBuild {
// Google Mirror of Maven Central, placed first so that it's used instead of flaky Maven Central.
// See https://storage-download.googleapis.com/maven-central/index.html for more info.
"gcs-maven-central-mirror" at "https://maven-central.storage-download.googleapis.com/maven2/",
"jitpack" at "https://jitpack.io",
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just wondering if this can cause a flakiness like the default Maven.

Due to the Apache Spark's high traffic, the Maven was flaky. So, we are using GCS Maven as the first cache here inevitably.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Understand your concerns. We can wait for a while longer to see if RoaringBitmap can resume its publish on Maven Central

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants