Skip to content

Bump org.apache.parquet:parquet-avro from 1.13.1 to 1.15.1 in /pipelines/common in the maven group across 1 directory #1347

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

dependabot[bot]
Copy link
Contributor

@dependabot dependabot bot commented on behalf of github Apr 1, 2025

Bumps the maven group with 1 update in the /pipelines/common directory: org.apache.parquet:parquet-avro.

Updates org.apache.parquet:parquet-avro from 1.13.1 to 1.15.1

Release notes

Sourced from org.apache.parquet:parquet-avro's releases.

Apache Parquet Java 1.15.1

What's Changed

Full Changelog: apache/parquet-java@apache-parquet-1.15.0...apache-parquet-1.15.1

Apache Parquet 1.15.0

What's Changed

... (truncated)

Changelog

Sourced from org.apache.parquet:parquet-avro's changelog.

Parquet

From 1.14.2 onwards, the Parquet project has migrated from Jira to GitHub, and the changelogs are now published under Releases.

Version 1.14.1

Release Notes - Parquet - Version 1.14.1

Bug

  • PARQUET-2468 - ParquetMetadata.toPrettyJSON throws exception on file read when LOG.isDebugEnabled()
  • PARQUET-2498 - Hadoop vector IO API doesn't handle empty list of ranges

Version 1.14.0

Release Notes - Parquet - Version 1.14.0

Bug

  • PARQUET-2260 - Bloom filter bytes size shouldn't be larger than maxBytes size in the configuration
  • PARQUET-2266 - Fix support for files without ColumnIndexes
  • PARQUET-2276 - ParquetReader reads do not work with Hadoop version 2.8.5
  • PARQUET-2300 - Update jackson-core 2.13.4 to a version without CVE PRISMA-2023-0067
  • PARQUET-2325 - Fix parquet-cli's dictionary subcommand to work with FIXED_LEN_BYTE_ARRAY
  • PARQUET-2329 - Fix wrong help messages of parquet-cli subcommands
  • PARQUET-2330 - Fix convert-csv to show the correct position of the invalid record
  • PARQUET-2332 - Fix unexpectedly disabled tests to be executed
  • PARQUET-2336 - Add caching key to CodecFactory
  • PARQUET-2342 - Parquet writer produced a corrupted file due to page value count overflow
  • PARQUET-2343 - Fixes NPE when rewriting file with multiple rowgroups
  • PARQUET-2348 - Recompression/Re-encrypt should rewrite bloomfilter

... (truncated)

Commits
  • c7257b8 [maven-release-plugin] prepare release apache-parquet-1.15.1-rc0
  • 8e70eea GH-3168: Restrict trusted packages in the parquet-avro module (#3169)
  • 9d6e19f GH-3172: Do not drop blocks with some null values if DictionaryFilter is ap...
  • a19e985 GH-3133: Fix SizeStatistics to handle omitted histogram (#3135)
  • de3c2d0 Prepare for next development iteration
  • 010b067 [maven-release-plugin] prepare for next development iteration
  • 4665401 [maven-release-plugin] prepare release apache-parquet-1.15.0-rc2
  • cc782d9 GH-3086: Allow for empty beans (#3087)
  • c120d8f MINOR: Revert buildnumber-maven-plugin to 3.2.0 (#3082)
  • 2e07bed MINOR: Add shading for JDK22 specific classes (#3081)
  • Additional commits viewable in compare view

Dependabot compatibility score

You can trigger a rebase of this PR by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot merge will merge this PR after your CI passes on it
  • @dependabot squash and merge will squash and merge this PR after your CI passes on it
  • @dependabot cancel merge will cancel a previously requested merge and block automerging
  • @dependabot reopen will reopen this PR if it is closed
  • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
  • @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
  • @dependabot ignore <dependency name> major version will close this group update PR and stop Dependabot creating any more for the specific dependency's major version (unless you unignore this specific dependency's major version or upgrade to it yourself)
  • @dependabot ignore <dependency name> minor version will close this group update PR and stop Dependabot creating any more for the specific dependency's minor version (unless you unignore this specific dependency's minor version or upgrade to it yourself)
  • @dependabot ignore <dependency name> will close this group update PR and stop Dependabot creating any more for the specific dependency (unless you unignore this specific dependency or upgrade to it yourself)
  • @dependabot unignore <dependency name> will remove all of the ignore conditions of the specified dependency
  • @dependabot unignore <dependency name> <ignore condition> will remove the ignore condition of the specified dependency and ignore conditions
    You can disable automated security fix PRs for this repo from the Security Alerts page.

Note
Automatic rebases have been disabled on this pull request as it has been open for over 30 days.

@dependabot dependabot bot added dependencies Pull requests that update a dependency file java Pull requests that update java code labels Apr 1, 2025
Bumps the maven group with 1 update in the /pipelines/common directory: [org.apache.parquet:parquet-avro](https://github.com/apache/parquet-mr).


Updates `org.apache.parquet:parquet-avro` from 1.13.1 to 1.15.1
- [Release notes](https://github.com/apache/parquet-mr/releases)
- [Changelog](https://github.com/apache/parquet-java/blob/master/CHANGES.md)
- [Commits](apache/parquet-java@apache-parquet-1.13.1...apache-parquet-1.15.1)

---
updated-dependencies:
- dependency-name: org.apache.parquet:parquet-avro
  dependency-version: 1.15.1
  dependency-type: direct:production
  dependency-group: maven
...

Signed-off-by: dependabot[bot] <[email protected]>
@dependabot dependabot bot force-pushed the dependabot/maven/pipelines/common/maven-0e3a7f3a5c branch from 597f1e6 to ba836d5 Compare April 3, 2025 22:42
@codecov-commenter
Copy link

codecov-commenter commented Apr 4, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 50.81%. Comparing base (c8066a9) to head (c3449d9).
Report is 37 commits behind head on master.

Additional details and impacted files
@@             Coverage Diff              @@
##             master    #1347      +/-   ##
============================================
+ Coverage     50.74%   50.81%   +0.06%     
  Complexity      694      694              
============================================
  Files            90       90              
  Lines          5719     5719              
  Branches        776      776              
============================================
+ Hits           2902     2906       +4     
+ Misses         2532     2528       -4     
  Partials        285      285              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@bashir2
Copy link
Collaborator

bashir2 commented Apr 4, 2025

The e2e failures seem to be legit (repeated 3 times) and needs investigation: In the "Run E2E Test for Dockerized Controller and Spark Thriftserver" stage, it fails to create parquet files:

java.io.IOException: Could not read footer: java.lang.RuntimeException: file:/workspace/e2e-tests/controller-spark/dwh/controller_DWH_TIMESTAMP_2025_04_04T16_00_14_906025613Z/Patient/ConvertResourceFn_Patient_output-parquet-th-706-ts-1743782425545-r-743922.parquet is not a Parquet file (too small length: 0)

java.io.IOException: Could not read footer: java.lang.RuntimeException: file:/workspace/e2e-tests/controller-spark/dwh/controller_DWH_TIMESTAMP_2025_04_04T16_00_14_906025613Z/Encounter/ConvertResourceFn_Encounter_output-parquet-th-421-ts-1743782426570-r-329667.parquet is not a Parquet file (too small length: 0)

java.io.IOException: Could not read footer: java.lang.RuntimeException: file:/workspace/e2e-tests/controller-spark/dwh/controller_DWH_TIMESTAMP_2025_04_04T16_00_14_906025613Z/Observation/ConvertResourceFn_Observation_output-parquet-th-1435-ts-1743782428616-r-515271.parquet is not a Parquet file (too small length: 0)

SUCCESSE2E TEST FOR CONTROLLER PARQUET BASED DEPLOYMENT: Total patients: 
E2E TEST FOR CONTROLLER PARQUET BASED DEPLOYMENT: Total encounters: 
E2E TEST FOR CONTROLLER PARQUET BASED DEPLOYMENT: Total observations: 
E2E TEST FOR CONTROLLER PARQUET BASED DEPLOYMENT: Total patient flat rows: 0
E2E TEST FOR CONTROLLER PARQUET BASED DEPLOYMENT: Total encounter flat rows: 0
E2E TEST FOR CONTROLLER PARQUET BASED DEPLOYMENT: Total observation flat rows: 0
E2E TEST FOR CONTROLLER PARQUET BASED DEPLOYMENT: Mismatch in count of records
E2E TEST FOR CONTROLLER PARQUET BASED DEPLOYMENT: Actual total patients: , expected total: 79
E2E TEST FOR CONTROLLER PARQUET BASED DEPLOYMENT: Actual total encounters: , expected total: 4006
E2E TEST FOR CONTROLLER PARQUET BASED DEPLOYMENT: Total observations: , expected total: 17279
E2E TEST FOR CONTROLLER PARQUET BASED DEPLOYMENT: Actual total materialized view patients: 0, expected total: 106
E2E TEST FOR CONTROLLER PARQUET BASED DEPLOYMENT: Actual total materialized view encounters: 0, expected total: 4006
E2E TEST FOR CONTROLLER PARQUET BASED DEPLOYMENT: Actual total materialized view observations: 0, expected total: 17279

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dependencies Pull requests that update a dependency file java Pull requests that update java code
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants