v1.8.1

• Update Hadoop, Scalaz and Circe to latest patch releases. (#24)

v1.7.3

• Update Hadoop, Scalaz and Circe to latest patch releases. (#25)

v1.7.2

• Upgrade all dependencies (Circe, Scalaz) except Spark/Parquet on the v1.7.x branch, allowing people still using Spark v2.1.x to continue using Pucket without upgrading. (#21)
  • This release might be useful to you because of issues with Spark and large Spark SQL jobs post v2.2.0. See https://issues.apache.org/jira/browse/SPARK-23801 for more information. However, in a nutshell, certain memory corruption issues now kill the job hard instead of being swept under the carpet, making large jobs potentially unstable.
  • This release may also be useful to you if you wish to continue using Avro with Pucket for the time being.

v1.8.0

• Upgrade all dependencies to latest version (most notably Spark to v2.3.0 and Parquet to v1.8.2). (#20)
• Remove support for Avro. Upgrading Spark to v2.3.0 meant finally dropping support for Avro because of Twitter Chill's lack of support for v1.8.0 of Avro, and it clashing with Parquet now requiring v1.8.0+. This means if you're an Avro user, you'll need to pin yourself to v1.7.1 or earlier (or roll your own Avro-Pucket integration, perhaps using the code from v1.7.1 as a starting point!)

v1.7.1

• Fix Twitter maven URL to be HTTPs which causes issues on SBT 1.0.2+ (#19).

v1.7.0

This is a maintenance release to upgrade the following dependencies:

• Hadoop from 2.7.3 to 2.7.4.
• Spark from 2.1.0 to 2.1.2.
• Circe from 0.7.0 to 0.8.0.
• Scalaz from 7.2.9 to 7.2.16.
• SLF4J and adapter libs from 1.7.24 to 1.7.25.

These should be non-breaking changes for you with the exception of
Circe, which is why we have bumped the major version to 1.7.0.

v1.6.0

• Catch parallel Pucket creation file contention and enable retries. There was a race-condition where if multiple threads/machines try to use findAndCreate at the same time, the command can fail. There are now options for retrying when this error occurs and the configuring wait time in between. Please be aware that pucket-core now has a new dependency on hadoop-hdfs, which could be a breaking change for you. (#16, #17)

v1.5.0

• Upgrade Thrift to 0.10.0 (#15).

v1.4.0

• Update all of the dependencies to the latest versions. This will be a breaking change for many. Please also check the transitive dependencies of this project to see if you need to exclude anything new. (#14)

v1.3.0

• Upgrade to Spark 2.0 (#12)