feat: add support for array_contains expression#1163

Merged

andygrove merged 24 commits intoapache:mainfrom dharanad:support-array_contains

Jan 2, 2025

+34

Commits on Dec 11, 2024

Commits on Jan 1, 2025

chore: Move more expressions from core crate to spark-expr crate (apache#1152 )

andygrove
authored and
dharanad
committed
remove dead code (apache#1155 )

andygrove
authored and
dharanad
committed
fix: Spark 4.0-preview1 SPARK-47120 (apache#1156 )

kazuyukitanimura
authored and
dharanad
committed
chore: Move string kernels and expressions to spark-expr crate (apache#1164 )

andygrove
authored and
dharanad
committed
chore: Move remaining expressions to spark-expr crate + some minor refactoring (apache#1165 )

andygrove
authored and
dharanad
committed
chore: Add ignored tests for reading complex types from Parquet (apache#1167 )

andygrove
authored and
dharanad
committed
feat: Add Spark-compatible implementation of SchemaAdapterFactory (apache#1169 )

andygrove
authored and
dharanad
committed
fix: Document enabling comet explain plan usage in Spark (4.0) (apache#1176 )

parthchandra
authored and
dharanad
committed
test: enabling Spark tests with offHeap requirement (apache#1177 )

kazuyukitanimura
authored and
dharanad
committed
feat: Improve shuffle metrics (second attempt) (apache#1175 )

andygrove
authored and
dharanad
committed
fix: stddev_pop should not directly return 0.0 when count is 1.0 (apache#1184 )

viirya
authored and
dharanad
committed
feat: Make native shuffle compression configurable and respect spark.shuffle.compress (apache#1185 )

andygrove
authored and
dharanad
committed
minor: move shuffle classes from common to spark (apache#1193 )

andygrove
authored and
dharanad
committed
minor: refactor decodeBatches to make private in broadcast exchange (apache#1195 )

andygrove
authored and
dharanad
committed
minor: refactor prepare_output so that it does not require an ExecutionContext (apache#1194 )

andygrove
authored and
dharanad
committed
fix: fix missing explanation for then branch in case when (apache#1200 )

rluvaton
authored and
dharanad
committed
minor: remove unused source files (apache#1202 )

andygrove
authored and
dharanad
committed
chore: Upgrade to DataFusion 44.0.0-rc2 (apache#1154 )

authored and
dharanad
committed
Merge branch 'main' into support-array_contains
dharanad
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat: add support for array_contains expression#1163

Commits on Dec 11, 2024

feat: add support for array_contains expression

test: add unit test for array_contains function

Removes unnecessary case expression for handling null values

Commits on Jan 1, 2025

chore: Move more expressions from core crate to spark-expr crate (apache#1152 )

remove dead code (apache#1155 )

fix: Spark 4.0-preview1 SPARK-47120 (apache#1156 )

chore: Move string kernels and expressions to spark-expr crate (apache#1164 )

chore: Move remaining expressions to spark-expr crate + some minor refactoring (apache#1165 )

chore: Add ignored tests for reading complex types from Parquet (apache#1167 )

feat: Add Spark-compatible implementation of SchemaAdapterFactory (apache#1169 )

fix: Document enabling comet explain plan usage in Spark (4.0) (apache#1176 )

test: enabling Spark tests with offHeap requirement (apache#1177 )

feat: Improve shuffle metrics (second attempt) (apache#1175 )

fix: stddev_pop should not directly return 0.0 when count is 1.0 (apache#1184 )

feat: Make native shuffle compression configurable and respect `spark.shuffle.compress` (apache#1185 )

minor: move shuffle classes from common to spark (apache#1193 )

minor: refactor decodeBatches to make private in broadcast exchange (apache#1195 )

minor: refactor prepare_output so that it does not require an ExecutionContext (apache#1194 )

fix: fix missing explanation for then branch in case when (apache#1200 )

minor: remove unused source files (apache#1202 )

chore: Upgrade to DataFusion 44.0.0-rc2 (apache#1154 )

Merge branch 'main' into support-array_contains

Commits on Jan 2, 2025

update UT

fix typo in UT