Search results

[SPARK-53064][CORE] Rewrite MDC LogKey in Java

CONNECT

CORE

DSTREAM

GRAPHX

KUBERNETES

ML

MLLIB

PYTHON

R

SQL

STRUCTURED STREAMING

WEB UI

YARN

Status: Open (in progress).

apache/sparknumber 51775

#51775 In apache/spark;

· pan3793 opened on Aug 1, 2025

[SPARK-53063][CORE] Remove inner references of deprecated APIs in FileCommitProtocol

CORE

SQL

STRUCTURED STREAMING

Status: Open (in progress).

apache/sparknumber 51772

#51772 In apache/spark;

· yaooqinn opened on Aug 1, 2025

[SPARK-53022][TESTS] Add MemoryConsumerBenchmark

CORE

Status: Open (in progress).

apache/sparknumber 51728

#51728 In apache/spark;

· zhztheplayer opened on Jul 30, 2025

[SPARK-53019][SQL] Fix job attempt path conflicts in o.a.hadoop..FileOutputCommitter

CORE

SQL

Status: Draft (not ready).

apache/sparknumber 51724

#51724 In apache/spark;

· yaooqinn opened on Jul 30, 2025

[SPARK-52980][PYTHON] Support Arrow Python UDTFs

BUILD

CONNECT

CORE

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51692

#51692 In apache/spark;

· allisonwang-db opened on Jul 28, 2025

[SPARK-52844][PYTHON][TESTS] Update black to 24.3.0

BUILD

CONNECT

CORE

DSTREAM

INFRA

ML

MLLIB

PANDAS API ON SPARK

PYTHON

SQL

STRUCTURED STREAMING

Status: Open (in progress).

apache/sparknumber 51687

#51687 In apache/spark;

· eschcam opened on Jul 28, 2025

[SPARK-52971] [PYTHON] Limit idle Python worker queue size

CORE

PYTHON

Status: Open (in progress).

apache/sparknumber 51684

#51684 In apache/spark;

· craiuconstantintiberiu opened on Jul 28, 2025

[SPARK-52943][PYTHON] Enable arrow_cast for all pandas UDF eval types

CORE

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51635

#51635 In apache/spark;

· benrobby opened on Jul 23, 2025

[SPARK-52923][CORE] Allow ShuffleManager to control push merge during shuffle registration

CORE

Status: Open (in progress).

apache/sparknumber 51629

#51629 In apache/spark;

· gaoyajun02 opened on Jul 23, 2025

[SPARK-52794][PYTHON] Performance improvement of arrow-optimized python UDTF with LocalDataToArrowConversion check

CORE

PYTHON

Status: Draft (not ready).

apache/sparknumber 51479

#51479 In apache/spark;

· asl3 opened on Jul 14, 2025

[SPARK-52790][CORE] Introduce new grid testing method in SparkFunSuite

CORE

SQL

Status: Open (in progress).

apache/sparknumber 51474

#51474 In apache/spark;

· urosstan-db opened on Jul 14, 2025

[SPARK-46912][CORE] Using correct environment variables on workers of StandAlone cluster

CORE

Status: Open (in progress).

apache/sparknumber 51314

#51314 In apache/spark;

· MeltonSmith opened on Jun 28, 2025