GH-47443: [Python][Packaging] Drop Python 3.9 support #47478

raulcd · 2025-09-02T15:32:48Z

Rationale for this change

Python 3.9 is End of Support on 31st October 2025. We can drop support for pyarrow 22.0.0.
See: https://endoflife.date/python

What changes are included in this PR?

Remove support for 3.9. Update minimum required Python version and update some CI jobs to use the minimum Python supported version

Are these changes tested?

They will be tested via CI and Archery

Are there any user-facing changes?

Yes in terms of not supporting older versions of Python. This will be a breaking change for some users but not for the API itself

GitHub Issue: [Python][Packaging] Drop Python 3.9 support #47443

github-actions · 2025-09-02T15:33:14Z

⚠️ GitHub issue #47443 has been automatically assigned in GitHub to PR creator.

raulcd · 2025-09-03T12:11:57Z

@github-actions crossbow submit -g python

github-actions · 2025-09-03T12:14:41Z

Revision: e6a2ef8

Submitted crossbow builds: ursacomputing/crossbow @ actions-f2bbc8c456

Task	Status
example-python-minimal-build-fedora-conda
example-python-minimal-build-ubuntu-venv
test-conda-python-3.10
test-conda-python-3.10-hdfs-2.9.2
test-conda-python-3.10-hdfs-3.2.1
test-conda-python-3.10-pandas-1.3.4-numpy-1.21.2
test-conda-python-3.11
test-conda-python-3.11-dask-latest
test-conda-python-3.11-dask-upstream_devel
test-conda-python-3.11-hypothesis
test-conda-python-3.11-pandas-latest-numpy-latest
test-conda-python-3.11-spark-master
test-conda-python-3.12
test-conda-python-3.12-cpython-debug
test-conda-python-3.12-pandas-latest-numpy-1.26
test-conda-python-3.12-pandas-latest-numpy-latest
test-conda-python-3.12-pandas-nightly-numpy-nightly
test-conda-python-3.12-pandas-upstream_devel-numpy-nightly
test-conda-python-3.13
test-conda-python-emscripten
test-cuda-python-ubuntu-22.04-cuda-11.7.1
test-debian-12-python-3-amd64
test-debian-12-python-3-i386
test-fedora-42-python-3
test-ubuntu-22.04-python-3
test-ubuntu-22.04-python-313-freethreading
test-ubuntu-24.04-python-3

raulcd · 2025-09-03T13:00:09Z

@github-actions crossbow submit -g wheel

github-actions · 2025-09-03T13:03:04Z

Revision: e6a2ef8

Submitted crossbow builds: ursacomputing/crossbow @ actions-1fe0f5e10d

Task	Status
python-sdist
wheel-macos-monterey-cp310-cp310-amd64
wheel-macos-monterey-cp310-cp310-arm64
wheel-macos-monterey-cp311-cp311-amd64
wheel-macos-monterey-cp311-cp311-arm64
wheel-macos-monterey-cp312-cp312-amd64
wheel-macos-monterey-cp312-cp312-arm64
wheel-macos-monterey-cp313-cp313-amd64
wheel-macos-monterey-cp313-cp313-arm64
wheel-macos-monterey-cp313-cp313t-amd64
wheel-macos-monterey-cp313-cp313t-arm64
wheel-manylinux-2-28-cp310-cp310-amd64
wheel-manylinux-2-28-cp310-cp310-arm64
wheel-manylinux-2-28-cp311-cp311-amd64
wheel-manylinux-2-28-cp311-cp311-arm64
wheel-manylinux-2-28-cp312-cp312-amd64
wheel-manylinux-2-28-cp312-cp312-arm64
wheel-manylinux-2-28-cp313-cp313-amd64
wheel-manylinux-2-28-cp313-cp313-arm64
wheel-manylinux-2-28-cp313-cp313t-amd64
wheel-manylinux-2-28-cp313-cp313t-arm64
wheel-musllinux-1-2-cp310-cp310-amd64
wheel-musllinux-1-2-cp310-cp310-arm64
wheel-musllinux-1-2-cp311-cp311-amd64
wheel-musllinux-1-2-cp311-cp311-arm64
wheel-musllinux-1-2-cp312-cp312-amd64
wheel-musllinux-1-2-cp312-cp312-arm64
wheel-musllinux-1-2-cp313-cp313-amd64
wheel-musllinux-1-2-cp313-cp313-arm64
wheel-musllinux-1-2-cp313-cp313t-amd64
wheel-musllinux-1-2-cp313-cp313t-arm64
wheel-windows-cp310-cp310-amd64
wheel-windows-cp311-cp311-amd64
wheel-windows-cp312-cp312-amd64
wheel-windows-cp313-cp313-amd64
wheel-windows-cp313-cp313t-amd64

raulcd · 2025-09-03T13:50:38Z

@github-actions crossbow submit python-sdist

github-actions · 2025-09-03T13:52:54Z

Revision: 1a93e2d

Submitted crossbow builds: ursacomputing/crossbow @ actions-d6131de9fb

Task	Status
python-sdist

raulcd · 2025-09-03T13:55:21Z

@github-actions crossbow submit wheel-manylinux-cp312

raulcd · 2025-09-03T13:56:12Z

@github-actions crossbow submit almalinux-8-*

github-actions · 2025-09-03T13:57:37Z

Revision: d3b86df

Submitted crossbow builds: ursacomputing/crossbow @ actions-57dbfc6a95

Task	Status
wheel-manylinux-2-28-cp312-cp312-amd64
wheel-manylinux-2-28-cp312-cp312-arm64

github-actions · 2025-09-03T13:58:21Z

Revision: d3b86df

Submitted crossbow builds: ursacomputing/crossbow @ actions-8cec7add92

Task	Status
almalinux-8-amd64
almalinux-8-arm64

raulcd · 2025-09-03T14:30:28Z

@github-actions crossbow submit almalinux-8-*

github-actions · 2025-09-03T14:32:41Z

Revision: 59d506c

Submitted crossbow builds: ursacomputing/crossbow @ actions-85a6c18ceb

Task	Status
almalinux-8-amd64
almalinux-8-arm64

raulcd · 2025-09-03T14:55:43Z

@github-actions crossbow submit almalinux-8-*

github-actions · 2025-09-03T14:57:53Z

Revision: ea2eebb

Submitted crossbow builds: ursacomputing/crossbow @ actions-598c97696a

Task	Status
almalinux-8-amd64
almalinux-8-arm64

raulcd · 2025-09-03T15:43:43Z

@github-actions crossbow submit python-sdist

github-actions · 2025-09-03T15:46:15Z

Revision: ea2eebb

Submitted crossbow builds: ursacomputing/crossbow @ actions-11a353c12e

Task	Status
python-sdist

raulcd · 2025-09-04T08:51:27Z

@github-actions crossbow submit python-sdist

github-actions · 2025-09-04T08:53:43Z

Revision: bdf89f8

Submitted crossbow builds: ursacomputing/crossbow @ actions-b377de5dd0

Task	Status
python-sdist

raulcd · 2025-09-04T08:59:05Z

.github/workflows/python.yml

+            pandas: "1.3.4"
+            numpy: "1.21.2"


Those are the first two versions with Py3.10 support. I am not sure whether this job with lower bound versions is necessary maybe @jorisvandenbossche @WillAyd

I can't speak to the history of this job, but this seems right to do

raulcd · 2025-09-04T09:18:49Z

The Windows wheels failures are being tackled on a different PR where I am currently working on

kou

+1

python/pyproject.toml

Co-authored-by: Sutou Kouhei <[email protected]>

github-actions bot added Component: R Component: Python Component: Documentation awaiting committer review Awaiting committer review labels Sep 2, 2025

raulcd added 2 commits September 3, 2025 10:00

apacheGH-47443: [Python][Packaging] Drop Python 3.9 support

cb7da31

Fix quotes on yaml for 3.10 Python version

1908395

raulcd force-pushed the GH-47443 branch from 8603018 to 1908395 Compare September 3, 2025 08:00

raulcd added 3 commits September 3, 2025 10:56

Fix minimum pandas and numpy versions with Py 3.10 support

a3d52fc

Add also quotes to numpy to 'fix' docker failure

f3fd309

Fix job name for matrix

e6a2ef8

Fix sdist Dockerfile to use a newer Ubuntu

1a93e2d

Use Python3.12 on Almalinux 8

d3b86df

Fix Python package name for Almalinux 8

59d506c

Remove unnecessary link for pip3

ea2eebb

Fix test collection to not go infinite on sdist test

bdf89f8

raulcd commented Sep 4, 2025

View reviewed changes

github-actions bot added awaiting changes Awaiting changes and removed awaiting committer review Awaiting committer review labels Sep 4, 2025

raulcd mentioned this pull request Sep 4, 2025

GH-47321: [CI][Dev] Fix shellcheck errors in the ci/scripts/python_sdist_test.sh #47322

Merged

raulcd marked this pull request as ready for review September 4, 2025 09:18

raulcd requested review from assignUser, jonkeane, kou, thisisnic, AlenkaF and rok as code owners September 4, 2025 09:18

kou approved these changes Sep 4, 2025

View reviewed changes

python/pyproject.toml Outdated Show resolved Hide resolved

github-actions bot added awaiting merge Awaiting merge and removed awaiting changes Awaiting changes labels Sep 4, 2025

Remove unnecessary constraint from pyproject.toml

f1f17cd

Co-authored-by: Sutou Kouhei <[email protected]>

github-actions bot added awaiting changes Awaiting changes and removed awaiting merge Awaiting merge labels Sep 4, 2025

WillAyd approved these changes Sep 5, 2025

View reviewed changes

GH-47443: [Python][Packaging] Drop Python 3.9 support #47478

Are you sure you want to change the base?

GH-47443: [Python][Packaging] Drop Python 3.9 support #47478

Conversation

raulcd commented Sep 2, 2025 • edited by github-actions bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Rationale for this change

What changes are included in this PR?

Are these changes tested?

Are there any user-facing changes?

Uh oh!

github-actions bot commented Sep 2, 2025

Uh oh!

raulcd commented Sep 3, 2025

Uh oh!

github-actions bot commented Sep 3, 2025

Uh oh!

raulcd commented Sep 3, 2025

Uh oh!

github-actions bot commented Sep 3, 2025

Uh oh!

raulcd commented Sep 3, 2025

Uh oh!

github-actions bot commented Sep 3, 2025

Uh oh!

raulcd commented Sep 3, 2025

Uh oh!

raulcd commented Sep 3, 2025

Uh oh!

github-actions bot commented Sep 3, 2025

Uh oh!

github-actions bot commented Sep 3, 2025

Uh oh!

raulcd commented Sep 3, 2025

Uh oh!

github-actions bot commented Sep 3, 2025

Uh oh!

raulcd commented Sep 3, 2025

Uh oh!

github-actions bot commented Sep 3, 2025

Uh oh!

raulcd commented Sep 3, 2025

Uh oh!

github-actions bot commented Sep 3, 2025

Uh oh!

raulcd commented Sep 4, 2025

Uh oh!

github-actions bot commented Sep 4, 2025

Uh oh!

raulcd Sep 4, 2025

Choose a reason for hiding this comment

Uh oh!

WillAyd Sep 5, 2025

Choose a reason for hiding this comment

Uh oh!

raulcd commented Sep 4, 2025

Uh oh!

kou left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

raulcd commented Sep 2, 2025 •

edited by github-actions bot

Loading