Skip to content

CI: 04/16/25 upstream sync #367

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 785 commits into from

Conversation

rocm-repo-management-api-2[bot]
Copy link

Daily sync with upstream

justinjfu and others added 30 commits April 7, 2025 14:47
…antics), in addition to the existing ThreadSemantics (renamed to LoweringSemantics).

UserThreadSemantics controls the thread semantics of the Pallas user's code, whereas LoweringSemantics controls the level at which Mosaic GPU emits code.

PiperOrigin-RevId: 744857085
Also, add a job to the release test workflow that verifies that the release wheels can be installed.

TESTED:
1. Full release: https://github.com/jax-ml/jax/actions/runs/14315832784

2. jax only release: https://github.com/jax-ml/jax/actions/runs/14316157252

PiperOrigin-RevId: 744857804
None is meant to represent the same thing as {replicated over all possible axes}. But without this canonicalization, we could compare None as not equal to {all possible axes}.

fixes jax-ml#26621

Unrelated: in several places, including the _check_rep path, we don't handle partial auto correctly, since we treat {all possible axes} as {all mesh axes}, but actually it should be more like {all mesh axes} - auto. We'll leave that fix for a follow-up...
PiperOrigin-RevId: 744864022
No internal code needs it any more.

PiperOrigin-RevId: 744870756
…n the users wants to let SPMD decide the sharding.

But this is a contradiction since layouts apply to device local shape and without knowing the sharding, you can't decide the layout. But there are cases where you don't care what the sharding is, you just want to force a row-major layout (for example). **This API should only be used for those cases**.

PiperOrigin-RevId: 744888557
…uracy is not printed if it's None.

PiperOrigin-RevId: 744889524
…xternal one is deprecated.

PiperOrigin-RevId: 744908555
The ml_dtype requirement in JAX was updated to version 0.5.0+ (on Mar 20, 2025) - commit 4b7ead4

This update allows us to address previous FP8-related TODOs in jaxlib/XLA.

PiperOrigin-RevId: 744943824
This enables exporting functions that use memory kinds to place
data in different memories.

jax-fixit

PiperOrigin-RevId: 745008959
…ted test for parsing all canonical layouts.

PiperOrigin-RevId: 745015431
It is just an identity after the "stackless" rewrite.

PiperOrigin-RevId: 745042532
If a function or class has a docstring, it does not need a `pass`.

PiperOrigin-RevId: 745052107
The change in `utils.py` is to enable the use of `bitwidth` when the mlir dialect is not registered.

PiperOrigin-RevId: 745060221
After this change we no longer skip tests that required 'RunState`. This necessitated a small fix in the pallas lowering of `while` and also enabling multiple i32 register bundling in the `optimization_barrier` lowering.

PiperOrigin-RevId: 745065173
It defaults to True and is not flipped to False by any internal JAX users.

PiperOrigin-RevId: 745067361
…lf reference cycle loop in python.

PiperOrigin-RevId: 745099538
sharadmv and others added 26 commits April 14, 2025 19:09
PiperOrigin-RevId: 747663692
PiperOrigin-RevId: 747782436
Not all of these have replacements, but I want to mark these as deprecated now so they can be removed in a future release.

PiperOrigin-RevId: 747867544
Shift ops expect RHS to have the same type as RHS, but a scalar was being used for RHS.

PiperOrigin-RevId: 747934619
Reverts b336daf

PiperOrigin-RevId: 747988862
* A garbage collected type bound by nanobind is allocated with `PyType_GenericAlloc` (https://github.com/wjakob/nanobind/blob/8f245bd6e5544ff828beb46435af24b8769bfcdc/src/nb_type.cpp#L81).
* `PyType_GenericAlloc` calls `_PyObject_GC_TRACK` (https://github.com/python/cpython/blob/884df116d79b05d9342e05e50484d61c684ecb8b/Objects/typeobject.c#L2357), and as soon as an object is tracked by the GC, it may be traversed (https://docs.python.org/3/c-api/gcsupport.html#c.PyObject_GC_Track).
* However, at this point, the nanobind-bound object has been allocated, but its C++ constructor need not yet have run. The constructor runs when `__init__` is called.
* In tp_traverse methods of nanobind-bound classes, we should test whether the instance is ready before visiting any C++ state. Instance readiness will be set at the end of the dispatch of `__init__` (https://github.com/wjakob/nanobind/blob/8f245bd6e5544ff828beb46435af24b8769bfcdc/src/nb_func.cpp#L857).

In addition, all nanobind-bound classes have heap-allocated types. Make sure we visit `Py_TYPE(self)`.

PiperOrigin-RevId: 747998575
…Array` data

Generally, we want to maintain that key data backing a `PRNGKeyArray` is a `jax.Array`. This change converts NumPy arrays on construction.

Co-authored-by: Yash Katariya <[email protected]>
PiperOrigin-RevId: 748077900
The first letter was inadvertently made lower-case in the previous re-naming CL.

PiperOrigin-RevId: 748086763
@rocm-repo-management-api-2 rocm-repo-management-api-2 bot requested a review from a team as a code owner April 16, 2025 06:02
@rocm-repo-management-api-2 rocm-repo-management-api-2 bot enabled auto-merge (rebase) April 16, 2025 06:02
auto-merge was automatically disabled May 1, 2025 15:03

Pull request was closed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.