Update Ray to v2.52.1 for RHOAI 2.25.1 (#954)

* NO-JIRA: Update Ray to 2.52.1

* [2.25] fix: upgrade test post CVE fixes

* fix: post ray 2.52.1 fix for mnist script

* Update python 3.11 image sha

* Update python 3.12 image sha

* Add v0.31 to the CI branches

---------

Co-authored-by: Pawel Paszki <[email protected]>

Author: kryanbeane

.github/workflows/e2e_tests.yaml

@@ -7,6 +7,7 @@ on:
       - main
       - 'release-*'
       - ray-jobs-feature
+      - v0.31
     paths-ignore:
       - 'docs/**'
       - '**.adoc'

.github/workflows/unit-tests.yml

@@ -2,9 +2,9 @@ name: Python Tests
 
 on:
   pull_request:
-    branches: [ main, ray-jobs-feature ]
+    branches: [ main, ray-jobs-feature, v0.31 ]
   push:
-    branches: [ main, ray-jobs-feature ]
+    branches: [ main, ray-jobs-feature, v0.31 ]
 
 jobs:
   unit-tests:

demo-notebooks/additional-demos/hf_interactive.ipynb

@@ -70,8 +70,8 @@
     "\n",
     "NOTE: The default images used by the CodeFlare SDK for creating a RayCluster resource depend on the installed Python version:\n",
     "\n",
-    "- For Python 3.11: 'quay.io/modh/ray:2.47.1-py311-cu121'\n",
-    "- For Python 3.12: 'quay.io/modh/ray:2.47.1-py312-cu128'\n",
+    "- For Python 3.11: 'quay.io/modh/ray:2.52.1-py311-cu121'\n",
+    "- For Python 3.12: 'quay.io/modh/ray:2.52.1-py312-cu128'\n",
     "\n",
     "If you prefer to use a custom Ray image that better suits your needs, you can specify it in the image field to override the default."
    ]

demo-notebooks/additional-demos/local_interactive.ipynb

@@ -37,8 +37,8 @@
     "\n",
     "NOTE: The default images used by the CodeFlare SDK for creating a RayCluster resource depend on the installed Python version:\n",
     "\n",
-    "- For Python 3.11: 'quay.io/modh/ray:2.47.1-py311-cu121'\n",
-    "- For Python 3.12: 'quay.io/modh/ray:2.47.1-py312-cu128'\n",
+    "- For Python 3.11: 'quay.io/modh/ray:2.52.1-py311-cu121'\n",
+    "- For Python 3.12: 'quay.io/modh/ray:2.52.1-py312-cu128'\n",
     "\n",
     "If you prefer to use a custom Ray image that better suits your needs, you can specify it in the image field to override the default."
    ]

demo-notebooks/additional-demos/ray_job_client.ipynb

@@ -43,8 +43,8 @@
     "\n",
     "NOTE: The default images used by the CodeFlare SDK for creating a RayCluster resource depend on the installed Python version:\n",
     "\n",
-    "- For Python 3.11: 'quay.io/modh/ray:2.47.1-py311-cu121'\n",
-    "- For Python 3.12: 'quay.io/modh/ray:2.47.1-py312-cu128'\n",
+    "- For Python 3.11: 'quay.io/modh/ray:2.52.1-py311-cu121'\n",
+    "- For Python 3.12: 'quay.io/modh/ray:2.52.1-py312-cu128'\n",
     "\n",
     "If you prefer to use a custom Ray image that better suits your needs, you can specify it in the image field to override the default."
    ]

demo-notebooks/guided-demos/0_basic_ray.ipynb

@@ -49,8 +49,8 @@
     "\n",
     "NOTE: The default images used by the CodeFlare SDK for creating a RayCluster resource depend on the installed Python version:\n",
     "\n",
-    "- For Python 3.11: 'quay.io/modh/ray:2.47.1-py311-cu121'\n",
-    "- For Python 3.12: 'quay.io/modh/ray:2.47.1-py312-cu128'\n",
+    "- For Python 3.11: 'quay.io/modh/ray:2.52.1-py311-cu121'\n",
+    "- For Python 3.12: 'quay.io/modh/ray:2.52.1-py312-cu128'\n",
     "\n",
     "If you prefer to use a custom Ray image that better suits your needs, you can specify it in the image field to override the default."
    ]

demo-notebooks/guided-demos/1_cluster_job_client.ipynb

@@ -43,8 +43,8 @@
     "\n",
     "NOTE: The default images used by the CodeFlare SDK for creating a RayCluster resource depend on the installed Python version:\n",
     "\n",
-    "- For Python 3.11: 'quay.io/modh/ray:2.47.1-py311-cu121'\n",
-    "- For Python 3.12: 'quay.io/modh/ray:2.47.1-py312-cu128'\n",
+    "- For Python 3.11: 'quay.io/modh/ray:2.52.1-py311-cu121'\n",
+    "- For Python 3.12: 'quay.io/modh/ray:2.52.1-py312-cu128'\n",
     "\n",
     "If you prefer to use a custom Ray image that better suits your needs, you can specify it in the image field to override the default."
    ]

demo-notebooks/guided-demos/2_basic_interactive.ipynb

@@ -46,8 +46,8 @@
     "\n",
     "NOTE: The default images used by the CodeFlare SDK for creating a RayCluster resource depend on the installed Python version:\n",
     "\n",
-    "- For Python 3.11: 'quay.io/modh/ray:2.47.1-py311-cu121'\n",
-    "- For Python 3.12: 'quay.io/modh/ray:2.47.1-py312-cu128'\n",
+    "- For Python 3.11: 'quay.io/modh/ray:2.52.1-py311-cu121'\n",
+    "- For Python 3.12: 'quay.io/modh/ray:2.52.1-py312-cu128'\n",
     "\n",
     "If you prefer to use a custom Ray image that better suits your needs, you can specify it in the image field to override the default."
    ]

demo-notebooks/guided-demos/3_widget_example.ipynb

@@ -49,8 +49,8 @@
     "\n",
     "NOTE: The default images used by the CodeFlare SDK for creating a RayCluster resource depend on the installed Python version:\n",
     "\n",
-    "- For Python 3.11: 'quay.io/modh/ray:2.47.1-py311-cu121'\n",
-    "- For Python 3.12: 'quay.io/modh/ray:2.47.1-py312-cu128'\n",
+    "- For Python 3.11: 'quay.io/modh/ray:2.52.1-py311-cu121'\n",
+    "- For Python 3.12: 'quay.io/modh/ray:2.52.1-py312-cu128'\n",
     "\n",
     "If you prefer to use a custom Ray image that better suits your needs, you can specify it in the image field to override the default."
    ]

demo-notebooks/guided-demos/mnist_fashion.py

@@ -8,15 +8,6 @@
 from ray.train import ScalingConfig
 
 
-def get_dataset():
-    return datasets.FashionMNIST(
-        root="/tmp/data",
-        train=True,
-        download=True,
-        transform=ToTensor(),
-    )
-
-
 class NeuralNetwork(nn.Module):
     def __init__(self):
         super().__init__()
@@ -84,9 +75,6 @@ def train_func_distributed():
         resources_per_worker={
             "CPU": 1,
         },
-        trainer_resources={
-            "CPU": 0,
-        },
     ),
 )