Build with nightly Torch instead of the latest (#1681)

Summary:

Changes in the PyTorch C++ layer affect Monarch's tensor engine builds. Without this change, the CI builds will pick up the latest PyTorch through build-requirements.txt. This diff removes this dependency.

We see this affecting #1680

Reviewed By: amirafzali

Differential Revision: D85670693

Author: allenwang28

.github/workflows/build-cpu.yml

@@ -29,5 +29,8 @@ jobs:
         # Setup build environment (conda + system deps + rust + build deps)
         setup_build_environment
 
+        # Install torch nightly (CPU version)
+        pip install --pre torch --index-url https://download.pytorch.org/whl/nightly/cpu
+
         # Build monarch (No tensor engine, CPU version)
         USE_TENSOR_ENGINE=0 python setup.py bdist_wheel

.github/workflows/build-cuda.yml

@@ -33,6 +33,7 @@ jobs:
 
         # Setup build environment (conda + system deps + rust + build deps)
         setup_build_environment
+        pip install ${{ matrix.torch-spec }}
 
         # Setup Tensor Engine
         setup_tensor_engine

.github/workflows/test-gpu-python.yml

@@ -45,6 +45,10 @@ jobs:
         # Setup CUDA environment and library paths
         setup_cuda_environment
 
+        # Install torch nightly before installing the wheel,
+        # so that we can test the wheel against the latest nightly
+        pip install ${{ matrix.torch-spec }}
+
         # Install the built wheel from artifact
         install_wheel_from_artifact
 

build-requirements.txt

@@ -1,4 +1,5 @@
-torch
+# torch is also a dependency here, but we want to ensure that
+# we're building against the PyTorch index for nightly.
 setuptools
 setuptools-rust
 wheel