Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add documentation for using the RayProvider for Cloud Providers #76

Open
CaliWee opened this issue Oct 3, 2024 · 1 comment
Open

Add documentation for using the RayProvider for Cloud Providers #76

CaliWee opened this issue Oct 3, 2024 · 1 comment

Comments

@CaliWee
Copy link

CaliWee commented Oct 3, 2024

I am using Ray on GKE in Google Cloud. How can I specify where Ray is running using the RayOperators?

Currently, we use the GKEOperator which allows you to specify things like project_id, and cluster_name - https://cloud.google.com/composer/docs/using-gke-operator#launch_workloads_in_the_cluster

@CaliWee
Copy link
Author

CaliWee commented Oct 3, 2024

After diving in a bit further, it looks like it could be possible by being able to configure these attributes of the RayHook - https://github.com/astronomer/astro-provider-ray/blob/main/ray_provider/hooks/ray.py#L104-L106, but I haven't been able to find docs on _get_field and it doesn't seem like these fields are exposed to the user at the moment from higher level classes like the SubmitJobOperator

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant