[RFC] Launching Axolotl with Ray Train

[erictang000]

⚠️ Please check that this feature request hasn't been suggested before.

• I searched previous Ideas in Discussions didn't find any similar feature requests.
• I searched previous Issues didn't find any similar feature requests.

🔖 Feature description

Introduce a new path for launching training runs in axolotl via an integration with Ray Train as an alternative to launching multi-gpu/node runs with accelerate.

✔️ Solution

Draft PR for the change and additional details can be found at: #2251!

❓ Alternatives

No response

📝 Additional Context

No response

Acknowledgements

• My issue title is concise, descriptive, and in title casing.
• I have searched the existing issues to make sure this feature has not been requested yet.
• I have provided enough information for the maintainers to understand and evaluate this request.