Python: Implement CI/CD Pipeline for Package Build, PyPI Push, and Dependency Conflict Resolution

[karimodm]

Description

Implement a CI/CD pipeline to automate the build and release process for Python packages within the monorepo. This pipeline should also incorporate dependency conflict checks to ensure compatibility across all packages.

Tasks

• Set up CI/CD pipeline: Configure GitHub Actions to trigger on relevant events (e.g., pushes, tags).
• Automate package building: Implement steps in the CI/CD pipeline to automatically build Python packages based on pyproject.toml files found in each package directory.
• PyPI publishing: Configure the pipeline to push new package versions to PyPI upon successful builds and tagged releases.
• Dependency conflict check:
  • Develop a mechanism within the CI/CD pipeline to install all Python packages from the single root virtual package (goat-sdk-monorepo). This virtual package represents the combined dependencies of all individual packages. This package is not meant to be built or published.
  • Implement dependency conflict detection during the virtual package installation. This step should identify any incompatible dependency versions across the entire monorepo.
  • Fail the CI/CD pipeline if dependency conflicts are detected.
• Reporting: Ensure the CI/CD pipeline provides clear reports on build status, PyPI publishing, and dependency conflict checks.

Goal

To streamline the release process and guarantee dependency compatibility across all Python packages within the goat-sdk-monorepo. This will prevent runtime errors and ensure a consistent experience for users integrating multiple packages from the monorepo.