Skip to content

Add "From Raw Data to Model Serving: A Blueprint for the AI/ML Lifecycle with Kubeflow" blog post #170

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 9 commits into from
Jul 18, 2025

Conversation

hbelmiro
Copy link
Contributor

@hbelmiro hbelmiro commented Jul 15, 2025

Resolves #171

…cle with Kubeflow" blog post

Signed-off-by: Helber Belmiro <[email protected]>
@hbelmiro hbelmiro force-pushed the fraud-detection-e2e branch from 86c034c to 1852f23 Compare July 15, 2025 20:38
@hbelmiro
Copy link
Contributor Author

@franciscojavierarceo @tarilabs @anishasthana can you guys PTAL?

@hbelmiro hbelmiro marked this pull request as ready for review July 15, 2025 20:52
Copy link
Member

@tarilabs tarilabs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

minor comment, otherwise
/lgtm

thank you very much @hbelmiro !!

Copy link
Contributor

@franciscojavierarceo franciscojavierarceo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is great @hbelmiro!!

/lgtm


By following this blueprint, you can adapt and extend the process for your own machine learning projects, whether you're working locally or scaling up to production. Kubeflow's modular platform and ecosystem make it possible to manage the entire ML lifecycle in a consistent, automated, and open way.

Ready to try it yourself? The complete source code for this project is available on [GitHub](https://github.com/hbelmiro/fraud_detection_e2e_demo/tree/kubeflow).
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

in an ideal world we'd put this in the example repos but we've stated that the examples repo is not maintained.

Copy link
Contributor

@anishasthana anishasthana left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I won't have time to run through the demo right now -- @hbelmiro has anyone else run through the entire process e2e? Just to ensure there wasn't some configuration in your system that you weren't aware of.


### Pushing Images

After building, push the images to a container registry accessible by your Kubernetes cluster. Update the image references in your pipeline or manifests as needed.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we include a link or pointers at what manifests would likely need updates?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actually, only the pipeline needs to be updated. I removed or manifests from the sentence.


### 2. Feature Engineering with Feast

[Feast](https://feast.dev/) is an open source feature store that lets you manage and serve features for both training and inference, ensuring consistency and reducing the risk of training/serving skew.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we also include a definition of "feature" in a sentence or two here?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done.


1. After uploading, click on your pipeline in the list.
2. Click **Create run**.
3. Fill in the run details and click **Start**.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What details?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We can just trust the defaults or optionally customize the run name and description.
I rephrased.

@hbelmiro
Copy link
Contributor Author

I won't have time to run through the demo right now -- @hbelmiro has anyone else run through the entire process e2e? Just to ensure there wasn't some configuration in your system that you weren't aware of.

@anishasthana I'm not aware of anyone who did it.

hbelmiro and others added 6 commits July 17, 2025 11:55
Co-authored-by: Anish Asthana <[email protected]>
Signed-off-by: Helber Belmiro <[email protected]>
Co-authored-by: Anish Asthana <[email protected]>
Signed-off-by: Helber Belmiro <[email protected]>
Co-authored-by: Anish Asthana <[email protected]>
Signed-off-by: Helber Belmiro <[email protected]>
Signed-off-by: Helber Belmiro <[email protected]>
Copy link

@alyssacgoins alyssacgoins left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good - I was able to run the setup steps successfully. Easy to follow!

Copy link
Contributor

@anishasthana anishasthana left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@google-oss-prow google-oss-prow bot removed the lgtm label Jul 17, 2025
Copy link
Member

@tarilabs tarilabs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

per #170 (review)
/lgtm

@google-oss-prow google-oss-prow bot added the lgtm label Jul 18, 2025
@franciscojavierarceo
Copy link
Contributor

This is huge @hbelmiro!! Thank you for it!!

CC @andreyvelich @vikas-saxena02

/lgtm
/approve

Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: franciscojavierarceo

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:
  • OWNERS [franciscojavierarceo]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@google-oss-prow google-oss-prow bot merged commit 3a7df70 into kubeflow:master Jul 18, 2025
7 checks passed
@hbelmiro hbelmiro deleted the fraud-detection-e2e branch July 18, 2025 12:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Blog Proposal: Complete MLOps Blueprint with Kubeflow
5 participants