-
Notifications
You must be signed in to change notification settings - Fork 49
Add "From Raw Data to Model Serving: A Blueprint for the AI/ML Lifecycle with Kubeflow" blog post #170
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add "From Raw Data to Model Serving: A Blueprint for the AI/ML Lifecycle with Kubeflow" blog post #170
Conversation
…cle with Kubeflow" blog post Signed-off-by: Helber Belmiro <[email protected]>
86c034c
to
1852f23
Compare
@franciscojavierarceo @tarilabs @anishasthana can you guys PTAL? |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
minor comment, otherwise
/lgtm
thank you very much @hbelmiro !!
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
this is great @hbelmiro!!
/lgtm
|
||
By following this blueprint, you can adapt and extend the process for your own machine learning projects, whether you're working locally or scaling up to production. Kubeflow's modular platform and ecosystem make it possible to manage the entire ML lifecycle in a consistent, automated, and open way. | ||
|
||
Ready to try it yourself? The complete source code for this project is available on [GitHub](https://github.com/hbelmiro/fraud_detection_e2e_demo/tree/kubeflow). |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
in an ideal world we'd put this in the example repos but we've stated that the examples repo is not maintained.
Signed-off-by: Helber Belmiro <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I won't have time to run through the demo right now -- @hbelmiro has anyone else run through the entire process e2e? Just to ensure there wasn't some configuration in your system that you weren't aware of.
|
||
### Pushing Images | ||
|
||
After building, push the images to a container registry accessible by your Kubernetes cluster. Update the image references in your pipeline or manifests as needed. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Should we include a link or pointers at what manifests would likely need updates?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Actually, only the pipeline needs to be updated. I removed or manifests
from the sentence.
|
||
### 2. Feature Engineering with Feast | ||
|
||
[Feast](https://feast.dev/) is an open source feature store that lets you manage and serve features for both training and inference, ensuring consistency and reducing the risk of training/serving skew. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Should we also include a definition of "feature" in a sentence or two here?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Done.
|
||
1. After uploading, click on your pipeline in the list. | ||
2. Click **Create run**. | ||
3. Fill in the run details and click **Start**. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
What details?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We can just trust the defaults or optionally customize the run name and description.
I rephrased.
@anishasthana I'm not aware of anyone who did it. |
Co-authored-by: Anish Asthana <[email protected]> Signed-off-by: Helber Belmiro <[email protected]>
Co-authored-by: Anish Asthana <[email protected]> Signed-off-by: Helber Belmiro <[email protected]>
Co-authored-by: Anish Asthana <[email protected]> Signed-off-by: Helber Belmiro <[email protected]>
Signed-off-by: Helber Belmiro <[email protected]>
Signed-off-by: Helber Belmiro <[email protected]>
Signed-off-by: Helber Belmiro <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good - I was able to run the setup steps successfully. Easy to follow!
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
/lgtm
Signed-off-by: Helber Belmiro <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
per #170 (review)
/lgtm
This is huge @hbelmiro!! Thank you for it!! CC @andreyvelich @vikas-saxena02 /lgtm |
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: franciscojavierarceo The full list of commands accepted by this bot can be found here. The pull request process is described here
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
Resolves #171