-
Notifications
You must be signed in to change notification settings - Fork 122
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
SNOW-1331967: Improve error message for pandas APIs calling UDFs/UDTFs with Snowpark objects #3114
SNOW-1331967: Improve error message for pandas APIs calling UDFs/UDTFs with Snowpark objects #3114
Conversation
…s with Snowpark objects
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
One nit, but looks good otherwise.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Approved with a comment/reminder
Which Jira issue is this PR addressing? Make sure that there is an accompanying issue to your PR.
Fixes SNOW-1331967
Fill out the following pre-review checklist:
Please describe how your code solves the related issue.
UDFs/UDTFs do not work with Snowpark objects. This also applies to pandas methods like
apply
andmap
that use UDFs/UDTFs in their implementation. Users invoking these functions would receive a NotImplementedError that was hard to decipher:Snowpark pandas does not yet support the method DataFrame.__reduce__
.This PR catches that NotImplementedError returns a more user-friendly ValueError message and links to the documentation describing Snowpark pandas limitations when such a case is hit.