Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create a method to return a spark df for pyspark backend #10673

Open
1 task done
sonic-x11 opened this issue Jan 15, 2025 · 0 comments
Open
1 task done

Create a method to return a spark df for pyspark backend #10673

sonic-x11 opened this issue Jan 15, 2025 · 0 comments
Labels
feature Features or general enhancements

Comments

@sonic-x11
Copy link

Is your feature request related to a problem?

No response

What is the motivation behind your request?

If we return a spark df the user can write to various formats as spark supports in my case it was hudi

Describe the solution you'd like

Create a simple to_spark or similar method which returns a spark df

currently there is hacky workaround pointed out by @gforsyth

#10671 (comment)

What version of ibis are you running?

9.5

What backend(s) are you using, if any?

Pyspark and duckdb

Code of Conduct

  • I agree to follow this project's Code of Conduct
@sonic-x11 sonic-x11 added the feature Features or general enhancements label Jan 15, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature Features or general enhancements
Projects
Status: backlog
Development

No branches or pull requests

1 participant