Spark 2.4 Support

[pedro93]

Hello,

From the readme, it seems support for the latest spark versions 2.3 & 2.4 in the benchmarks do not yet exist. Are there plans for that?

Thanks!

[Zethson]

I also would like to know this. Extending this question: is support for Spark 3.0 planned?

[carsonwang]

Spark 2.4 support will be added in #586 . We can add Spark 2.3 support in another patch. We just need add a new profile for it.
Spark 3.0 will be released this year. I expect there will more changes to support it. It will be planned after the release.