Respect Spark compression settings in native Parquet writer #2814
Description
What is the problem the feature request solves?
#2812 adds basic support for native Parquet writes, but does not fully support compression codec configs from Spark. Also, lz4 compression level is not configurable.
Describe the potential solution
Respect Spark configuration options.
Also add a Comet conf for specifying lz4 compression level.
Additional context
No response