[
https://issues.apache.org/jira/browse/SPARK-45481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiaan Geng updated SPARK-45481:
-------------------------------
Description:
Currently, Spark supported most of all parquet compression codecs, the parquet
supported compression codecs and spark supported are not completely one-on-one.
There are a lot of magic strings copy from parquet compression codecs. This
issue lead to developers need to manually maintain its consistency. It is easy
to make mistakes and reduce development efficiency.
was:Currently, StorageLevel provides fromString to get the StorageLevel's
instance with StorageLevel's name. So developers or users have to copy the
string literal about StorageLevel's name to set or get instance of
StorageLevel. This issue lead to developers need to manually maintain its
consistency. It is easy to make mistakes and reduce development efficiency.
> Introduce a mapper for parquet compression codecs
> -------------------------------------------------
>
> Key: SPARK-45481
> URL: https://issues.apache.org/jira/browse/SPARK-45481
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 4.0.0
> Reporter: Jiaan Geng
> Priority: Major
>
> Currently, Spark supported most of all parquet compression codecs, the
> parquet supported compression codecs and spark supported are not completely
> one-on-one.
> There are a lot of magic strings copy from parquet compression codecs. This
> issue lead to developers need to manually maintain its consistency. It is
> easy to make mistakes and reduce development efficiency.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
