[
https://issues.apache.org/jira/browse/BEAM-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ismaël Mejía updated BEAM-8616:
-------------------------------
Labels: backward-incompatible (was: )
> ParquetIO should have Hadoop dependencies as provided
> -----------------------------------------------------
>
> Key: BEAM-8616
> URL: https://issues.apache.org/jira/browse/BEAM-8616
> Project: Beam
> Issue Type: Sub-task
> Components: io-java-parquet
> Affects Versions: 2.16.0
> Reporter: Ismaël Mejía
> Assignee: Ismaël Mejía
> Priority: Major
> Labels: backward-incompatible
> Fix For: 2.20.0
>
> Time Spent: 3h 10m
> Remaining Estimate: 0h
>
> ParquetIO has the hadoop-client dependency as a compile-time dependency
> however this dependency should be provided by the user as defined in
> parquet-hadoop. By pinning a hadoop version we are limiting users from
> providing different Hadoop jars (as they can with native Parquet), it also
> limits us from providing different hadoop versions to test that the Parquet
> module is compatible with Hadoop 3 (when it will).
> Note this is a 'backwards incompatible' change in the sense that users might
> need to explicitly provide the dependency from now on.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
