[ https://issues.apache.org/jira/browse/BEAM-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16972396#comment-16972396 ]
Lukasz Gajowy commented on BEAM-8616: ------------------------------------- ParquetIO is marked as experimental so I think it's safe to assume that its dependencies will change too, do you agree? > ParquetIO should have Hadoop dependencies as provided > ----------------------------------------------------- > > Key: BEAM-8616 > URL: https://issues.apache.org/jira/browse/BEAM-8616 > Project: Beam > Issue Type: Sub-task > Components: io-java-parquet > Affects Versions: 2.16.0 > Reporter: Ismaël Mejía > Assignee: Ismaël Mejía > Priority: Major > Time Spent: 0.5h > Remaining Estimate: 0h > > ParquetIO has the hadoop-client dependency as a compile-time dependency > however this dependency should be provided by the user as defined in > parquet-hadoop. By pinning a hadoop version we are limiting users from > providing different Hadoop jars (as they can with native Parquet), it also > limits us from providing different hadoop versions to test that the Parquet > module is compatible with Hadoop 3 (when it will). > Note this is a 'backwards incompatible' change in the sense that users might > need to explicitly provide the dependency from now on. -- This message was sent by Atlassian Jira (v8.3.4#803005)