Michael Luckey created BEAM-13157:
-------------------------------------
Summary: ParquetIO.parseGenericRecords does not support
Configuration
Key: BEAM-13157
URL: https://issues.apache.org/jira/browse/BEAM-13157
Project: Beam
Issue Type: Bug
Components: io-java-parquet
Reporter: Michael Luckey
Assignee: Michael Luckey
ParquetIO.Parse currently does not support a Hadoop configuration.
Although it is possible to set the configuration object, it is ignored later
on. Parse delegates to ParseFiles, but misses to pass the configuration object
here. Therefore, config is lost.
Workaround:
Use ParseFiles directly by unrolling Parse.expand implementation.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)