Claire McGinty created PARQUET-2351:
---------------------------------------
Summary: ParquetWriter/ParquetReader should parse options directly
from supplied Configuration
Key: PARQUET-2351
URL: https://issues.apache.org/jira/browse/PARQUET-2351
Project: Parquet
Issue Type: Improvement
Reporter: Claire McGinty
As a Parquet user, my expectation is that ParquetWriter/ParquetReader will
automatically parse any options passed in the supplied Configuration. For
example:
```
Configuration conf = new Configuration();
conf.setBoolean(ParquetOutputFormat.BLOOM_FILTER_ENABLED, true);
ParquetWriter<Car> writer = AvroParquetWriter.<Car>builder(path)
.withSchema(Car.SCHEMA$)
.withConf(conf)
.build();
```
However, the above code results in a ParquetWriter where `bloomFilterEnabled`
is set to false-the expected way to configure this is to use
`ParquetWriter#withBloomFilterEnabled` directly.
IMO, when `ParquetWriter#withConf` is invoked, it should also delegate to
`encodingPropsBuilder` and set any Configured properties.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
