gszadovszky opened a new issue, #3291:
URL: https://github.com/apache/parquet-java/issues/3291
### Describe the bug, including details regarding any error messages,
version, and platform.
It seems that #3154 was incomplete. During executing `parquet-cli meta
{parquet-file}` on a file where schema contains UNKNOWN logical types, we are
getting a similar exception:
```
org.apache.parquet.ShouldNeverHappenException: No comparator logic
implemented for INT32 logical type: UNKNOWN
at
org.apache.parquet.schema.PrimitiveType$PrimitiveTypeName$2.lambda$comparator$0(PrimitiveType.java:187)
at java.base/java.util.Optional.orElseThrow(Optional.java:403)
at
org.apache.parquet.schema.PrimitiveType$PrimitiveTypeName$2.comparator(PrimitiveType.java:187)
at
org.apache.parquet.schema.PrimitiveType.comparator(PrimitiveType.java:848)
at
org.apache.parquet.column.statistics.Statistics.<init>(Statistics.java:189)
at
org.apache.parquet.column.statistics.IntStatistics.<init>(IntStatistics.java:43)
at
org.apache.parquet.column.statistics.Statistics.createStats(Statistics.java:237)
at
org.apache.parquet.column.statistics.Statistics$Builder.build(Statistics.java:68)
at
org.apache.parquet.format.converter.ParquetMetadataConverter.fromParquetStatisticsInternal(ParquetMetadataConverter.java:933)
at
org.apache.parquet.format.converter.ParquetMetadataConverter.fromParquetStatistics(ParquetMetadataConverter.java:939)
at
org.apache.parquet.format.converter.ParquetMetadataConverter.buildColumnChunkMetaData(ParquetMetadataConverter.java:1764)
at
org.apache.parquet.format.converter.ParquetMetadataConverter.fromParquetMetadata(ParquetMetadataConverter.java:1869)
at
org.apache.parquet.format.converter.ParquetMetadataConverter.readParquetMetadata(ParquetMetadataConverter.java:1749)
at
org.apache.parquet.hadoop.ParquetFileReader.readFooter(ParquetFileReader.java:634)
at
org.apache.parquet.hadoop.ParquetFileReader.readFooter(ParquetFileReader.java:571)
at
org.apache.parquet.hadoop.ParquetFileReader.readFooter(ParquetFileReader.java:564)
at
org.apache.parquet.hadoop.ParquetFileReader.readFooter(ParquetFileReader.java:508)
at
org.apache.parquet.cli.commands.ParquetMetadataCommand.run(ParquetMetadataCommand.java:74)
at org.apache.parquet.cli.Main.run(Main.java:169)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at org.apache.parquet.cli.Main.main(Main.java:197)
```
This is because we did not update the comparator creation logic for an
UNKNOWN column.
(This exception happens not only in `parquet-cli` but in any case we are
reading the schema with an UNKNOWN logical type in it.)
### Component(s)
Core
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
