sherman opened a new issue, #12047:
URL: https://github.com/apache/iceberg/issues/12047
### Query engine
Spark 3.5.x
Iceberg 1.7.0
### Question
According to the source code, the column iterator is created without
specifying a version:
```java
protected PrimitiveReader(ColumnDescriptor desc) {
this.desc = desc;
this.column = ColumnIterator.newIterator(desc, "");
this.children = ImmutableList.of(column);
}
```
When using Parquet format version 2, this leads to excessive log messages
such as (when an iterator instance is created):
`Requiring sequential reads because file version is empty. See PARQUET-246`
I am not familiar with the source code, so I have two questions:
* What does this mean in terms of error behavior, performance impact, etc.?
* How can this be fixed?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
