Hi all,

I am Jiashen and I am currently working on updating Parquet version. We've
added a feature for cell level encryption
<https://docs.google.com/document/d/1WCBhdBXpDbxUck0B4CDiUf9E08n6dyapYPRhmAS7tXQ/edit>
in version 1.10. Now, we're in the process of upgrading from Parquet
version 1.10 to 1.13.1. However, we've encountered an issue: an
*assertion* introduced
with the Column Indexes feature (diff
<https://github.com/apache/parquet-mr/pull/507/files>) is causing one of
our unit tests to fail. We suspect it might be due to the cell level
encryption not meeting the Page Index's requirements, specifically that a
page cannot start with a null value. Unfortunately, we haven't been able to
find the exact cause of this issue and would greatly appreciate your help
in investigating it. Could you please help take a look at this problem?

Code:
https://github.com/zhangjiashen/parquet-mr/commit/ce3b0f8aa2140c75f93db2eb7917cd24dc569323#diff-a24f1094ef9f914a638875e664fc411dcca320076d41227b120d1a2c8d1c3d96

The unit test triggers
assertion:parquet-hadoop/src/test/java/org/apache/parquet/crypto/CellEncryptionTest.java,
*testManySubGroups()*

Cell Encryption Writer and Reader:
https://docs.google.com/document/d/1WCBhdBXpDbxUck0B4CDiUf9E08n6dyapYPRhmAS7tXQ/edit

-- 
Thanks,
Jiashen

Reply via email to