[jira] [Resolved] (PARQUET-2252) Make some methods public to allow external projects to implement page skipping

2023-03-06 Thread Yujiang Zhong (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yujiang Zhong resolved PARQUET-2252. Resolution: Fixed Resolved by https://github.com/apache/parquet-mr/pull/1038 > Make some

[jira] [Assigned] (PARQUET-2252) Make some methods public to allow external projects to implement page skipping

2023-03-06 Thread Yujiang Zhong (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yujiang Zhong reassigned PARQUET-2252: -- Assignee: Yujiang Zhong > Make some methods public to allow external projects to imp

[jira] [Created] (PARQUET-2252) Make some methods public to allow external projects to implement page skipping

2023-03-01 Thread Yujiang Zhong (Jira)
Yujiang Zhong created PARQUET-2252: -- Summary: Make some methods public to allow external projects to implement page skipping Key: PARQUET-2252 URL: https://issues.apache.org/jira/browse/PARQUET-2252

[jira] [Created] (PARQUET-2246) Add short circuit logic to column index filter

2023-02-15 Thread Yujiang Zhong (Jira)
Yujiang Zhong created PARQUET-2246: -- Summary: Add short circuit logic to column index filter Key: PARQUET-2246 URL: https://issues.apache.org/jira/browse/PARQUET-2246 Project: Parquet Issue

[jira] [Created] (PARQUET-2245) Improve dictionary filter evaluating notEq

2023-02-15 Thread Yujiang Zhong (Jira)
Yujiang Zhong created PARQUET-2245: -- Summary: Improve dictionary filter evaluating notEq Key: PARQUET-2245 URL: https://issues.apache.org/jira/browse/PARQUET-2245 Project: Parquet Issue Type

[jira] [Updated] (PARQUET-2244) Dictionary filter may skip row-groups incorrectly when evaluating notIn

2023-02-15 Thread Yujiang Zhong (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yujiang Zhong updated PARQUET-2244: --- Description: Dictionary filter may skip row-groups incorrectly when evaluating `notIn` on

[jira] [Created] (PARQUET-2244) Dictionary filter may skip row-groups incorrectly when evaluating notIn

2023-02-15 Thread Yujiang Zhong (Jira)
Yujiang Zhong created PARQUET-2244: -- Summary: Dictionary filter may skip row-groups incorrectly when evaluating notIn Key: PARQUET-2244 URL: https://issues.apache.org/jira/browse/PARQUET-2244 Project

[jira] [Commented] (PARQUET-2160) Close decompression stream to free off-heap memory in time

2022-08-07 Thread Yujiang Zhong (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17576477#comment-17576477 ] Yujiang Zhong commented on PARQUET-2160: {quote} I was only comparing the code

[jira] [Commented] (PARQUET-2160) Close decompression stream to free off-heap memory in time

2022-08-05 Thread Yujiang Zhong (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17575918#comment-17575918 ] Yujiang Zhong commented on PARQUET-2160: {quote}The reason I can generate so mu

[jira] [Commented] (PARQUET-2160) Close decompression stream to free off-heap memory in time

2022-08-05 Thread Yujiang Zhong (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17575802#comment-17575802 ] Yujiang Zhong commented on PARQUET-2160: {quote}Hmm it does need to allocate ex

[jira] [Comment Edited] (PARQUET-2160) Close decompression stream to free off-heap memory in time

2022-08-04 Thread Yujiang Zhong (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17575528#comment-17575528 ] Yujiang Zhong edited comment on PARQUET-2160 at 8/5/22 5:59 AM: -

[jira] [Comment Edited] (PARQUET-2160) Close decompression stream to free off-heap memory in time

2022-08-04 Thread Yujiang Zhong (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17575528#comment-17575528 ] Yujiang Zhong edited comment on PARQUET-2160 at 8/5/22 6:00 AM: -

[jira] [Comment Edited] (PARQUET-2160) Close decompression stream to free off-heap memory in time

2022-08-04 Thread Yujiang Zhong (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17575529#comment-17575529 ] Yujiang Zhong edited comment on PARQUET-2160 at 8/5/22 2:50 AM: -

[jira] [Commented] (PARQUET-2160) Close decompression stream to free off-heap memory in time

2022-08-04 Thread Yujiang Zhong (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17575529#comment-17575529 ] Yujiang Zhong commented on PARQUET-2160: ??What about query performance? was it

[jira] [Commented] (PARQUET-2160) Close decompression stream to free off-heap memory in time

2022-08-04 Thread Yujiang Zhong (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17575528#comment-17575528 ] Yujiang Zhong commented on PARQUET-2160: [~Kimahriman] I didn't recreate this w

[jira] [Updated] (PARQUET-2160) Close decompression stream to free off-heap memory in time

2022-06-16 Thread Yujiang Zhong (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yujiang Zhong updated PARQUET-2160: --- Description: The decompressed stream in HeapBytesDecompressor$decompress now relies on the

[jira] [Updated] (PARQUET-2160) Close decompression stream to free off-heap memory in time

2022-06-16 Thread Yujiang Zhong (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yujiang Zhong updated PARQUET-2160: --- Description: The decompressed stream in HeapBytesDecompressor$decompress now relies on the

[jira] [Updated] (PARQUET-2160) Close decompression stream to free off-heap memory in time

2022-06-16 Thread Yujiang Zhong (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yujiang Zhong updated PARQUET-2160: --- Description: The decompressed stream in HeapBytesDecompressor$decompress now relies on the

[jira] [Commented] (PARQUET-2160) Close decompression stream to free off-heap memory in time

2022-06-16 Thread Yujiang Zhong (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-2160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17555082#comment-17555082 ] Yujiang Zhong commented on PARQUET-2160: [~shangxinli] [~dongjoon] Can you plea

[jira] [Created] (PARQUET-2160) Close decompression stream to free off-heap memory in time

2022-06-16 Thread Yujiang Zhong (Jira)
Yujiang Zhong created PARQUET-2160: -- Summary: Close decompression stream to free off-heap memory in time Key: PARQUET-2160 URL: https://issues.apache.org/jira/browse/PARQUET-2160 Project: Parquet