[jira] [Commented] (SPARK-39763) Executor memory footprint substantially increases while reading zstd compressed parquet files

2022-10-06 Thread Oscar Delicaat (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17613536#comment-17613536 ] Oscar Delicaat commented on SPARK-39763: Thanks for the work [~camper42]! This s

[jira] [Commented] (SPARK-39763) Executor memory footprint substantially increases while reading zstd compressed parquet files

2022-09-08 Thread Fengyu Cao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17602154#comment-17602154 ] Fengyu Cao commented on SPARK-39763: [https://github.com/apache/parquet-mr/pull/982]

[jira] [Commented] (SPARK-39763) Executor memory footprint substantially increases while reading zstd compressed parquet files

2022-08-30 Thread Fengyu Cao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17597685#comment-17597685 ] Fengyu Cao commented on SPARK-39763: had the same problem   one of our dataset, 75