[ https://issues.apache.org/jira/browse/HUDI-3742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ethan Guo updated HUDI-3742: ---------------------------- Sprint: (was: 2022/09/19) > Enable parquet enableVectorizedReader for spark incremental read to prevent > pef regression > ------------------------------------------------------------------------------------------- > > Key: HUDI-3742 > URL: https://issues.apache.org/jira/browse/HUDI-3742 > Project: Apache Hudi > Issue Type: Improvement > Components: spark > Reporter: Tao Meng > Assignee: Tao Meng > Priority: Critical > Labels: pull-request-available > Fix For: 0.12.1 > > > now we disable parquet enableVectorizedReader for mor incremental read, > and set "spark.sql.parquet.recordLevelFilter.enabled" = "true" to achieve > data filter > which is slow -- This message was sent by Atlassian Jira (v8.20.10#820010)