boneanxs commented on code in PR #8452: URL: https://github.com/apache/hudi/pull/8452#discussion_r1191975737
########## hudi-spark-datasource/hudi-spark2/src/main/scala/org/apache/spark/sql/adapter/Spark2Adapter.scala: ########## @@ -186,4 +186,13 @@ class Spark2Adapter extends SparkAdapter { case OFF_HEAP => "OFF_HEAP" case _ => throw new IllegalArgumentException(s"Invalid StorageLevel: $level") } + + override def translateFilter(predicate: Expression, + supportNestedPredicatePushdown: Boolean = false): Option[Filter] = { + if (supportNestedPredicatePushdown) { Review Comment: Currently, for partition push down, there shouldn't be any nested columns are partition columns, so I fail it both in spark2Adapter and spark3Adapter to keep consistent. But in case this method could be used in other codes, we should only fail it if using spark2? Since Spark3 supports `supportNestedPredicatePushdown` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org