cxzl25 commented on pull request #32583: URL: https://github.com/apache/spark/pull/32583#issuecomment-871075158
In PR https://github.com/apache/spark/pull/30708, we don’t plan to pass more functions to the Hive MetaStore Server. Then we can fallback to the client to do filters like Hive. ```java private static PrunedPartitionList getPartitionsFromServer(Table tab, final String key, final ExprNodeGenericFuncDesc compactExpr, HiveConf conf, String alias, Set<String> partColsUsedInFilter, boolean isPruningByExactFilter) throws SemanticException { try { // Finally, check the filter for non-built-in UDFs. If these are present, we cannot // do filtering on the server, and have to fall back to client path. boolean doEvalClientSide = hasUserFunctions(compactExpr); ``` https://github.com/apache/hive/blob/dc8891ec9459d2eff5a23154383ec3bd19481fd2/ql/src/java/org/apache/hadoop/hive/ql/optimizer/ppr/PartitionPruner.java#L437-L443 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
