zhztheplayer commented on code in PR #7360:
URL: https://github.com/apache/incubator-gluten/pull/7360#discussion_r1778183213
##########
shims/common/src/main/scala/org/apache/gluten/GlutenConfig.scala:
##########
@@ -1864,6 +1866,12 @@ object GlutenConfig {
.booleanConf
.createWithDefault(true)
+ val ENABLE_COLUMNAR_PARTIAL_PROJECT =
+ buildConf("spark.gluten.sql.columnar.partial.project")
+ .doc("Execute partial project which is not supported in backend in
Spark")
Review Comment:
```
Break up one project node into 2 phases when some of the expressions are non
offload-able. Phase one is a regular offloaded project transformer that
evaluates the offload-able expressions in native, phase two preserves the
output from stage one and evaluates the remaining non-offload-able expressions
using vanilla Spark projections.
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
