uros-db commented on PR #46597: URL: https://github.com/apache/spark/pull/46597#issuecomment-2119216632
How about we go with this: - try to get the modified `Mode.update` approach working, and see how it does on the benchmark - limit the support to collated StringType only, no complex types for now - that can be a separate change hint: to properly limit the support for collated types, you can use `override def checkInputDataTypes` to throw something like `UNSUPPORTED_DATATYPE` if child.dataType is a complex type with **collated** strings -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
