yaooqinn commented on issue #28167: [SPARK-31106][SQL] Support valid_json function URL: https://github.com/apache/spark/pull/28167#issuecomment-615577524 Since 3.0, we are able to inject functions. Maybe we can create a separate sub-project or third-party project to maintain dialect functions from other platforms instead of adding them directly to Spark. For example, I recently created https://github.com/yaooqinn/spark-func-extras to achieve such a goal(Maybe we can move this project to a proper place to maintain). Functions in this project can overwrite spark builtin ones to keep the meaning of the platforms where they come from if conflicts occur. Also, some function candidates may eventually go into the spark’s master branch if they turn out that they are quite useful and do not conflict. cc @cloud-fan @maropu, @gatorsmile, @HyukjinKwon, @dongjoon-hyun, thanks.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
