Hello all, Spark 2.4.0 was released last month. I noticed that Spark 2.4 “Add a lot of new built-in functions, including higher-order functions, to deal with complex data types easier.”[1] I wonder if it's necessary for Flink to add higher-order functions to enhance it's ability.
By the way, I found that if we wants to enhance the functionality of Flink sql, we often need to modify Calcite. It may be a little inconvenient,so may be we can extend Calcite core parser in Flink to deal with some non-standard SQL syntax, as mentioned in Flink SQL DDL Design[2]. Look forward to your feedback. Best, Wen-hui Tang [1] https://issues.apache.org/jira/browse/SPARK-23899 [2] https://docs.google.com/document/d/1TTP-GCC8wSsibJaSUyFZ_5NBAHYEB1FVmPpP7RgDGBA/edit# Winifred-wenhui Tang