Why Apache Spark doesn't use Calcite?

2020-01-13 Thread newroyker
Was there a qualitative or quantitative benchmark done before a design decision was made not to use Calcite? Are there limitations (for heuristic based, cost based, * aware optimizer) in Calcite, and frameworks built on top of Calcite? In the context of big data / TCPH benchmarks. I was unable

How to recursively aggregate Treelike(hierarchical) data using Spark?

2018-09-25 Thread newroyker
The problem statement and an approach to solve it recursively is described here: https://stackoverflow.com/questions/52508872/how-to-recursively-aggregate-treelikehierarchical-data-using-spark Looking for more elegant/performant solutions, if they exist. TIA ! -- Sent from: