Re: What about additional support on deeply nested data?

Seems like you are also looking for transform and reduce for arrays? https://issues.apache.org/jira/browse/SPARK-23908 https://issues.apache.org/jira/browse/SPARK-23911 On Wed, Jun 20, 2018 at 10:43 AM bobotu wrote: > I store some trajectories data in parquet with this schema: > > create

What about additional support on deeply nested data?

I store some trajectories data in parquet with this schema: create table traj ( id string, points array> >> ) It contains a lots of attribute comes from sensors. It also have a nested array which contains information generated during map-matching algorithm. All of my

Re: Jenkins build errors

It's still dying. Back to this error (it used to be spark-2.2.0 before): java.io.IOException: Cannot run program "./bin/spark-submit" (in directory "/tmp/test-spark/spark-2.1.2"): error=2, No such file or directory So, a mirror is missing that Spark version... I don't understand why nobody