[ml] Deep learning talks at the Spark Summit Europe

Hello all, following the last Summit, there will be a couple of exciting talks about deep learning and Spark at the next Spark Summit in Dublin.  - Deep Dive Into Deep Learning Pipelines, in which we will go even deeper into the technical aspects for an hour-long session  - Apache Spark and

Re: Will higher order functions in spark SQL be pushed upstream?

Hello, At Netflix's algorithm team, we work on ranking problems a lot where we naturally deal with the dataset with nested list of the structs. We built Scala APIs like map, filter, drop, withColumn that can work on the nested list of structs efficiently using SQL expression with codegen. Here