[META] What to do about "This post has NOT been accepted by the mailing list yet." ?

2017-01-08 Thread dpapathanasiou
I both subscribed to the mailing list and registered with Nabble, and I was able to post my question[1] there yesterday. While it has gotten a few views, there is no answer yet, and I also saw this warning: "This post has NOT been accepted by the mailing list yet." How do I resolve that, so the

How to use an anonymous function with DataFrame.explode() ?

2017-01-07 Thread dpapathanasiou
I need to take a DataFrame of events, and explode them row-wise so that there's at least one representation per time interval (usually day) in between events. Here's a simplified version of the problem, which I have gotten to work in spark-shell: case class Meal (food: String, calories: Double,