Thanks Michael – this is a great article… very helpful
From: Michael Armbrust [mailto:mich...@databricks.com]
Sent: Wednesday, August 23, 2017 4:33 PM
To: JG Perrin
Cc: user@spark.apache.org
Subject: Re: Joining 2 dataframes, getting result as nested list/structure in
dataframe
You can create
You can create a nested struct that contains multiple columns using
struct().
Here's a pretty complete guide on working with nested data:
https://databricks.com/blog/2017/02/23/working-complex-data-formats-structured-streaming-apache-spark-2-1.html
On Wed, Aug 23, 2017 at 2:30 PM, JG Perrin wrot
