Hi, I am using org.apache.spark.sql.types.Metadata to store extra
information along with each of my fields. I'd also like to store Metadata
for the entire DataFrame, not attached to any specific field. Is this
supported?
- Philip
Unfortunately this isn't supported at the moment
https://issues.apache.org/jira/browse/SPARK-10803
Cheng
On 9/30/15 10:54 AM, Philip Weaver wrote:
Hi, I am using org.apache.spark.sql.types.Metadata to store extra
information along with each of my fields. I'd also like to store
Metadata for
