Re: spark-xml to avro - SchemaParseException: Can't redefine

2016-09-09 Thread Arun Patel
; > github.com > sixers changed the title from Save DF with nested records with the same > name to spark-avro fails to save DF with nested records having the same > name Jun 23, 2015 > > > > -- > *From:* Arun Patel <arunp.bigd...@gmail.com> &g

Re: spark-xml to avro - SchemaParseException: Can't redefine

2016-09-08 Thread Yong Zhang
om> Sent: Thursday, September 8, 2016 5:31 PM To: user Subject: spark-xml to avro - SchemaParseException: Can't redefine I'm trying to convert XML to AVRO. But, I am getting SchemaParser exception for 'Rules' which is existing in two separate containers. Any thoughts? XML is attached. df = s

spark-xml to avro - SchemaParseException: Can't redefine

2016-09-08 Thread Arun Patel
I'm trying to convert XML to AVRO. But, I am getting SchemaParser exception for 'Rules' which is existing in two separate containers. Any thoughts? XML is attached. df = sqlContext.read.format('com.databricks.spark.xml').options(rowTag='GGLResponse',attributePrefix='').load('GGL.xml')