Gerardo Villarroel created SPARK-12955: ------------------------------------------
Summary: Spark-HiveSQL: It fail when is quering a nested structure Key: SPARK-12955 URL: https://issues.apache.org/jira/browse/SPARK-12955 Project: Spark Issue Type: Bug Components: Spark Submit Affects Versions: 1.3.0 Environment: CDH-5.4.7-1.cdh5.4.7 Reporter: Gerardo Villarroel If you create a hive table using a structure with a nested structure and spark query it, it get fail. you'll test with a structure similar to: { a : { a { aa1: "subValue", aa2: 1 } } , b : "value" } a extended example is bellow: { "namespace": "AA", "type": "record", "name": "CreditRecord", "fields": [ { "doc": "string", "type": "string", "name": "aaa" }, { "doc": "string", "type": "string", "name": "bbb" }, { "doc": "string", "type": "string", "name": "l90" }, { "doc": "boolean, ", "type": ["boolean", "null" ], "name": "isSubjectDeceased" }, { "doc": "string", "type": "string", "name": "gender" }, { "doc": "string", "type": "string", "name": "dateOfBirth" }, { "doc": "array of Trade, ", "type": [ { "items": { "fields": [ { "doc": "int, ", "type": [ "int", "null" ], "name": "sequenceNumber" }, { "doc": "string", "type": "string", "name": "tradeKey" }, { "doc": "PHR,", "type": [ { "fields": [ { "doc": "string", "type": "string", "name": "rate" }, { "doc": "string", "type": "string", "name": "date" } ], "type": "record", "name": "PHR" }, "null" ], "name": "phrgt48DR" } ], "type": "record", "name": "Trade" }, "type": "array" }, "null" ], "name": "trades" } ] } -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org