Manjay Kumar created SPARK-32619:
------------------------------------
Summary: converting dataframe to dataset for the json schema
Key: SPARK-32619
URL: https://issues.apache.org/jira/browse/SPARK-32619
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 2.4.3
Reporter: Manjay Kumar
have a schema
{
Details :[{
phone : "98977999"
contacts: [{
name:"manjay"
---------- has missing street block in json
]}
]}
}
Case class , based on schema
case class Details (
phone : String,
contacts : Array[Adress]
)
case class Adress(
name : String
street : String
)
this throws : No such struct field street - Analysis exception.
dataframe.as[Details]
Is this a bug ?? or there is a resolution for this.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
