Mike created SPARK-21255:
----------------------------
Summary: NPE when creating encoder for enum
Key: SPARK-21255
URL: https://issues.apache.org/jira/browse/SPARK-21255
Project: Spark
Issue Type: Bug
Components: Java API
Affects Versions: 2.1.0
Environment: org.apache.spark:spark-core_2.10:2.1.0
org.apache.spark:spark-sql_2.10:2.1.0
Reporter: Mike
When you try to create an encoder for Enum type (or bean with enum property)
via Encoders.bean(...), it fails with NullPointerException at TypeToken:495.
I did a little research and it turns out, that in JavaTypeInference:126
following code
{code:scala}
val beanInfo = Introspector.getBeanInfo(typeToken.getRawType)
val properties = beanInfo.getPropertyDescriptors.filterNot(_.getName == "class")
val fields = properties.map { property =>
val returnType =
typeToken.method(property.getReadMethod).getReturnType
val (dataType, nullable) = inferDataType(returnType)
new StructField(property.getName, dataType, nullable)
}
(new StructType(fields), true)
{code}
filters out properties named "class", because we wouldn't want to serialize
that. But enum types have another property of type Class named
"declaringClass", which we are trying to inspect recursively. Eventually we try
to inspect ClassLoader class, which has property "defaultAssertionStatus" with
no read method, which leads to NPE at TypeToken:495.
I think adding property name "declaringClass" to filtering will resolve this.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
