[
https://issues.apache.org/jira/browse/SPARK-15374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Euan de Kock updated SPARK-15374:
---------------------------------
Description:
When an external table is built from Spark, and is subsequently accessed by
Hive it will generate an NPE error if one of the columns contains only null
values. Spark (and Presto) can successfully read this data, but Hive cannot. If
the same dataset is created by Hive, it is readable by all systems.
> Spark created Parquet files cause NPE when a column has only NULL values
> ------------------------------------------------------------------------
>
> Key: SPARK-15374
> URL: https://issues.apache.org/jira/browse/SPARK-15374
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 1.6.0, 1.6.1
> Environment: AWS EMR running Spark 1.6.1
> Reporter: Euan de Kock
>
> When an external table is built from Spark, and is subsequently accessed by
> Hive it will generate an NPE error if one of the columns contains only null
> values. Spark (and Presto) can successfully read this data, but Hive cannot.
> If the same dataset is created by Hive, it is readable by all systems.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
