[
https://issues.apache.org/jira/browse/SPARK-19871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-19871.
----------------------------------
Resolution: Duplicate
> Improve error message in verify_type to indicate which field the error is for
> -----------------------------------------------------------------------------
>
> Key: SPARK-19871
> URL: https://issues.apache.org/jira/browse/SPARK-19871
> Project: Spark
> Issue Type: Bug
> Components: PySpark, SQL
> Affects Versions: 2.0.2, 2.1.0
> Reporter: Len Frodgers
>
> The error message for _verify_type is too vague. It should specify for which
> field the type verification failed.
> e.g. error: "This field is not nullable, but got None" – but what is the
> field?!
> In a dataframe with many non-nullable fields, it is a nightmare trying to
> hunt down which field is null, since one has to resort to basic (and very
> slow) trial and error.
> I have happily created a PR to fix this.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
