[jira] [Commented] (SPARK-17039) cannot read null dates from csv file

2016-08-15 Thread Barry Becker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15421688#comment-15421688 ] Barry Becker commented on SPARK-17039: -- I did notice that

[jira] [Commented] (SPARK-17039) cannot read null dates from csv file

2016-08-15 Thread Barry Becker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15421611#comment-15421611 ] Barry Becker commented on SPARK-17039: -- I was able to pull the patch

[jira] [Commented] (SPARK-17039) cannot read null dates from csv file

2016-08-12 Thread Barry Becker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15419768#comment-15419768 ] Barry Becker commented on SPARK-17039: -- I read the comments in SPARK-16462. It looks like it would

[jira] [Commented] (SPARK-17039) cannot read null dates from csv file

2016-08-12 Thread Liwei Lin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15419730#comment-15419730 ] Liwei Lin commented on SPARK-17039: --- Thanks [~barrybecker4] for reporting this. Please also see

[jira] [Commented] (SPARK-17039) cannot read null dates from csv file

2016-08-12 Thread Barry Becker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15419073#comment-15419073 ] Barry Becker commented on SPARK-17039: -- There are literal ?'s in the datafile. The "nullValue"

[jira] [Commented] (SPARK-17039) cannot read null dates from csv file

2016-08-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15419062#comment-15419062 ] Sean Owen commented on SPARK-17039: --- Oh right looked right past that. But if a date is null, converted

[jira] [Commented] (SPARK-17039) cannot read null dates from csv file

2016-08-12 Thread Barry Becker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15419040#comment-15419040 ] Barry Becker commented on SPARK-17039: -- I do specify a schema (.schema(dfSchema)), and it says that

[jira] [Commented] (SPARK-17039) cannot read null dates from csv file

2016-08-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15419017#comment-15419017 ] Sean Owen commented on SPARK-17039: --- Hm, how are they being parsed as dates -- or is that the issue?