[jira] [Commented] (SPARK-17195) Dealing with JDBC column nullability when it is not reliable

[ https://issues.apache.org/jira/browse/SPARK-17195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15453801#comment-15453801 ] Jason Moore commented on SPARK-17195: - That's right, and I totally agree that's where the fix needs

[jira] [Commented] (SPARK-17195) Dealing with JDBC column nullability when it is not reliable

[ https://issues.apache.org/jira/browse/SPARK-17195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15452148#comment-15452148 ] Herman van Hovell commented on SPARK-17195: --- There is no easy way to get around this. What

[jira] [Commented] (SPARK-17195) Dealing with JDBC column nullability when it is not reliable

[ https://issues.apache.org/jira/browse/SPARK-17195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15451927#comment-15451927 ] Sean Owen commented on SPARK-17195: --- So you're saying the TD driver says a column is non-null, not

[jira] [Commented] (SPARK-17195) Dealing with JDBC column nullability when it is not reliable

[ https://issues.apache.org/jira/browse/SPARK-17195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432314#comment-15432314 ] Jason Moore commented on SPARK-17195: - That's right. The JDBC API has ResultSetMetaData.isNullable

[jira] [Commented] (SPARK-17195) Dealing with JDBC column nullability when it is not reliable

[ https://issues.apache.org/jira/browse/SPARK-17195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432299#comment-15432299 ] Sean Owen commented on SPARK-17195: --- Got it. Is there really value in a third state? If something is

[jira] [Commented] (SPARK-17195) Dealing with JDBC column nullability when it is not reliable

[ https://issues.apache.org/jira/browse/SPARK-17195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432285#comment-15432285 ] Jason Moore commented on SPARK-17195: - Correct, currently Spark doesn't allow us to override what the

[jira] [Commented] (SPARK-17195) Dealing with JDBC column nullability when it is not reliable

[ https://issues.apache.org/jira/browse/SPARK-17195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432268#comment-15432268 ] Sean Owen commented on SPARK-17195: --- Is it not sufficient to mark them as nullable? Or do I

[jira] [Commented] (SPARK-17195) Dealing with JDBC column nullability when it is not reliable

[ https://issues.apache.org/jira/browse/SPARK-17195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432129#comment-15432129 ] Jason Moore commented on SPARK-17195: - > I think it might be sensible to support this by implementing

[jira] [Commented] (SPARK-17195) Dealing with JDBC column nullability when it is not reliable

[ https://issues.apache.org/jira/browse/SPARK-17195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432103#comment-15432103 ] Hyukjin Kwon commented on SPARK-17195: -- I think if Teradata JDBC gives an incorrect schema (about