[
https://issues.apache.org/jira/browse/SPARK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951228#comment-16951228
]
Dongjoon Hyun commented on SPARK-10848:
---
Hi, [~purijatin]. If you are sure the schema, there is a
[
https://issues.apache.org/jira/browse/SPARK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950461#comment-16950461
]
Maxim Gekk commented on SPARK-10848:
Nullable = false in user's schema cannot guarantee that nulls
[
https://issues.apache.org/jira/browse/SPARK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16948361#comment-16948361
]
Jatin Puri commented on SPARK-10848:
This issue still exists in `2.4.4`. Should a new issue be
[
https://issues.apache.org/jira/browse/SPARK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16407851#comment-16407851
]
Natalia Gorchakova commented on SPARK-10848:
As I understand, intent of calling .asNullable
[
https://issues.apache.org/jira/browse/SPARK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16265406#comment-16265406
]
Nurdin Premji commented on SPARK-10848:
---
I've also encountered this issue with spark 2.2.0.
Please
[
https://issues.apache.org/jira/browse/SPARK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263867#comment-16263867
]
Amit commented on SPARK-10848:
--
This issue is still persistent in Spark 2.1.0.
I tried below steps and in
[
https://issues.apache.org/jira/browse/SPARK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15561328#comment-15561328
]
Xiao Li commented on SPARK-10848:
-
This should be resolved in the latest file format refactoring in Spark
[
https://issues.apache.org/jira/browse/SPARK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003178#comment-15003178
]
Xin Wu commented on SPARK-10848:
With rdd created in the application, as following:
{code}
val jsonRdd =
[
https://issues.apache.org/jira/browse/SPARK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15001404#comment-15001404
]
Xin Wu commented on SPARK-10848:
I can recreate this as describe. Looking into the code.
> Applied JSON
[
https://issues.apache.org/jira/browse/SPARK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15001667#comment-15001667
]
Xin Wu commented on SPARK-10848:
Debugging through the code and found that in ResolvedDataSource.apply
[
https://issues.apache.org/jira/browse/SPARK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15001685#comment-15001685
]
Xin Wu commented on SPARK-10848:
One case I found where there is inconsistency between using asNullable
11 matches
Mail list logo
