[
https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080193#comment-17080193
]
Wenchen Fan commented on SPARK-30951:
-
FTYI I've created a ticket for the fail-by-default behavior:
[
https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17074745#comment-17074745
]
Bruce Robbins commented on SPARK-30951:
---
{quote}
we can fail by default when reading datetime
[
https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073463#comment-17073463
]
Wenchen Fan commented on SPARK-30951:
-
Theoretically, Parquet spec implicitly requires Gregorian
[
https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073233#comment-17073233
]
Dongjoon Hyun commented on SPARK-30951:
---
The decision will depend on how much people are exposed
[
https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073231#comment-17073231
]
Dongjoon Hyun commented on SPARK-30951:
---
I'm +1 basically. Please make a Jira issue and PR for
[
https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073026#comment-17073026
]
Bruce Robbins commented on SPARK-30951:
---
Since there is some inherit danger in a migrating user
[
https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070169#comment-17070169
]
Dongjoon Hyun commented on SPARK-30951:
---
I added `release-notes` label because
[
https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17066177#comment-17066177
]
Dongjoon Hyun commented on SPARK-30951:
---
Thank you so much, [~bersprockets]!
> Potential data
[
https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17066170#comment-17066170
]
Bruce Robbins commented on SPARK-30951:
---
I added a subtask for ORC. The issue is only for date
[
https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17066159#comment-17066159
]
Dongjoon Hyun commented on SPARK-30951:
---
Hi, [~bersprockets].
Could you file a new JIRA about
[
https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17066153#comment-17066153
]
Bruce Robbins commented on SPARK-30951:
---
[~cloud_fan]
{quote}
For ORC, it follows the Java
[
https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063050#comment-17063050
]
Dongjoon Hyun commented on SPARK-30951:
---
Thanks. According to [~cloud_fan] comment, `correctness`
[
https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060024#comment-17060024
]
Wenchen Fan commented on SPARK-30951:
-
[~dongjoon] different query result doesn't always mean
[
https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059080#comment-17059080
]
Dongjoon Hyun commented on SPARK-30951:
---
I marked as `correctness` since the query result is
[
https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051094#comment-17051094
]
Wenchen Fan commented on SPARK-30951:
-
[~bersprockets] You are making a good point here. It's very
[
https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17050708#comment-17050708
]
Yuanjian Li commented on SPARK-30951:
-
[~bersprockets] Thanks for the report and detailed analysis.
[
https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17049894#comment-17049894
]
Hyukjin Kwon commented on SPARK-30951:
--
FYI [~cloud_fan], [~maxgekk], [~XuanYuan]
> Potential data
17 matches
Mail list logo