[jira] [Commented] (SPARK-30951) Potential data loss for legacy applications after switch to proleptic Gregorian calendar

2020-04-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080193#comment-17080193 ] Wenchen Fan commented on SPARK-30951: - FTYI I've created a ticket for the fail-by-default behavior:

[jira] [Commented] (SPARK-30951) Potential data loss for legacy applications after switch to proleptic Gregorian calendar

2020-04-03 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17074745#comment-17074745 ] Bruce Robbins commented on SPARK-30951: --- {quote} we can fail by default when reading datetime

[jira] [Commented] (SPARK-30951) Potential data loss for legacy applications after switch to proleptic Gregorian calendar

2020-04-02 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073463#comment-17073463 ] Wenchen Fan commented on SPARK-30951: - Theoretically, Parquet spec implicitly requires Gregorian

[jira] [Commented] (SPARK-30951) Potential data loss for legacy applications after switch to proleptic Gregorian calendar

2020-04-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073233#comment-17073233 ] Dongjoon Hyun commented on SPARK-30951: --- The decision will depend on how much people are exposed

[jira] [Commented] (SPARK-30951) Potential data loss for legacy applications after switch to proleptic Gregorian calendar

2020-04-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073231#comment-17073231 ] Dongjoon Hyun commented on SPARK-30951: --- I'm +1 basically. Please make a Jira issue and PR for

[jira] [Commented] (SPARK-30951) Potential data loss for legacy applications after switch to proleptic Gregorian calendar

2020-04-01 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073026#comment-17073026 ] Bruce Robbins commented on SPARK-30951: --- Since there is some inherit danger in a migrating user

[jira] [Commented] (SPARK-30951) Potential data loss for legacy applications after switch to proleptic Gregorian calendar

2020-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070169#comment-17070169 ] Dongjoon Hyun commented on SPARK-30951: --- I added `release-notes` label because

[jira] [Commented] (SPARK-30951) Potential data loss for legacy applications after switch to proleptic Gregorian calendar

2020-03-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17066177#comment-17066177 ] Dongjoon Hyun commented on SPARK-30951: --- Thank you so much, [~bersprockets]! > Potential data

[jira] [Commented] (SPARK-30951) Potential data loss for legacy applications after switch to proleptic Gregorian calendar

2020-03-24 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17066170#comment-17066170 ] Bruce Robbins commented on SPARK-30951: --- I added a subtask for ORC. The issue is only for date

[jira] [Commented] (SPARK-30951) Potential data loss for legacy applications after switch to proleptic Gregorian calendar

2020-03-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17066159#comment-17066159 ] Dongjoon Hyun commented on SPARK-30951: --- Hi, [~bersprockets]. Could you file a new JIRA about

[jira] [Commented] (SPARK-30951) Potential data loss for legacy applications after switch to proleptic Gregorian calendar

2020-03-24 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17066153#comment-17066153 ] Bruce Robbins commented on SPARK-30951: --- [~cloud_fan] {quote} For ORC, it follows the Java

[jira] [Commented] (SPARK-30951) Potential data loss for legacy applications after switch to proleptic Gregorian calendar

2020-03-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063050#comment-17063050 ] Dongjoon Hyun commented on SPARK-30951: --- Thanks. According to [~cloud_fan] comment, `correctness`

[jira] [Commented] (SPARK-30951) Potential data loss for legacy applications after switch to proleptic Gregorian calendar

2020-03-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060024#comment-17060024 ] Wenchen Fan commented on SPARK-30951: - [~dongjoon] different query result doesn't always mean

[jira] [Commented] (SPARK-30951) Potential data loss for legacy applications after switch to proleptic Gregorian calendar

2020-03-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059080#comment-17059080 ] Dongjoon Hyun commented on SPARK-30951: --- I marked as `correctness` since the query result is

[jira] [Commented] (SPARK-30951) Potential data loss for legacy applications after switch to proleptic Gregorian calendar

2020-03-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051094#comment-17051094 ] Wenchen Fan commented on SPARK-30951: - [~bersprockets] You are making a good point here. It's very

[jira] [Commented] (SPARK-30951) Potential data loss for legacy applications after switch to proleptic Gregorian calendar

2020-03-03 Thread Yuanjian Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17050708#comment-17050708 ] Yuanjian Li commented on SPARK-30951: - [~bersprockets] Thanks for the report and detailed analysis.

[jira] [Commented] (SPARK-30951) Potential data loss for legacy applications after switch to proleptic Gregorian calendar

2020-03-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17049894#comment-17049894 ] Hyukjin Kwon commented on SPARK-30951: -- FYI [~cloud_fan], [~maxgekk], [~XuanYuan] > Potential data