[jira] [Commented] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

2020-02-02 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17028748#comment-17028748 ] Wenchen Fan commented on SPARK-30668: - [~maxgekk] can we do them one by one? The SimpleDateFormat

[jira] [Created] (SPARK-30707) Lead/Lag window function throws AnalysisException without ORDER BY clause

2020-02-02 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-30707: -- Summary: Lead/Lag window function throws AnalysisException without ORDER BY clause Key: SPARK-30707 URL: https://issues.apache.org/jira/browse/SPARK-30707 Project: Spark

[jira] [Commented] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

2020-02-02 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17028731#comment-17028731 ] Maxim Gekk commented on SPARK-30668: Behind of the removed config 

[jira] [Updated] (SPARK-30706) TimeZone in writing pure date type in CSV output

2020-02-02 Thread Waldemar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Waldemar updated SPARK-30706: - Description: If I read string date from CSV file, then cast to date type and write into CSV file again

[jira] [Created] (SPARK-30706) TimeZone in writing pure date type in CSV output

2020-02-02 Thread Waldemar (Jira)
Waldemar created SPARK-30706: Summary: TimeZone in writing pure date type in CSV output Key: SPARK-30706 URL: https://issues.apache.org/jira/browse/SPARK-30706 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

2020-02-02 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17028709#comment-17028709 ] Wenchen Fan commented on SPARK-30668: - I checked the doc in [Spark

[jira] [Assigned] (SPARK-24434) Support user-specified driver and executor pod templates

2020-02-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-24434: - Assignee: Onur Satici > Support user-specified driver and executor pod templates >

[jira] [Commented] (SPARK-26448) retain the difference between 0.0 and -0.0

2020-02-02 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17028699#comment-17028699 ] Wenchen Fan commented on SPARK-26448: - I don't think the 0.0 and -0.0 difference is a serious issue,

[jira] [Resolved] (SPARK-25531) new write APIs for data source v2

2020-02-02 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-25531. - Fix Version/s: 3.0.0 Target Version/s: (was: 3.1.0) Resolution: Fixed > new

[jira] [Resolved] (SPARK-24253) DataSourceV2: Add DeleteSupport for delete and overwrite operations

2020-02-02 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-24253. - Resolution: Duplicate > DataSourceV2: Add DeleteSupport for delete and overwrite operations >

[jira] [Commented] (SPARK-24625) put all the backward compatible behavior change configs under spark.sql.legacy.*

2020-02-02 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17028695#comment-17028695 ] Wenchen Fan commented on SPARK-24625: - I believe all of them are fixed. > put all the backward

[jira] [Resolved] (SPARK-24625) put all the backward compatible behavior change configs under spark.sql.legacy.*

2020-02-02 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-24625. - Fix Version/s: 3.0.0 Resolution: Fixed > put all the backward compatible behavior change

[jira] [Assigned] (SPARK-30697) Handle database and namespace exceptions in catalog.isView

2020-02-02 Thread Burak Yavuz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz reassigned SPARK-30697: --- Assignee: Burak Yavuz > Handle database and namespace exceptions in catalog.isView >

[jira] [Resolved] (SPARK-30697) Handle database and namespace exceptions in catalog.isView

2020-02-02 Thread Burak Yavuz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz resolved SPARK-30697. - Fix Version/s: 3.0.0 Resolution: Fixed Resolved by 

[jira] [Commented] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

2020-02-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17028586#comment-17028586 ] Dongjoon Hyun commented on SPARK-30668: --- [~maxgekk]. What I meant was the scope of this `BUG`

[jira] [Commented] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

2020-02-02 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17028545#comment-17028545 ] Maxim Gekk commented on SPARK-30668: > as a bug introduced by a new improvement patch.  Don't

[jira] [Comment Edited] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

2020-02-02 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17028532#comment-17028532 ] Maxim Gekk edited comment on SPARK-30668 at 2/2/20 7:47 PM: [~dongjoon] I

[jira] [Comment Edited] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

2020-02-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17028537#comment-17028537 ] Dongjoon Hyun edited comment on SPARK-30668 at 2/2/20 7:41 PM: --- Given the

[jira] [Comment Edited] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

2020-02-02 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17028532#comment-17028532 ] Maxim Gekk edited comment on SPARK-30668 at 2/2/20 7:40 PM: [~dongjoon] I

[jira] [Commented] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

2020-02-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17028537#comment-17028537 ] Dongjoon Hyun commented on SPARK-30668: --- Given the current circumstance, this seems to be

[jira] [Commented] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

2020-02-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17028535#comment-17028535 ] Dongjoon Hyun commented on SPARK-30668: --- [~maxgekk]. We don't backport improvement. You registered

[jira] [Commented] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

2020-02-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17028533#comment-17028533 ] Dongjoon Hyun commented on SPARK-30668: --- [~maxgekk]. You should be the last man who surprised.

[jira] [Commented] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

2020-02-02 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17028532#comment-17028532 ] Maxim Gekk commented on SPARK-30668: [~dongjoon] I have found the reason 

[jira] [Updated] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

2020-02-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30668: -- Description: {code:java} SELECT to_timestamp("2020-01-27T20:06:11.847-0800",

[jira] [Updated] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

2020-02-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30668: -- Description: {code:java} SELECT to_timestamp("2020-01-27T20:06:11.847-0800",

[jira] [Updated] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

2020-02-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30668: -- Description: {code:java} SELECT to_timestamp("2020-01-27T20:06:11.847-0800",

[jira] [Comment Edited] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

2020-02-02 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17028515#comment-17028515 ] Maxim Gekk edited comment on SPARK-30668 at 2/2/20 6:51 PM: [~dongjoon] 

[jira] [Commented] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

2020-02-02 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17028515#comment-17028515 ] Maxim Gekk commented on SPARK-30668: [~dongjoon] Output of your example is surprised - it doesn't

[jira] [Updated] (SPARK-30668) to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"

2020-02-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30668: -- Description: {code:java} SELECT to_timestamp("2020-01-27T20:06:11.847-0800",

[jira] [Commented] (SPARK-30559) Spark 2.4.4 - spark.sql.hive.caseSensitiveInferenceMode does not work with Hive

2020-02-02 Thread Ori Popowski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17028386#comment-17028386 ] Ori Popowski commented on SPARK-30559: -- Can someone please take a look at this? > Spark 2.4.4 -

[jira] [Updated] (SPARK-30705) Improve CaseWhen sub-expression equality

2020-02-02 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-30705: Description: We only support the first condition expression. But we can improve this pattern:

[jira] [Created] (SPARK-30705) Improve CaseWhen sub-expression equality

2020-02-02 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-30705: --- Summary: Improve CaseWhen sub-expression equality Key: SPARK-30705 URL: https://issues.apache.org/jira/browse/SPARK-30705 Project: Spark Issue Type:

[jira] [Commented] (SPARK-29564) Cluster deploy mode should support Spark Thrift server

2020-02-02 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17028327#comment-17028327 ] zhoukang commented on SPARK-29564: -- Any progress? [~cltlfcjin] We also support yarn cluster mode in our

[jira] [Resolved] (SPARK-30704) Use jekyll-redirect-from 0.15.0 instead of the latest

2020-02-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30704. --- Fix Version/s: 3.0.0 2.4.5 Resolution: Fixed Issue resolved by

[jira] [Assigned] (SPARK-30704) Use jekyll-redirect-from 0.15.0 instead of the latest

2020-02-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30704: - Assignee: Dongjoon Hyun > Use jekyll-redirect-from 0.15.0 instead of the latest >

[jira] [Updated] (SPARK-29732) Add two Jenkins job to run `check-cran.sh` on branch-2.4/master

2020-02-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29732: -- Priority: Major (was: Blocker) > Add two Jenkins job to run `check-cran.sh` on

[jira] [Resolved] (SPARK-29732) Add two Jenkins job to run `check-cran.sh` on branch-2.4/master

2020-02-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29732. --- Resolution: Won't Do > Add two Jenkins job to run `check-cran.sh` on branch-2.4/master >

[jira] [Closed] (SPARK-29732) Add two Jenkins job to run `check-cran.sh` on branch-2.4/master

2020-02-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-29732. - > Add two Jenkins job to run `check-cran.sh` on branch-2.4/master >