[jira] [Updated] (SPARK-31459) When using the insert overwrite directory syntax, if the target path is an existing file, the final run result is incorrect

2020-04-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31459: -- Affects Version/s: (was: 3) 3.0.0 > When using the insert

[jira] [Resolved] (SPARK-31390) Document Window Function

2020-04-17 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-31390. -- Fix Version/s: 3.0.0 Assignee: Huaxin Gao Resolution: Fixed Resolved

[jira] [Created] (SPARK-31476) Add an ExpressionInfo entry for EXTRACT

2020-04-17 Thread Takeshi Yamamuro (Jira)
Takeshi Yamamuro created SPARK-31476: Summary: Add an ExpressionInfo entry for EXTRACT Key: SPARK-31476 URL: https://issues.apache.org/jira/browse/SPARK-31476 Project: Spark Issue Type:

[jira] [Updated] (SPARK-31476) Add an ExpressionInfo entry for EXTRACT

2020-04-17 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-31476: - Description: This ticket intends to add an ExpressionInfo entry for EXTRACT for better

[jira] [Commented] (SPARK-29302) dynamic partition overwrite with speculation enabled

2020-04-17 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086124#comment-17086124 ] Mridul Muralidharan commented on SPARK-29302: - I agree with [~feiwang], it looks like

[jira] [Issue Comment Deleted] (SPARK-29302) dynamic partition overwrite with speculation enabled

2020-04-17 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-29302: Comment: was deleted (was: Drive by observations: * Speculative execution does

[jira] [Commented] (SPARK-29302) dynamic partition overwrite with speculation enabled

2020-04-17 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086117#comment-17086117 ] Mridul Muralidharan commented on SPARK-29302: - Drive by observations: * Speculative

[jira] [Updated] (SPARK-31420) Infinite timeline redraw in job details page

2020-04-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31420: -- Fix Version/s: (was: 3.1.0) (was: 2.4.5) 2.4.6

[jira] [Updated] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Florentino Sainz updated SPARK-31417: - Description: *I would like some help to explore if the following feature makes sense

[jira] [Updated] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Florentino Sainz updated SPARK-31417: - Description: *I would like some help to explore if the following feature makes sense

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086039#comment-17086039 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 9:26 PM:

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086039#comment-17086039 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 9:26 PM:

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086039#comment-17086039 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 9:00 PM:

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086039#comment-17086039 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 8:57 PM:

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086039#comment-17086039 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 8:56 PM:

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086039#comment-17086039 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 8:55 PM:

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086039#comment-17086039 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 8:54 PM:

[jira] [Updated] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Florentino Sainz updated SPARK-31417: - Description: *I would like some help to explore if the following feature makes sense

[jira] [Resolved] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Florentino Sainz resolved SPARK-31417. -- Resolution: Abandoned > Allow broadcast variables when using isin code >

[jira] [Updated] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Florentino Sainz updated SPARK-31417: - Description: Read last comment :) *I would like some help to explore if the following

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086039#comment-17086039 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 8:45 PM:

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086039#comment-17086039 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 8:45 PM:

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086039#comment-17086039 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 8:45 PM:

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086039#comment-17086039 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 8:44 PM:

[jira] [Updated] (SPARK-31446) Make html elements for a paged table possible to have different id attribute.

2020-04-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31446: -- Fix Version/s: (was: 3.1.0) 3.0.0 > Make html elements for a paged

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086039#comment-17086039 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 8:42 PM:

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086039#comment-17086039 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 8:42 PM:

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086039#comment-17086039 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 8:41 PM:

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086039#comment-17086039 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 8:41 PM:

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086039#comment-17086039 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 8:40 PM:

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086039#comment-17086039 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 8:40 PM:

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086039#comment-17086039 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 8:39 PM:

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086039#comment-17086039 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 8:15 PM:

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086039#comment-17086039 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 8:15 PM:

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086039#comment-17086039 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 8:12 PM:

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086039#comment-17086039 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 8:11 PM:

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086039#comment-17086039 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 8:10 PM:

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086039#comment-17086039 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 8:09 PM:

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086039#comment-17086039 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 8:09 PM:

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086039#comment-17086039 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 8:09 PM:

[jira] [Commented] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086039#comment-17086039 ] Florentino Sainz commented on SPARK-31417: -- Well... just finished my PoC by adding a custom

[jira] [Comment Edited] (SPARK-27249) Developers API for Transformers beyond UnaryTransformer

2020-04-17 Thread Nick Afshartous (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086029#comment-17086029 ] Nick Afshartous edited comment on SPARK-27249 at 4/17/20, 7:54 PM: ---

[jira] [Commented] (SPARK-27249) Developers API for Transformers beyond UnaryTransformer

2020-04-17 Thread Nick Afshartous (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086029#comment-17086029 ] Nick Afshartous commented on SPARK-27249: - [~enrush] Hi Everett, Using the {{Iterator}}

[jira] [Created] (SPARK-31475) Broadcast stage in AQE did not timeout

2020-04-17 Thread Wei Xue (Jira)
Wei Xue created SPARK-31475: --- Summary: Broadcast stage in AQE did not timeout Key: SPARK-31475 URL: https://issues.apache.org/jira/browse/SPARK-31475 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-31474) Consistancy between dayofweek/dow in extract expression and dayofweek function

2020-04-17 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-31474: - Summary: Consistancy between dayofweek/dow in extract expression and dayofweek function (was:

[jira] [Created] (SPARK-31474) Consistancy betwwen dayofweek/dow in extract expression and dayofweek function

2020-04-17 Thread Kent Yao (Jira)
Kent Yao created SPARK-31474: Summary: Consistancy betwwen dayofweek/dow in extract expression and dayofweek function Key: SPARK-31474 URL: https://issues.apache.org/jira/browse/SPARK-31474 Project:

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17085900#comment-17085900 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 5:59 PM:

[jira] [Created] (SPARK-31473) AQE should set active session during execution

2020-04-17 Thread Wei Xue (Jira)
Wei Xue created SPARK-31473: --- Summary: AQE should set active session during execution Key: SPARK-31473 URL: https://issues.apache.org/jira/browse/SPARK-31473 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17085900#comment-17085900 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 5:15 PM:

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17085900#comment-17085900 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 5:14 PM:

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17085900#comment-17085900 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 5:14 PM:

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17085900#comment-17085900 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 5:13 PM:

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17085900#comment-17085900 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 5:08 PM:

[jira] [Commented] (SPARK-1537) Add integration with Yarn's Application Timeline Server

2020-04-17 Thread Daniel Templeton (Jira)
[ https://issues.apache.org/jira/browse/SPARK-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17085922#comment-17085922 ] Daniel Templeton commented on SPARK-1537: - [~vanzin], is that because the community has invested

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17085900#comment-17085900 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 4:43 PM:

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17085900#comment-17085900 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 4:41 PM:

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17085900#comment-17085900 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 4:40 PM:

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17085900#comment-17085900 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 4:38 PM:

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17085900#comment-17085900 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 4:38 PM:

[jira] [Commented] (SPARK-30495) How to disable 'spark.security.credentials.${service}.enabled' in Structured streaming while connecting to a kafka cluster

2020-04-17 Thread Eric (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17085914#comment-17085914 ] Eric commented on SPARK-30495: -- Anyone knows when this fix will make it to a public build?  I see that it

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17085900#comment-17085900 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 4:26 PM:

[jira] [Comment Edited] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17085900#comment-17085900 ] Florentino Sainz edited comment on SPARK-31417 at 4/17/20, 4:08 PM:

[jira] [Commented] (SPARK-31417) Allow broadcast variables when using isin code

2020-04-17 Thread Florentino Sainz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17085900#comment-17085900 ] Florentino Sainz commented on SPARK-31417: -- I'm going ahead with something. Just realized the

[jira] [Commented] (SPARK-27913) Spark SQL's native ORC reader implements its own schema evolution

2020-04-17 Thread Giri Dandu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17085852#comment-17085852 ] Giri Dandu commented on SPARK-27913: [~viirya] Sorry for late reply. I re-ran the same test in

[jira] [Resolved] (SPARK-31468) Null types should be implicitly casted to Decimal types

2020-04-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31468. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28241

[jira] [Assigned] (SPARK-31468) Null types should be implicitly casted to Decimal types

2020-04-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31468: --- Assignee: Takeshi Yamamuro > Null types should be implicitly casted to Decimal types >

[jira] [Created] (SPARK-31472) allGather() may return null messages

2020-04-17 Thread wuyi (Jira)
wuyi created SPARK-31472: Summary: allGather() may return null messages Key: SPARK-31472 URL: https://issues.apache.org/jira/browse/SPARK-31472 Project: Spark Issue Type: Bug Components:

[jira] [Resolved] (SPARK-31469) Make extract interval field ANSI compliance

2020-04-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31469. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28242

[jira] [Assigned] (SPARK-31469) Make extract interval field ANSI compliance

2020-04-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31469: --- Assignee: Kent Yao > Make extract interval field ANSI compliance >

[jira] [Commented] (SPARK-26902) Support java.time.Instant as an external type of TimestampType

2020-04-17 Thread Jorge Machado (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17085759#comment-17085759 ] Jorge Machado commented on SPARK-26902: --- what about Supporting the interface Temporal ? > Support

[jira] [Resolved] (SPARK-31436) MinHash keyDistance optimization

2020-04-17 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-31436. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28206

[jira] [Assigned] (SPARK-31436) MinHash keyDistance optimization

2020-04-17 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-31436: Assignee: zhengruifeng > MinHash keyDistance optimization >

[jira] [Created] (SPARK-31471) Add a script to run multiple benchmarks

2020-04-17 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31471: -- Summary: Add a script to run multiple benchmarks Key: SPARK-31471 URL: https://issues.apache.org/jira/browse/SPARK-31471 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-31448) Difference in Storage Levels used in cache() and persist() for pyspark dataframes

2020-04-17 Thread Abhishek Dixit (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Dixit updated SPARK-31448: --- Labels: (was: pys) > Difference in Storage Levels used in cache() and persist() for

[jira] [Updated] (SPARK-31448) Difference in Storage Levels used in cache() and persist() for pyspark dataframes

2020-04-17 Thread Abhishek Dixit (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Dixit updated SPARK-31448: --- Labels: pys (was: ) > Difference in Storage Levels used in cache() and persist() for

[jira] [Resolved] (SPARK-31423) DATES and TIMESTAMPS for a certain range are off by 10 days when stored in ORC

2020-04-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31423. - Resolution: Not A Problem > DATES and TIMESTAMPS for a certain range are off by 10 days when

[jira] [Commented] (SPARK-31423) DATES and TIMESTAMPS for a certain range are off by 10 days when stored in ORC

2020-04-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17085585#comment-17085585 ] Wenchen Fan commented on SPARK-31423: - I'm closing it as "not a bug". This happens because we

[jira] [Created] (SPARK-31470) Introduce SORTED BY clause in CREATE TABLE statement

2020-04-17 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-31470: --- Summary: Introduce SORTED BY clause in CREATE TABLE statement Key: SPARK-31470 URL: https://issues.apache.org/jira/browse/SPARK-31470 Project: Spark Issue

[jira] [Created] (SPARK-31469) Make extract interval field ANSI compliance

2020-04-17 Thread Kent Yao (Jira)
Kent Yao created SPARK-31469: Summary: Make extract interval field ANSI compliance Key: SPARK-31469 URL: https://issues.apache.org/jira/browse/SPARK-31469 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-31467) Fix test issue with table named `test` in hive/SQLQuerySuite

2020-04-17 Thread feiwang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwang updated SPARK-31467: Description: If we add ut in hive/SQLQuerySuite and use table named `test`. We may meet these

[jira] [Created] (SPARK-31468) Null types should be implicitly casted to Decimal types

2020-04-17 Thread Takeshi Yamamuro (Jira)
Takeshi Yamamuro created SPARK-31468: Summary: Null types should be implicitly casted to Decimal types Key: SPARK-31468 URL: https://issues.apache.org/jira/browse/SPARK-31468 Project: Spark

[jira] [Created] (SPARK-31467) Fix test issue with table named `test` in hive/SQLQuerySuite

2020-04-17 Thread feiwang (Jira)
feiwang created SPARK-31467: --- Summary: Fix test issue with table named `test` in hive/SQLQuerySuite Key: SPARK-31467 URL: https://issues.apache.org/jira/browse/SPARK-31467 Project: Spark Issue

[jira] [Assigned] (SPARK-30913) Add version information to the configuration of Tests.scala

2020-04-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-30913: Assignee: jiaan.geng > Add version information to the configuration of Tests.scala >