[jira] [Assigned] (SPARK-32347) BROADCAST hint makes a weird message that "column can't be resolved" (it was OK in Spark 2.4)

2020-07-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32347: Assignee: Apache Spark > BROADCAST hint makes a weird message that "column can't be resol

[jira] [Assigned] (SPARK-32347) BROADCAST hint makes a weird message that "column can't be resolved" (it was OK in Spark 2.4)

2020-07-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32347: Assignee: (was: Apache Spark) > BROADCAST hint makes a weird message that "column can

[jira] [Commented] (SPARK-32347) BROADCAST hint makes a weird message that "column can't be resolved" (it was OK in Spark 2.4)

2020-07-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160619#comment-17160619 ] Apache Spark commented on SPARK-32347: -- User 'TJX2014' has created a pull request f

[jira] [Commented] (SPARK-32347) BROADCAST hint makes a weird message that "column can't be resolved" (it was OK in Spark 2.4)

2020-07-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160620#comment-17160620 ] Apache Spark commented on SPARK-32347: -- User 'TJX2014' has created a pull request f

[jira] [Commented] (SPARK-32347) BROADCAST hint makes a weird message that "column can't be resolved" (it was OK in Spark 2.4)

2020-07-19 Thread JinxinTang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160627#comment-17160627 ] JinxinTang commented on SPARK-32347: cc [~ibobak] Thanks for your issue, I have just

[jira] [Created] (SPARK-32358) temp view not working after upgrading from 2.3.3 to 2.4.5

2020-07-19 Thread philipse (Jira)
philipse created SPARK-32358: Summary: temp view not working after upgrading from 2.3.3 to 2.4.5 Key: SPARK-32358 URL: https://issues.apache.org/jira/browse/SPARK-32358 Project: Spark Issue Type:

[jira] [Updated] (SPARK-32358) temp view not working after upgrading from 2.3.3 to 2.4.5

2020-07-19 Thread philipse (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] philipse updated SPARK-32358: - Description: After upgrading from 2.3.3 to spark 2.4.5. the temp view seems not working . Please correc

[jira] [Updated] (SPARK-32358) temp view not working after upgrading from 2.3.3 to 2.4.5

2020-07-19 Thread philipse (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] philipse updated SPARK-32358: - Description: After upgrading from 2.3.3 to spark 2.4.5. the temp view seems not working . Please correc

[jira] [Commented] (SPARK-32317) Parquet file loading with different schema(Decimal(N, P)) in files is not working as expected

2020-07-19 Thread Krish (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160776#comment-17160776 ] Krish commented on SPARK-32317: --- Thanks for the update. The problem here I see is given be

[jira] [Comment Edited] (SPARK-32317) Parquet file loading with different schema(Decimal(N, P)) in files is not working as expected

2020-07-19 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160207#comment-17160207 ] Chen Zhang edited comment on SPARK-32317 at 7/19/20, 6:10 PM:

[jira] [Comment Edited] (SPARK-32317) Parquet file loading with different schema(Decimal(N, P)) in files is not working as expected

2020-07-19 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160207#comment-17160207 ] Chen Zhang edited comment on SPARK-32317 at 7/19/20, 6:38 PM:

[jira] [Commented] (SPARK-32317) Parquet file loading with different schema(Decimal(N, P)) in files is not working as expected

2020-07-19 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160786#comment-17160786 ] Chen Zhang commented on SPARK-32317: Spark uses requiredSchema to convert the read p

[jira] [Comment Edited] (SPARK-32317) Parquet file loading with different schema(Decimal(N, P)) in files is not working as expected

2020-07-19 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160207#comment-17160207 ] Chen Zhang edited comment on SPARK-32317 at 7/19/20, 6:40 PM:

[jira] [Assigned] (SPARK-32276) Remove redundant sorts before repartition nodes

2020-07-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32276: - Assignee: Anton Okolnychyi > Remove redundant sorts before repartition nodes >

[jira] [Resolved] (SPARK-32276) Remove redundant sorts before repartition nodes

2020-07-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32276. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29089 [https://

[jira] [Created] (SPARK-32359) Implement max_error metric evaluator for spark regression mllib

2020-07-19 Thread Sayed Mohammad Hossein Torabi (Jira)
Sayed Mohammad Hossein Torabi created SPARK-32359: - Summary: Implement max_error metric evaluator for spark regression mllib Key: SPARK-32359 URL: https://issues.apache.org/jira/browse/SPARK-32359

[jira] [Commented] (SPARK-24815) Structured Streaming should support dynamic allocation

2020-07-19 Thread Gerard Alexander (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160816#comment-17160816 ] Gerard Alexander commented on SPARK-24815: -- When I read this, I am not sure wha

[jira] [Comment Edited] (SPARK-24815) Structured Streaming should support dynamic allocation

2020-07-19 Thread Gerard Alexander (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160816#comment-17160816 ] Gerard Alexander edited comment on SPARK-24815 at 7/19/20, 8:45 PM: --

[jira] [Commented] (SPARK-24815) Structured Streaming should support dynamic allocation

2020-07-19 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160818#comment-17160818 ] Jungtaek Lim commented on SPARK-24815: -- I don't think the goal of the issue is only

[jira] [Commented] (SPARK-24815) Structured Streaming should support dynamic allocation

2020-07-19 Thread Gerard Alexander (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160820#comment-17160820 ] Gerard Alexander commented on SPARK-24815: -- Thanks, but I get that; but it is h

[jira] [Comment Edited] (SPARK-24815) Structured Streaming should support dynamic allocation

2020-07-19 Thread Gerard Alexander (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160820#comment-17160820 ] Gerard Alexander edited comment on SPARK-24815 at 7/19/20, 9:23 PM: --

[jira] [Commented] (SPARK-24156) Enable no-data micro batches for more eager streaming state clean up

2020-07-19 Thread Gerard Alexander (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160831#comment-17160831 ] Gerard Alexander commented on SPARK-24156: -- Please see  [https://stackoverflow.

[jira] [Created] (SPARK-32360) Add MaxMinBy to support eliminate sorts

2020-07-19 Thread ulysses you (Jira)
ulysses you created SPARK-32360: --- Summary: Add MaxMinBy to support eliminate sorts Key: SPARK-32360 URL: https://issues.apache.org/jira/browse/SPARK-32360 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-32360) Add MaxMinBy to support eliminate sorts

2020-07-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32360: Assignee: (was: Apache Spark) > Add MaxMinBy to support eliminate sorts > ---

[jira] [Assigned] (SPARK-32360) Add MaxMinBy to support eliminate sorts

2020-07-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32360: Assignee: Apache Spark > Add MaxMinBy to support eliminate sorts > --

[jira] [Commented] (SPARK-32360) Add MaxMinBy to support eliminate sorts

2020-07-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160839#comment-17160839 ] Apache Spark commented on SPARK-32360: -- User 'ulysses-you' has created a pull reque

[jira] [Commented] (SPARK-32360) Add MaxMinBy to support eliminate sorts

2020-07-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160841#comment-17160841 ] Apache Spark commented on SPARK-32360: -- User 'ulysses-you' has created a pull reque

[jira] [Created] (SPARK-32361) Support collapse project with case Aggregate(_, _, Project)

2020-07-19 Thread ulysses you (Jira)
ulysses you created SPARK-32361: --- Summary: Support collapse project with case Aggregate(_, _, Project) Key: SPARK-32361 URL: https://issues.apache.org/jira/browse/SPARK-32361 Project: Spark Is

[jira] [Updated] (SPARK-32361) Support collapse project with case Aggregate(Project)

2020-07-19 Thread ulysses you (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you updated SPARK-32361: Summary: Support collapse project with case Aggregate(Project) (was: Support collapse project wit

[jira] [Resolved] (SPARK-29157) DataSourceV2: Add DataFrameWriterV2 to Python API

2020-07-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29157. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27331 [https://gi

[jira] [Assigned] (SPARK-29157) DataSourceV2: Add DataFrameWriterV2 to Python API

2020-07-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-29157: Assignee: Maciej Szymkiewicz > DataSourceV2: Add DataFrameWriterV2 to Python API > --

[jira] [Commented] (SPARK-32257) [SQL Parser] Report Error for invalid usage of SET command

2020-07-19 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160854#comment-17160854 ] jiaan.geng commented on SPARK-32257: [~maropu]Thanks! > [SQL Parser] Report Error f

[jira] [Commented] (SPARK-32347) BROADCAST hint makes a weird message that "column can't be resolved" (it was OK in Spark 2.4)

2020-07-19 Thread Lantao Jin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160859#comment-17160859 ] Lantao Jin commented on SPARK-32347: Duplicates to SPARK-32237 > BROADCAST hint mak

[jira] [Commented] (SPARK-32344) Unevaluable expr is set to FIRST/LAST ignoreNullsExpr in distinct aggregates

2020-07-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160865#comment-17160865 ] Apache Spark commented on SPARK-32344: -- User 'maropu' has created a pull request fo

[jira] [Created] (SPARK-32362) AdaptiveQueryExecSuite has problem

2020-07-19 Thread Lantao Jin (Jira)
Lantao Jin created SPARK-32362: -- Summary: AdaptiveQueryExecSuite has problem Key: SPARK-32362 URL: https://issues.apache.org/jira/browse/SPARK-32362 Project: Spark Issue Type: Bug Comp

[jira] [Updated] (SPARK-32362) AdaptiveQueryExecSuite misses verifying AE results

2020-07-19 Thread Lantao Jin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin updated SPARK-32362: --- Summary: AdaptiveQueryExecSuite misses verifying AE results (was: AdaptiveQueryExecSuite has proble

[jira] [Commented] (SPARK-32362) AdaptiveQueryExecSuite misses verifying AE results

2020-07-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160879#comment-17160879 ] Apache Spark commented on SPARK-32362: -- User 'LantaoJin' has created a pull request

[jira] [Assigned] (SPARK-32362) AdaptiveQueryExecSuite misses verifying AE results

2020-07-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32362: Assignee: (was: Apache Spark) > AdaptiveQueryExecSuite misses verifying AE results >

[jira] [Assigned] (SPARK-32362) AdaptiveQueryExecSuite misses verifying AE results

2020-07-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32362: Assignee: Apache Spark > AdaptiveQueryExecSuite misses verifying AE results > ---

[jira] [Updated] (SPARK-32362) AdaptiveQueryExecSuite misses verifying AE results

2020-07-19 Thread Lantao Jin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin updated SPARK-32362: --- Description: {code} QueryTest.sameRows(result.toSeq, df.collect().toSeq) {code} Even the results are

[jira] [Commented] (SPARK-32362) AdaptiveQueryExecSuite misses verifying AE results

2020-07-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160880#comment-17160880 ] Apache Spark commented on SPARK-32362: -- User 'LantaoJin' has created a pull request

[jira] [Resolved] (SPARK-20629) Copy shuffle data when nodes are being shut down

2020-07-19 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-20629. -- Fix Version/s: 3.1.0 Assignee: Holden Karau Resolution: Fixed > Copy shuffle d

[jira] [Created] (SPARK-32363) Flaky pip installation test in Jenkins

2020-07-19 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-32363: Summary: Flaky pip installation test in Jenkins Key: SPARK-32363 URL: https://issues.apache.org/jira/browse/SPARK-32363 Project: Spark Issue Type: Test

[jira] [Assigned] (SPARK-32363) Flaky pip installation test in Jenkins

2020-07-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32363: Assignee: (was: Apache Spark) > Flaky pip installation test in Jenkins >

[jira] [Assigned] (SPARK-32363) Flaky pip installation test in Jenkins

2020-07-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32363: Assignee: Apache Spark > Flaky pip installation test in Jenkins > ---

[jira] [Commented] (SPARK-32363) Flaky pip installation test in Jenkins

2020-07-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160887#comment-17160887 ] Apache Spark commented on SPARK-32363: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-32363) Flaky pip installation test in Jenkins

2020-07-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160888#comment-17160888 ] Apache Spark commented on SPARK-32363: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-32310) ML params default value parity

2020-07-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160905#comment-17160905 ] Apache Spark commented on SPARK-32310: -- User 'huaxingao' has created a pull request

[jira] [Commented] (SPARK-32310) ML params default value parity

2020-07-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160907#comment-17160907 ] Apache Spark commented on SPARK-32310: -- User 'huaxingao' has created a pull request

[jira] [Created] (SPARK-32364) `path` argument of DataFrame.load/save should override the existing options

2020-07-19 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-32364: - Summary: `path` argument of DataFrame.load/save should override the existing options Key: SPARK-32364 URL: https://issues.apache.org/jira/browse/SPARK-32364 Project

[jira] [Assigned] (SPARK-32364) `path` argument of DataFrame.load/save should override the existing options

2020-07-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32364: Assignee: (was: Apache Spark) > `path` argument of DataFrame.load/save should overrid

[jira] [Assigned] (SPARK-32364) `path` argument of DataFrame.load/save should override the existing options

2020-07-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32364: Assignee: Apache Spark > `path` argument of DataFrame.load/save should override the exist

[jira] [Commented] (SPARK-32364) `path` argument of DataFrame.load/save should override the existing options

2020-07-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160924#comment-17160924 ] Apache Spark commented on SPARK-32364: -- User 'dongjoon-hyun' has created a pull req

[jira] [Updated] (SPARK-32364) `path` argument of DataFrame.load/save should override the existing options

2020-07-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32364: -- Description: {code} spark.read .option("paTh", "1") .option("PATH", "2") .option("Path",

[jira] [Updated] (SPARK-32344) Unevaluable expr is set to FIRST/LAST ignoreNullsExpr in distinct aggregates

2020-07-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32344: -- Affects Version/s: 2.3.4 > Unevaluable expr is set to FIRST/LAST ignoreNullsExpr in distinct a

[jira] [Updated] (SPARK-32344) Unevaluable expr is set to FIRST/LAST ignoreNullsExpr in distinct aggregates

2020-07-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32344: -- Affects Version/s: 2.2.3 > Unevaluable expr is set to FIRST/LAST ignoreNullsExpr in distinct a

[jira] [Created] (SPARK-32365) Fix java.lang.IndexOutOfBoundsException: No group -1

2020-07-19 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-32365: -- Summary: Fix java.lang.IndexOutOfBoundsException: No group -1 Key: SPARK-32365 URL: https://issues.apache.org/jira/browse/SPARK-32365 Project: Spark Issue Type:

[jira] [Updated] (SPARK-32365) Fix java.lang.IndexOutOfBoundsException: No group -1

2020-07-19 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-32365: --- Description: The current implement of regexp_extract will throws a unprocessed exception show below

[jira] [Updated] (SPARK-32365) Fix java.lang.IndexOutOfBoundsException: No group -1

2020-07-19 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-32365: --- Description: The current implement of regexp_extract will throws a unprocessed exception show below

[jira] [Assigned] (SPARK-32365) Fix java.lang.IndexOutOfBoundsException: No group -1

2020-07-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32365: Assignee: Apache Spark > Fix java.lang.IndexOutOfBoundsException: No group -1 > -

[jira] [Commented] (SPARK-32365) Fix java.lang.IndexOutOfBoundsException: No group -1

2020-07-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160942#comment-17160942 ] Apache Spark commented on SPARK-32365: -- User 'beliefer' has created a pull request

[jira] [Assigned] (SPARK-32365) Fix java.lang.IndexOutOfBoundsException: No group -1

2020-07-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32365: Assignee: (was: Apache Spark) > Fix java.lang.IndexOutOfBoundsException: No group -1

[jira] [Updated] (SPARK-32344) Unevaluable expr is set to FIRST/LAST ignoreNullsExpr in distinct aggregates

2020-07-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32344: -- Fix Version/s: 2.4.7 > Unevaluable expr is set to FIRST/LAST ignoreNullsExpr in distinct aggre

[jira] [Updated] (SPARK-32364) `path` argument of DataFrame.load/save should override the existing options

2020-07-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32364: -- Description: {code} spark.read .option("paTh", "1") .option("PATH", "2") .option("Path",