[jira] [Commented] (SPARK-32852) spark.sql.hive.metastore.jars support HDFS location

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17234318#comment-17234318 ] Apache Spark commented on SPARK-32852: -- User 'gengliangwang' has created a pull req

[jira] [Commented] (SPARK-32852) spark.sql.hive.metastore.jars support HDFS location

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17234319#comment-17234319 ] Apache Spark commented on SPARK-32852: -- User 'gengliangwang' has created a pull req

[jira] [Commented] (SPARK-33473) Extend interpreted subexpression elimination to other interpreted projection

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17234286#comment-17234286 ] Apache Spark commented on SPARK-33473: -- User 'viirya' has created a pull request fo

[jira] [Assigned] (SPARK-33473) Extend interpreted subexpression elimination to other interpreted projection

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33473: Assignee: L. C. Hsieh (was: Apache Spark) > Extend interpreted subexpression elimination

[jira] [Commented] (SPARK-33473) Extend interpreted subexpression elimination to other interpreted projection

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17234285#comment-17234285 ] Apache Spark commented on SPARK-33473: -- User 'viirya' has created a pull request fo

[jira] [Assigned] (SPARK-33473) Extend interpreted subexpression elimination to other interpreted projection

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33473: Assignee: Apache Spark (was: L. C. Hsieh) > Extend interpreted subexpression elimination

[jira] [Updated] (SPARK-33476) Generalize ExecutorSource to expose user-given file system schemes

2020-11-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33476: -- Summary: Generalize ExecutorSource to expose user-given file system schemes (was: Generalize

[jira] [Commented] (SPARK-33476) Generalize filesystem metric to support user-given file scheme

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17234248#comment-17234248 ] Apache Spark commented on SPARK-33476: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-33475) Bump ANTLR runtime version to 4.8-1

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17234247#comment-17234247 ] Apache Spark commented on SPARK-33475: -- User 'maropu' has created a pull request fo

[jira] [Assigned] (SPARK-33476) Generalize filesystem metric to support user-given file scheme

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33476: Assignee: (was: Apache Spark) > Generalize filesystem metric to support user-given fi

[jira] [Commented] (SPARK-33476) Generalize filesystem metric to support user-given file scheme

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17234246#comment-17234246 ] Apache Spark commented on SPARK-33476: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-33475) Bump ANTLR runtime version to 4.8-1

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33475: Assignee: (was: Apache Spark) > Bump ANTLR runtime version to 4.8-1 > ---

[jira] [Assigned] (SPARK-33475) Bump ANTLR runtime version to 4.8-1

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33475: Assignee: Apache Spark > Bump ANTLR runtime version to 4.8-1 > --

[jira] [Assigned] (SPARK-33476) Generalize filesystem metric to support user-given file scheme

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33476: Assignee: Apache Spark > Generalize filesystem metric to support user-given file scheme >

[jira] [Created] (SPARK-33476) Generalize filesystem metric to support user-given file scheme

2020-11-17 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-33476: - Summary: Generalize filesystem metric to support user-given file scheme Key: SPARK-33476 URL: https://issues.apache.org/jira/browse/SPARK-33476 Project: Spark

[jira] [Created] (SPARK-33475) Bump ANTLR runtime version to 4.8-1

2020-11-17 Thread Takeshi Yamamuro (Jira)
Takeshi Yamamuro created SPARK-33475: Summary: Bump ANTLR runtime version to 4.8-1 Key: SPARK-33475 URL: https://issues.apache.org/jira/browse/SPARK-33475 Project: Spark Issue Type: Impro

[jira] [Assigned] (SPARK-33448) Migrate CACHE/UNCACHE TABLE to new resolution framework

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33448: Assignee: Apache Spark > Migrate CACHE/UNCACHE TABLE to new resolution framework > --

[jira] [Assigned] (SPARK-33448) Migrate CACHE/UNCACHE TABLE to new resolution framework

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33448: Assignee: (was: Apache Spark) > Migrate CACHE/UNCACHE TABLE to new resolution framewo

[jira] [Commented] (SPARK-33448) Migrate CACHE/UNCACHE TABLE to new resolution framework

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17234223#comment-17234223 ] Apache Spark commented on SPARK-33448: -- User 'imback82' has created a pull request

[jira] [Updated] (SPARK-33474) Incorrect value when inserting into date type partition table with date type value

2020-11-17 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33474: Description: {code:java} create table test_part (name STRING) partitioned by (part date) STORED AS

[jira] [Created] (SPARK-33474) Incorrect value when inserting into date type partition table with date type value

2020-11-17 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-33474: --- Summary: Incorrect value when inserting into date type partition table with date type value Key: SPARK-33474 URL: https://issues.apache.org/jira/browse/SPARK-33474 Proj

[jira] [Created] (SPARK-33473) Extend interpreted subexpression elimination to other interpreted projection

2020-11-17 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-33473: --- Summary: Extend interpreted subexpression elimination to other interpreted projection Key: SPARK-33473 URL: https://issues.apache.org/jira/browse/SPARK-33473 Project: S

[jira] [Assigned] (SPARK-31069) high cpu caused by chunksBeingTransferred in external shuffle service

2020-11-17 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-31069: --- Assignee: angerszhu > high cpu caused by chunksBeingTransferred in external

[jira] [Assigned] (SPARK-31069) high cpu caused by chunksBeingTransferred in external shuffle service

2020-11-17 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-31069: --- Assignee: angerszhu (was: angerszhu) > high cpu caused by chunksBeingTrans

[jira] [Resolved] (SPARK-31069) high cpu caused by chunksBeingTransferred in external shuffle service

2020-11-17 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-31069. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 301

[jira] [Resolved] (SPARK-33465) RDD.takeOrdered should get rid of usage of reduce or use treeReduce instead

2020-11-17 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-33465. - Resolution: Not A Problem > RDD.takeOrdered should get rid of usage of reduce or use treeReduce

[jira] [Assigned] (SPARK-33472) IllegalArgumentException when applying RemoveRedundantSorts before EnsureRequirements

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33472: Assignee: (was: Apache Spark) > IllegalArgumentException when applying RemoveRedundan

[jira] [Commented] (SPARK-33472) IllegalArgumentException when applying RemoveRedundantSorts before EnsureRequirements

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17234163#comment-17234163 ] Apache Spark commented on SPARK-33472: -- User 'allisonwang-db' has created a pull re

[jira] [Commented] (SPARK-33472) IllegalArgumentException when applying RemoveRedundantSorts before EnsureRequirements

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17234162#comment-17234162 ] Apache Spark commented on SPARK-33472: -- User 'allisonwang-db' has created a pull re

[jira] [Assigned] (SPARK-33472) IllegalArgumentException when applying RemoveRedundantSorts before EnsureRequirements

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33472: Assignee: Apache Spark > IllegalArgumentException when applying RemoveRedundantSorts befo

[jira] [Updated] (SPARK-33472) IllegalArgumentException when applying RemoveRedundantSorts before EnsureRequirements

2020-11-17 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-33472: - Description: `RemoveRedundantSorts` rule uses SparkPlan's `outputPartitioning` to check whether

[jira] [Updated] (SPARK-33472) IllegalArgumentException when applying RemoveRedundantSorts before EnsureRequirements

2020-11-17 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-33472: - Description: `RemoveRedundantSorts` rule uses SparkPlan's `outputPartitioning` to check whether

[jira] [Created] (SPARK-33472) IllegalArgumentException when applying RemoveRedundantSorts before EnsureRequirements

2020-11-17 Thread Allison Wang (Jira)
Allison Wang created SPARK-33472: Summary: IllegalArgumentException when applying RemoveRedundantSorts before EnsureRequirements Key: SPARK-33472 URL: https://issues.apache.org/jira/browse/SPARK-33472

[jira] [Updated] (SPARK-33470) HistoryServer stuck "Loading history summary" with Spark 3.0.1 and hadoop 2.10.1

2020-11-17 Thread Dino Tufekcic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dino Tufekcic updated SPARK-33470: -- Description: History Server starts correctly and shows "No completed applications found!" mes

[jira] [Updated] (SPARK-33470) HistoryServer stuck "Loading history summary" with Spark 3.0.1 and hadoop 2.10.1

2020-11-17 Thread Dino Tufekcic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dino Tufekcic updated SPARK-33470: -- Attachment: stack.trace > HistoryServer stuck "Loading history summary" with Spark 3.0.1 and h

[jira] [Updated] (SPARK-33461) Propagating SPARK_CONF_DIR in K8s and tests

2020-11-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33461: -- Target Version/s: 3.1.0 > Propagating SPARK_CONF_DIR in K8s and tests > --

[jira] [Resolved] (SPARK-33471) Upgrade kubernetes-client to 4.12.0

2020-11-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33471. --- Resolution: Fixed Issue resolved by pull request 30401 [https://github.com/apache/spark/pull

[jira] [Assigned] (SPARK-33471) Upgrade kubernetes-client to 4.12.0

2020-11-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33471: - Assignee: rameshkrishnan muthusamy > Upgrade kubernetes-client to 4.12.0 >

[jira] [Updated] (SPARK-32862) Left semi stream-stream join

2020-11-17 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-32862: Labels: release-notes (was: ) > Left semi stream-stream join > > >

[jira] [Updated] (SPARK-33470) HistoryServer stuck "Loading history summary" with Spark 3.0.1 and hadoop 2.10.1

2020-11-17 Thread Dino Tufekcic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dino Tufekcic updated SPARK-33470: -- Environment: Spark version: 3.0.1 and 3.0.0. Spark 2.4.5 works as expected (running applicati

[jira] [Updated] (SPARK-33471) Upgrade kubernetes-client to 4.12.0

2020-11-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33471: -- Parent: SPARK-33005 Issue Type: Sub-task (was: Improvement) > Upgrade kubernetes-clie

[jira] [Assigned] (SPARK-33471) Upgrade kubernetes-client to 4.12.0

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33471: Assignee: Apache Spark > Upgrade kubernetes-client to 4.12.0 > --

[jira] [Commented] (SPARK-33471) Upgrade kubernetes-client to 4.12.0

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17233931#comment-17233931 ] Apache Spark commented on SPARK-33471: -- User 'ramesh-muthusamy' has created a pull

[jira] [Assigned] (SPARK-33471) Upgrade kubernetes-client to 4.12.0

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33471: Assignee: (was: Apache Spark) > Upgrade kubernetes-client to 4.12.0 > ---

[jira] [Commented] (SPARK-33471) Upgrade kubernetes-client to 4.12.0

2020-11-17 Thread rameshkrishnan muthusamy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17233928#comment-17233928 ] rameshkrishnan muthusamy commented on SPARK-33471: -- https://github.com/

[jira] [Created] (SPARK-33471) Upgrade kubernetes-client to 4.12.0

2020-11-17 Thread rameshkrishnan muthusamy (Jira)
rameshkrishnan muthusamy created SPARK-33471: Summary: Upgrade kubernetes-client to 4.12.0 Key: SPARK-33471 URL: https://issues.apache.org/jira/browse/SPARK-33471 Project: Spark I

[jira] [Updated] (SPARK-33400) Normalize sameOrderExpressions in SortOrder

2020-11-17 Thread Prakhar Jain (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prakhar Jain updated SPARK-33400: - Summary: Normalize sameOrderExpressions in SortOrder (was: Reduce unneeded sorts between two So

[jira] [Updated] (SPARK-33470) HistoryServer stuck "Loading history summary" with Spark 3.0.1 and hadoop 2.10.1

2020-11-17 Thread Dino Tufekcic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dino Tufekcic updated SPARK-33470: -- Description: History Server starts correctly and shows "No completed applications found!" mes

[jira] [Created] (SPARK-33470) HistoryServer stuck "Loading history summary" with Spark 3.0.1 and hadoop 2.10.1

2020-11-17 Thread Dino Tufekcic (Jira)
Dino Tufekcic created SPARK-33470: - Summary: HistoryServer stuck "Loading history summary" with Spark 3.0.1 and hadoop 2.10.1 Key: SPARK-33470 URL: https://issues.apache.org/jira/browse/SPARK-33470 Pr

[jira] [Commented] (SPARK-19609) Broadcast joins should pushdown join constraints as Filter to the larger relation

2020-11-17 Thread Jackson Westeen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-19609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17233785#comment-17233785 ] Jackson Westeen commented on SPARK-19609: - For what it's worth I think we're run

[jira] [Commented] (SPARK-33469) Add current_timezone function

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17233773#comment-17233773 ] Apache Spark commented on SPARK-33469: -- User 'ulysses-you' has created a pull reque

[jira] [Assigned] (SPARK-33469) Add current_timezone function

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33469: Assignee: Apache Spark > Add current_timezone function > - >

[jira] [Commented] (SPARK-33469) Add current_timezone function

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17233771#comment-17233771 ] Apache Spark commented on SPARK-33469: -- User 'ulysses-you' has created a pull reque

[jira] [Assigned] (SPARK-33469) Add current_timezone function

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33469: Assignee: (was: Apache Spark) > Add current_timezone function > -

[jira] [Created] (SPARK-33469) Add current_timezone function

2020-11-17 Thread ulysses you (Jira)
ulysses you created SPARK-33469: --- Summary: Add current_timezone function Key: SPARK-33469 URL: https://issues.apache.org/jira/browse/SPARK-33469 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-32222) Add K8s IT for conf propagation

2020-11-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-3. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30388 [https://

[jira] [Assigned] (SPARK-33468) ParseUrl should fail if input string is not a valid url

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33468: Assignee: Apache Spark > ParseUrl should fail if input string is not a valid url > --

[jira] [Assigned] (SPARK-33468) ParseUrl should fail if input string is not a valid url

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33468: Assignee: (was: Apache Spark) > ParseUrl should fail if input string is not a valid u

[jira] [Commented] (SPARK-33468) ParseUrl should fail if input string is not a valid url

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17233714#comment-17233714 ] Apache Spark commented on SPARK-33468: -- User 'ulysses-you' has created a pull reque

[jira] [Resolved] (SPARK-33427) Interpreted subexpression elimination

2020-11-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33427. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30341 [https://gith

[jira] [Created] (SPARK-33468) ParseUrl should fail if input string is not a valid url

2020-11-17 Thread ulysses you (Jira)
ulysses you created SPARK-33468: --- Summary: ParseUrl should fail if input string is not a valid url Key: SPARK-33468 URL: https://issues.apache.org/jira/browse/SPARK-33468 Project: Spark Issue T

[jira] [Resolved] (SPARK-33467) ParseUrl should fail if input string is not a valid url

2020-11-17 Thread ulysses you (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you resolved SPARK-33467. - Resolution: Invalid > ParseUrl should fail if input string is not a valid url >

[jira] [Created] (SPARK-33467) ParseUrl should fail if input string is not a valid url

2020-11-17 Thread ulysses you (Jira)
ulysses you created SPARK-33467: --- Summary: ParseUrl should fail if input string is not a valid url Key: SPARK-33467 URL: https://issues.apache.org/jira/browse/SPARK-33467 Project: Spark Issue T

[jira] [Comment Edited] (SPARK-33445) Can't parse decimal type from csv file

2020-11-17 Thread Punit Shah (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17233589#comment-17233589 ] Punit Shah edited comment on SPARK-33445 at 11/17/20, 1:38 PM: ---

[jira] [Reopened] (SPARK-33445) Can't parse decimal type from csv file

2020-11-17 Thread Punit Shah (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Punit Shah reopened SPARK-33445: As per the issue description, the call to spark_session.schema results in error.  Not spark_session.p

[jira] [Updated] (SPARK-32221) Avoid possible errors due to incorrect file size or type supplied in spark conf.

2020-11-17 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-32221: Description: This would avoid failures, in case the files are a bit large or a user places

[jira] [Commented] (SPARK-33452) Create a V2 SHOW PARTITIONS execution node

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17233502#comment-17233502 ] Apache Spark commented on SPARK-33452: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-33452) Create a V2 SHOW PARTITIONS execution node

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17233499#comment-17233499 ] Apache Spark commented on SPARK-33452: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-33452) Create a V2 SHOW PARTITIONS execution node

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33452: Assignee: Apache Spark > Create a V2 SHOW PARTITIONS execution node > ---

[jira] [Assigned] (SPARK-33452) Create a V2 SHOW PARTITIONS execution node

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33452: Assignee: (was: Apache Spark) > Create a V2 SHOW PARTITIONS execution node >

[jira] [Updated] (SPARK-33466) Imputer support mode(most_frequent) strategy

2020-11-17 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-33466: - Component/s: PySpark > Imputer support mode(most_frequent) strategy > --

[jira] [Assigned] (SPARK-33466) Imputer support mode(most_frequent) strategy

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33466: Assignee: Apache Spark > Imputer support mode(most_frequent) strategy > -

[jira] [Assigned] (SPARK-33466) Imputer support mode(most_frequent) strategy

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33466: Assignee: (was: Apache Spark) > Imputer support mode(most_frequent) strategy > --

[jira] [Commented] (SPARK-33466) Imputer support mode(most_frequent) strategy

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17233472#comment-17233472 ] Apache Spark commented on SPARK-33466: -- User 'zhengruifeng' has created a pull requ

[jira] [Created] (SPARK-33466) Imputer support mode(most_frequent) strategy

2020-11-17 Thread zhengruifeng (Jira)
zhengruifeng created SPARK-33466: Summary: Imputer support mode(most_frequent) strategy Key: SPARK-33466 URL: https://issues.apache.org/jira/browse/SPARK-33466 Project: Spark Issue Type: New

[jira] [Assigned] (SPARK-32863) Full outer stream-stream join

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32863: Assignee: (was: Apache Spark) > Full outer stream-stream join > -

[jira] [Assigned] (SPARK-32863) Full outer stream-stream join

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32863: Assignee: Apache Spark > Full outer stream-stream join > - >

[jira] [Commented] (SPARK-32863) Full outer stream-stream join

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17233424#comment-17233424 ] Apache Spark commented on SPARK-32863: -- User 'c21' has created a pull request for t

[jira] [Commented] (SPARK-32863) Full outer stream-stream join

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17233425#comment-17233425 ] Apache Spark commented on SPARK-32863: -- User 'c21' has created a pull request for t

[jira] [Commented] (SPARK-33464) Add/remove (un)necessary cache and restructure GitHub Actions yaml

2020-11-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17233408#comment-17233408 ] Apache Spark commented on SPARK-33464: -- User 'HyukjinKwon' has created a pull reque