[jira] [Updated] (SPARK-31440) Improve SQL Rest API

2020-05-01 Thread Eren Avsarogullari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-31440: --- Attachment: improved_version_May1th.json > Improve SQL Rest API > --

[jira] [Updated] (SPARK-31590) The filter used by Metadata-only queries should filter out all the unevaluable expr

2020-05-01 Thread dzcxzl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dzcxzl updated SPARK-31590: --- Summary: The filter used by Metadata-only queries should filter out all the unevaluable expr (was: The filt

[jira] [Commented] (SPARK-31625) Unregister application from YARN resource manager outside the shutdown hook

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17097793#comment-17097793 ] Apache Spark commented on SPARK-31625: -- User 'imback82' has created a pull request

[jira] [Assigned] (SPARK-31625) Unregister application from YARN resource manager outside the shutdown hook

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31625: Assignee: Apache Spark > Unregister application from YARN resource manager outside the sh

[jira] [Assigned] (SPARK-31625) Unregister application from YARN resource manager outside the shutdown hook

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31625: Assignee: (was: Apache Spark) > Unregister application from YARN resource manager out

[jira] [Commented] (SPARK-31625) Unregister application from YARN resource manager outside the shutdown hook

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17097792#comment-17097792 ] Apache Spark commented on SPARK-31625: -- User 'imback82' has created a pull request

[jira] [Updated] (SPARK-31625) Unregister application from YARN resource manager outside the shutdown hook

2020-05-01 Thread Terry Kim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim updated SPARK-31625: -- Description: Currently, an application is unregistered from YARN resource manager as a shutdown hook.

[jira] [Created] (SPARK-31625) Unregister application from YARN resource manager outside the shutdown hook

2020-05-01 Thread Terry Kim (Jira)
Terry Kim created SPARK-31625: - Summary: Unregister application from YARN resource manager outside the shutdown hook Key: SPARK-31625 URL: https://issues.apache.org/jira/browse/SPARK-31625 Project: Spark

[jira] [Assigned] (SPARK-31624) SHOW TBLPROPERTIES doesn't handle Session Catalog correctly

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31624: Assignee: Burak Yavuz (was: Apache Spark) > SHOW TBLPROPERTIES doesn't handle Session Ca

[jira] [Assigned] (SPARK-31624) SHOW TBLPROPERTIES doesn't handle Session Catalog correctly

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31624: Assignee: Burak Yavuz (was: Apache Spark) > SHOW TBLPROPERTIES doesn't handle Session Ca

[jira] [Assigned] (SPARK-31624) SHOW TBLPROPERTIES doesn't handle Session Catalog correctly

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31624: Assignee: Apache Spark (was: Burak Yavuz) > SHOW TBLPROPERTIES doesn't handle Session Ca

[jira] [Commented] (SPARK-31624) SHOW TBLPROPERTIES doesn't handle Session Catalog correctly

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17097776#comment-17097776 ] Apache Spark commented on SPARK-31624: -- User 'brkyvz' has created a pull request fo

[jira] [Updated] (SPARK-31235) Separates different categories of applications

2020-05-01 Thread wangzhun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangzhun updated SPARK-31235: - Fix Version/s: 3.0.0 > Separates different categories of applications >

[jira] [Assigned] (SPARK-31624) SHOW TBLPROPERTIES doesn't handle Session Catalog correctly

2020-05-01 Thread Burak Yavuz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz reassigned SPARK-31624: --- Assignee: Burak Yavuz > SHOW TBLPROPERTIES doesn't handle Session Catalog correctly > -

[jira] [Created] (SPARK-31624) SHOW TBLPROPERTIES doesn't handle Session Catalog correctly

2020-05-01 Thread Burak Yavuz (Jira)
Burak Yavuz created SPARK-31624: --- Summary: SHOW TBLPROPERTIES doesn't handle Session Catalog correctly Key: SPARK-31624 URL: https://issues.apache.org/jira/browse/SPARK-31624 Project: Spark Is

[jira] [Commented] (SPARK-31030) Backward Compatibility for Parsing and Formatting Datetime

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17097750#comment-17097750 ] Apache Spark commented on SPARK-31030: -- User 'dilipbiswal' has created a pull reque

[jira] [Commented] (SPARK-31030) Backward Compatibility for Parsing and Formatting Datetime

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17097749#comment-17097749 ] Apache Spark commented on SPARK-31030: -- User 'dilipbiswal' has created a pull reque

[jira] [Assigned] (SPARK-21117) Built-in SQL Function Support - WIDTH_BUCKET

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21117: Assignee: (was: Apache Spark) > Built-in SQL Function Support - WIDTH_BUCKET > --

[jira] [Updated] (SPARK-21117) Built-in SQL Function Support - WIDTH_BUCKET

2020-05-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21117: Target Version/s: 3.1.0 > Built-in SQL Function Support - WIDTH_BUCKET > -

[jira] [Assigned] (SPARK-21117) Built-in SQL Function Support - WIDTH_BUCKET

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21117: Assignee: Apache Spark > Built-in SQL Function Support - WIDTH_BUCKET > -

[jira] [Updated] (SPARK-21117) Built-in SQL Function Support - WIDTH_BUCKET

2020-05-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21117: Labels: (was: bulk-closed) > Built-in SQL Function Support - WIDTH_BUCKET >

[jira] [Reopened] (SPARK-21117) Built-in SQL Function Support - WIDTH_BUCKET

2020-05-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-21117: - > Built-in SQL Function Support - WIDTH_BUCKET > > >

[jira] [Commented] (SPARK-31582) Being able to not populate Hadoop classpath

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17097580#comment-17097580 ] Apache Spark commented on SPARK-31582: -- User 'dbtsai' has created a pull request fo

[jira] [Commented] (SPARK-31582) Being able to not populate Hadoop classpath

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17097576#comment-17097576 ] Apache Spark commented on SPARK-31582: -- User 'dbtsai' has created a pull request fo

[jira] [Commented] (SPARK-29701) Different answers when empty input given in GROUPING SETS

2020-05-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17097521#comment-17097521 ] Dongjoon Hyun commented on SPARK-29701: --- For the record, please see the discussion

[jira] [Updated] (SPARK-29701) Different answers when empty input given in GROUPING SETS

2020-05-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29701: -- Parent: (was: SPARK-27764) Issue Type: Bug (was: Sub-task) > Different answers wh

[jira] [Updated] (SPARK-29701) Different answers when empty input given in GROUPING SETS

2020-05-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29701: -- Parent: SPARK-31085 Issue Type: Sub-task (was: Bug) > Different answers when empty in

[jira] [Assigned] (SPARK-31523) LogicalPlan doCanonicalize should throw exception if not resolved

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31523: Assignee: (was: Apache Spark) > LogicalPlan doCanonicalize should throw exception if

[jira] [Assigned] (SPARK-31523) LogicalPlan doCanonicalize should throw exception if not resolved

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31523: Assignee: Apache Spark > LogicalPlan doCanonicalize should throw exception if not resolve

[jira] [Assigned] (SPARK-31493) Optimize InSet to In according partition size at InSubqueryExec

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31493: Assignee: (was: Apache Spark) > Optimize InSet to In according partition size at InSu

[jira] [Commented] (SPARK-31523) LogicalPlan doCanonicalize should throw exception if not resolved

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17097506#comment-17097506 ] Apache Spark commented on SPARK-31523: -- User 'ulysses-you' has created a pull reque

[jira] [Assigned] (SPARK-31493) Optimize InSet to In according partition size at InSubqueryExec

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31493: Assignee: Apache Spark > Optimize InSet to In according partition size at InSubqueryExec

[jira] [Commented] (SPARK-31493) Optimize InSet to In according partition size at InSubqueryExec

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17097505#comment-17097505 ] Apache Spark commented on SPARK-31493: -- User 'ulysses-you' has created a pull reque

[jira] [Assigned] (SPARK-31551) createSparkUser lost user's non-Hadoop credentials

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31551: Assignee: (was: Apache Spark) > createSparkUser lost user's non-Hadoop credentials >

[jira] [Assigned] (SPARK-31487) Move slots check of barrier job from DAGScheduler to TaskSchedulerImpl

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31487: Assignee: (was: Apache Spark) > Move slots check of barrier job from DAGScheduler to

[jira] [Assigned] (SPARK-31458) LOAD DATA support for builtin datasource tables

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31458: Assignee: Apache Spark > LOAD DATA support for builtin datasource tables > --

[jira] [Assigned] (SPARK-29274) Should not coerce decimal type to double type when it's join column

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29274: Assignee: Pengfei Chang (was: Apache Spark) > Should not coerce decimal type to double t

[jira] [Assigned] (SPARK-31377) Add unit tests for "number of output rows" metric for joins in SQLMetricsSuite

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31377: Assignee: (was: Apache Spark) > Add unit tests for "number of output rows" metric for

[jira] [Assigned] (SPARK-31454) An optimized K-Means based on DenseMatrix and GEMM

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31454: Assignee: (was: Apache Spark) > An optimized K-Means based on DenseMatrix and GEMM >

[jira] [Assigned] (SPARK-31467) Fix test issue with table named `test` in hive/SQLQuerySuite

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31467: Assignee: (was: Apache Spark) > Fix test issue with table named `test` in hive/SQLQue

[jira] [Assigned] (SPARK-29274) Should not coerce decimal type to double type when it's join column

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29274: Assignee: Apache Spark (was: Pengfei Chang) > Should not coerce decimal type to double t

[jira] [Assigned] (SPARK-31431) CalendarInterval encoder support

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31431: Assignee: Apache Spark > CalendarInterval encoder support > -

[jira] [Assigned] (SPARK-31440) Improve SQL Rest API

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31440: Assignee: (was: Apache Spark) > Improve SQL Rest API > > >

[jira] [Assigned] (SPARK-31459) When using the insert overwrite directory syntax, if the target path is an existing file, the final run result is incorrect

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31459: Assignee: (was: Apache Spark) > When using the insert overwrite directory syntax, if

[jira] [Commented] (SPARK-25065) Driver and executors pick the wrong logging configuration file.

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17097501#comment-17097501 ] Apache Spark commented on SPARK-25065: -- User 'ScrapCodes' has created a pull reques

[jira] [Assigned] (SPARK-31432) Make SPARK_JARS_DIR configurable

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31432: Assignee: (was: Apache Spark) > Make SPARK_JARS_DIR configurable > --

[jira] [Assigned] (SPARK-31551) createSparkUser lost user's non-Hadoop credentials

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31551: Assignee: Apache Spark > createSparkUser lost user's non-Hadoop credentials > ---

[jira] [Assigned] (SPARK-31440) Improve SQL Rest API

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31440: Assignee: Apache Spark > Improve SQL Rest API > > >

[jira] [Assigned] (SPARK-31432) Make SPARK_JARS_DIR configurable

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31432: Assignee: Apache Spark > Make SPARK_JARS_DIR configurable > -

[jira] [Assigned] (SPARK-31431) CalendarInterval encoder support

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31431: Assignee: (was: Apache Spark) > CalendarInterval encoder support > --

[jira] [Assigned] (SPARK-31418) Blacklisting feature aborts Spark job without retrying for max num retries in case of Dynamic allocation

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31418: Assignee: (was: Apache Spark) > Blacklisting feature aborts Spark job without retryin

[jira] [Assigned] (SPARK-31106) Support is_json function

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31106: Assignee: Apache Spark > Support is_json function > > >

[jira] [Assigned] (SPARK-31458) LOAD DATA support for builtin datasource tables

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31458: Assignee: (was: Apache Spark) > LOAD DATA support for builtin datasource tables > ---

[jira] [Assigned] (SPARK-31467) Fix test issue with table named `test` in hive/SQLQuerySuite

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31467: Assignee: Apache Spark > Fix test issue with table named `test` in hive/SQLQuerySuite > -

[jira] [Assigned] (SPARK-31487) Move slots check of barrier job from DAGScheduler to TaskSchedulerImpl

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31487: Assignee: Apache Spark > Move slots check of barrier job from DAGScheduler to TaskSchedul

[jira] [Assigned] (SPARK-29791) Add a spark config to allow user to use executor cores virtually.

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29791: Assignee: Apache Spark > Add a spark config to allow user to use executor cores virtually

[jira] [Assigned] (SPARK-31418) Blacklisting feature aborts Spark job without retrying for max num retries in case of Dynamic allocation

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31418: Assignee: Apache Spark > Blacklisting feature aborts Spark job without retrying for max n

[jira] [Assigned] (SPARK-31483) pyspark shell IPython launch throws ".../pyspark/bin/load-spark-env.sh: No such file or directory"

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31483: Assignee: (was: Apache Spark) > pyspark shell IPython launch throws ".../pyspark/bin/

[jira] [Assigned] (SPARK-31478) Executors Stop() method is not executed when they are killed

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31478: Assignee: (was: Apache Spark) > Executors Stop() method is not executed when they are

[jira] [Assigned] (SPARK-31478) Executors Stop() method is not executed when they are killed

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31478: Assignee: Apache Spark > Executors Stop() method is not executed when they are killed > -

[jira] [Assigned] (SPARK-31106) Support is_json function

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31106: Assignee: (was: Apache Spark) > Support is_json function > >

[jira] [Assigned] (SPARK-31377) Add unit tests for "number of output rows" metric for joins in SQLMetricsSuite

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31377: Assignee: Apache Spark > Add unit tests for "number of output rows" metric for joins in S

[jira] [Assigned] (SPARK-31454) An optimized K-Means based on DenseMatrix and GEMM

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31454: Assignee: Apache Spark > An optimized K-Means based on DenseMatrix and GEMM > ---

[jira] [Assigned] (SPARK-31459) When using the insert overwrite directory syntax, if the target path is an existing file, the final run result is incorrect

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31459: Assignee: Apache Spark > When using the insert overwrite directory syntax, if the target

[jira] [Assigned] (SPARK-31483) pyspark shell IPython launch throws ".../pyspark/bin/load-spark-env.sh: No such file or directory"

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31483: Assignee: Apache Spark > pyspark shell IPython launch throws ".../pyspark/bin/load-spark-

[jira] [Assigned] (SPARK-29791) Add a spark config to allow user to use executor cores virtually.

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29791: Assignee: (was: Apache Spark) > Add a spark config to allow user to use executor core

[jira] [Assigned] (SPARK-31056) Add CalendarIntervals division

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31056: Assignee: (was: Apache Spark) > Add CalendarIntervals division >

[jira] [Assigned] (SPARK-31056) Add CalendarIntervals division

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31056: Assignee: Apache Spark > Add CalendarIntervals division > --

[jira] [Assigned] (SPARK-30679) REPLACE TABLE can omit the USING clause

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30679: Assignee: Wenchen Fan (was: Apache Spark) > REPLACE TABLE can omit the USING clause > --

[jira] [Assigned] (SPARK-30366) Remove Redundant Information for InMemoryTableScan in SQL UI

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30366: Assignee: (was: Apache Spark) > Remove Redundant Information for InMemoryTableScan in

[jira] [Assigned] (SPARK-30366) Remove Redundant Information for InMemoryTableScan in SQL UI

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30366: Assignee: Apache Spark > Remove Redundant Information for InMemoryTableScan in SQL UI > -

[jira] [Assigned] (SPARK-28330) ANSI SQL: Top-level in

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28330: Assignee: Apache Spark > ANSI SQL: Top-level in > -

[jira] [Assigned] (SPARK-30679) REPLACE TABLE can omit the USING clause

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30679: Assignee: Apache Spark (was: Wenchen Fan) > REPLACE TABLE can omit the USING clause > --

[jira] [Assigned] (SPARK-30600) Migrate ALTER VIEW SET/UNSET commands to the new resolution framework

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30600: Assignee: Apache Spark > Migrate ALTER VIEW SET/UNSET commands to the new resolution fram

[jira] [Assigned] (SPARK-30828) Improve insertInto behaviour

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30828: Assignee: Apache Spark > Improve insertInto behaviour > > >

[jira] [Assigned] (SPARK-30648) Support filters pushdown in JSON datasource

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30648: Assignee: Apache Spark > Support filters pushdown in JSON datasource > --

[jira] [Assigned] (SPARK-30666) Reliable single-stage accumulators

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30666: Assignee: Apache Spark > Reliable single-stage accumulators > ---

[jira] [Assigned] (SPARK-30705) Improve CaseWhen sub-expression equality

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30705: Assignee: (was: Apache Spark) > Improve CaseWhen sub-expression equality > --

[jira] [Assigned] (SPARK-30688) Spark SQL Unix Timestamp produces incorrect result with unix_timestamp UDF

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30688: Assignee: (was: Apache Spark) > Spark SQL Unix Timestamp produces incorrect result wi

[jira] [Assigned] (SPARK-27951) ANSI SQL: NTH_VALUE function

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27951: Assignee: (was: Apache Spark) > ANSI SQL: NTH_VALUE function > --

[jira] [Assigned] (SPARK-30276) Support Filter expression allows simultaneous use of DISTINCT

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30276: Assignee: (was: Apache Spark) > Support Filter expression allows simultaneous use of

[jira] [Assigned] (SPARK-27996) Spark UI redirect will be failed behind the https reverse proxy

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27996: Assignee: Apache Spark > Spark UI redirect will be failed behind the https reverse proxy

[jira] [Assigned] (SPARK-30276) Support Filter expression allows simultaneous use of DISTINCT

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30276: Assignee: Apache Spark > Support Filter expression allows simultaneous use of DISTINCT >

[jira] [Assigned] (SPARK-27996) Spark UI redirect will be failed behind the https reverse proxy

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27996: Assignee: (was: Apache Spark) > Spark UI redirect will be failed behind the https rev

[jira] [Assigned] (SPARK-29157) DataSourceV2: Add DataFrameWriterV2 to Python API

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29157: Assignee: (was: Apache Spark) > DataSourceV2: Add DataFrameWriterV2 to Python API > -

[jira] [Assigned] (SPARK-30621) Dynamic Pruning thread propagates the localProperties to task

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30621: Assignee: Apache Spark > Dynamic Pruning thread propagates the localProperties to task >

[jira] [Assigned] (SPARK-29157) DataSourceV2: Add DataFrameWriterV2 to Python API

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29157: Assignee: Apache Spark > DataSourceV2: Add DataFrameWriterV2 to Python API >

[jira] [Assigned] (SPARK-30705) Improve CaseWhen sub-expression equality

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30705: Assignee: Apache Spark > Improve CaseWhen sub-expression equality > -

[jira] [Assigned] (SPARK-30600) Migrate ALTER VIEW SET/UNSET commands to the new resolution framework

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30600: Assignee: (was: Apache Spark) > Migrate ALTER VIEW SET/UNSET commands to the new reso

[jira] [Assigned] (SPARK-24884) Implement regexp_extract_all

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24884: Assignee: (was: Apache Spark) > Implement regexp_extract_all > --

[jira] [Assigned] (SPARK-30821) Executor pods with multiple containers will not be rescheduled unless all containers fail

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30821: Assignee: Apache Spark > Executor pods with multiple containers will not be rescheduled u

[jira] [Assigned] (SPARK-30664) Add more metrics to the all stages page

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30664: Assignee: Apache Spark > Add more metrics to the all stages page > --

[jira] [Assigned] (SPARK-30648) Support filters pushdown in JSON datasource

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30648: Assignee: (was: Apache Spark) > Support filters pushdown in JSON datasource > ---

[jira] [Assigned] (SPARK-24884) Implement regexp_extract_all

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24884: Assignee: Apache Spark > Implement regexp_extract_all > > >

[jira] [Assigned] (SPARK-28325) Support ANSI SQL:SIMILAR TO ... ESCAPE syntax

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28325: Assignee: Apache Spark > Support ANSI SQL:SIMILAR TO ... ESCAPE syntax >

[jira] [Assigned] (SPARK-28325) Support ANSI SQL:SIMILAR TO ... ESCAPE syntax

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28325: Assignee: (was: Apache Spark) > Support ANSI SQL:SIMILAR TO ... ESCAPE syntax > -

[jira] [Assigned] (SPARK-30666) Reliable single-stage accumulators

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30666: Assignee: (was: Apache Spark) > Reliable single-stage accumulators >

[jira] [Assigned] (SPARK-30664) Add more metrics to the all stages page

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30664: Assignee: (was: Apache Spark) > Add more metrics to the all stages page > ---

[jira] [Assigned] (SPARK-27951) ANSI SQL: NTH_VALUE function

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27951: Assignee: Apache Spark > ANSI SQL: NTH_VALUE function > > >

[jira] [Assigned] (SPARK-30768) Constraints inferred from inequality attributes

2020-05-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30768: Assignee: Apache Spark > Constraints inferred from inequality attributes > --

  1   2   >