[jira] [Updated] (SPARK-27896) Fix definition of clustering silhouette coefficient for 1-element clusters

2019-05-31 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27896: -- Fix Version/s: (was: 2.4.4) > Fix definition of clustering silhouette coefficient for

[jira] [Updated] (SPARK-23626) DAGScheduler blocked due to JobSubmitted event

2019-05-31 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S updated SPARK-23626: Affects Version/s: 2.4.3 > DAGScheduler blocked due to JobSubmitted event >

[jira] [Updated] (SPARK-23626) DAGScheduler blocked due to JobSubmitted event

2019-05-31 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S updated SPARK-23626: Summary: DAGScheduler blocked due to JobSubmitted event (was: Spark DAGScheduler scheduling performance

[jira] [Updated] (SPARK-23626) Spark DAGScheduler scheduling performance hindered on JobSubmitted Event

2019-05-31 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S updated SPARK-23626: Labels: (was: bulk-closed) > Spark DAGScheduler scheduling performance hindered on JobSubmitted Event >

[jira] [Updated] (SPARK-20856) support statement using nested joins

2019-05-31 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-20856: Issue Type: Sub-task (was: Improvement) Parent: SPARK-27764 > support statement using

[jira] [Commented] (SPARK-20856) support statement using nested joins

2019-05-31 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16853575#comment-16853575 ] Yuming Wang commented on SPARK-20856: - PostgreSQL 11.3 also support this join case: {code:sql}

[jira] [Updated] (SPARK-24077) Issue a better error message for `CREATE TEMPORARY FUNCTION IF NOT EXISTS`

2019-05-31 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-24077: - Description: The error message of {{CREATE TEMPORARY FUNCTION IF NOT EXISTS}} looks confusing:

[jira] [Commented] (SPARK-24077) Issue a better error message for `CREATE TEMPORARY FUNCTION IF NOT EXISTS`

2019-05-31 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16853573#comment-16853573 ] Hyukjin Kwon commented on SPARK-24077: -- Reopened after editing the JIRA. > Issue a better error

[jira] [Updated] (SPARK-24077) Issue a better error message for `CREATE TEMPORARY FUNCTION IF NOT EXISTS`

2019-05-31 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-24077: - Description: {code} scala>

[jira] [Updated] (SPARK-24077) Issue a better error message for `CREATE TEMPORARY FUNCTION IF NOT EXISTS`

2019-05-31 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-24077: - Description: {code} scala>

[jira] [Updated] (SPARK-24077) Issue a better error message for `CREATE TEMPORARY FUNCTION IF NOT EXISTS`

2019-05-31 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-24077: - Summary: Issue a better error message for `CREATE TEMPORARY FUNCTION IF NOT EXISTS` (was:

[jira] [Resolved] (SPARK-27896) Fix definition of clustering silhouette coefficient for 1-element clusters

2019-05-31 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27896. --- Resolution: Fixed Fix Version/s: 3.0.0 2.4.4 This is resolved via 

[jira] [Resolved] (SPARK-27794) Use secure URLs for downloading CRAN artifacts

2019-05-31 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27794. --- Resolution: Fixed Fix Version/s: 3.0.0 2.4.4 This is resolved via

[jira] [Assigned] (SPARK-27885) Announce deprecation of Python 2 support

2019-05-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-27885: - Assignee: Xiangrui Meng > Announce deprecation of Python 2 support >

[jira] [Created] (SPARK-27914) Improve parser error message for ALTER TABLE ADD COLUMNS statement

2019-05-31 Thread Yesheng Ma (JIRA)
Yesheng Ma created SPARK-27914: -- Summary: Improve parser error message for ALTER TABLE ADD COLUMNS statement Key: SPARK-27914 URL: https://issues.apache.org/jira/browse/SPARK-27914 Project: Spark

[jira] [Created] (SPARK-27913) Spark SQL's native ORC reader implements its own schema evolution

2019-05-31 Thread Owen O'Malley (JIRA)
Owen O'Malley created SPARK-27913: - Summary: Spark SQL's native ORC reader implements its own schema evolution Key: SPARK-27913 URL: https://issues.apache.org/jira/browse/SPARK-27913 Project: Spark

[jira] [Created] (SPARK-27912) Improve parser error message for CASE clause

2019-05-31 Thread Yesheng Ma (JIRA)
Yesheng Ma created SPARK-27912: -- Summary: Improve parser error message for CASE clause Key: SPARK-27912 URL: https://issues.apache.org/jira/browse/SPARK-27912 Project: Spark Issue Type:

[jira] [Updated] (SPARK-27911) PySpark Packages should automatically choose correct scala version

2019-05-31 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-27911: - Description: Today, users of pyspark (and Scala) need to manually specify the version

[jira] [Created] (SPARK-27911) PySpark Packages should automatically choose correct scala version

2019-05-31 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-27911: Summary: PySpark Packages should automatically choose correct scala version Key: SPARK-27911 URL: https://issues.apache.org/jira/browse/SPARK-27911 Project:

[jira] [Created] (SPARK-27910) Improve parser error message for misused numeric identifiers

2019-05-31 Thread Yesheng Ma (JIRA)
Yesheng Ma created SPARK-27910: -- Summary: Improve parser error message for misused numeric identifiers Key: SPARK-27910 URL: https://issues.apache.org/jira/browse/SPARK-27910 Project: Spark

[jira] [Commented] (SPARK-17164) Query with colon in the table name fails to parse in 2.0

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16853412#comment-16853412 ] Xiao Li commented on SPARK-17164: - I think we can issue a better error message here. like 

[jira] [Updated] (SPARK-17164) Query with colon in the table name fails to parse in 2.0

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-17164: Issue Type: Sub-task (was: Bug) Parent: SPARK-27901 > Query with colon in the table name fails

[jira] [Assigned] (SPARK-27909) Fix CTE substitution dependence on ResolveRelations throwing AnalysisException

2019-05-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27909: Assignee: (was: Apache Spark) > Fix CTE substitution dependence on ResolveRelations

[jira] [Assigned] (SPARK-27909) Fix CTE substitution dependence on ResolveRelations throwing AnalysisException

2019-05-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27909: Assignee: Apache Spark > Fix CTE substitution dependence on ResolveRelations throwing

[jira] [Resolved] (SPARK-27374) Fetch assigned resources from TaskContext

2019-05-31 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-27374. --- Resolution: Duplicate > Fetch assigned resources from TaskContext >

[jira] [Resolved] (SPARK-27362) Kubernetes support for GPU-aware scheduling

2019-05-31 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-27362. --- Resolution: Fixed Fix Version/s: 3.0.0 > Kubernetes support for GPU-aware scheduling

[jira] [Resolved] (SPARK-27373) Design: Kubernetes support for GPU-aware scheduling

2019-05-31 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-27373. --- Resolution: Fixed Fix Version/s: 3.0.0 > Design: Kubernetes support for GPU-aware

[jira] [Created] (SPARK-27909) Fix CTE substitution dependence on ResolveRelations throwing AnalysisException

2019-05-31 Thread Ryan Blue (JIRA)
Ryan Blue created SPARK-27909: - Summary: Fix CTE substitution dependence on ResolveRelations throwing AnalysisException Key: SPARK-27909 URL: https://issues.apache.org/jira/browse/SPARK-27909 Project:

[jira] [Resolved] (SPARK-27897) GPU Scheduling - move example discovery Script to scripts directory

2019-05-31 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-27897. --- Resolution: Fixed Fix Version/s: 3.0.0 > GPU Scheduling - move example discovery

[jira] [Updated] (SPARK-27907) HiveUDAF with 0 rows throw NPE

2019-05-31 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S updated SPARK-27907: Description: When query returns zero rows, the HiveUDAFFunction throws NPE CASE 1: create table abc(a

[jira] [Updated] (SPARK-27907) HiveUDAF with 0 rows throw NPE

2019-05-31 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S updated SPARK-27907: Summary: HiveUDAF with 0 rows throw NPE (was: HiveUDAF with 0 rows throw NPE when try to serialize) >

[jira] [Created] (SPARK-27908) Improve parser error message for SELECT TOP statement

2019-05-31 Thread Yesheng Ma (JIRA)
Yesheng Ma created SPARK-27908: -- Summary: Improve parser error message for SELECT TOP statement Key: SPARK-27908 URL: https://issues.apache.org/jira/browse/SPARK-27908 Project: Spark Issue

[jira] [Assigned] (SPARK-27907) HiveUDAF with 0 rows throw NPE when try to serialize

2019-05-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27907: Assignee: (was: Apache Spark) > HiveUDAF with 0 rows throw NPE when try to serialize

[jira] [Assigned] (SPARK-27907) HiveUDAF with 0 rows throw NPE when try to serialize

2019-05-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27907: Assignee: Apache Spark > HiveUDAF with 0 rows throw NPE when try to serialize >

[jira] [Created] (SPARK-27907) HiveUDAF with 0 rows throw NPE when try to serialize

2019-05-31 Thread Ajith S (JIRA)
Ajith S created SPARK-27907: --- Summary: HiveUDAF with 0 rows throw NPE when try to serialize Key: SPARK-27907 URL: https://issues.apache.org/jira/browse/SPARK-27907 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-27905) Add higher order function`forall`

2019-05-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27905: Assignee: (was: Apache Spark) > Add higher order function`forall` >

[jira] [Assigned] (SPARK-27905) Add higher order function`forall`

2019-05-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27905: Assignee: Apache Spark > Add higher order function`forall` >

[jira] [Updated] (SPARK-27906) Improve parser error message for CREATE LOCAL TEMPORARY TABLE statement

2019-05-31 Thread Yesheng Ma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesheng Ma updated SPARK-27906: --- Description: The {{CREATE LOCAL TEMPORARY TABLE}} statement is actually not supported in Spark

[jira] [Updated] (SPARK-27906) Improve parser error message for CREATE LOCAL TABLE statement

2019-05-31 Thread Yesheng Ma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesheng Ma updated SPARK-27906: --- Description: {{SHOW VIEW}} statement is actually not supported in Spark SQL. However, when a user

[jira] [Updated] (SPARK-27903) Improve parser error message for mismatched parentheses in expressions

2019-05-31 Thread Yesheng Ma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesheng Ma updated SPARK-27903: --- Description: When parentheses are mismatched in expressions in queries, the error message is

[jira] [Updated] (SPARK-27906) Improve parser error message for CREATE LOCAL TEMPORARY TABLE statement

2019-05-31 Thread Yesheng Ma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesheng Ma updated SPARK-27906: --- Summary: Improve parser error message for CREATE LOCAL TEMPORARY TABLE statement (was: Improve

[jira] [Created] (SPARK-27906) Improve parser error message for CREATE LOCAL TABLE statement

2019-05-31 Thread Yesheng Ma (JIRA)
Yesheng Ma created SPARK-27906: -- Summary: Improve parser error message for CREATE LOCAL TABLE statement Key: SPARK-27906 URL: https://issues.apache.org/jira/browse/SPARK-27906 Project: Spark

[jira] [Updated] (SPARK-27903) Improve parser error message for mismatched parentheses in expressions

2019-05-31 Thread Yesheng Ma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesheng Ma updated SPARK-27903: --- Description: was: When parentheses are mismatched in expressions in queries, the error

[jira] [Created] (SPARK-27905) Add higher order function`forall`

2019-05-31 Thread Nikolas Vanderhoof (JIRA)
Nikolas Vanderhoof created SPARK-27905: -- Summary: Add higher order function`forall` Key: SPARK-27905 URL: https://issues.apache.org/jira/browse/SPARK-27905 Project: Spark Issue Type:

[jira] [Created] (SPARK-27904) Improve parser error message for SHOW VIEW statement

2019-05-31 Thread Yesheng Ma (JIRA)
Yesheng Ma created SPARK-27904: -- Summary: Improve parser error message for SHOW VIEW statement Key: SPARK-27904 URL: https://issues.apache.org/jira/browse/SPARK-27904 Project: Spark Issue Type:

[jira] [Updated] (SPARK-21529) Improve the error message for unsupported Uniontype

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21529: Issue Type: Sub-task (was: Bug) Parent: SPARK-27901 > Improve the error message for unsupported

[jira] [Updated] (SPARK-21529) Improve the error message for unsupported Uniontype

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21529: Labels: hive starter uniontype (was: bulk-closed hive uniontype) > Improve the error message for

[jira] [Updated] (SPARK-21529) Improve the error message for unsupported Uniontype

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21529: Summary: Improve the error message for unsupported Uniontype (was: Uniontype not supported when reading

[jira] [Reopened] (SPARK-21529) Improve the error message for unsupported Uniontype

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-21529: - > Improve the error message for unsupported Uniontype > ---

[jira] [Created] (SPARK-27903) Improve parser error message for mismatched parentheses in expressions

2019-05-31 Thread Yesheng Ma (JIRA)
Yesheng Ma created SPARK-27903: -- Summary: Improve parser error message for mismatched parentheses in expressions Key: SPARK-27903 URL: https://issues.apache.org/jira/browse/SPARK-27903 Project: Spark

[jira] [Commented] (SPARK-27098) Flaky missing file parts when writing to Ceph without error

2019-05-31 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16853250#comment-16853250 ] Steve Loughran commented on SPARK-27098: I don't think we'd silently swallow exceptions during a

[jira] [Created] (SPARK-27902) Improve error message for DESCRIBE statement

2019-05-31 Thread Yesheng Ma (JIRA)
Yesheng Ma created SPARK-27902: -- Summary: Improve error message for DESCRIBE statement Key: SPARK-27902 URL: https://issues.apache.org/jira/browse/SPARK-27902 Project: Spark Issue Type:

[jira] [Updated] (SPARK-21136) Misleading error message for typo in SQL

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21136: Priority: Critical (was: Minor) > Misleading error message for typo in SQL >

[jira] [Commented] (SPARK-27098) Flaky missing file parts when writing to Ceph without error

2019-05-31 Thread Martin Loncaric (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16853245#comment-16853245 ] Martin Loncaric commented on SPARK-27098: - After upgrading to Hadoop 2.9 and using

[jira] [Assigned] (SPARK-21136) Misleading error message for typo in SQL

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-21136: --- Assignee: Yesheng Ma > Misleading error message for typo in SQL >

[jira] [Updated] (SPARK-24077) Issue a better error message for `CREATE TEMPORARY FUNCTION IF NOT EXISTS`?

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-24077: Labels: starter (was: ) > Issue a better error message for `CREATE TEMPORARY FUNCTION IF NOT EXISTS`? >

[jira] [Updated] (SPARK-21136) Misleading error message for typo in SQL

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21136: Labels: (was: bulk-closed) > Misleading error message for typo in SQL >

[jira] [Reopened] (SPARK-24077) Why spark SQL not support `CREATE TEMPORARY FUNCTION IF NOT EXISTS`?

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-24077: - > Why spark SQL not support `CREATE TEMPORARY FUNCTION IF NOT EXISTS`? >

[jira] [Updated] (SPARK-24077) Issue a better error message for `CREATE TEMPORARY FUNCTION IF NOT EXISTS`?

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-24077: Issue Type: Sub-task (was: Question) Parent: SPARK-27901 > Issue a better error message for

[jira] [Updated] (SPARK-24077) Issue a better error message for `CREATE TEMPORARY FUNCTION IF NOT EXISTS`?

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-24077: Summary: Issue a better error message for `CREATE TEMPORARY FUNCTION IF NOT EXISTS`? (was: Why spark SQL

[jira] [Reopened] (SPARK-21136) Misleading error message for typo in SQL

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-21136: - > Misleading error message for typo in SQL > > >

[jira] [Updated] (SPARK-21136) Misleading error message for typo in SQL

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21136: Issue Type: Sub-task (was: Bug) Parent: SPARK-27901 > Misleading error message for typo in SQL >

[jira] [Commented] (SPARK-21154) ParseException when Create View from another View in Spark SQL

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16853234#comment-16853234 ] Xiao Li commented on SPARK-21154: - This issue should have been resolved in the new version of Spark >

[jira] [Commented] (SPARK-27812) kubernetes client import non-daemon thread which block jvm exit.

2019-05-31 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16853227#comment-16853227 ] Dongjoon Hyun commented on SPARK-27812: --- What I meat was *upgrading*, [~igor.calabria]. Currently,

[jira] [Updated] (SPARK-27809) Make optional clauses order insensitive for CREATE DATABASE/VIEW SQL statement

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27809: Issue Type: Sub-task (was: Bug) Parent: SPARK-27901 > Make optional clauses order insensitive

[jira] [Updated] (SPARK-27890) Improve SQL parser error message when missing backquotes for identifiers with hyphens

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27890: Issue Type: Sub-task (was: Improvement) Parent: SPARK-27901 > Improve SQL parser error message

[jira] [Updated] (SPARK-27901) Improve the error messages of SQL parser

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27901: Issue Type: Umbrella (was: Bug) > Improve the error messages of SQL parser >

[jira] [Created] (SPARK-27901) Improve the error messages of SQL parser

2019-05-31 Thread Xiao Li (JIRA)
Xiao Li created SPARK-27901: --- Summary: Improve the error messages of SQL parser Key: SPARK-27901 URL: https://issues.apache.org/jira/browse/SPARK-27901 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-27899) Make HiveMetastoreClient.getTableObjectsByName available in ExternalCatalog/SessionCatalog API

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-27899: --- Assignee: Lantao Jin > Make HiveMetastoreClient.getTableObjectsByName available in >

[jira] [Commented] (SPARK-27899) Make HiveMetastoreClient.getTableObjectsByName available in ExternalCatalog/SessionCatalog API

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16853209#comment-16853209 ] Xiao Li commented on SPARK-27899: - Also cc [~cltlfcjin]   > Make

[jira] [Updated] (SPARK-27899) Make HiveMetastoreClient.getTableObjectsByName available in ExternalCatalog/SessionCatalog API

2019-05-31 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27899: Target Version/s: 3.0.0 > Make HiveMetastoreClient.getTableObjectsByName available in >

[jira] [Commented] (SPARK-27812) kubernetes client import non-daemon thread which block jvm exit.

2019-05-31 Thread Igor Calabria (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16853159#comment-16853159 ] Igor Calabria commented on SPARK-27812: --- [~dongjoon] Do you mean downgrading? Because the issue

[jira] [Assigned] (SPARK-27395) Improve EXPLAIN command

2019-05-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27395: Assignee: (was: Apache Spark) > Improve EXPLAIN command > --- >

[jira] [Assigned] (SPARK-27395) Improve EXPLAIN command

2019-05-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27395: Assignee: Apache Spark > Improve EXPLAIN command > --- > >

[jira] [Commented] (SPARK-27891) Long running spark jobs fail because of HDFS delegation token expires

2019-05-31 Thread hemshankar sahu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16853140#comment-16853140 ] hemshankar sahu commented on SPARK-27891: - Attached log for spark 2.3.1

[jira] [Updated] (SPARK-27891) Long running spark jobs fail because of HDFS delegation token expires

2019-05-31 Thread hemshankar sahu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemshankar sahu updated SPARK-27891: Attachment: spark_2.3.1_failure.log > Long running spark jobs fail because of HDFS

[jira] [Updated] (SPARK-26192) MesosClusterScheduler reads options from dispatcher conf instead of submission conf

2019-05-31 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26192: -- Fix Version/s: 2.4.4 > MesosClusterScheduler reads options from dispatcher conf instead of >

[jira] [Updated] (SPARK-27900) Spark on K8s will not report container failure due to oom

2019-05-31 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-27900: Description: A spark pi job is running: spark-pi-driver 1/1 Running 0 1h

[jira] [Created] (SPARK-27900) Spark on K8s will not report container failure due to oom

2019-05-31 Thread Stavros Kontopoulos (JIRA)
Stavros Kontopoulos created SPARK-27900: --- Summary: Spark on K8s will not report container failure due to oom Key: SPARK-27900 URL: https://issues.apache.org/jira/browse/SPARK-27900 Project:

[jira] [Assigned] (SPARK-27873) Csv reader, adding a corrupt record column causes error if enforceSchema=false

2019-05-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27873: Assignee: Apache Spark > Csv reader, adding a corrupt record column causes error if

[jira] [Assigned] (SPARK-27873) Csv reader, adding a corrupt record column causes error if enforceSchema=false

2019-05-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27873: Assignee: (was: Apache Spark) > Csv reader, adding a corrupt record column causes

[jira] [Commented] (SPARK-27899) Make HiveMetastoreClient.getTableObjectsByName available in ExternalCatalog/SessionCatalog API

2019-05-31 Thread Juliusz Sompolski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16853083#comment-16853083 ] Juliusz Sompolski commented on SPARK-27899: --- cc [~LI,Xiao], [~yumwang] > Make

[jira] [Created] (SPARK-27899) Make HiveMetastoreClient.getTableObjectsByName available in ExternalCatalog/SessionCatalog API

2019-05-31 Thread Juliusz Sompolski (JIRA)
Juliusz Sompolski created SPARK-27899: - Summary: Make HiveMetastoreClient.getTableObjectsByName available in ExternalCatalog/SessionCatalog API Key: SPARK-27899 URL:

[jira] [Closed] (SPARK-26822) Upgrade the deprecated module 'optparse'

2019-05-31 Thread Neo Chien (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neo Chien closed SPARK-26822. - > Upgrade the deprecated module 'optparse' > > >

[jira] [Assigned] (SPARK-27896) Fix definition of clustering silhouette coefficient for 1-element clusters

2019-05-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27896: Assignee: Apache Spark (was: Sean Owen) > Fix definition of clustering silhouette

[jira] [Assigned] (SPARK-27896) Fix definition of clustering silhouette coefficient for 1-element clusters

2019-05-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27896: Assignee: Sean Owen (was: Apache Spark) > Fix definition of clustering silhouette

[jira] [Assigned] (SPARK-27898) Support 4 date operators(date + integer, integer + date, date - integer and date - date)

2019-05-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27898: Assignee: Apache Spark > Support 4 date operators(date + integer, integer + date, date -

[jira] [Assigned] (SPARK-27898) Support 4 date operators(date + integer, integer + date, date - integer and date - date)

2019-05-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27898: Assignee: (was: Apache Spark) > Support 4 date operators(date + integer, integer +

[jira] [Created] (SPARK-27898) Support 4 date operators(date + integer, integer + date, date - integer and date - date)

2019-05-31 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-27898: --- Summary: Support 4 date operators(date + integer, integer + date, date - integer and date - date) Key: SPARK-27898 URL: https://issues.apache.org/jira/browse/SPARK-27898

[jira] [Assigned] (SPARK-27897) GPU Scheduling - move example discovery Script to scripts directory

2019-05-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27897: Assignee: Apache Spark (was: Thomas Graves) > GPU Scheduling - move example discovery

[jira] [Assigned] (SPARK-27897) GPU Scheduling - move example discovery Script to scripts directory

2019-05-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27897: Assignee: Thomas Graves (was: Apache Spark) > GPU Scheduling - move example discovery

[jira] [Created] (SPARK-27897) GPU Scheduling - move example discovery Script to scripts directory

2019-05-31 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-27897: - Summary: GPU Scheduling - move example discovery Script to scripts directory Key: SPARK-27897 URL: https://issues.apache.org/jira/browse/SPARK-27897 Project: Spark

[jira] [Updated] (SPARK-27880) Implement boolean aggregates(BOOL_AND, BOOL_OR and EVERY)

2019-05-31 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-27880: Description: {code:sql} bool_and/booland_statefunc(expression) -- true if all input values are

[jira] [Commented] (SPARK-27896) Fix definition of clustering silhouette coefficient for 1-element clusters

2019-05-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16852962#comment-16852962 ] Sean Owen commented on SPARK-27896: --- Copying follow up from email: Yes the paper does say the

[jira] [Created] (SPARK-27896) Fix definition of clustering silhouette coefficient for 1-element clusters

2019-05-31 Thread Sean Owen (JIRA)
Sean Owen created SPARK-27896: - Summary: Fix definition of clustering silhouette coefficient for 1-element clusters Key: SPARK-27896 URL: https://issues.apache.org/jira/browse/SPARK-27896 Project: Spark

[jira] [Commented] (SPARK-24815) Structured Streaming should support dynamic allocation

2019-05-31 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16852874#comment-16852874 ] Stavros Kontopoulos commented on SPARK-24815: - @[~Karthik Palaniappan] I can help with the

[jira] [Commented] (SPARK-27791) Support SQL year-month INTERVAL type

2019-05-31 Thread Zhu, Lipeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16852870#comment-16852870 ] Zhu, Lipeng commented on SPARK-27791: - [~yumwang]  I think it should be  {code:sql} select

[jira] [Resolved] (SPARK-27700) SparkSubmit closes with SocketTimeoutException in kubernetes mode.

2019-05-31 Thread Udbhav Agrawal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udbhav Agrawal resolved SPARK-27700. Resolution: Duplicate > SparkSubmit closes with SocketTimeoutException in kubernetes

[jira] [Commented] (SPARK-27791) Support SQL year-month INTERVAL type

2019-05-31 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16852761#comment-16852761 ] Yuming Wang commented on SPARK-27791: - Hi, [~maxgekk] Is this ticket to cover these 2 cases?

[jira] [Created] (SPARK-27895) Spark streaming - RDD filter is always refreshing providing updated filtered items

2019-05-31 Thread Ilias Karalis (JIRA)
Ilias Karalis created SPARK-27895: - Summary: Spark streaming - RDD filter is always refreshing providing updated filtered items Key: SPARK-27895 URL: https://issues.apache.org/jira/browse/SPARK-27895

  1   2   >