[jira] [Updated] (SPARK-29145) Spark SQL cannot handle "NOT IN" condition when using "JOIN"

2019-10-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29145: -- Affects Version/s: 2.3.4 > Spark SQL cannot handle "NOT IN" condition when using "JOIN" >

[jira] [Updated] (SPARK-29551) There is a bug about fetch failed when an executor lost

2019-10-22 Thread weixiuli (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] weixiuli updated SPARK-29551: - Description: There will be a regression when the executor lost and then causes 'fetch failed'. When

[jira] [Closed] (SPARK-28925) Update Kubernetes-client to 4.4.2 to be compatible with Kubernetes 1.13 and 1.14

2019-10-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-28925. - > Update Kubernetes-client to 4.4.2 to be compatible with Kubernetes 1.13 and > 1.14 >

[jira] [Closed] (SPARK-29071) Upgrade Scala to 2.12.10

2019-10-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-29071. - > Upgrade Scala to 2.12.10 > > > Key: SPARK-29071 >

[jira] [Closed] (SPARK-29446) Upgrade netty-all to 4.1.42 and fix vulnerabilities.

2019-10-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-29446. - > Upgrade netty-all to 4.1.42 and fix vulnerabilities. >

[jira] [Closed] (SPARK-29495) Add ability to estimate per

2019-10-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-29495. - > Add ability to estimate per > --- > > Key: SPARK-29495 >

[jira] [Updated] (SPARK-27741) Transitivity on predicate pushdown

2019-10-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27741: -- Fix Version/s: (was: 2.4.0) > Transitivity on predicate pushdown >

[jira] [Updated] (SPARK-29193) Update fabric8 version to 4.3 continue docker 4 desktop support

2019-10-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29193: -- Fix Version/s: (was: 3.0.0) > Update fabric8 version to 4.3 continue docker 4 desktop

[jira] [Closed] (SPARK-29547) Make `docker-integration-tests` work in JDK11

2019-10-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-29547. - > Make `docker-integration-tests` work in JDK11 > - > >

[jira] [Assigned] (SPARK-29546) Recover jersey-guava test dependency in docker-integration-tests

2019-10-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29546: - Assignee: Dongjoon Hyun > Recover jersey-guava test dependency in

[jira] [Updated] (SPARK-29546) Recover jersey-guava test dependency in docker-integration-tests

2019-10-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29546: -- Description: While SPARK-28737 upgrades `Jersey` to 2.29, `docker-integration-tests` is

[jira] [Resolved] (SPARK-29547) Make `docker-integration-tests` work in JDK11

2019-10-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29547. --- Resolution: Duplicate This is fixed by SPARK-29546 > Make `docker-integration-tests` work

[jira] [Updated] (SPARK-29546) Recover jersey-guava test dependency in docker-integration-tests

2019-10-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29546: -- Parent: SPARK-29194 Issue Type: Sub-task (was: Bug) > Recover jersey-guava test

[jira] [Assigned] (SPARK-29511) DataSourceV2: Support CREATE NAMESPACE

2019-10-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29511: --- Assignee: Terry Kim > DataSourceV2: Support CREATE NAMESPACE >

[jira] [Resolved] (SPARK-29511) DataSourceV2: Support CREATE NAMESPACE

2019-10-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29511. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26166

[jira] [Assigned] (SPARK-29563) CREATE TABLE LIKE should look up catalog/table like v2 commands

2019-10-22 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-29563: --- Assignee: Dilip Biswal (was: Wenchen Fan) > CREATE TABLE LIKE should look up

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

2019-10-22 Thread huangtianhua (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16957508#comment-16957508 ] huangtianhua commented on SPARK-29106: -- [~shaneknapp],there are two small suggestions: # we don't

[jira] [Comment Edited] (SPARK-20880) When spark SQL is used with Avro-backed HIVE tables, NPE from org.apache.hadoop.hive.serde2.avro.AvroObjectInspectorGenerator.supportedCategories.

2019-10-22 Thread Benjamyn Ward (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16957491#comment-16957491 ] Benjamyn Ward edited comment on SPARK-20880 at 10/23/19 2:05 AM: - Gentle

[jira] [Commented] (SPARK-20880) When spark SQL is used with Avro-backed HIVE tables, NPE from org.apache.hadoop.hive.serde2.avro.AvroObjectInspectorGenerator.supportedCategories.

2019-10-22 Thread Benjamyn Ward (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16957491#comment-16957491 ] Benjamyn Ward commented on SPARK-20880: --- Gentle ping. While the description states that the issue

[jira] [Resolved] (SPARK-29107) Add window.sql - Part 1

2019-10-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29107. -- Resolution: Fixed Issue resolved by pull request 26119

[jira] [Resolved] (SPARK-23160) Port window.sql

2019-10-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23160. -- Resolution: Duplicate > Port window.sql > --- > > Key:

[jira] [Commented] (SPARK-23160) Port window.sql

2019-10-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16957481#comment-16957481 ] Hyukjin Kwon commented on SPARK-23160: -- This JIRA will be resolved at SPARK-29107 SPARK-29108

[jira] [Updated] (SPARK-29553) This problemis about using native BLAS to improvement ML/MLLIB performance

2019-10-22 Thread WuZeyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] WuZeyi updated SPARK-29553: --- Description: I use {color:#ff}native BLAS{color} to improvement ML/MLLIB performance on Yarn. The

[jira] [Comment Edited] (SPARK-29488) In Web UI, stage page has js error when sort table.

2019-10-22 Thread jenny (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16957470#comment-16957470 ] jenny edited comment on SPARK-29488 at 10/23/19 1:07 AM: - Thank you  [~srowen]  

[jira] [Comment Edited] (SPARK-29488) In Web UI, stage page has js error when sort table.

2019-10-22 Thread jenny (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16957470#comment-16957470 ] jenny edited comment on SPARK-29488 at 10/23/19 1:06 AM: - Thank you  

[jira] [Commented] (SPARK-29488) In Web UI, stage page has js error when sort table.

2019-10-22 Thread jenny (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16957470#comment-16957470 ] jenny commented on SPARK-29488: --- Thank you 

[jira] [Created] (SPARK-29563) CREATE TABLE LIKE should look up catalog/table like v2 commands

2019-10-22 Thread Dilip Biswal (Jira)
Dilip Biswal created SPARK-29563: Summary: CREATE TABLE LIKE should look up catalog/table like v2 commands Key: SPARK-29563 URL: https://issues.apache.org/jira/browse/SPARK-29563 Project: Spark

[jira] [Created] (SPARK-29562) SQLAppStatusListener metrics aggregation is slow and memory hungry

2019-10-22 Thread Marcelo Masiero Vanzin (Jira)
Marcelo Masiero Vanzin created SPARK-29562: -- Summary: SQLAppStatusListener metrics aggregation is slow and memory hungry Key: SPARK-29562 URL: https://issues.apache.org/jira/browse/SPARK-29562

[jira] [Updated] (SPARK-29561) Large Case Statement Code Generation OOM

2019-10-22 Thread Michael Chen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Chen updated SPARK-29561: - Description: Spark Configuration spark.driver.memory = 1g spark.master = "local"

[jira] [Updated] (SPARK-29560) Add typesafe bintray repo for sbt-mima-plugin

2019-10-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29560: -- Summary: Add typesafe bintray repo for sbt-mima-plugin (was: sbt-mima-plugin is missing) >

[jira] [Assigned] (SPARK-29560) sbt-mima-plugin is missing

2019-10-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29560: - Assignee: Dongjoon Hyun > sbt-mima-plugin is missing > -- > >

[jira] [Resolved] (SPARK-29560) sbt-mima-plugin is missing

2019-10-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29560. --- Fix Version/s: 3.0.0 2.4.5 Resolution: Fixed Issue resolved by

[jira] [Updated] (SPARK-29561) Large Case Statement Code Generation OOM

2019-10-22 Thread Michael Chen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Chen updated SPARK-29561: - Attachment: apacheSparkCase.sql > Large Case Statement Code Generation OOM >

[jira] [Updated] (SPARK-29561) Large Case Statement Code Generation OOM

2019-10-22 Thread Michael Chen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Chen updated SPARK-29561: - Description: Spark Configuration spark.driver.memory = 1g spark.master = "local"

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

2019-10-22 Thread zhao bo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16957421#comment-16957421 ] zhao bo commented on SPARK-29106: - Shane, thanks for recheck the #9 build fail, let's see whether the

[jira] [Created] (SPARK-29561) Large Case Statement Code Generation OOM

2019-10-22 Thread Michael Chen (Jira)
Michael Chen created SPARK-29561: Summary: Large Case Statement Code Generation OOM Key: SPARK-29561 URL: https://issues.apache.org/jira/browse/SPARK-29561 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-29561) Large Case Statement Code Generation OOM

2019-10-22 Thread Michael Chen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Chen updated SPARK-29561: - Description: Spark Configuration spark.driver.memory = 1g spark.master = "local"

[jira] [Updated] (SPARK-29542) [SQL][DOC] The descriptions of `spark.sql.files.*` are confused.

2019-10-22 Thread feiwang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwang updated SPARK-29542: Description: Hi,the description of `spark.sql.files.maxPartitionBytes` is shown as below. {code:java}

[jira] [Commented] (SPARK-23897) Guava version

2019-10-22 Thread Tak-Lon (Stephen) Wu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16957387#comment-16957387 ] Tak-Lon (Stephen) Wu commented on SPARK-23897: -- hadoop-3.2.x has included

[jira] [Updated] (SPARK-29542) [SQL][DOC] The descriptions of `spark.sql.files.*` are confused.

2019-10-22 Thread feiwang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwang updated SPARK-29542: Summary: [SQL][DOC] The descriptions of `spark.sql.files.*` are confused. (was: [DOC] The description of

[jira] [Resolved] (SPARK-29539) SHOW PARTITIONS should look up catalog/table like v2 commands

2019-10-22 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-29539. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26198

[jira] [Assigned] (SPARK-29539) SHOW PARTITIONS should look up catalog/table like v2 commands

2019-10-22 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-29539: --- Assignee: Huaxin Gao > SHOW PARTITIONS should look up catalog/table like v2 commands >

[jira] [Commented] (SPARK-28859) Remove value check of MEMORY_OFFHEAP_SIZE in declaration section

2019-10-22 Thread Yifan Xing (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16957365#comment-16957365 ] Yifan Xing commented on SPARK-28859: Created a pr: 

[jira] [Updated] (SPARK-29560) sbt-mima-plugin is missing

2019-10-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29560: -- Description: GitHub Action detects the following from yesterday (Oct 21, 2019). -

[jira] [Commented] (SPARK-29560) sbt-mima-plugin is missing

2019-10-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16957363#comment-16957363 ] Dongjoon Hyun commented on SPARK-29560: --- I raised the priority to `Blocker` because Jenkins is

[jira] [Updated] (SPARK-29560) sbt-mima-plugin is missing

2019-10-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29560: -- Priority: Blocker (was: Major) > sbt-mima-plugin is missing > -- > >

[jira] [Commented] (SPARK-29560) sbt-mima-plugin is missing

2019-10-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16957362#comment-16957362 ] Dongjoon Hyun commented on SPARK-29560: --- Yes. It does. I'm trying to fix this because this starts

[jira] [Updated] (SPARK-29557) Upgrade dropwizard metrics library to 4.1.1

2019-10-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29557: -- Component/s: (was: Spark Core) Build > Upgrade dropwizard metrics

[jira] [Updated] (SPARK-29556) Avoid including path in error response from REST submission server

2019-10-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29556: -- Affects Version/s: 1.6.3 > Avoid including path in error response from REST submission server

[jira] [Updated] (SPARK-29556) Avoid including path in error response from REST submission server

2019-10-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29556: -- Affects Version/s: 2.0.2 2.1.3 2.2.3

[jira] [Resolved] (SPARK-29556) Avoid including path in error response from REST submission server

2019-10-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29556. --- Fix Version/s: 3.0.0 2.4.5 Resolution: Fixed Issue resolved by

[jira] [Commented] (SPARK-29560) sbt-mima-plugin is missing

2019-10-22 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16957340#comment-16957340 ] Sean R. Owen commented on SPARK-29560: -- Hm. I note that 0.3.0 is the last version that works with

[jira] [Updated] (SPARK-29560) sbt-mima-plugin is missing

2019-10-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29560: -- Description: GitHub Action detects the following from yesterday (Oct 21, 2019). -

[jira] [Commented] (SPARK-29560) sbt-mima-plugin is missing

2019-10-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16957260#comment-16957260 ] Dongjoon Hyun commented on SPARK-29560: --- Although this is not an Apache Spark issue, but we are

[jira] [Created] (SPARK-29560) sbt-mima-plugin is missing

2019-10-22 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-29560: - Summary: sbt-mima-plugin is missing Key: SPARK-29560 URL: https://issues.apache.org/jira/browse/SPARK-29560 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-29559) Support pagination for JDBC/ODBC UI page

2019-10-22 Thread shahid (Jira)
shahid created SPARK-29559: -- Summary: Support pagination for JDBC/ODBC UI page Key: SPARK-29559 URL: https://issues.apache.org/jira/browse/SPARK-29559 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-29558) ResolveTables and ResolveRelations should be order-insensitive

2019-10-22 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-29558: --- Summary: ResolveTables and ResolveRelations should be order-insensitive Key: SPARK-29558 URL: https://issues.apache.org/jira/browse/SPARK-29558 Project: Spark

[jira] [Created] (SPARK-29557) Upgrade dropwizard metrics library to 4.1.1

2019-10-22 Thread Luca Canali (Jira)
Luca Canali created SPARK-29557: --- Summary: Upgrade dropwizard metrics library to 4.1.1 Key: SPARK-29557 URL: https://issues.apache.org/jira/browse/SPARK-29557 Project: Spark Issue Type:

[jira] [Updated] (SPARK-29555) Getting 404 while opening link for Sequence file on latest documentation page

2019-10-22 Thread Vishal Akkalkote (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vishal Akkalkote updated SPARK-29555: - Description: Trying to open the link for Sequence file on Page

[jira] [Updated] (SPARK-29555) Getting 404 while opening link for Sequence file on latest documentation page

2019-10-22 Thread Vishal Akkalkote (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vishal Akkalkote updated SPARK-29555: - Description: Trying to open the link for Sequence file on Page

[jira] [Created] (SPARK-29556) Avoid including path in error response from REST submission server

2019-10-22 Thread Sean R. Owen (Jira)
Sean R. Owen created SPARK-29556: Summary: Avoid including path in error response from REST submission server Key: SPARK-29556 URL: https://issues.apache.org/jira/browse/SPARK-29556 Project: Spark

[jira] [Updated] (SPARK-29551) There is a bug about fetch failed when an executor lost

2019-10-22 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-29551: - Fix Version/s: (was: 2.4.3) Target Version/s: (was: 2.4.3, 2.4.5, 3.0.0)

[jira] [Updated] (SPARK-29488) In Web UI, stage page has js error when sort table.

2019-10-22 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-29488: - Priority: Minor (was: Major) > In Web UI, stage page has js error when sort table. >

[jira] [Assigned] (SPARK-29488) In Web UI, stage page has js error when sort table.

2019-10-22 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-29488: Assignee: jenny > In Web UI, stage page has js error when sort table. >

[jira] [Resolved] (SPARK-29488) In Web UI, stage page has js error when sort table.

2019-10-22 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-29488. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26136

[jira] [Updated] (SPARK-28793) Document CREATE FUNCTION in SQL Reference.

2019-10-22 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-28793: - Priority: Minor (was: Major) > Document CREATE FUNCTION in SQL Reference. >

[jira] [Assigned] (SPARK-28793) Document CREATE FUNCTION in SQL Reference.

2019-10-22 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-28793: Assignee: Dilip Biswal > Document CREATE FUNCTION in SQL Reference. >

[jira] [Resolved] (SPARK-28793) Document CREATE FUNCTION in SQL Reference.

2019-10-22 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-28793. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25894

[jira] [Updated] (SPARK-28787) Document LOAD DATA statement in SQL Reference.

2019-10-22 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-28787: - Priority: Minor (was: Major) > Document LOAD DATA statement in SQL Reference. >

[jira] [Resolved] (SPARK-28787) Document LOAD DATA statement in SQL Reference.

2019-10-22 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-28787. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25522

[jira] [Assigned] (SPARK-28787) Document LOAD DATA statement in SQL Reference.

2019-10-22 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-28787: Assignee: Huaxin Gao > Document LOAD DATA statement in SQL Reference. >

[jira] [Created] (SPARK-29555) Getting 404 while opening link for Sequence file on latest documentation page

2019-10-22 Thread Vishal Akkalkote (Jira)
Vishal Akkalkote created SPARK-29555: Summary: Getting 404 while opening link for Sequence file on latest documentation page Key: SPARK-29555 URL: https://issues.apache.org/jira/browse/SPARK-29555

[jira] [Resolved] (SPARK-29517) TRUNCATE TABLE should look up catalog/table like v2 commands

2019-10-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29517. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26174

[jira] [Created] (SPARK-29554) Add a misc function named version

2019-10-22 Thread Kent Yao (Jira)
Kent Yao created SPARK-29554: Summary: Add a misc function named version Key: SPARK-29554 URL: https://issues.apache.org/jira/browse/SPARK-29554 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-29552) Fix the flaky test failed in AdaptiveQueryExecSuite # multiple joins

2019-10-22 Thread Ke Jia (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Jia updated SPARK-29552: --- Description: AQE will optimize the logical plan once there is query stage finished. So for inner join, when

[jira] [Created] (SPARK-29553) This problemis about using native BLAS to improvement ML/MLLIB performance

2019-10-22 Thread WuZeyi (Jira)
WuZeyi created SPARK-29553: -- Summary: This problemis about using native BLAS to improvement ML/MLLIB performance Key: SPARK-29553 URL: https://issues.apache.org/jira/browse/SPARK-29553 Project: Spark

[jira] [Created] (SPARK-29552) Fix the flaky test failed in AdaptiveQueryExecSuite # multiple joins

2019-10-22 Thread Ke Jia (Jira)
Ke Jia created SPARK-29552: -- Summary: Fix the flaky test failed in AdaptiveQueryExecSuite # multiple joins Key: SPARK-29552 URL: https://issues.apache.org/jira/browse/SPARK-29552 Project: Spark

[jira] [Assigned] (SPARK-21492) Memory leak in SortMergeJoin

2019-10-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-21492: --- Assignee: Yuanjian Li > Memory leak in SortMergeJoin > > >

[jira] [Resolved] (SPARK-21492) Memory leak in SortMergeJoin

2019-10-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21492. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26164

[jira] [Updated] (SPARK-29550) Enhance locking in session catalog

2019-10-22 Thread Nikita Gorbachevski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikita Gorbachevski updated SPARK-29550: Component/s: (was: Spark Core) > Enhance locking in session catalog >

[jira] [Created] (SPARK-29551) There is a bug about fetch failed when an executor lost

2019-10-22 Thread weixiuli (Jira)
weixiuli created SPARK-29551: Summary: There is a bug about fetch failed when an executor lost Key: SPARK-29551 URL: https://issues.apache.org/jira/browse/SPARK-29551 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-29516) Test ThriftServerQueryTestSuite asynchronously

2019-10-22 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-29516: --- Assignee: Yuming Wang > Test ThriftServerQueryTestSuite asynchronously >

[jira] [Resolved] (SPARK-29516) Test ThriftServerQueryTestSuite asynchronously

2019-10-22 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-29516. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26172

[jira] [Commented] (SPARK-29550) Enhance locking in session catalog

2019-10-22 Thread Nikita Gorbachevski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956902#comment-16956902 ] Nikita Gorbachevski commented on SPARK-29550: - Working on this. > Enhance locking in

[jira] [Created] (SPARK-29550) Enhance locking in session catalog

2019-10-22 Thread Nikita Gorbachevski (Jira)
Nikita Gorbachevski created SPARK-29550: --- Summary: Enhance locking in session catalog Key: SPARK-29550 URL: https://issues.apache.org/jira/browse/SPARK-29550 Project: Spark Issue Type:

[jira] [Created] (SPARK-29549) Union of DataSourceV2 datasources leads to duplicated results

2019-10-22 Thread Miguel Molina (Jira)
Miguel Molina created SPARK-29549: - Summary: Union of DataSourceV2 datasources leads to duplicated results Key: SPARK-29549 URL: https://issues.apache.org/jira/browse/SPARK-29549 Project: Spark

[jira] [Commented] (SPARK-29548) Redirect system print stream to log4j and improve robustness

2019-10-22 Thread Ching Lin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956885#comment-16956885 ] Ching Lin commented on SPARK-29548: --- how about using checkpoint instead of log4j ? > Redirect system

[jira] [Assigned] (SPARK-29232) RandomForestRegressionModel does not update the parameter maps of the DecisionTreeRegressionModels underneath

2019-10-22 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng reassigned SPARK-29232: Assignee: Huaxin Gao > RandomForestRegressionModel does not update the parameter maps of

[jira] [Resolved] (SPARK-29232) RandomForestRegressionModel does not update the parameter maps of the DecisionTreeRegressionModels underneath

2019-10-22 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-29232. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26154

[jira] [Commented] (SPARK-29540) Thrift in some cases can't parse string to date

2019-10-22 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956863#comment-16956863 ] angerszhu commented on SPARK-29540: --- check on this. > Thrift in some cases can't parse string to date

[jira] [Updated] (SPARK-29545) Implement bitwise integer aggregates bit_xor

2019-10-22 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-29545: - Description: {code:java}  {code} As we support bit_and, bit_or now, we'd better support the related

[jira] [Created] (SPARK-29548) Redirect system print stream to log4j and improve robustness

2019-10-22 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-29548: -- Summary: Redirect system print stream to log4j and improve robustness Key: SPARK-29548 URL: https://issues.apache.org/jira/browse/SPARK-29548 Project: Spark

[jira] [Created] (SPARK-29547) Make `docker-integration-tests` work in JDK11

2019-10-22 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-29547: - Summary: Make `docker-integration-tests` work in JDK11 Key: SPARK-29547 URL: https://issues.apache.org/jira/browse/SPARK-29547 Project: Spark Issue Type:

[jira] [Updated] (SPARK-29545) Implement bitwise integer aggregates bit_xor

2019-10-22 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-29545: - Description: {code:java}  {code} As we support bit_and, bot_or now, we'd better support the related

[jira] [Updated] (SPARK-29545) Implement bitwise integer aggregates bit_xor

2019-10-22 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-29545: - Description: {code:java}  {code} As we support bit_and, bot_or now, we'd better support the related

[jira] [Updated] (SPARK-29546) Recover jersey-guava test dependency in docker-integration-tests

2019-10-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29546: -- Description: While SPARK-28737 upgrades `Jersey` to 2.29, `docker-integration-tests` is

[jira] [Created] (SPARK-29546) Recover jersey-guava test dependency in docker-integration-tests

2019-10-22 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-29546: - Summary: Recover jersey-guava test dependency in docker-integration-tests Key: SPARK-29546 URL: https://issues.apache.org/jira/browse/SPARK-29546 Project: Spark

[jira] [Updated] (SPARK-29545) Implement bitwise integer aggregates bit_xor

2019-10-22 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-29545: - Parent: (was: SPARK-27764) Issue Type: Improvement (was: Sub-task) > Implement bitwise

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

2019-10-22 Thread huangtianhua (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956781#comment-16956781 ] huangtianhua commented on SPARK-29106: -- [~shaneknapp], thank you for clarification. And thanks for

[jira] [Created] (SPARK-29545) Implement bitwise integer aggregates bit_xor

2019-10-22 Thread Kent Yao (Jira)
Kent Yao created SPARK-29545: Summary: Implement bitwise integer aggregates bit_xor Key: SPARK-29545 URL: https://issues.apache.org/jira/browse/SPARK-29545 Project: Spark Issue Type: Sub-task

  1   2   >