[jira] [Resolved] (SPARK-28134) Trigonometric Functions

2019-09-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28134. - Resolution: Later > Trigonometric Functions > --- > > Key:

[jira] [Resolved] (SPARK-28909) ANSI SQL: delete and update does not support in Spark

2019-09-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28909. - Resolution: Duplicate > ANSI SQL: delete and update does not support in Spark >

[jira] [Resolved] (SPARK-28663) Aggregate Functions for Statistics

2019-09-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28663. - Resolution: Later > Aggregate Functions for Statistics > -- > >

[jira] [Resolved] (SPARK-28731) Support limit on recursive queries

2019-09-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28731. - Resolution: Later > Support limit on recursive queries > -- > >

[jira] [Resolved] (SPARK-28661) Hypothetical-Set Aggregate Functions

2019-09-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28661. - Resolution: Later > Hypothetical-Set Aggregate Functions > > >

[jira] [Resolved] (SPARK-28171) Difference of interval type conversion between SparkSQL and PostgreSQL

2019-09-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28171. - Resolution: Later > Difference of interval type conversion between SparkSQL and PostgreSQL >

[jira] [Resolved] (SPARK-28379) Correlated scalar subqueries must be aggregated

2019-09-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28379. - Resolution: Later > Correlated scalar subqueries must be aggregated >

[jira] [Resolved] (SPARK-28316) Decimal precision issue

2019-09-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28316. - Resolution: Later > Decimal precision issue > --- > > Key:

[jira] [Updated] (SPARK-25411) Implement range partition in Spark

2019-09-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25411: Parent: (was: SPARK-27764) Issue Type: New Feature (was: Sub-task) > Implement range

[jira] [Commented] (SPARK-25411) Implement range partition in Spark

2019-09-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929690#comment-16929690 ] Xiao Li commented on SPARK-25411: - I think it is very specific to the impl of data sources. We can

[jira] [Resolved] (SPARK-28669) System Information Functions

2019-09-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28669. - Resolution: Later > System Information Functions > > >

[jira] [Resolved] (SPARK-28400) Add built-in Array Functions: array_upper

2019-09-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28400. - Resolution: Later > Add built-in Array Functions: array_upper >

[jira] [Resolved] (SPARK-29003) Spark history server startup hang due to deadlock

2019-09-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29003. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25705

[jira] [Assigned] (SPARK-29003) Spark history server startup hang due to deadlock

2019-09-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29003: - Assignee: shanyu zhao > Spark history server startup hang due to deadlock >

[jira] [Created] (SPARK-29084) Check method bytecode size in BenchmarkQueryTest

2019-09-13 Thread Takeshi Yamamuro (Jira)
Takeshi Yamamuro created SPARK-29084: Summary: Check method bytecode size in BenchmarkQueryTest Key: SPARK-29084 URL: https://issues.apache.org/jira/browse/SPARK-29084 Project: Spark

[jira] [Created] (SPARK-29083) Speed up toLocalIterator with prefetching when enabled

2019-09-13 Thread holdenk (Jira)
holdenk created SPARK-29083: --- Summary: Speed up toLocalIterator with prefetching when enabled Key: SPARK-29083 URL: https://issues.apache.org/jira/browse/SPARK-29083 Project: Spark Issue Type:

[jira] [Created] (SPARK-29082) Spark driver cannot start with only delegation tokens

2019-09-13 Thread Marcelo Vanzin (Jira)
Marcelo Vanzin created SPARK-29082: -- Summary: Spark driver cannot start with only delegation tokens Key: SPARK-29082 URL: https://issues.apache.org/jira/browse/SPARK-29082 Project: Spark

[jira] [Created] (SPARK-29081) Replace calls to SerializationUtils.clone on properties with a faster implementation.

2019-09-13 Thread David Lewis (Jira)
David Lewis created SPARK-29081: --- Summary: Replace calls to SerializationUtils.clone on properties with a faster implementation. Key: SPARK-29081 URL: https://issues.apache.org/jira/browse/SPARK-29081

[jira] [Created] (SPARK-29080) Make r file extension check case insensitive

2019-09-13 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-29080: - Summary: Make r file extension check case insensitive Key: SPARK-29080 URL: https://issues.apache.org/jira/browse/SPARK-29080 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-29079) Enable GitHub Action on PR

2019-09-13 Thread DB Tsai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-29079. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25786

[jira] [Resolved] (SPARK-29075) Add enforcer rule to ban duplicated pom dependency

2019-09-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29075. --- Fix Version/s: 3.0.0 2.4.5 Resolution: Fixed Issue resolved by

[jira] [Assigned] (SPARK-29075) Add enforcer rule to ban duplicated pom dependency

2019-09-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29075: - Assignee: Dongjoon Hyun > Add enforcer rule to ban duplicated pom dependency >

[jira] [Resolved] (SPARK-29032) Simplify Prometheus support by adding PrometheusServlet

2019-09-13 Thread DB Tsai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-29032. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25769

[jira] [Resolved] (SPARK-29064) Add PrometheusResource to export Executor metrics

2019-09-13 Thread DB Tsai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-29064. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25770

[jira] [Assigned] (SPARK-29042) Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-13 Thread Liang-Chi Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh reassigned SPARK-29042: --- Assignee: Liang-Chi Hsieh > Sampling-based RDD with unordered input should be

[jira] [Resolved] (SPARK-29042) Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-13 Thread Liang-Chi Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh resolved SPARK-29042. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25751

[jira] [Created] (SPARK-29079) Enable GitHub Action on PR

2019-09-13 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-29079: - Summary: Enable GitHub Action on PR Key: SPARK-29079 URL: https://issues.apache.org/jira/browse/SPARK-29079 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-29078) Spark shell fails if read permission is not granted to hive warehouse directory

2019-09-13 Thread Mihaly Toth (Jira)
Mihaly Toth created SPARK-29078: --- Summary: Spark shell fails if read permission is not granted to hive warehouse directory Key: SPARK-29078 URL: https://issues.apache.org/jira/browse/SPARK-29078

[jira] [Updated] (SPARK-29077) submitting a SparkSession job fails on a spark://localhost:7077 url on Mac

2019-09-13 Thread alex (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] alex updated SPARK-29077: - Description: When creating a spark context running on a local host getting connection refused error, however

[jira] [Updated] (SPARK-29077) submitting a SparkSession job fails on a spark://localhost:7077 url on Mac

2019-09-13 Thread alex (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] alex updated SPARK-29077: - Description: When creating a spark context running on a local host getting connection refused error, however

[jira] [Updated] (SPARK-29077) submitting a SparkSession job fails on a spark://localhost:7077 url on Mac

2019-09-13 Thread alex (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] alex updated SPARK-29077: - Description: When creating a spark context running on a local host getting connection refused error, however

[jira] [Created] (SPARK-29077) submitting a SparkSession job fails on a spark://localhost:7077 url on Mac

2019-09-13 Thread alex (Jira)
alex created SPARK-29077: Summary: submitting a SparkSession job fails on a spark://localhost:7077 url on Mac Key: SPARK-29077 URL: https://issues.apache.org/jira/browse/SPARK-29077 Project: Spark

[jira] [Commented] (SPARK-29066) Remove old Jenkins jobs for EOL versions or obsolete combinations

2019-09-13 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929510#comment-16929510 ] shane knapp commented on SPARK-29066: - well, we weren't actually stressed for space. each of the

[jira] [Commented] (SPARK-29066) Remove old Jenkins jobs for EOL versions or obsolete combinations

2019-09-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929504#comment-16929504 ] Dongjoon Hyun commented on SPARK-29066: --- Wow. That's another benefits. > Remove old Jenkins jobs

[jira] [Commented] (SPARK-27812) kubernetes client import non-daemon thread which block jvm exit.

2019-09-13 Thread Igor Calabria (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929501#comment-16929501 ] Igor Calabria commented on SPARK-27812: --- Hi everyone, I have added a simple PR

[jira] [Commented] (SPARK-29066) Remove old Jenkins jobs for EOL versions or obsolete combinations

2019-09-13 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929493#comment-16929493 ] shane knapp commented on SPARK-29066: - i'm also going through all of the centos and ubuntu workers

[jira] [Created] (SPARK-29076) Generalize the PVTestSuite to no longer need the minikube tag

2019-09-13 Thread holdenk (Jira)
holdenk created SPARK-29076: --- Summary: Generalize the PVTestSuite to no longer need the minikube tag Key: SPARK-29076 URL: https://issues.apache.org/jira/browse/SPARK-29076 Project: Spark Issue

[jira] [Updated] (SPARK-29075) Add enforcer rule to ban duplicated pom dependency

2019-09-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29075: -- Description: This issue aims to add a new enforcer rule to ban duplicated pom dependency

[jira] [Created] (SPARK-29075) Add enforcer rule to ban duplicated pom dependency

2019-09-13 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-29075: - Summary: Add enforcer rule to ban duplicated pom dependency Key: SPARK-29075 URL: https://issues.apache.org/jira/browse/SPARK-29075 Project: Spark Issue

[jira] [Resolved] (SPARK-28865) Table inheritance

2019-09-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28865. - Resolution: Won't Fix > Table inheritance > - > > Key: SPARK-28865 >

[jira] [Commented] (SPARK-29066) Remove old Jenkins jobs for EOL versions or obsolete combinations

2019-09-13 Thread shane knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929396#comment-16929396 ] shane knapp commented on SPARK-29066: - done... this is great! the jenkins build list is looking

[jira] [Resolved] (SPARK-28566) window functions should not be allowed in window definitions

2019-09-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28566. - Resolution: Won't Fix > window functions should not be allowed in window definitions >

[jira] [Resolved] (SPARK-23539) Add support for Kafka headers in Structured Streaming

2019-09-13 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-23539. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 22282

[jira] [Assigned] (SPARK-23539) Add support for Kafka headers in Structured Streaming

2019-09-13 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-23539: - Assignee: Lee Dongjin > Add support for Kafka headers in Structured Streaming >

[jira] [Assigned] (SPARK-28969) OneVsRestModel in the py side should not set WeightCol and Classifier

2019-09-13 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28969: - Assignee: Huaxin Gao > OneVsRestModel in the py side should not set WeightCol and Classifier >

[jira] [Resolved] (SPARK-28969) OneVsRestModel in the py side should not set WeightCol and Classifier

2019-09-13 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28969. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25715

[jira] [Commented] (SPARK-26205) Optimize InSet expression for bytes, shorts, ints, dates

2019-09-13 Thread Liang-Chi Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929334#comment-16929334 ] Liang-Chi Hsieh commented on SPARK-26205: - [~cloud_fan] I ran a simple test, seems no failure

[jira] [Resolved] (SPARK-29056) ThriftServerSessionPage displays 1970/01/01 for queries that are not finished and not closed

2019-09-13 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-29056. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25762

[jira] [Assigned] (SPARK-29056) ThriftServerSessionPage displays 1970/01/01 for queries that are not finished and not closed

2019-09-13 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-29056: --- Assignee: Juliusz Sompolski > ThriftServerSessionPage displays 1970/01/01 for queries that

[jira] [Assigned] (SPARK-29073) Add GitHub Action to branch-2.4 for `Scala-2.11 / Scala-2.12` build

2019-09-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29073: - Assignee: Dongjoon Hyun > Add GitHub Action to branch-2.4 for `Scala-2.11 /

[jira] [Resolved] (SPARK-29073) Add GitHub Action to branch-2.4 for `Scala-2.11 / Scala-2.12` build

2019-09-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29073. --- Fix Version/s: 2.4.5 Resolution: Fixed Issue resolved by pull request 25781

[jira] [Commented] (SPARK-29068) CSV read reports incorrect row count

2019-09-13 Thread Sandeep Katta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929158#comment-16929158 ] Sandeep Katta commented on SPARK-29068: --- looks similar to

[jira] [Commented] (SPARK-29058) Reading csv file with DROPMALFORMED showing incorrect record count

2019-09-13 Thread Sandeep Katta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929156#comment-16929156 ] Sandeep Katta commented on SPARK-29058: --- I will look into this issue, thanks for reporting >

[jira] [Commented] (SPARK-25088) Rest Server default & doc updates

2019-09-13 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929103#comment-16929103 ] t oo commented on SPARK-25088: -- they are on different ports, now i have to maintain a patched fork >

[jira] [Updated] (SPARK-29055) Memory leak in Spark Driver

2019-09-13 Thread George Papa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Papa updated SPARK-29055: Description: I used Spark 2.1.1 and I upgraded into the latest version 2.4.4. I observed from

[jira] [Updated] (SPARK-29055) Memory leak in Spark Driver

2019-09-13 Thread George Papa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Papa updated SPARK-29055: Description: I used Spark 2.1.1 and I upgraded into the latest version 2.4.4. I observed from

[jira] [Updated] (SPARK-29055) Memory leak in Spark Driver

2019-09-13 Thread George Papa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Papa updated SPARK-29055: Description: I used Spark 2.1.1 and I upgrade my Spark a the latest version 2.4.4. I observed

[jira] [Updated] (SPARK-29055) Memory leak in Spark Driver

2019-09-13 Thread George Papa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Papa updated SPARK-29055: Description: **I used Spark 2.1.1 and I upgrade my Spark a the latest version 2.4.4. I observed

[jira] [Updated] (SPARK-29055) Memory leak in Spark Driver

2019-09-13 Thread George Papa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Papa updated SPARK-29055: Description:  *ISSUE* I used Spark 2.1.1 and I upgrade my Spark a the latest version 2.4.4. I

[jira] [Updated] (SPARK-29055) Memory leak in Spark Driver

2019-09-13 Thread George Papa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Papa updated SPARK-29055: Attachment: (was: image-2019-09-11-16-14-34-963.png) > Memory leak in Spark Driver >

[jira] [Updated] (SPARK-29055) Memory leak in Spark Driver

2019-09-13 Thread George Papa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Papa updated SPARK-29055: Attachment: (was: image-2019-09-11-16-14-26-765.png) > Memory leak in Spark Driver >

[jira] [Updated] (SPARK-29055) Memory leak in Spark Driver

2019-09-13 Thread George Papa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Papa updated SPARK-29055: Description:  *ISSUE* I used Spark 2.1.1 and I upgrade my Spark a the latest version 2.4.4. I

[jira] [Commented] (SPARK-21183) Unable to return Google BigQuery INTEGER data type into Spark via google BigQuery JDBC driver: java.sql.SQLDataException: [Simba][JDBC](10140) Error converting value t

2019-09-13 Thread Philippe ROSSIGNOL (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929075#comment-16929075 ] Philippe ROSSIGNOL commented on SPARK-21183: For me UseNativeQuery=0 works well with the

[jira] [Commented] (SPARK-21179) Unable to return Hive INT data type into Spark via Hive JDBC driver: Caused by: java.sql.SQLDataException: [Simba][JDBC](10140) Error converting value to int.

2019-09-13 Thread Philippe ROSSIGNOL (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929072#comment-16929072 ] Philippe ROSSIGNOL commented on SPARK-21179: For me UseNativeQuery=0 works well with the

[jira] [Created] (SPARK-29074) Optimize `date_format` for foldable `fmt`

2019-09-13 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29074: -- Summary: Optimize `date_format` for foldable `fmt` Key: SPARK-29074 URL: https://issues.apache.org/jira/browse/SPARK-29074 Project: Spark Issue Type:

[jira] [Commented] (SPARK-29067) divide function does not throw an error, if a number is not passed to it

2019-09-13 Thread Mangesh Rananavare (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929066#comment-16929066 ] Mangesh Rananavare commented on SPARK-29067: Thank you. Also to add this is the case with

[jira] [Updated] (SPARK-29055) Memory leak in Spark Driver

2019-09-13 Thread George Papa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Papa updated SPARK-29055: Description:       In Spark 2.3.3+ the driver memory is increasing continuously. I don't have

[jira] [Resolved] (SPARK-28795) Document CREATE VIEW statement in SQL Reference.

2019-09-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28795. - Fix Version/s: 3.0.0 Assignee: Aman Omer Resolution: Fixed > Document CREATE VIEW

[jira] [Resolved] (SPARK-28796) Document DROP DATABASE statement in SQL Reference.

2019-09-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28796. - Fix Version/s: 3.0.0 Assignee: Sandeep Katta Resolution: Fixed > Document DROP DATABASE

[jira] [Assigned] (SPARK-28828) Document REFRESH statement in SQL Reference.

2019-09-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-28828: --- Assignee: kevin yu > Document REFRESH statement in SQL Reference. >

[jira] [Resolved] (SPARK-28828) Document REFRESH statement in SQL Reference.

2019-09-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28828. - Fix Version/s: 3.0.0 Resolution: Fixed > Document REFRESH statement in SQL Reference. >