[jira] [Assigned] (SPARK-28020) Add date.sql

2019-07-05 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28020: - Assignee: Yuming Wang > Add date.sql > > > Key:

[jira] [Resolved] (SPARK-28020) Add date.sql

2019-07-05 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28020. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24850

[jira] [Updated] (SPARK-27296) User Defined Aggregating Functions (UDAFs) have a major efficiency problem

2019-07-05 Thread Erik Erlandson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Erlandson updated SPARK-27296: --- Target Version/s: 3.0.0 > User Defined Aggregating Functions (UDAFs) have a major

[jira] [Created] (SPARK-28266) data correctness issue: data duplication when `path` serde peroperty is present

2019-07-05 Thread Ruslan Dautkhanov (JIRA)
Ruslan Dautkhanov created SPARK-28266: - Summary: data correctness issue: data duplication when `path` serde peroperty is present Key: SPARK-28266 URL: https://issues.apache.org/jira/browse/SPARK-28266

[jira] [Created] (SPARK-28265) Missing TableCatalog API to rename table

2019-07-05 Thread Edgar Rodriguez (JIRA)
Edgar Rodriguez created SPARK-28265: --- Summary: Missing TableCatalog API to rename table Key: SPARK-28265 URL: https://issues.apache.org/jira/browse/SPARK-28265 Project: Spark Issue Type:

[jira] [Created] (SPARK-28264) Revisiting Python / pandas UDF

2019-07-05 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-28264: --- Summary: Revisiting Python / pandas UDF Key: SPARK-28264 URL: https://issues.apache.org/jira/browse/SPARK-28264 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-25994) SPIP: Property Graphs, Cypher Queries, and Algorithms

2019-07-05 Thread Sam hendley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879508#comment-16879508 ] Sam hendley commented on SPARK-25994: - Forgive the intrusion but it is unclear to me if there is

[jira] [Created] (SPARK-28263) Spark-submit can not find class (ClassNotFoundException)

2019-07-05 Thread Zhiyuan (JIRA)
Zhiyuan created SPARK-28263: --- Summary: Spark-submit can not find class (ClassNotFoundException) Key: SPARK-28263 URL: https://issues.apache.org/jira/browse/SPARK-28263 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-27296) User Defined Aggregating Functions (UDAFs) have a major efficiency problem

2019-07-05 Thread Erik Erlandson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Erlandson reassigned SPARK-27296: -- Assignee: Erik Erlandson > User Defined Aggregating Functions (UDAFs) have a major

[jira] [Assigned] (SPARK-28206) "@pandas_udf" in doctest is rendered as ":pandas_udf" in html API doc

2019-07-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-28206: - Assignee: Hyukjin Kwon > "@pandas_udf" in doctest is rendered as ":pandas_udf" in html

[jira] [Resolved] (SPARK-28206) "@pandas_udf" in doctest is rendered as ":pandas_udf" in html API doc

2019-07-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-28206. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25060

[jira] [Resolved] (SPARK-27898) Support 4 date operators(date + integer, integer + date, date - integer and date - date)

2019-07-05 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27898. --- Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 3.0.0 This is

[jira] [Updated] (SPARK-28262) Support DROP GLOBAL TEMPORARY VIEW

2019-07-05 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28262: Description: We create global temporary view by: CREATE GLOBAL TEMPORARY VIEW temp_view AS SELECT

[jira] [Assigned] (SPARK-28262) Support DROP GLOBAL TEMPORARY VIEW

2019-07-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28262: Assignee: Apache Spark > Support DROP GLOBAL TEMPORARY VIEW >

[jira] [Assigned] (SPARK-28262) Support DROP GLOBAL TEMPORARY VIEW

2019-07-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28262: Assignee: (was: Apache Spark) > Support DROP GLOBAL TEMPORARY VIEW >

[jira] [Created] (SPARK-28262) Support DROP GLOBAL TEMPORARY VIEW

2019-07-05 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-28262: --- Summary: Support DROP GLOBAL TEMPORARY VIEW Key: SPARK-28262 URL: https://issues.apache.org/jira/browse/SPARK-28262 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-28261) Flaky test: org.apache.spark.network.TransportClientFactorySuite.reuseClientsUpToConfigVariable

2019-07-05 Thread Gabor Somogyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi updated SPARK-28261: -- Description: Error message: {noformat} java.lang.AssertionError: expected:<3> but was:<4>

[jira] [Created] (SPARK-28261) Flaky test: org.apache.spark.network.TransportClientFactorySuite.reuseClientsUpToConfigVariable

2019-07-05 Thread Gabor Somogyi (JIRA)
Gabor Somogyi created SPARK-28261: - Summary: Flaky test: org.apache.spark.network.TransportClientFactorySuite.reuseClientsUpToConfigVariable Key: SPARK-28261 URL: https://issues.apache.org/jira/browse/SPARK-28261

[jira] [Commented] (SPARK-28261) Flaky test: org.apache.spark.network.TransportClientFactorySuite.reuseClientsUpToConfigVariable

2019-07-05 Thread Gabor Somogyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879350#comment-16879350 ] Gabor Somogyi commented on SPARK-28261: --- I'm working on this. > Flaky test: >

[jira] [Commented] (SPARK-28260) Add CLOSED state to ExecutionState

2019-07-05 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879349#comment-16879349 ] Yuming Wang commented on SPARK-28260: - I'm working on. > Add CLOSED state to ExecutionState >

[jira] [Created] (SPARK-28260) Add CLOSED state to ExecutionState

2019-07-05 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-28260: --- Summary: Add CLOSED state to ExecutionState Key: SPARK-28260 URL: https://issues.apache.org/jira/browse/SPARK-28260 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-28200) Decimal overflow handling in ExpressionEncoder

2019-07-05 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-28200: --- Assignee: Mick Jermsurawong > Decimal overflow handling in ExpressionEncoder >

[jira] [Resolved] (SPARK-28200) Decimal overflow handling in ExpressionEncoder

2019-07-05 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28200. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25016

[jira] [Updated] (SPARK-28259) Date/Time Output Styles and Date Order Conventions

2019-07-05 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28259: Description: *Date/Time Output Styles* ||Style Specification||Description||Example|| |{{ISO}}|ISO

[jira] [Created] (SPARK-28259) Date/Time Output Styles and Date Order Conventions

2019-07-05 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-28259: --- Summary: Date/Time Output Styles and Date Order Conventions Key: SPARK-28259 URL: https://issues.apache.org/jira/browse/SPARK-28259 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-28206) "@pandas_udf" in doctest is rendered as ":pandas_udf" in html API doc

2019-07-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28206: Assignee: (was: Apache Spark) > "@pandas_udf" in doctest is rendered as

[jira] [Assigned] (SPARK-28206) "@pandas_udf" in doctest is rendered as ":pandas_udf" in html API doc

2019-07-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28206: Assignee: Apache Spark > "@pandas_udf" in doctest is rendered as ":pandas_udf" in html

[jira] [Updated] (SPARK-28258) Incopatibility betweek spark docker image and hadoop 3.2 and azure tools

2019-07-05 Thread Jose Luis Pedrosa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jose Luis Pedrosa updated SPARK-28258: -- Description: Currently the docker images generated by the distro uses openjdk8 based

[jira] [Resolved] (SPARK-28241) Show metadata operations on ThriftServerTab

2019-07-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-28241. --- Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 3.0.0 > Show

[jira] [Created] (SPARK-28258) Incopatibility betweek spark docker image and hadoop 3.2 and azure tools

2019-07-05 Thread Jose Luis Pedrosa (JIRA)
Jose Luis Pedrosa created SPARK-28258: - Summary: Incopatibility betweek spark docker image and hadoop 3.2 and azure tools Key: SPARK-28258 URL: https://issues.apache.org/jira/browse/SPARK-28258

[jira] [Commented] (SPARK-28206) "@pandas_udf" in doctest is rendered as ":pandas_udf" in html API doc

2019-07-05 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879121#comment-16879121 ] Hyukjin Kwon commented on SPARK-28206: -- This is a side effect by Epydoc doc plugin, which is a

[jira] [Assigned] (SPARK-28257) Use ConfigEntry for hardcoded configs in SQL module

2019-07-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28257: Assignee: Apache Spark > Use ConfigEntry for hardcoded configs in SQL module >

[jira] [Assigned] (SPARK-28257) Use ConfigEntry for hardcoded configs in SQL module

2019-07-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28257: Assignee: (was: Apache Spark) > Use ConfigEntry for hardcoded configs in SQL module

[jira] [Created] (SPARK-28257) Use ConfigEntry for hardcoded configs in SQL module

2019-07-05 Thread EdisonWang (JIRA)
EdisonWang created SPARK-28257: -- Summary: Use ConfigEntry for hardcoded configs in SQL module Key: SPARK-28257 URL: https://issues.apache.org/jira/browse/SPARK-28257 Project: Spark Issue Type:

[jira] [Commented] (SPARK-28015) Invalid date formats should throw an exception

2019-07-05 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879062#comment-16879062 ] Dongjoon Hyun commented on SPARK-28015: --- Thank you, [~iskenderunlu804]. Please file a PR on Apache

[jira] [Resolved] (SPARK-28218) Migrate Avro to File source V2

2019-07-05 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28218. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25017

[jira] [Assigned] (SPARK-28218) Migrate Avro to File source V2

2019-07-05 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28218: - Assignee: Gengliang Wang > Migrate Avro to File source V2 >

[jira] [Updated] (SPARK-28248) Upgrade docker image and library for PostgreSQL integration test

2019-07-05 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28248: -- Summary: Upgrade docker image and library for PostgreSQL integration test (was: Upgrade

[jira] [Resolved] (SPARK-28248) Upgrade docker image and library for PostgreSQL integration test

2019-07-05 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28248. --- Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 3.0.0 This is

[jira] [Updated] (SPARK-28248) Upgrade Postgres docker image

2019-07-05 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28248: -- Priority: Minor (was: Major) > Upgrade Postgres docker image > -

[jira] [Assigned] (SPARK-21067) Thrift Server - CTAS fail with Unable to move source

2019-07-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21067: Assignee: Apache Spark > Thrift Server - CTAS fail with Unable to move source >

[jira] [Assigned] (SPARK-21067) Thrift Server - CTAS fail with Unable to move source

2019-07-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21067: Assignee: (was: Apache Spark) > Thrift Server - CTAS fail with Unable to move source

[jira] [Assigned] (SPARK-28239) Allow TCP connections created by shuffle service auto close on YARN NodeManagers

2019-07-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28239: Assignee: (was: Apache Spark) > Allow TCP connections created by shuffle service

[jira] [Assigned] (SPARK-28239) Allow TCP connections created by shuffle service auto close on YARN NodeManagers

2019-07-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28239: Assignee: Apache Spark > Allow TCP connections created by shuffle service auto close on

[jira] [Updated] (SPARK-28248) Upgrade Postgres docker image

2019-07-05 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28248: Summary: Upgrade Postgres docker image (was: Upgrade DB2 and Postgres docker image) > Upgrade

[jira] [Assigned] (SPARK-28256) Failed to initialize FileContextBasedCheckpointFileManager with uri without authority

2019-07-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28256: Assignee: Apache Spark > Failed to initialize FileContextBasedCheckpointFileManager with

[jira] [Assigned] (SPARK-28256) Failed to initialize FileContextBasedCheckpointFileManager with uri without authority

2019-07-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28256: Assignee: (was: Apache Spark) > Failed to initialize

[jira] [Updated] (SPARK-28256) Failed to initialize FileContextBasedCheckpointFileManager with uri without authority

2019-07-05 Thread Genmao Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Genmao Yu updated SPARK-28256: -- Description: reproduce code {code:sql} CREATE TABLE `user_click_count` (`userId` STRING, `click`

[jira] [Updated] (SPARK-28256) Failed to initialize FileContextBasedCheckpointFileManager with uri without authority

2019-07-05 Thread Genmao Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Genmao Yu updated SPARK-28256: -- Description: {code:java} java.lang.RuntimeException: java.lang.reflect.InvocationTargetException

[jira] [Created] (SPARK-28256) Failed to initialize FileContextBasedCheckpointFileManager with uri without authority

2019-07-05 Thread Genmao Yu (JIRA)
Genmao Yu created SPARK-28256: - Summary: Failed to initialize FileContextBasedCheckpointFileManager with uri without authority Key: SPARK-28256 URL: https://issues.apache.org/jira/browse/SPARK-28256