[jira] [Updated] (SPARK-28034) Port with.sql

2019-07-11 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28034: -- Summary: Port with.sql (was: Add with.sql) > Port with.sql > - > >

[jira] [Resolved] (SPARK-28034) Add with.sql

2019-07-11 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28034. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24860

[jira] [Assigned] (SPARK-28034) Add with.sql

2019-07-11 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28034: - Assignee: Peter Toth > Add with.sql > > > Key:

[jira] [Created] (SPARK-28360) The serviceAccountName configuration item does not take effect in client mode.

2019-07-11 Thread zhixingheyi_tian (JIRA)
zhixingheyi_tian created SPARK-28360: Summary: The serviceAccountName configuration item does not take effect in client mode. Key: SPARK-28360 URL: https://issues.apache.org/jira/browse/SPARK-28360

[jira] [Assigned] (SPARK-28257) Use ConfigEntry for hardcoded configs in SQL module

2019-07-11 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28257: - Assignee: EdisonWang > Use ConfigEntry for hardcoded configs in SQL module >

[jira] [Resolved] (SPARK-28257) Use ConfigEntry for hardcoded configs in SQL module

2019-07-11 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28257. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25059

[jira] [Created] (SPARK-28359) Make integrated UDF tests robust by making them no-op

2019-07-11 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-28359: Summary: Make integrated UDF tests robust by making them no-op Key: SPARK-28359 URL: https://issues.apache.org/jira/browse/SPARK-28359 Project: Spark Issue

[jira] [Assigned] (SPARK-28139) DataSourceV2: Add AlterTable v2 implementation

2019-07-11 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-28139: --- Assignee: Ryan Blue > DataSourceV2: Add AlterTable v2 implementation >

[jira] [Resolved] (SPARK-28139) DataSourceV2: Add AlterTable v2 implementation

2019-07-11 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28139. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24937

[jira] [Commented] (SPARK-11248) Spark hivethriftserver is using the wrong user to while getting HDFS permissions

2019-07-11 Thread HonglunChen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883465#comment-16883465 ] HonglunChen commented on SPARK-11248: - [~githubbot]  [~wuchang1989]  Did you just have this problem

[jira] [Updated] (SPARK-28358) Fix Flaky Tests - test_time_with_timezone (pyspark.sql.tests.test_serde.SerdeTests)

2019-07-11 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28358: -- Description: -

[jira] [Created] (SPARK-28358) Fix Flaky Tests - test_time_with_timezone (pyspark.sql.tests.test_serde.SerdeTests)

2019-07-11 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-28358: - Summary: Fix Flaky Tests - test_time_with_timezone (pyspark.sql.tests.test_serde.SerdeTests) Key: SPARK-28358 URL: https://issues.apache.org/jira/browse/SPARK-28358

[jira] [Assigned] (SPARK-28284) Convert and port 'join-empty-relation.sql' into UDF test base

2019-07-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28284: Assignee: Apache Spark > Convert and port 'join-empty-relation.sql' into UDF test base >

[jira] [Assigned] (SPARK-28284) Convert and port 'join-empty-relation.sql' into UDF test base

2019-07-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28284: Assignee: (was: Apache Spark) > Convert and port 'join-empty-relation.sql' into UDF

[jira] [Commented] (SPARK-25080) NPE in HiveShim$.toCatalystDecimal(HiveShim.scala:110)

2019-07-11 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883419#comment-16883419 ] Hyukjin Kwon commented on SPARK-25080: -- 2.2.x is EOL releases. Can you check if the bus exists in

[jira] [Commented] (SPARK-28306) Once optimizer rule NormalizeFloatingNumbers is not idempotent

2019-07-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883399#comment-16883399 ] Apache Spark commented on SPARK-28306: -- User 'yeshengm' has created a pull request for this issue:

[jira] [Updated] (SPARK-28357) Fix Flaky Test - FileAppenderSuite.rolling file appender - size-based rolling compressed

2019-07-11 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28357: -- Summary: Fix Flaky Test - FileAppenderSuite.rolling file appender - size-based rolling

[jira] [Assigned] (SPARK-28357) Fix Flaky Test - FileAppenderSuite.rolling file appender - size-based rolling

2019-07-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28357: Assignee: Apache Spark > Fix Flaky Test - FileAppenderSuite.rolling file appender -

[jira] [Assigned] (SPARK-28357) Fix Flaky Test - FileAppenderSuite.rolling file appender - size-based rolling

2019-07-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28357: Assignee: (was: Apache Spark) > Fix Flaky Test - FileAppenderSuite.rolling file

[jira] [Assigned] (SPARK-28282) Convert and port 'inline-table.sql' into UDF test base

2019-07-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28282: Assignee: Apache Spark > Convert and port 'inline-table.sql' into UDF test base >

[jira] [Assigned] (SPARK-28282) Convert and port 'inline-table.sql' into UDF test base

2019-07-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28282: Assignee: (was: Apache Spark) > Convert and port 'inline-table.sql' into UDF test

[jira] [Created] (SPARK-28357) Fix Flaky Test - FileAppenderSuite.rolling file appender - size-based rolling

2019-07-11 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-28357: - Summary: Fix Flaky Test - FileAppenderSuite.rolling file appender - size-based rolling Key: SPARK-28357 URL: https://issues.apache.org/jira/browse/SPARK-28357

[jira] [Assigned] (SPARK-28355) Use Spark conf for threshold at which UDF is compressed by broadcast

2019-07-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28355: Assignee: (was: Apache Spark) > Use Spark conf for threshold at which UDF is

[jira] [Assigned] (SPARK-28355) Use Spark conf for threshold at which UDF is compressed by broadcast

2019-07-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28355: Assignee: Apache Spark > Use Spark conf for threshold at which UDF is compressed by

[jira] [Assigned] (SPARK-28286) Convert and port 'pivot.sql' into UDF test base

2019-07-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28286: Assignee: Apache Spark > Convert and port 'pivot.sql' into UDF test base >

[jira] [Assigned] (SPARK-28286) Convert and port 'pivot.sql' into UDF test base

2019-07-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28286: Assignee: (was: Apache Spark) > Convert and port 'pivot.sql' into UDF test base >

[jira] [Assigned] (SPARK-28356) Do not reduce the number of partitions for repartition in adaptive execution

2019-07-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28356: Assignee: (was: Apache Spark) > Do not reduce the number of partitions for

[jira] [Assigned] (SPARK-28356) Do not reduce the number of partitions for repartition in adaptive execution

2019-07-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28356: Assignee: Apache Spark > Do not reduce the number of partitions for repartition in

[jira] [Created] (SPARK-28356) Do not reduce the number of partitions for repartition in adaptive execution

2019-07-11 Thread Carson Wang (JIRA)
Carson Wang created SPARK-28356: --- Summary: Do not reduce the number of partitions for repartition in adaptive execution Key: SPARK-28356 URL: https://issues.apache.org/jira/browse/SPARK-28356 Project:

[jira] [Created] (SPARK-28355) Use Spark conf for threshold at which UDF is compressed by broadcast

2019-07-11 Thread Jesse Cai (JIRA)
Jesse Cai created SPARK-28355: - Summary: Use Spark conf for threshold at which UDF is compressed by broadcast Key: SPARK-28355 URL: https://issues.apache.org/jira/browse/SPARK-28355 Project: Spark

[jira] [Assigned] (SPARK-28354) Use JIRA user name instead of JIRA user key

2019-07-11 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28354: - Assignee: Yuming Wang > Use JIRA user name instead of JIRA user key >

[jira] [Assigned] (SPARK-28354) Use JIRA user name instead of JIRA user key

2019-07-11 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28354: - Assignee: Dongjoon Hyun (was: Yuming Wang) > Use JIRA user name instead of JIRA user

[jira] [Assigned] (SPARK-28354) Use JIRA user name instead of JIRA user key

2019-07-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28354: Assignee: (was: Apache Spark) > Use JIRA user name instead of JIRA user key >

[jira] [Assigned] (SPARK-28354) Use JIRA user name instead of JIRA user key

2019-07-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28354: Assignee: Apache Spark > Use JIRA user name instead of JIRA user key >

[jira] [Comment Edited] (SPARK-16738) Queryable state for Spark State Store

2019-07-11 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883332#comment-16883332 ] Stavros Kontopoulos edited comment on SPARK-16738 at 7/11/19 9:19 PM:

[jira] [Updated] (SPARK-28354) Use JIRA user name instead of JIRA user key

2019-07-11 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28354: -- Description: `dev/merge_spark_pr.py` script always fail for some users (e.g. [~yumwang])

[jira] [Created] (SPARK-28354) Use JIRA user name instead of JIRA user key

2019-07-11 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-28354: - Summary: Use JIRA user name instead of JIRA user key Key: SPARK-28354 URL: https://issues.apache.org/jira/browse/SPARK-28354 Project: Spark Issue Type:

[jira] [Commented] (SPARK-16738) Queryable state for Spark State Store

2019-07-11 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883332#comment-16883332 ] Stavros Kontopoulos commented on SPARK-16738: - [~kabhwan] is correct we need something

[jira] [Updated] (SPARK-28334) Port select.sql

2019-07-11 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28334: -- Summary: Port select.sql (was: Add select.sql) > Port select.sql > --- > >

[jira] [Assigned] (SPARK-28334) Add select.sql

2019-07-11 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28334: - Assignee: Yuming Wang > Add select.sql > -- > > Key:

[jira] [Resolved] (SPARK-28334) Add select.sql

2019-07-11 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28334. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25096

[jira] [Comment Edited] (SPARK-25080) NPE in HiveShim$.toCatalystDecimal(HiveShim.scala:110)

2019-07-11 Thread Serge Shikov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883296#comment-16883296 ] Serge Shikov edited comment on SPARK-25080 at 7/11/19 8:05 PM: ---

[jira] [Comment Edited] (SPARK-16738) Queryable state for Spark State Store

2019-07-11 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883297#comment-16883297 ] Jungtaek Lim edited comment on SPARK-16738 at 7/11/19 8:05 PM: --- No it

[jira] [Commented] (SPARK-16738) Queryable state for Spark State Store

2019-07-11 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883297#comment-16883297 ] Jungtaek Lim commented on SPARK-16738: -- No it deals with different issue. Basically queryable state

[jira] [Commented] (SPARK-25080) NPE in HiveShim$.toCatalystDecimal(HiveShim.scala:110)

2019-07-11 Thread Serge Shikov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883296#comment-16883296 ] Serge Shikov commented on SPARK-25080: -- Reproducible on Spark 2.2.0. Executing SQL select

[jira] [Created] (SPARK-28353) Inserting Into Partitioned Parquet Table Behaves Incorrectly

2019-07-11 Thread Justin Fincher (JIRA)
Justin Fincher created SPARK-28353: -- Summary: Inserting Into Partitioned Parquet Table Behaves Incorrectly Key: SPARK-28353 URL: https://issues.apache.org/jira/browse/SPARK-28353 Project: Spark

[jira] [Commented] (SPARK-27609) from_json expects values of options dictionary to be

2019-07-11 Thread Zachary Jablons (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883249#comment-16883249 ] Zachary Jablons commented on SPARK-27609: - Sorry, no I haven't had the time to do this and I

[jira] [Commented] (SPARK-28266) data correctness issue: data duplication when `path` serde property is present

2019-07-11 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883222#comment-16883222 ] Ruslan Dautkhanov commented on SPARK-28266: --- Another interesting side Spark bug found while

[jira] [Commented] (SPARK-28286) Convert and port 'pivot.sql' into UDF test base

2019-07-11 Thread Chitral Verma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883213#comment-16883213 ] Chitral Verma commented on SPARK-28286: --- Thanks. I've started working on this. > Convert and port

[jira] [Commented] (SPARK-28284) Convert and port 'join-empty-relation.sql' into UDF test base

2019-07-11 Thread Terry Kim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883197#comment-16883197 ] Terry Kim commented on SPARK-28284: --- Yes, I am working on it. You can take up the pivot.sql. >

[jira] [Commented] (SPARK-28286) Convert and port 'pivot.sql' into UDF test base

2019-07-11 Thread Terry Kim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883182#comment-16883182 ] Terry Kim commented on SPARK-28286: --- no, go ahead. > Convert and port 'pivot.sql' into UDF test base

[jira] [Commented] (SPARK-28286) Convert and port 'pivot.sql' into UDF test base

2019-07-11 Thread Chitral Verma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883179#comment-16883179 ] Chitral Verma commented on SPARK-28286: --- [~imback82] will you mind sharing this one ? thanks. >

[jira] [Commented] (SPARK-28284) Convert and port 'join-empty-relation.sql' into UDF test base

2019-07-11 Thread Chitral Verma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883177#comment-16883177 ] Chitral Verma commented on SPARK-28284: --- Hi, Is some one working on this? I'd like to pick it up.

[jira] [Commented] (SPARK-16738) Queryable state for Spark State Store

2019-07-11 Thread Chitral Verma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883174#comment-16883174 ] Chitral Verma commented on SPARK-16738: --- Hi [~skonto]. You think this can help ?

[jira] [Commented] (SPARK-28286) Convert and port 'pivot.sql' into UDF test base

2019-07-11 Thread Terry Kim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883167#comment-16883167 ] Terry Kim commented on SPARK-28286: --- I will work on this. > Convert and port 'pivot.sql' into UDF

[jira] [Updated] (SPARK-28352) Spark UI misses some executor metrics

2019-07-11 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-28352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak KÖSE updated SPARK-28352: --- Attachment: executor_summary.png > Spark UI misses some executor metrics >

[jira] [Updated] (SPARK-28352) Spark UI misses some executor metrics

2019-07-11 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-28352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak KÖSE updated SPARK-28352: --- Attachment: storage_page.png > Spark UI misses some executor metrics >

[jira] [Updated] (SPARK-28352) Spark UI misses some executor metrics

2019-07-11 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-28352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak KÖSE updated SPARK-28352: --- Attachment: executor_page.png > Spark UI misses some executor metrics >

[jira] [Commented] (SPARK-28282) Convert and port 'inline-table.sql' into UDF test base

2019-07-11 Thread Terry Kim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883166#comment-16883166 ] Terry Kim commented on SPARK-28282: --- I will work on this > Convert and port 'inline-table.sql' into

[jira] [Created] (SPARK-28352) Spark UI misses some executor metrics

2019-07-11 Thread JIRA
Burak KÖSE created SPARK-28352: -- Summary: Spark UI misses some executor metrics Key: SPARK-28352 URL: https://issues.apache.org/jira/browse/SPARK-28352 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-28348) Avoid cast twice for decimal type

2019-07-11 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883165#comment-16883165 ] Marco Gaido commented on SPARK-28348: - Mmmhyes, you're right. > Avoid cast twice for decimal

[jira] [Assigned] (SPARK-28283) Convert and port 'intersect-all.sql' into UDF test base

2019-07-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28283: Assignee: (was: Apache Spark) > Convert and port 'intersect-all.sql' into UDF test

[jira] [Assigned] (SPARK-28283) Convert and port 'intersect-all.sql' into UDF test base

2019-07-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28283: Assignee: Apache Spark > Convert and port 'intersect-all.sql' into UDF test base >

[jira] [Assigned] (SPARK-23472) Add config properties for administrator JVM options

2019-07-11 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-23472: -- Assignee: Gabor Somogyi > Add config properties for administrator JVM options >

[jira] [Resolved] (SPARK-23472) Add config properties for administrator JVM options

2019-07-11 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-23472. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24804

[jira] [Resolved] (SPARK-28055) Add delegation token custom AdminClient configurations.

2019-07-11 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28055. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24875

[jira] [Assigned] (SPARK-28055) Add delegation token custom AdminClient configurations.

2019-07-11 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28055: -- Assignee: Gabor Somogyi > Add delegation token custom AdminClient configurations. >

[jira] [Assigned] (SPARK-27878) Support ARRAY(sub-SELECT) expressions

2019-07-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27878: Assignee: (was: Apache Spark) > Support ARRAY(sub-SELECT) expressions >

[jira] [Assigned] (SPARK-27878) Support ARRAY(sub-SELECT) expressions

2019-07-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27878: Assignee: Apache Spark > Support ARRAY(sub-SELECT) expressions >

[jira] [Assigned] (SPARK-28213) Remove duplication between columnar and ColumnarBatchScan

2019-07-11 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-28213: - Assignee: Robert Joseph Evans > Remove duplication between columnar and

[jira] [Resolved] (SPARK-28213) Remove duplication between columnar and ColumnarBatchScan

2019-07-11 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-28213. --- Resolution: Fixed Fix Version/s: 3.0.0 > Remove duplication between columnar and

[jira] [Resolved] (SPARK-28337) spark jars do not contain commons-jxpath jar, cause ClassNotFound exception

2019-07-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28337. --- Resolution: Not A Problem > spark jars do not contain commons-jxpath jar, cause ClassNotFound

[jira] [Commented] (SPARK-24615) SPIP: Accelerator-aware task scheduling for Spark

2019-07-11 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882954#comment-16882954 ] Thomas Graves commented on SPARK-24615: --- Hey [~jomach], thanks for the offer, you can find SPIP

[jira] [Commented] (SPARK-28320) Spark job eventually fails after several "attempted to access non-existent accumulator" in DAGScheduler

2019-07-11 Thread Martin Studer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882939#comment-16882939 ] Martin Studer commented on SPARK-28320: --- At this point I don't have a self-contained reproducible

[jira] [Commented] (SPARK-28338) spark.read.format("csv") treat empty string as null if csv file don't have quotes in data

2019-07-11 Thread Jayadevan M (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882920#comment-16882920 ] Jayadevan M commented on SPARK-28338: - Hi [~maxgekk] Consider a specific example of SAP/ SQL server

[jira] [Commented] (SPARK-27609) from_json expects values of options dictionary to be

2019-07-11 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882885#comment-16882885 ] Maxim Gekk commented on SPARK-27609: [~zmjjmz] Please, let us know if you are working on this. If

[jira] [Commented] (SPARK-28338) spark.read.format("csv") treat empty string as null if csv file don't have quotes in data

2019-07-11 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882879#comment-16882879 ] Maxim Gekk commented on SPARK-28338: This is the expected behavior, actually. Missed column value or

[jira] [Assigned] (SPARK-28351) Support DELETE in DataSource V2

2019-07-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28351: Assignee: Apache Spark > Support DELETE in DataSource V2 >

[jira] [Updated] (SPARK-28303) Support DELETE/UPDATE/MERGE Operations in DataSource V2

2019-07-11 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin updated SPARK-28303: Description: Now many datasources (delta, jdbc, hive with transaction support, kudu, etc)

[jira] [Assigned] (SPARK-28351) Support DELETE in DataSource V2

2019-07-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28351: Assignee: (was: Apache Spark) > Support DELETE in DataSource V2 >

[jira] [Commented] (SPARK-28338) spark.read.format("csv") treat empty string as null if csv file don't have quotes in data

2019-07-11 Thread pavithra ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882872#comment-16882872 ] pavithra ramachandran commented on SPARK-28338: --- Could you given more information, as to

[jira] [Resolved] (SPARK-28350) Support DELETE in DataSource V2

2019-07-11 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin resolved SPARK-28350. - Resolution: Duplicate Resolve this, and create sub-task of

[jira] [Created] (SPARK-28351) Support DELETE in DataSource V2

2019-07-11 Thread Xianyin Xin (JIRA)
Xianyin Xin created SPARK-28351: --- Summary: Support DELETE in DataSource V2 Key: SPARK-28351 URL: https://issues.apache.org/jira/browse/SPARK-28351 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-28350) Support DELETE in DataSource V2

2019-07-11 Thread Xianyin Xin (JIRA)
Xianyin Xin created SPARK-28350: --- Summary: Support DELETE in DataSource V2 Key: SPARK-28350 URL: https://issues.apache.org/jira/browse/SPARK-28350 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-28269) ArrowStreamPandasSerializer get stack

2019-07-11 Thread Modi Tamam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882846#comment-16882846 ] Modi Tamam commented on SPARK-28269: [~hyukjin.kwon] Sorry, but it doesn't work on my machie, can

[jira] [Commented] (SPARK-28348) Avoid cast twice for decimal type

2019-07-11 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882800#comment-16882800 ] Yuming Wang commented on SPARK-28348: - But finally it is overflowed: {code:sql} spark-sql> select

[jira] [Updated] (SPARK-28279) Convert and port 'group-analytics.sql' into UDF test base

2019-07-11 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28279: - Summary: Convert and port 'group-analytics.sql' into UDF test base (was: Convert and port

[jira] [Commented] (SPARK-28279) Convert and port 'group-analysis.sql' into UDF test base

2019-07-11 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882788#comment-16882788 ] Hyukjin Kwon commented on SPARK-28279: -- oops, thanks for catching this. please go ahead! > Convert

[jira] [Comment Edited] (SPARK-28264) Revisiting Python / pandas UDF

2019-07-11 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882774#comment-16882774 ] Maciej Szymkiewicz edited comment on SPARK-28264 at 7/11/19 9:23 AM: -

[jira] [Comment Edited] (SPARK-28264) Revisiting Python / pandas UDF

2019-07-11 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882774#comment-16882774 ] Maciej Szymkiewicz edited comment on SPARK-28264 at 7/11/19 9:18 AM: -

[jira] [Comment Edited] (SPARK-28287) Convert and port 'udaf.sql' into UDF test base

2019-07-11 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882775#comment-16882775 ] Stavros Kontopoulos edited comment on SPARK-28287 at 7/11/19 9:18 AM:

[jira] [Commented] (SPARK-28279) Convert and port 'group-analysis.sql' into UDF test base

2019-07-11 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882780#comment-16882780 ] Stavros Kontopoulos commented on SPARK-28279: - [~hyukjin.kwon] I can do this one, the file

[jira] [Commented] (SPARK-28264) Revisiting Python / pandas UDF

2019-07-11 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882774#comment-16882774 ] Maciej Szymkiewicz commented on SPARK-28264: Personally I fail to see why some UDF types are

[jira] [Commented] (SPARK-28287) Convert and port 'udaf.sql' into UDF test base

2019-07-11 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882775#comment-16882775 ] Stavros Kontopoulos commented on SPARK-28287: - its ok itr trivial. > Convert and port

[jira] [Commented] (SPARK-28348) Avoid cast twice for decimal type

2019-07-11 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882773#comment-16882773 ] Marco Gaido commented on SPARK-28348: - No, I don't think that's a good idea. Setting the result type

[jira] [Assigned] (SPARK-28349) Add FALSE and SETMINUS to ansiNonReserved

2019-07-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28349: Assignee: (was: Apache Spark) > Add FALSE and SETMINUS to ansiNonReserved >

[jira] [Assigned] (SPARK-28349) Add FALSE and SETMINUS to ansiNonReserved

2019-07-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28349: Assignee: Apache Spark > Add FALSE and SETMINUS to ansiNonReserved >

[jira] [Created] (SPARK-28349) Add FALSE and SETMINUS to ansiNonReserved

2019-07-11 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-28349: --- Summary: Add FALSE and SETMINUS to ansiNonReserved Key: SPARK-28349 URL: https://issues.apache.org/jira/browse/SPARK-28349 Project: Spark Issue Type:

[jira] [Commented] (SPARK-28348) Avoid cast twice for decimal type

2019-07-11 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882758#comment-16882758 ] Yuming Wang commented on SPARK-28348: - Sorry. I mean could we avoid set scale number to 6 and then

[jira] [Comment Edited] (SPARK-28287) Convert and port 'udaf.sql' into UDF test base

2019-07-11 Thread Vinod KC (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882743#comment-16882743 ] Vinod KC edited comment on SPARK-28287 at 7/11/19 8:31 AM: --- [~skonto]I'm

  1   2   >