[jira] [Commented] (SPARK-28363) Enable run test with clover

2019-07-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884860#comment-16884860 ] Hyukjin Kwon commented on SPARK-28363: -- Can you clarify 1. What Clover does. 2. What we get from

[jira] [Commented] (SPARK-28364) Unable to read complete data from an external hive table stored as ORC that points to a managed table's data files which is getting stored in sub-directories.

2019-07-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884859#comment-16884859 ] Hyukjin Kwon commented on SPARK-28364: -- Will you be able to make a simple reproducer so that people

[jira] [Updated] (SPARK-28364) Unable to read complete data from an external hive table stored as ORC that points to a managed table's data files which is getting stored in sub-directories.

2019-07-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28364: - Description: Unable to read complete data from an external hive table stored as ORC that

[jira] [Commented] (SPARK-28376) Support to write sorted parquet files in each row group

2019-07-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884858#comment-16884858 ] Hyukjin Kwon commented on SPARK-28376: -- Is it a regression? the slides say Spark supports. Please

[jira] [Resolved] (SPARK-28376) Support to write sorted parquet files in each row group

2019-07-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28376. -- Resolution: Incomplete > Support to write sorted parquet files in each row group >

[jira] [Commented] (SPARK-28376) Write sorted parquet files

2019-07-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884857#comment-16884857 ] Hyukjin Kwon commented on SPARK-28376: -- Which parquet version does it support? > Write sorted

[jira] [Updated] (SPARK-28376) Support to write sorted parquet files in each row group

2019-07-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28376: - Summary: Support to write sorted parquet files in each row group (was: Write sorted parquet

[jira] [Commented] (SPARK-28380) DataSourceV2 API based JDBC connector

2019-07-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884856#comment-16884856 ] Hyukjin Kwon commented on SPARK-28380: -- Does this target to implement JDBC datasource by Datasource

[jira] [Updated] (SPARK-28316) Decimal precision issue

2019-07-14 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28316: Description: Multiply check: {code:sql} -- Spark SQL spark-sql> select cast(-34338492.215397047

[jira] [Commented] (SPARK-28391) Convert and port 'pgSQL/select_implicit.sql' into UDF test base

2019-07-14 Thread Udbhav Agrawal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884853#comment-16884853 ] Udbhav Agrawal commented on SPARK-28391: I will work on this > Convert and port

[jira] [Commented] (SPARK-28316) Decimal precision issue

2019-07-14 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884852#comment-16884852 ] Yuming Wang commented on SPARK-28316: - Yes. another case is some function's output is double type.

[jira] [Updated] (SPARK-28316) Decimal precision issue

2019-07-14 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28316: Description: Multiply check: {code:sql} -- Spark SQL spark-sql> select cast(-34338492.215397047

[jira] [Assigned] (SPARK-28384) Port select_distinct.sql

2019-07-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28384: - Assignee: Yuming Wang > Port select_distinct.sql > > >

[jira] [Resolved] (SPARK-28384) Port select_distinct.sql

2019-07-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28384. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25150

[jira] [Commented] (SPARK-28394) Performance Metrics for Driver

2019-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884849#comment-16884849 ] Apache Spark commented on SPARK-28394: -- User 'hthuynh2' has created a pull request for this issue:

[jira] [Assigned] (SPARK-28394) Performance Metrics for Driver

2019-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28394: Assignee: Apache Spark > Performance Metrics for Driver > --

[jira] [Assigned] (SPARK-28394) Performance Metrics for Driver

2019-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28394: Assignee: (was: Apache Spark) > Performance Metrics for Driver >

[jira] [Resolved] (SPARK-28387) Port select_having.sql

2019-07-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28387. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25151

[jira] [Assigned] (SPARK-28387) Port select_having.sql

2019-07-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28387: - Assignee: Yuming Wang > Port select_having.sql > -- > >

[jira] [Created] (SPARK-28394) Performance Metrics for Driver

2019-07-14 Thread Hieu Tri Huynh (JIRA)
Hieu Tri Huynh created SPARK-28394: -- Summary: Performance Metrics for Driver Key: SPARK-28394 URL: https://issues.apache.org/jira/browse/SPARK-28394 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-28390) Convert and port 'pgSQL/select_having.sql' into UDF test base

2019-07-14 Thread Shivu Sondur (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884839#comment-16884839 ] Shivu Sondur commented on SPARK-28390: -- i am working on this > Convert and port

[jira] [Commented] (SPARK-28358) Fix Flaky Tests - test_time_with_timezone (pyspark.sql.tests.test_serde.SerdeTests)

2019-07-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884835#comment-16884835 ] Dongjoon Hyun commented on SPARK-28358: --- Got it. I lower it to `Major`. > Fix Flaky Tests -

[jira] [Updated] (SPARK-28358) Fix Flaky Tests - test_time_with_timezone (pyspark.sql.tests.test_serde.SerdeTests)

2019-07-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28358: -- Priority: Major (was: Blocker) > Fix Flaky Tests - test_time_with_timezone >

[jira] [Resolved] (SPARK-28133) Hyperbolic Functions

2019-07-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28133. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25041

[jira] [Assigned] (SPARK-28133) Hyperbolic Functions

2019-07-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28133: - Assignee: Tony Zhang > Hyperbolic Functions > > >

[jira] [Updated] (SPARK-28375) Enforce idempotence on the PullupCorrelatedPredicates optimizer rule

2019-07-14 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-28375: --- Labels: correctness (was: ) Adding the 'correctness' label so we remember to backport this fix to

[jira] [Resolved] (SPARK-28381) Upgraded version of Pyrolite to 4.30

2019-07-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28381. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25143

[jira] [Assigned] (SPARK-28381) Upgraded version of Pyrolite to 4.30

2019-07-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28381: Assignee: Liang-Chi Hsieh > Upgraded version of Pyrolite to 4.30 >

[jira] [Commented] (SPARK-28358) Fix Flaky Tests - test_time_with_timezone (pyspark.sql.tests.test_serde.SerdeTests)

2019-07-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884828#comment-16884828 ] Hyukjin Kwon commented on SPARK-28358: -- Is it a blocker BTW [~dongjoon]? > Fix Flaky Tests -

[jira] [Comment Edited] (SPARK-28358) Fix Flaky Tests - test_time_with_timezone (pyspark.sql.tests.test_serde.SerdeTests)

2019-07-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884827#comment-16884827 ] Hyukjin Kwon edited comment on SPARK-28358 at 7/15/19 3:23 AM: --- i think

[jira] [Commented] (SPARK-28358) Fix Flaky Tests - test_time_with_timezone (pyspark.sql.tests.test_serde.SerdeTests)

2019-07-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884827#comment-16884827 ] Hyukjin Kwon commented on SPARK-28358: -- i think this is a bug in py4j itself. I have seen this

[jira] [Created] (SPARK-28393) Convert and port 'pgSQL/join.sql' into UDF test base

2019-07-14 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-28393: Summary: Convert and port 'pgSQL/join.sql' into UDF test base Key: SPARK-28393 URL: https://issues.apache.org/jira/browse/SPARK-28393 Project: Spark Issue

[jira] [Commented] (SPARK-28288) Convert and port 'window.sql' into UDF test base

2019-07-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884818#comment-16884818 ] Hyukjin Kwon commented on SPARK-28288: -- I think that will be resolved after

[jira] [Assigned] (SPARK-28392) Converted PostgreSQL UDF test should change some default config

2019-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28392: Assignee: (was: Apache Spark) > Converted PostgreSQL UDF test should change some

[jira] [Assigned] (SPARK-28392) Converted PostgreSQL UDF test should change some default config

2019-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28392: Assignee: Apache Spark > Converted PostgreSQL UDF test should change some default config

[jira] [Commented] (SPARK-24079) Update the nullability of Join output based on inferred predicates

2019-07-14 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884815#comment-16884815 ] Josh Rosen commented on SPARK-24079: I'm marking SPARK-27915 (a newer ticket filed by me) as a

[jira] [Updated] (SPARK-28391) Convert and port 'pgSQL/select_implicit.sql' into UDF test base

2019-07-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28391: - Component/s: Tests > Convert and port 'pgSQL/select_implicit.sql' into UDF test base >

[jira] [Created] (SPARK-28392) Converted PostgreSQL UDF test should change some default config

2019-07-14 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-28392: Summary: Converted PostgreSQL UDF test should change some default config Key: SPARK-28392 URL: https://issues.apache.org/jira/browse/SPARK-28392 Project: Spark

[jira] [Updated] (SPARK-28390) Convert and port 'pgSQL/select_having.sql' into UDF test base

2019-07-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28390: - Component/s: Tests > Convert and port 'pgSQL/select_having.sql' into UDF test base >

[jira] [Commented] (SPARK-28304) FileFormatWriter introduces an uncoditional sort, even when all attributes are constants

2019-07-14 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884801#comment-16884801 ] Josh Rosen commented on SPARK-28304: I'm linking SPARK-21317 as a related issue: that older ticket

[jira] [Created] (SPARK-28391) Convert and port 'pgSQL/select_implicit.sql' into UDF test base

2019-07-14 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-28391: Summary: Convert and port 'pgSQL/select_implicit.sql' into UDF test base Key: SPARK-28391 URL: https://issues.apache.org/jira/browse/SPARK-28391 Project: Spark

[jira] [Created] (SPARK-28390) Convert and port 'pgSQL/select_having.sql' into UDF test base

2019-07-14 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-28390: Summary: Convert and port 'pgSQL/select_having.sql' into UDF test base Key: SPARK-28390 URL: https://issues.apache.org/jira/browse/SPARK-28390 Project: Spark

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-14 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884791#comment-16884791 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/15/19 12:41 AM:

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-14 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884791#comment-16884791 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/15/19 12:38 AM:

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-14 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884791#comment-16884791 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/15/19 12:38 AM:

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-14 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884791#comment-16884791 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/15/19 12:37 AM:

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-14 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884791#comment-16884791 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/15/19 12:36 AM:

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-14 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884791#comment-16884791 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/15/19 12:35 AM:

[jira] [Commented] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-14 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884791#comment-16884791 ] Stavros Kontopoulos commented on SPARK-27927: - I was able to reproduce it reasily with

[jira] [Resolved] (SPARK-24786) Executors not being released after all cached data is unpersisted

2019-07-14 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-24786. Resolution: Duplicate I'm resolving this PR because it's marked as a duplicate of SPARK-20286,

[jira] [Resolved] (SPARK-23992) ShuffleDependency does not need to be deserialized every time

2019-07-14 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-23992. Resolution: Won't Fix Per my comment on GitHub at

[jira] [Resolved] (SPARK-28199) Move Trigger implementations to Triggers.scala and avoid exposing these to the end users

2019-07-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28199. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24996

[jira] [Assigned] (SPARK-28389) Use Java 8 API to add months to dates

2019-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28389: Assignee: (was: Apache Spark) > Use Java 8 API to add months to dates >

[jira] [Assigned] (SPARK-28389) Use Java 8 API to add months to dates

2019-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28389: Assignee: Apache Spark > Use Java 8 API to add months to dates >

[jira] [Created] (SPARK-28389) Use Java 8 API to add months to dates

2019-07-14 Thread Maxim Gekk (JIRA)
Maxim Gekk created SPARK-28389: -- Summary: Use Java 8 API to add months to dates Key: SPARK-28389 URL: https://issues.apache.org/jira/browse/SPARK-28389 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-28388) Port select_implicit.sql

2019-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28388: Assignee: (was: Apache Spark) > Port select_implicit.sql >

[jira] [Assigned] (SPARK-28388) Port select_implicit.sql

2019-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28388: Assignee: Apache Spark > Port select_implicit.sql > > >

[jira] [Created] (SPARK-28388) Port select_implicit.sql

2019-07-14 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-28388: --- Summary: Port select_implicit.sql Key: SPARK-28388 URL: https://issues.apache.org/jira/browse/SPARK-28388 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-28387) Port select_having.sql

2019-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28387: Assignee: Apache Spark > Port select_having.sql > -- > >

[jira] [Assigned] (SPARK-28387) Port select_having.sql

2019-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28387: Assignee: (was: Apache Spark) > Port select_having.sql > -- > >

[jira] [Created] (SPARK-28387) Port select_having.sql

2019-07-14 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-28387: --- Summary: Port select_having.sql Key: SPARK-28387 URL: https://issues.apache.org/jira/browse/SPARK-28387 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-28386) Cannot resolve ORDER BY columns with GROUP BY and HAVING

2019-07-14 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-28386: --- Summary: Cannot resolve ORDER BY columns with GROUP BY and HAVING Key: SPARK-28386 URL: https://issues.apache.org/jira/browse/SPARK-28386 Project: Spark Issue

[jira] [Created] (SPARK-28385) SELECT DISTINCT ON ( expression [, ...] ) syntax

2019-07-14 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-28385: --- Summary: SELECT DISTINCT ON ( expression [, ...] ) syntax Key: SPARK-28385 URL: https://issues.apache.org/jira/browse/SPARK-28385 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-28384) Port select_distinct.sql

2019-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28384: Assignee: (was: Apache Spark) > Port select_distinct.sql >

[jira] [Assigned] (SPARK-28384) Port select_distinct.sql

2019-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28384: Assignee: Apache Spark > Port select_distinct.sql > > >

[jira] [Created] (SPARK-28384) Port select_distinct.sql

2019-07-14 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-28384: --- Summary: Port select_distinct.sql Key: SPARK-28384 URL: https://issues.apache.org/jira/browse/SPARK-28384 Project: Spark Issue Type: Sub-task

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-14 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884675#comment-16884675 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/14/19 1:50 PM:

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-14 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884675#comment-16884675 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/14/19 1:23 PM:

[jira] [Commented] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-14 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884675#comment-16884675 ] Stavros Kontopoulos commented on SPARK-27927: - That call, among others, creates a

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-14 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884675#comment-16884675 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/14/19 1:21 PM:

[jira] [Updated] (SPARK-28138) Add timestamp.sql

2019-07-14 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28138: Description: In this ticket, we plan to add the regression test cases of 

[jira] [Updated] (SPARK-28365) Fallback locale to en_US in StopWordsRemover if system default locale isn't in available locales in JVM

2019-07-14 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-28365: Summary: Fallback locale to en_US in StopWordsRemover if system default locale isn't in

[jira] [Updated] (SPARK-28365) Set default locale param for StopWordsRemover to en_US if system default locale isn't in available locales in JVM

2019-07-14 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-28365: Summary: Set default locale param for StopWordsRemover to en_US if system default locale

[jira] [Updated] (SPARK-28365) Set default locale param for StopWordsRemover to en_US if system default locale isn't in available locales in JVM

2019-07-14 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-28365: Priority: Major (was: Minor) > Set default locale param for StopWordsRemover to en_US if

[jira] [Updated] (SPARK-28365) Set default locale param for StopWordsRemover to en_US if system default locale isn't in available locales in JVM

2019-07-14 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-28365: Component/s: (was: PySpark) > Set default locale param for StopWordsRemover to en_US

[jira] [Updated] (SPARK-28365) Set default locale param for StopWordsRemover to en_US if system default locale isn't in available locales in JVM

2019-07-14 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-28365: Issue Type: Bug (was: Test) > Set default locale param for StopWordsRemover to en_US if

[jira] [Updated] (SPARK-28365) Set default locale for StopWordsRemover tests to prevent invalid locale error during test

2019-07-14 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-28365: Component/s: (was: Tests) ML > Set default locale for

[jira] [Updated] (SPARK-28365) Set default locale for StopWordsRemover tests to prevent invalid locale error during test

2019-07-14 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-28365: Description: Because the local default locale isn't in available locales at {{Locale}},

[jira] [Commented] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-14 Thread Edwin Biemond (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884631#comment-16884631 ] Edwin Biemond commented on SPARK-27927: --- This is what I see now, driver starts up with an

[jira] [Assigned] (SPARK-28383) SHOW CREATE TABLE is not supported on a temporary view

2019-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28383: Assignee: (was: Apache Spark) > SHOW CREATE TABLE is not supported on a temporary

[jira] [Assigned] (SPARK-28383) SHOW CREATE TABLE is not supported on a temporary view

2019-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28383: Assignee: Apache Spark > SHOW CREATE TABLE is not supported on a temporary view >

[jira] [Created] (SPARK-28383) SHOW CREATE TABLE is not supported on a temporary view

2019-07-14 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-28383: --- Summary: SHOW CREATE TABLE is not supported on a temporary view Key: SPARK-28383 URL: https://issues.apache.org/jira/browse/SPARK-28383 Project: Spark Issue

[jira] [Assigned] (SPARK-28326) Add join.sql

2019-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28326: Assignee: Apache Spark > Add join.sql > > > Key:

[jira] [Assigned] (SPARK-28326) Add join.sql

2019-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28326: Assignee: (was: Apache Spark) > Add join.sql > > > Key:

[jira] [Resolved] (SPARK-28343) PostgreSQL test should change some default config

2019-07-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28343. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25109

[jira] [Assigned] (SPARK-28343) PostgreSQL test should change some default config

2019-07-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28343: - Assignee: Yuming Wang > PostgreSQL test should change some default config >

[jira] [Updated] (SPARK-28378) Remove usage of cgi.escape

2019-07-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28378: - Fix Version/s: 2.4.4 > Remove usage of cgi.escape > -- > >

[jira] [Assigned] (SPARK-28378) Remove usage of cgi.escape

2019-07-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28378: Assignee: Liang-Chi Hsieh > Remove usage of cgi.escape > -- > >

[jira] [Resolved] (SPARK-28378) Remove usage of cgi.escape

2019-07-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28378. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25142

[jira] [Created] (SPARK-28382) Array Functions: unnest

2019-07-14 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-28382: --- Summary: Array Functions: unnest Key: SPARK-28382 URL: https://issues.apache.org/jira/browse/SPARK-28382 Project: Spark Issue Type: Sub-task