[jira] [Commented] (SPARK-28289) Convert and port 'union.sql' into UDF test base

2019-07-09 Thread Yiheng Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881750#comment-16881750 ] Yiheng Wang commented on SPARK-28289: - Hi [~hyukjin.kwon], I'll be working on this. Thanks. >

[jira] [Commented] (SPARK-28324) The LOG function using 10 as the base, but Spark using E

2019-07-09 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881748#comment-16881748 ] Yuming Wang commented on SPARK-28324: - PostgreSQL, Vertica, Teradata using 10 as the base. DB2, SQL

[jira] [Assigned] (SPARK-28312) Add numeric.sql

2019-07-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28312: Assignee: Apache Spark > Add numeric.sql > --- > > Key:

[jira] [Assigned] (SPARK-28312) Add numeric.sql

2019-07-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28312: Assignee: (was: Apache Spark) > Add numeric.sql > --- > >

[jira] [Commented] (SPARK-28283) Convert and port 'intersect-all.sql' into UDF test base

2019-07-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881739#comment-16881739 ] Hyukjin Kwon commented on SPARK-28283: -- Thanks. [~imback82] > Convert and port 'intersect-all.sql'

[jira] [Commented] (SPARK-28284) Convert and port 'join-empty-relation.sql' into UDF test base

2019-07-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881738#comment-16881738 ] Hyukjin Kwon commented on SPARK-28284: -- Yea, or we can add some conditions on {{ON}} that returns

[jira] [Updated] (SPARK-27921) Convert applicable *.sql tests into UDF integrated test base

2019-07-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-27921: - Description: This JIRA targets to improve Python test coverage in particular about

[jira] [Commented] (SPARK-28283) Convert and port 'intersect-all.sql' into UDF test base

2019-07-09 Thread Terry Kim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881732#comment-16881732 ] Terry Kim commented on SPARK-28283: --- I will work on this. > Convert and port 'intersect-all.sql' into

[jira] [Updated] (SPARK-27921) Convert applicable *.sql tests into UDF integrated test base

2019-07-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-27921: - Description: This JIRA targets to improve Python test coverage in particular about

[jira] [Commented] (SPARK-28284) Convert and port 'join-empty-relation.sql' into UDF test base

2019-07-09 Thread Terry Kim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881731#comment-16881731 ] Terry Kim commented on SPARK-28284: --- join-empty-relation.sql has the following: {code:java} SELECT *

[jira] [Updated] (SPARK-27923) List all cases that PostgreSQL throws an exception but Spark SQL is NULL

2019-07-09 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-27923: Description: In this ticket, we plan to list all cases that PostgreSQL throws an exception but

[jira] [Created] (SPARK-28324) The LOG function using 10 as the base, but Spark using E

2019-07-09 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-28324: --- Summary: The LOG function using 10 as the base, but Spark using E Key: SPARK-28324 URL: https://issues.apache.org/jira/browse/SPARK-28324 Project: Spark Issue

[jira] [Updated] (SPARK-27923) List all cases that PostgreSQL throws an exception but Spark SQL is NULL

2019-07-09 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-27923: Description: In this ticket, we plan to list all cases that PostgreSQL throws an exception but

[jira] [Updated] (SPARK-27923) List all cases that PostgreSQL throws an exception but Spark SQL is NULL

2019-07-09 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-27923: Description: In this ticket, we plan to list all cases that PostgreSQL throws an exception but

[jira] [Updated] (SPARK-27923) List all cases that PostgreSQL throws an exception but Spark SQL is NULL

2019-07-09 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-27923: Description: In this ticket, we plan to list all cases that PostgreSQL throws an exception but

[jira] [Updated] (SPARK-27921) Convert applicable *.sql tests into UDF integrated test base

2019-07-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-27921: - Description: This JIRA targets to improve Python test coverage in particular about

[jira] [Commented] (SPARK-28323) PythonUDF should be able to use in join condition

2019-07-09 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881717#comment-16881717 ] Liang-Chi Hsieh commented on SPARK-28323: - I found this bug when doing SPARK-28276. > PythonUDF

[jira] [Assigned] (SPARK-28323) PythonUDF should be able to use in join condition

2019-07-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28323: Assignee: (was: Apache Spark) > PythonUDF should be able to use in join condition >

[jira] [Assigned] (SPARK-28323) PythonUDF should be able to use in join condition

2019-07-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28323: Assignee: Apache Spark > PythonUDF should be able to use in join condition >

[jira] [Created] (SPARK-28323) PythonUDF should be able to use in join condition

2019-07-09 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-28323: --- Summary: PythonUDF should be able to use in join condition Key: SPARK-28323 URL: https://issues.apache.org/jira/browse/SPARK-28323 Project: Spark

[jira] [Issue Comment Deleted] (SPARK-28073) ANSI SQL: Character literals

2019-07-09 Thread jiaan.geng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-28073: --- Comment: was deleted (was: I'm working on.) > ANSI SQL: Character literals >

[jira] [Assigned] (SPARK-28136) Add int8.sql

2019-07-09 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28136: - Assignee: Yuming Wang > Add int8.sql > > > Key:

[jira] [Updated] (SPARK-28136) Port int8.sql

2019-07-09 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28136: -- Summary: Port int8.sql (was: Add int8.sql) > Port int8.sql > - > >

[jira] [Resolved] (SPARK-28136) Add int8.sql

2019-07-09 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28136. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24933

[jira] [Assigned] (SPARK-28278) Convert and port 'except-all.sql' into UDF test base

2019-07-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28278: Assignee: Apache Spark > Convert and port 'except-all.sql' into UDF test base >

[jira] [Assigned] (SPARK-28278) Convert and port 'except-all.sql' into UDF test base

2019-07-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28278: Assignee: (was: Apache Spark) > Convert and port 'except-all.sql' into UDF test base

[jira] [Commented] (SPARK-28322) DIV support decimal type

2019-07-09 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881694#comment-16881694 ] Yuming Wang commented on SPARK-28322: - {{DIV}} and {{/}} are a little different: {code:sql} select

[jira] [Assigned] (SPARK-28275) Convert and port 'count.sql' into UDF test base

2019-07-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28275: Assignee: (was: Apache Spark) > Convert and port 'count.sql' into UDF test base >

[jira] [Assigned] (SPARK-28275) Convert and port 'count.sql' into UDF test base

2019-07-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28275: Assignee: Apache Spark > Convert and port 'count.sql' into UDF test base >

[jira] [Commented] (SPARK-28322) DIV support decimal type

2019-07-09 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881691#comment-16881691 ] Yuming Wang commented on SPARK-28322: - cc [~mgaido] > DIV support decimal type >

[jira] [Created] (SPARK-28322) DIV support decimal type

2019-07-09 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-28322: --- Summary: DIV support decimal type Key: SPARK-28322 URL: https://issues.apache.org/jira/browse/SPARK-28322 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-28288) Convert and port 'window.sql' into UDF test base

2019-07-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881689#comment-16881689 ] Hyukjin Kwon commented on SPARK-28288: -- Please go ahead. > Convert and port 'window.sql' into UDF

[jira] [Commented] (SPARK-28288) Convert and port 'window.sql' into UDF test base

2019-07-09 Thread YoungGyu Chun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881675#comment-16881675 ] YoungGyu Chun commented on SPARK-28288: --- Hello [~hyukjin.kwon], I'll be working on this. Thank

[jira] [Commented] (SPARK-28274) Convert and port 'pgSQL/window.sql' into UDF test base

2019-07-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881671#comment-16881671 ] Hyukjin Kwon commented on SPARK-28274: -- We should wait for SPARK-23160 > Convert and port

[jira] [Commented] (SPARK-28274) Convert and port 'pgSQL/window.sql' into UDF test base

2019-07-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881670#comment-16881670 ] Hyukjin Kwon commented on SPARK-28274: -- Oops, seems like it was my mistake. > Convert and port

[jira] [Commented] (SPARK-28274) Convert and port 'pgSQL/window.sql' into UDF test base

2019-07-09 Thread Terry Kim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881664#comment-16881664 ] Terry Kim commented on SPARK-28274: --- [~hyukjin.kwon] I don't see the window.sql file under

[jira] [Commented] (SPARK-27889) Make development scripts under dev/ support Python 3

2019-07-09 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881663#comment-16881663 ] Weichen Xu commented on SPARK-27889: Discussed with [~mengxr] offline. I will work on this. > Make

[jira] [Commented] (SPARK-25382) Remove ImageSchema.readImages in 3.0

2019-07-09 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881662#comment-16881662 ] Weichen Xu commented on SPARK-25382: I will work on this. Thank! > Remove ImageSchema.readImages in

[jira] [Commented] (SPARK-28316) Decimal precision issue

2019-07-09 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881648#comment-16881648 ] Yuming Wang commented on SPARK-28316: - cc [~joshrosen] [~cloud_fan] [~Gengliang.Wang] > Decimal

[jira] [Commented] (SPARK-28278) Convert and port 'except-all.sql' into UDF test base

2019-07-09 Thread Terry Kim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881645#comment-16881645 ] Terry Kim commented on SPARK-28278: --- I will work on this. > Convert and port 'except-all.sql' into

[jira] [Updated] (SPARK-27921) Convert applicable *.sql tests into UDF integrated test base

2019-07-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-27921: - Description: This JIRA targets to improve Python test coverage in particular about

[jira] [Updated] (SPARK-27921) Convert applicable *.sql tests into UDF integrated test base

2019-07-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-27921: - Description: This JIRA targets to improve Python test coverage in particular about

[jira] [Updated] (SPARK-28281) Convert and port 'having.sql' into UDF test base

2019-07-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28281: - Component/s: Tests PySpark > Convert and port 'having.sql' into UDF test base

[jira] [Updated] (SPARK-28286) Convert and port 'pivot.sql' into UDF test base

2019-07-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28286: - Component/s: Tests PySpark > Convert and port 'pivot.sql' into UDF test base >

[jira] [Updated] (SPARK-28280) Convert and port 'group-by.sql' into UDF test base

2019-07-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28280: - Component/s: Tests PySpark > Convert and port 'group-by.sql' into UDF test

[jira] [Updated] (SPARK-28278) Convert and port 'except-all.sql' into UDF test base

2019-07-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28278: - Component/s: Tests PySpark > Convert and port 'except-all.sql' into UDF test

[jira] [Updated] (SPARK-28287) Convert and port 'udaf.sql' into UDF test base

2019-07-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28287: - Component/s: Tests PySpark > Convert and port 'udaf.sql' into UDF test base >

[jira] [Updated] (SPARK-28275) Convert and port 'count.sql' into UDF test base

2019-07-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28275: - Component/s: Tests PySpark > Convert and port 'count.sql' into UDF test base >

[jira] [Updated] (SPARK-28282) Convert and port 'inline-table.sql' into UDF test base

2019-07-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28282: - Component/s: Tests PySpark > Convert and port 'inline-table.sql' into UDF test

[jira] [Updated] (SPARK-28279) Convert and port 'group-analysis.sql' into UDF test base

2019-07-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28279: - Component/s: Tests PySpark > Convert and port 'group-analysis.sql' into UDF

[jira] [Updated] (SPARK-28289) Convert and port 'union.sql' into UDF test base

2019-07-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28289: - Component/s: Tests PySpark > Convert and port 'union.sql' into UDF test base >

[jira] [Updated] (SPARK-28288) Convert and port 'window.sql' into UDF test base

2019-07-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28288: - Component/s: Tests PySpark > Convert and port 'window.sql' into UDF test base

[jira] [Updated] (SPARK-28277) Convert and port 'except.sql' into UDF test base

2019-07-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28277: - Component/s: Tests PySpark > Convert and port 'except.sql' into UDF test base

[jira] [Updated] (SPARK-28273) Convert and port 'pgSQL/case.sql' into UDF test base

2019-07-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28273: - Component/s: Tests PySpark > Convert and port 'pgSQL/case.sql' into UDF test

[jira] [Updated] (SPARK-28276) Convert and port 'cross-join.sql' into UDF test base

2019-07-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28276: - Component/s: Tests PySpark > Convert and port 'cross-join.sql' into UDF test

[jira] [Commented] (SPARK-28285) Convert and port 'outer-join.sql' into UDF test base

2019-07-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881630#comment-16881630 ] Hyukjin Kwon commented on SPARK-28285: -- Thanks. > Convert and port 'outer-join.sql' into UDF test

[jira] [Commented] (SPARK-28277) Convert and port 'except.sql' into UDF test base

2019-07-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881629#comment-16881629 ] Hyukjin Kwon commented on SPARK-28277: -- Please go ahead! > Convert and port 'except.sql' into UDF

[jira] [Updated] (SPARK-28283) Convert and port 'intersect-all.sql' into UDF test base

2019-07-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28283: - Component/s: Tests PySpark > Convert and port 'intersect-all.sql' into UDF

[jira] [Updated] (SPARK-28285) Convert and port 'outer-join.sql' into UDF test base

2019-07-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28285: - Component/s: Tests PySpark > Convert and port 'outer-join.sql' into UDF test

[jira] [Updated] (SPARK-27922) Convert and port 'natural-join.sql' into UDF test base

2019-07-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-27922: - Component/s: Tests > Convert and port 'natural-join.sql' into UDF test base >

[jira] [Updated] (SPARK-28272) Convert and port 'pgSQL/aggregates_part3.sql' into UDF test base

2019-07-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28272: - Component/s: Tests PySpark > Convert and port 'pgSQL/aggregates_part3.sql'

[jira] [Updated] (SPARK-28274) Convert and port 'pgSQL/window.sql' into UDF test base

2019-07-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28274: - Component/s: Tests PySpark > Convert and port 'pgSQL/window.sql' into UDF test

[jira] [Updated] (SPARK-28284) Convert and port 'join-empty-relation.sql' into UDF test base

2019-07-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28284: - Component/s: Tests PySpark > Convert and port 'join-empty-relation.sql' into

[jira] [Updated] (SPARK-28271) Convert and port 'pgSQL/aggregates_part2.sql' into UDF test base

2019-07-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28271: - Component/s: PySpark > Convert and port 'pgSQL/aggregates_part2.sql' into UDF test base >

[jira] [Updated] (SPARK-28270) Convert and port 'pgSQL/aggregates_part1.sql' into UDF test base

2019-07-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28270: - Component/s: Tests PySpark > Convert and port 'pgSQL/aggregates_part1.sql'

[jira] [Updated] (SPARK-27921) Convert applicable *.sql tests into UDF integrated test base

2019-07-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-27921: - Component/s: Tests > Convert applicable *.sql tests into UDF integrated test base >

[jira] [Updated] (SPARK-27921) Convert applicable *.sql tests into UDF integrated test base

2019-07-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-27921: - Description: This JIRA targets to improve Python test coverage in particular about

[jira] [Updated] (SPARK-27921) Convert applicable *.sql tests into UDF integrated test base

2019-07-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-27921: - Description: This JIRA targets to improve Python test coverage in particular about

[jira] [Comment Edited] (SPARK-27570) java.io.EOFException Reached the end of stream - Reading Parquet from Swift

2019-07-09 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881623#comment-16881623 ] Josh Rosen edited comment on SPARK-27570 at 7/10/19 12:22 AM: -- I ran into a

[jira] [Commented] (SPARK-28277) Convert and port 'except.sql' into UDF test base

2019-07-09 Thread Huaxin Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881624#comment-16881624 ] Huaxin Gao commented on SPARK-28277: I will work on this. Thanks.  > Convert and port 'except.sql'

[jira] [Commented] (SPARK-25966) "EOF Reached the end of stream with bytes left to read" while reading/writing to Parquets

2019-07-09 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881625#comment-16881625 ] Josh Rosen commented on SPARK-25966: Cross-post: there's discussion of a similar issue at

[jira] [Commented] (SPARK-28285) Convert and port 'outer-join.sql' into UDF test base

2019-07-09 Thread Huaxin Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881622#comment-16881622 ] Huaxin Gao commented on SPARK-28285: I will work on this. Thanks.  > Convert and port

[jira] [Commented] (SPARK-27570) java.io.EOFException Reached the end of stream - Reading Parquet from Swift

2019-07-09 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881623#comment-16881623 ] Josh Rosen commented on SPARK-27570: I ran into a very similar issue, except I was reading from S3

[jira] [Assigned] (SPARK-27922) Convert and port 'natural-join.sql' into UDF test base

2019-07-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27922: Assignee: Apache Spark > Convert and port 'natural-join.sql' into UDF test base >

[jira] [Assigned] (SPARK-27922) Convert and port 'natural-join.sql' into UDF test base

2019-07-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27922: Assignee: (was: Apache Spark) > Convert and port 'natural-join.sql' into UDF test

[jira] [Commented] (SPARK-22158) convertMetastore should not ignore storage properties

2019-07-09 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881602#comment-16881602 ] Ruslan Dautkhanov commented on SPARK-22158: --- [~dongjoon] I may have misreported it - sorry. 

[jira] [Commented] (SPARK-22158) convertMetastore should not ignore storage properties

2019-07-09 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881592#comment-16881592 ] Dongjoon Hyun commented on SPARK-22158: --- [~Tagar]. This is not related to that because that is

[jira] [Resolved] (SPARK-28140) Pyspark API to create spark.mllib RowMatrix from DataFrame

2019-07-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28140. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24953

[jira] [Updated] (SPARK-28140) Pyspark API to create spark.mllib RowMatrix from DataFrame

2019-07-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28140: -- Priority: Minor (was: Major) > Pyspark API to create spark.mllib RowMatrix from DataFrame >

[jira] [Assigned] (SPARK-28140) Pyspark API to create spark.mllib RowMatrix from DataFrame

2019-07-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28140: - Assignee: Henry Davidge > Pyspark API to create spark.mllib RowMatrix from DataFrame >

[jira] [Updated] (SPARK-28321) functions.udf(UDF0, DataType) produces unexpected results

2019-07-09 Thread Vladimir Matveev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vladimir Matveev updated SPARK-28321: - Description: It looks like that the `f.udf(UDF0, DataType)` variant of the UDF

[jira] [Created] (SPARK-28321) functions.udf(UDF0, DataType) produces unexpected results

2019-07-09 Thread Vladimir Matveev (JIRA)
Vladimir Matveev created SPARK-28321: Summary: functions.udf(UDF0, DataType) produces unexpected results Key: SPARK-28321 URL: https://issues.apache.org/jira/browse/SPARK-28321 Project: Spark

[jira] [Updated] (SPARK-28271) Convert and port 'pgSQL/aggregates_part2.sql' into UDF test base

2019-07-09 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28271: -- Component/s: Tests > Convert and port 'pgSQL/aggregates_part2.sql' into UDF test base >

[jira] [Comment Edited] (SPARK-22158) convertMetastore should not ignore storage properties

2019-07-09 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881437#comment-16881437 ] Ruslan Dautkhanov edited comment on SPARK-22158 at 7/9/19 6:57 PM: ---

[jira] [Commented] (SPARK-28310) ANSI SQL grammar support: first_value/last_value(expression, [RESPECT NULLS | IGNORE NULLS])

2019-07-09 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881462#comment-16881462 ] Dongjoon Hyun commented on SPARK-28310: --- I marked this to `Minor` because this is just a syntax

[jira] [Updated] (SPARK-28310) ANSI SQL grammar support: first_value/last_value(expression, [RESPECT NULLS | IGNORE NULLS])

2019-07-09 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28310: -- Priority: Minor (was: Major) > ANSI SQL grammar support: first_value/last_value(expression,

[jira] [Assigned] (SPARK-28234) Spark Resources - add python support to get resources

2019-07-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28234: Assignee: (was: Apache Spark) > Spark Resources - add python support to get

[jira] [Assigned] (SPARK-28234) Spark Resources - add python support to get resources

2019-07-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28234: Assignee: Apache Spark > Spark Resources - add python support to get resources >

[jira] [Assigned] (SPARK-28234) Spark Resources - add python support to get resources

2019-07-09 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-28234: - Assignee: Thomas Graves > Spark Resources - add python support to get resources >

[jira] [Assigned] (SPARK-28271) Convert and port 'pgSQL/aggregates_part2.sql' into UDF test base

2019-07-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28271: Assignee: Apache Spark > Convert and port 'pgSQL/aggregates_part2.sql' into UDF test

[jira] [Assigned] (SPARK-28271) Convert and port 'pgSQL/aggregates_part2.sql' into UDF test base

2019-07-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28271: Assignee: (was: Apache Spark) > Convert and port 'pgSQL/aggregates_part2.sql' into

[jira] [Created] (SPARK-28320) Spark job eventually fails after several "attempted to access non-existent accumulator" in DAGScheduler

2019-07-09 Thread Martin Studer (JIRA)
Martin Studer created SPARK-28320: - Summary: Spark job eventually fails after several "attempted to access non-existent accumulator" in DAGScheduler Key: SPARK-28320 URL:

[jira] [Commented] (SPARK-22158) convertMetastore should not ignore storage properties

2019-07-09 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881437#comment-16881437 ] Ruslan Dautkhanov commented on SPARK-22158: --- [~dongjoon] can you please check if this causes

[jira] [Created] (SPARK-28319) DataSourceV2: Support SHOW TABLES

2019-07-09 Thread Ryan Blue (JIRA)
Ryan Blue created SPARK-28319: - Summary: DataSourceV2: Support SHOW TABLES Key: SPARK-28319 URL: https://issues.apache.org/jira/browse/SPARK-28319 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-28157) Make SHS clear KVStore LogInfo for the blacklisted entries

2019-07-09 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881352#comment-16881352 ] Dongjoon Hyun commented on SPARK-28157: --- I raised it as a blocker because this causes a missing

[jira] [Updated] (SPARK-28157) Make SHS clear KVStore LogInfo for the blacklisted entries

2019-07-09 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28157: -- Priority: Blocker (was: Major) > Make SHS clear KVStore LogInfo for the blacklisted entries

[jira] [Updated] (SPARK-28312) Add numeric.sql

2019-07-09 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28312: -- Component/s: Tests > Add numeric.sql > --- > > Key: SPARK-28312 >

[jira] [Updated] (SPARK-28138) Add timestamp.sql

2019-07-09 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28138: -- Component/s: SQL > Add timestamp.sql > - > > Key: SPARK-28138

[jira] [Updated] (SPARK-28129) Add float8.sql

2019-07-09 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28129: -- Component/s: Tests > Add float8.sql > -- > > Key: SPARK-28129 >

[jira] [Updated] (SPARK-28059) Add int4.sql

2019-07-09 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28059: -- Component/s: SQL > Add int4.sql > > > Key: SPARK-28059 >

  1   2   >