[jira] [Assigned] (SPARK-28285) Convert and port 'outer-join.sql' into UDF test base

2019-07-18 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28285: Assignee: Huaxin Gao (was: Apache Spark) > Convert and port 'outer-join.sql' into UDF

[jira] [Resolved] (SPARK-28277) Convert and port 'except.sql' into UDF test base

2019-07-18 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28277. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25101

[jira] [Assigned] (SPARK-28277) Convert and port 'except.sql' into UDF test base

2019-07-18 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28277: Assignee: Huaxin Gao > Convert and port 'except.sql' into UDF test base >

[jira] [Commented] (SPARK-24632) Allow 3rd-party libraries to use pyspark.ml abstractions for Java wrappers for persistence

2019-07-18 Thread Mathew Wicks (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888495#comment-16888495 ] Mathew Wicks commented on SPARK-24632: -- I have an elegant solution for this: You can include a

[jira] [Updated] (SPARK-28436) Throw better exception when datasource's schema is not equal to user-specific shema

2019-07-18 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28436: - Summary: Throw better exception when datasource's schema is not equal to user-specific shema

[jira] [Resolved] (SPARK-28438) Ignore metadata's(comments) difference when comparing datasource's schema and user-specific schema

2019-07-18 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28438. -- Resolution: Duplicate > Ignore metadata's(comments) difference when comparing datasource's

[jira] [Updated] (SPARK-28438) Ignore metadata's(comments) difference when comparing datasource's schema and user-specific schema

2019-07-18 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28438: - Summary: Ignore metadata's(comments) difference when comparing datasource's schema and

[jira] [Commented] (SPARK-28442) Potentially persist data without leadership

2019-07-18 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888478#comment-16888478 ] Hyukjin Kwon commented on SPARK-28442: -- [~Tison], please provide reproducer and/or console print

[jira] [Resolved] (SPARK-28285) Convert and port 'outer-join.sql' into UDF test base

2019-07-18 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28285. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25103

[jira] [Updated] (SPARK-28443) Spark sql add exception when create field type NullType

2019-07-18 Thread ulysses you (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you updated SPARK-28443: Environment: (was:    ) > Spark sql add exception when create field type NullType >

[jira] [Updated] (SPARK-28443) Spark sql add exception when create field type NullType

2019-07-18 Thread ulysses you (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you updated SPARK-28443: Description: [28313|https://issues.apache.org/jira/browse/SPARK-28313] 28313 change a behavior

[jira] [Updated] (SPARK-28443) Spark sql add exception when create field type NullType

2019-07-18 Thread ulysses you (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you updated SPARK-28443: Environment: [28313|https://issues.apache.org/jira/browse/SPARK-28313] 28313 change a behavior

[jira] [Updated] (SPARK-28443) Spark sql add exception when create field type NullType

2019-07-18 Thread ulysses you (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you updated SPARK-28443: Description: 28313 28313 change a behavior that `Add rule to throw exception when

[jira] [Updated] (SPARK-28443) Spark sql add exception when create field type NullType

2019-07-18 Thread ulysses you (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you updated SPARK-28443: Environment:     was: [28313|https://issues.apache.org/jira/browse/SPARK-28313] 28313 change

[jira] [Created] (SPARK-28443) Spark sql add exception when create field type NullType

2019-07-18 Thread ulysses you (JIRA)
ulysses you created SPARK-28443: --- Summary: Spark sql add exception when create field type NullType Key: SPARK-28443 URL: https://issues.apache.org/jira/browse/SPARK-28443 Project: Spark Issue

[jira] [Updated] (SPARK-28443) Spark sql add exception when create field type NullType

2019-07-18 Thread ulysses you (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you updated SPARK-28443: Environment: 28313 28313 change a behavior that `Add rule to throw exception when

[jira] [Resolved] (SPARK-28287) Convert and port 'udaf.sql' into UDF test base

2019-07-18 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28287. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25194

[jira] [Assigned] (SPARK-28287) Convert and port 'udaf.sql' into UDF test base

2019-07-18 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28287: Assignee: Vinod KC > Convert and port 'udaf.sql' into UDF test base >

[jira] [Updated] (SPARK-28442) Potentially persist data without leadership

2019-07-18 Thread TisonKun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TisonKun updated SPARK-28442: - Description: Spark Master could potentially persist data via {{ZooKeeperPersistenceEngine}} even if it

[jira] [Updated] (SPARK-28442) Potentially persist data without leadership

2019-07-18 Thread TisonKun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TisonKun updated SPARK-28442: - Description: Spark Master could potentially persist data via {{ZooKeeperPersistenceEngine}} even if it

[jira] [Updated] (SPARK-28442) Potentially persist data without leadership

2019-07-18 Thread TisonKun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TisonKun updated SPARK-28442: - Component/s: (was: Documentation) Deploy > Potentially persist data without

[jira] [Created] (SPARK-28442) Potentially persist data without leadership

2019-07-18 Thread TisonKun (JIRA)
TisonKun created SPARK-28442: Summary: Potentially persist data without leadership Key: SPARK-28442 URL: https://issues.apache.org/jira/browse/SPARK-28442 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-28441) udf(max(udf(column))) throws java.lang.UnsupportedOperationException: Cannot evaluate expression: udf(null)

2019-07-18 Thread Huaxin Gao (JIRA)
Huaxin Gao created SPARK-28441: -- Summary: udf(max(udf(column))) throws java.lang.UnsupportedOperationException: Cannot evaluate expression: udf(null) Key: SPARK-28441 URL:

[jira] [Resolved] (SPARK-28416) Use java.time API in timestampAddInterval

2019-07-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28416. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25173

[jira] [Assigned] (SPARK-28416) Use java.time API in timestampAddInterval

2019-07-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28416: - Assignee: Maxim Gekk > Use java.time API in timestampAddInterval >

[jira] [Assigned] (SPARK-28312) Add numeric.sql

2019-07-18 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28312: - Assignee: Yuming Wang > Add numeric.sql > --- > > Key:

[jira] [Resolved] (SPARK-28312) Add numeric.sql

2019-07-18 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28312. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25092

[jira] [Commented] (SPARK-28432) Date/Time Functions: make_date/make_timestamp

2019-07-18 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888324#comment-16888324 ] Maxim Gekk commented on SPARK-28432: I am working on this > Date/Time Functions:

[jira] [Resolved] (SPARK-28430) Some stage table rows render wrong number of columns if tasks are missing metrics

2019-07-18 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28430. --- Resolution: Fixed Fix Version/s: 2.4.4 2.3.4

[jira] [Assigned] (SPARK-28439) pyspark.sql.functions.array_repeat should support Column as count argument

2019-07-18 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28439: - Assignee: Maciej Szymkiewicz > pyspark.sql.functions.array_repeat should support

[jira] [Resolved] (SPARK-28439) pyspark.sql.functions.array_repeat should support Column as count argument

2019-07-18 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28439. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25193

[jira] [Commented] (SPARK-28427) Support more Postgres JSON functions

2019-07-18 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888258#comment-16888258 ] Maxim Gekk commented on SPARK-28427: Probably, we can switch the flag spark.sql.legacy.sizeOfNull,

[jira] [Commented] (SPARK-28382) Array Functions: unnest

2019-07-18 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888248#comment-16888248 ] Maxim Gekk commented on SPARK-28382: Is it just explode()? > Array Functions: unnest >

[jira] [Commented] (SPARK-14543) SQL/Hive insertInto has unexpected results

2019-07-18 Thread Alexander Tronchin-James (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888246#comment-16888246 ] Alexander Tronchin-James commented on SPARK-14543: -- OK, thanks! > SQL/Hive insertInto

[jira] [Updated] (SPARK-28440) Use TestingUtils to compare floating point values

2019-07-18 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28440: -- Component/s: (was: ML) MLlib > Use TestingUtils to compare floating

[jira] [Created] (SPARK-28440) Use TestingUtils to compare floating point values

2019-07-18 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-28440: - Summary: Use TestingUtils to compare floating point values Key: SPARK-28440 URL: https://issues.apache.org/jira/browse/SPARK-28440 Project: Spark Issue

[jira] [Commented] (SPARK-14543) SQL/Hive insertInto has unexpected results

2019-07-18 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888222#comment-16888222 ] Ryan Blue commented on SPARK-14543: --- {{byName}} was never added to Apache Spark. The change was

[jira] [Commented] (SPARK-14948) Exception when joining DataFrames derived form the same DataFrame

2019-07-18 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888146#comment-16888146 ] Wenchen Fan commented on SPARK-14948: - There is an ongoing effort to detect this case and fail

[jira] [Commented] (SPARK-27416) UnsafeMapData & UnsafeArrayData Kryo serialization breaks when two machines have different Oops size

2019-07-18 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888130#comment-16888130 ] Wenchen Fan commented on SPARK-27416: - yea let's backport it! > UnsafeMapData & UnsafeArrayData

[jira] [Resolved] (SPARK-28388) Port select_implicit.sql

2019-07-18 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28388. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25152

[jira] [Assigned] (SPARK-28388) Port select_implicit.sql

2019-07-18 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28388: - Assignee: Yuming Wang > Port select_implicit.sql > > >

[jira] [Assigned] (SPARK-28138) Add timestamp.sql

2019-07-18 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28138: - Assignee: Yuming Wang > Add timestamp.sql > - > > Key:

[jira] [Resolved] (SPARK-28138) Add timestamp.sql

2019-07-18 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28138. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25181

[jira] [Resolved] (SPARK-28286) Convert and port 'pivot.sql' into UDF test base

2019-07-18 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28286. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25122

[jira] [Assigned] (SPARK-28286) Convert and port 'pivot.sql' into UDF test base

2019-07-18 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28286: Assignee: Chitral Verma > Convert and port 'pivot.sql' into UDF test base >

[jira] [Updated] (SPARK-28438) [SQL] Ignore metadata's(comments) difference when comparing datasource's schema and user-specific schema

2019-07-18 Thread ShuMing Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShuMing Li updated SPARK-28438: --- Description: When users register a datasource table to Spark,  Spark only support complete schema

[jira] [Updated] (SPARK-28438) [SQL] Ignore metadata's(comments) difference when comparing datasource's schema and user-specific schema

2019-07-18 Thread ShuMing Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShuMing Li updated SPARK-28438: --- Description: When users register a datasource table to Spark,  Spark only support complete schema

[jira] [Updated] (SPARK-28439) pyspark.sql.functions.array_repeat should support Column as count argument

2019-07-18 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-28439: --- Description: In Scala, Spark supports

[jira] [Updated] (SPARK-28439) pyspark.sql.functions.array_repeat should support Column as count argument

2019-07-18 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-28439: --- Description: In Scala Spark supports   {code:java} (Column, Column) => Column

[jira] [Updated] (SPARK-28439) pyspark.sql.functions.array_repeat should support Column as count argument

2019-07-18 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-28439: --- Description: In Scala Spark supports   {code:java} (Column, Column) => Column

[jira] [Updated] (SPARK-28439) pyspark.sql.functions.array_repeat should support Column as count argument

2019-07-18 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-28439: --- Description: In Scala Spark supports   {code:java} (Column, Column) => Column

[jira] [Created] (SPARK-28439) pyspark.sql.functions.array_repeat should support Column as count argument

2019-07-18 Thread Maciej Szymkiewicz (JIRA)
Maciej Szymkiewicz created SPARK-28439: -- Summary: pyspark.sql.functions.array_repeat should support Column as count argument Key: SPARK-28439 URL: https://issues.apache.org/jira/browse/SPARK-28439

[jira] [Created] (SPARK-28438) [SQL] Ignore metadata's(comments) difference when comparing datasource's schema and user-specific schema

2019-07-18 Thread ShuMing Li (JIRA)
ShuMing Li created SPARK-28438: -- Summary: [SQL] Ignore metadata's(comments) difference when comparing datasource's schema and user-specific schema Key: SPARK-28438 URL:

[jira] [Commented] (SPARK-25788) Elastic net penalties for GLMs

2019-07-18 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887874#comment-16887874 ] shahid commented on SPARK-25788: [~pralabhkumar] yeah. Please go ahead. I think I don't have enough time

[jira] [Assigned] (SPARK-28278) Convert and port 'except-all.sql' into UDF test base

2019-07-18 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28278: Assignee: Terry Kim > Convert and port 'except-all.sql' into UDF test base >

[jira] [Resolved] (SPARK-28278) Convert and port 'except-all.sql' into UDF test base

2019-07-18 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28278. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25090

[jira] [Assigned] (SPARK-28283) Convert and port 'intersect-all.sql' into UDF test base

2019-07-18 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28283: Assignee: Terry Kim > Convert and port 'intersect-all.sql' into UDF test base >

[jira] [Resolved] (SPARK-28283) Convert and port 'intersect-all.sql' into UDF test base

2019-07-18 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28283. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25119

[jira] [Assigned] (SPARK-28276) Convert and port 'cross-join.sql' into UDF test base

2019-07-18 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28276: Assignee: Liang-Chi Hsieh (was: Hyukjin Kwon) > Convert and port 'cross-join.sql' into

[jira] [Resolved] (SPARK-28276) Convert and port 'cross-join.sql' into UDF test base

2019-07-18 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28276. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25168

[jira] [Assigned] (SPARK-28276) Convert and port 'cross-join.sql' into UDF test base

2019-07-18 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28276: Assignee: Hyukjin Kwon > Convert and port 'cross-join.sql' into UDF test base >

[jira] [Commented] (SPARK-25788) Elastic net penalties for GLMs

2019-07-18 Thread pralabhkumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887858#comment-16887858 ] pralabhkumar commented on SPARK-25788: -- [~shahid] I can work on this . Please let me know if its ok 

[jira] [Created] (SPARK-28437) Different format when casting interval type to string type

2019-07-18 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-28437: --- Summary: Different format when casting interval type to string type Key: SPARK-28437 URL: https://issues.apache.org/jira/browse/SPARK-28437 Project: Spark

[jira] [Reopened] (SPARK-26796) Testcases failing with "org.apache.hadoop.fs.ChecksumException" error

2019-07-18 Thread Anuja Jakhade (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anuja Jakhade reopened SPARK-26796: --- > Testcases failing with "org.apache.hadoop.fs.ChecksumException" error >

[jira] [Updated] (SPARK-28436) [SQL] Throw better exception when datasource's schema is not equal to user-specific shema

2019-07-18 Thread ShuMing Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShuMing Li updated SPARK-28436: --- Affects Version/s: 2.3.0 > [SQL] Throw better exception when datasource's schema is not equal to >

[jira] [Created] (SPARK-28436) [SQL] Throw better exception when datasource's schema is not equal to user-specific shema

2019-07-18 Thread ShuMing Li (JIRA)
ShuMing Li created SPARK-28436: -- Summary: [SQL] Throw better exception when datasource's schema is not equal to user-specific shema Key: SPARK-28436 URL: https://issues.apache.org/jira/browse/SPARK-28436

[jira] [Updated] (SPARK-28436) [SQL] Throw better exception when datasource's schema is not equal to user-specific shema

2019-07-18 Thread ShuMing Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShuMing Li updated SPARK-28436: --- Description: When this exception is thrown, users cannot find what's the difference between

[jira] [Commented] (SPARK-28424) Improve interval input

2019-07-18 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887754#comment-16887754 ] Yuming Wang commented on SPARK-28424: - I'm working on. > Improve interval input >

[jira] [Commented] (SPARK-28411) insertInto with overwrite inconsistent behaviour Python/Scala

2019-07-18 Thread Maria Rebelka (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887725#comment-16887725 ] Maria Rebelka commented on SPARK-28411: --- Great, thank you! > insertInto with overwrite

[jira] [Issue Comment Deleted] (SPARK-28429) SQL Datetime util function being casted to double instead of timestamp

2019-07-18 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28429: Comment: was deleted (was: I'm working on.) > SQL Datetime util function being casted to double

[jira] [Commented] (SPARK-28288) Convert and port 'window.sql' into UDF test base

2019-07-18 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887707#comment-16887707 ] Liang-Chi Hsieh commented on SPARK-28288: - Those errors can be found in original window.sql.

[jira] [Resolved] (SPARK-28194) [SQL] A NoSuchElementException maybe thrown when EnsureRequirement

2019-07-18 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28194. -- Resolution: Cannot Reproduce So, this is likely a duplicate of another JIRA. Let's find the

[jira] [Commented] (SPARK-28429) SQL Datetime util function being casted to double instead of timestamp

2019-07-18 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887673#comment-16887673 ] Yuming Wang commented on SPARK-28429: - I'm working on. > SQL Datetime util function being casted to

[jira] [Updated] (SPARK-28435) Support cast StringType to IntervalType for SQL interface

2019-07-18 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28435: Summary: Support cast StringType to IntervalType for SQL interface (was: Support cast string to

[jira] [Created] (SPARK-28435) Support cast string to interval for SQL interface

2019-07-18 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-28435: --- Summary: Support cast string to interval for SQL interface Key: SPARK-28435 URL: https://issues.apache.org/jira/browse/SPARK-28435 Project: Spark Issue Type: