[jira] [Updated] (SPARK-29361) Enable streaming source support on DSv1

2019-10-04 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-29361: - Component/s: (was: Spark Core) SQL > Enable streaming source support on

[jira] [Updated] (SPARK-29361) Enable DataFrame with streaming source support on DSv1

2019-10-04 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-29361: - Summary: Enable DataFrame with streaming source support on DSv1(was: Enable streaming

[jira] [Commented] (SPARK-29361) Enable streaming source support on DSv1

2019-10-04 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944987#comment-16944987 ] Jungtaek Lim commented on SPARK-29361: -- The plan for now is overloading below methods marked as

[jira] [Created] (SPARK-29361) Enable streaming source support on DSv1

2019-10-04 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-29361: Summary: Enable streaming source support on DSv1 Key: SPARK-29361 URL: https://issues.apache.org/jira/browse/SPARK-29361 Project: Spark Issue Type:

[jira] [Commented] (SPARK-29267) rdd.countApprox should stop when 'timeout'

2019-10-04 Thread Kangtian (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944984#comment-16944984 ] Kangtian commented on SPARK-29267: -- [~hyukjin.kwon] Just finish when timeout, we don't need final

[jira] [Updated] (SPARK-29267) rdd.countApprox should stop when 'timeout'

2019-10-04 Thread Kangtian (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kangtian updated SPARK-29267: - Attachment: image-2019-10-05-12-38-52-039.png > rdd.countApprox should stop when 'timeout' >

[jira] [Updated] (SPARK-29267) rdd.countApprox should stop when 'timeout'

2019-10-04 Thread Kangtian (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kangtian updated SPARK-29267: - Attachment: image-2019-10-05-12-37-22-927.png > rdd.countApprox should stop when 'timeout' >

[jira] [Updated] (SPARK-29267) rdd.countApprox should stop when 'timeout'

2019-10-04 Thread Kangtian (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kangtian updated SPARK-29267: - Attachment: image-2019-10-05-12-38-26-867.png > rdd.countApprox should stop when 'timeout' >

[jira] [Commented] (SPARK-29358) Make unionByName optionally fill missing columns with nulls

2019-10-04 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944927#comment-16944927 ] L. C. Hsieh commented on SPARK-29358: - And I also concern that it is more far away from SQL union.

[jira] [Commented] (SPARK-29358) Make unionByName optionally fill missing columns with nulls

2019-10-04 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944899#comment-16944899 ] L. C. Hsieh commented on SPARK-29358: - My concern is it breaks current behavior of unionByName. >

[jira] [Comment Edited] (SPARK-27681) Use scala.collection.Seq explicitly instead of scala.Seq alias

2019-10-04 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944879#comment-16944879 ] Sean R. Owen edited comment on SPARK-27681 at 10/4/19 10:33 PM: I looked

[jira] [Commented] (SPARK-27681) Use scala.collection.Seq explicitly instead of scala.Seq alias

2019-10-04 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944879#comment-16944879 ] Sean R. Owen commented on SPARK-27681: -- I looked at this one more time today after clearing out

[jira] [Resolved] (SPARK-28813) Document SHOW CREATE TABLE in SQL Reference.

2019-10-04 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-28813. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25885

[jira] [Updated] (SPARK-28813) Document SHOW CREATE TABLE in SQL Reference.

2019-10-04 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-28813: - Priority: Minor (was: Major) > Document SHOW CREATE TABLE in SQL Reference. >

[jira] [Assigned] (SPARK-28813) Document SHOW CREATE TABLE in SQL Reference.

2019-10-04 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-28813: Assignee: Huaxin Gao > Document SHOW CREATE TABLE in SQL Reference. >

[jira] [Updated] (SPARK-29108) Add window.sql - Part 2

2019-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29108: -- Fix Version/s: (was: 3.0.0) > Add window.sql - Part 2 > --- > >

[jira] [Updated] (SPARK-29109) Add window.sql - Part 3

2019-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29109: -- Fix Version/s: (was: 3.0.0) > Add window.sql - Part 3 > --- > >

[jira] [Updated] (SPARK-29110) Add window.sql - Part 4

2019-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29110: -- Fix Version/s: (was: 3.0.0) > Add window.sql - Part 4 > --- > >

[jira] [Updated] (SPARK-29107) Add window.sql - Part 1

2019-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29107: -- Fix Version/s: (was: 3.0.0) > Add window.sql - Part 1 > --- > >

[jira] [Updated] (SPARK-29323) Add tooltip for The Executors Tab's column names in the Spark history server Page

2019-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29323: -- Affects Version/s: (was: 2.4.4) 3.0.0 > Add tooltip for The

[jira] [Commented] (SPARK-29323) Add tooltip for The Executors Tab's column names in the Spark history server Page

2019-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944827#comment-16944827 ] Dongjoon Hyun commented on SPARK-29323: --- Hi, [~liucht-inspur]. Thank you for creating a JIRA, but

[jira] [Updated] (SPARK-29323) Add tooltip for The Executors Tab's column names in the Spark history server Page

2019-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29323: -- Fix Version/s: (was: 2.4.4) > Add tooltip for The Executors Tab's column names in the

[jira] [Commented] (SPARK-29225) Spark SQL 'DESC FORMATTED TABLE' show different format with hive

2019-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944826#comment-16944826 ] Dongjoon Hyun commented on SPARK-29225: --- Hi, [~angerszhuuu]. Please use `3.0.0` for the

[jira] [Updated] (SPARK-29225) Spark SQL 'DESC FORMATTED TABLE' show different format with hive

2019-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29225: -- Priority: Minor (was: Major) > Spark SQL 'DESC FORMATTED TABLE' show different format with

[jira] [Updated] (SPARK-29225) Spark SQL 'DESC FORMATTED TABLE' show different format with hive

2019-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29225: -- Affects Version/s: (was: 2.4.0) > Spark SQL 'DESC FORMATTED TABLE' show different format

[jira] [Commented] (SPARK-25440) Dump query execution info to a file

2019-10-04 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944822#comment-16944822 ] Maxim Gekk commented on SPARK-25440: [~shashidha...@gmail.com] Call

[jira] [Commented] (SPARK-29360) PySpark FPGrowthModel supports getter/setter

2019-10-04 Thread Huaxin Gao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944821#comment-16944821 ] Huaxin Gao commented on SPARK-29360: I will submit a PR soon. > PySpark FPGrowthModel supports

[jira] [Created] (SPARK-29360) PySpark FPGrowthModel supports getter/setter

2019-10-04 Thread Huaxin Gao (Jira)
Huaxin Gao created SPARK-29360: -- Summary: PySpark FPGrowthModel supports getter/setter Key: SPARK-29360 URL: https://issues.apache.org/jira/browse/SPARK-29360 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-25753) binaryFiles broken for small files

2019-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944817#comment-16944817 ] Dongjoon Hyun edited comment on SPARK-25753 at 10/4/19 8:51 PM: This is

[jira] [Updated] (SPARK-25753) binaryFiles broken for small files

2019-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25753: -- Fix Version/s: 2.4.5 > binaryFiles broken for small files >

[jira] [Commented] (SPARK-25753) binaryFiles broken for small files

2019-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944817#comment-16944817 ] Dongjoon Hyun commented on SPARK-25753: --- This is backported to branch-2.4 via

[jira] [Updated] (SPARK-25753) binaryFiles broken for small files

2019-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25753: -- Affects Version/s: 2.4.4 > binaryFiles broken for small files >

[jira] [Updated] (SPARK-24540) Support for multiple character delimiter in Spark CSV read

2019-10-04 Thread Jeff Evans (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Evans updated SPARK-24540: --- Summary: Support for multiple character delimiter in Spark CSV read (was: Support for multiple

[jira] [Commented] (SPARK-24540) Support for multiple delimiter in Spark CSV read

2019-10-04 Thread Jeff Evans (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944783#comment-16944783 ] Jeff Evans commented on SPARK-24540: I created a pull request to support this (which was linked

[jira] [Created] (SPARK-29359) Better exception handling in SQLQueryTestSuite and ThriftServerQueryTestSuite

2019-10-04 Thread Peter Toth (Jira)
Peter Toth created SPARK-29359: -- Summary: Better exception handling in SQLQueryTestSuite and ThriftServerQueryTestSuite Key: SPARK-29359 URL: https://issues.apache.org/jira/browse/SPARK-29359 Project:

[jira] [Resolved] (SPARK-29340) Spark Sql executions do not use thread local jobgroup

2019-10-04 Thread Navdeep Poonia (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navdeep Poonia resolved SPARK-29340. Resolution: Not A Problem Hi [~hyukjin.kwon] thanks for your response, you made me

[jira] [Updated] (SPARK-11150) Dynamic partition pruning

2019-10-04 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-11150: Labels: release-notes (was: ) > Dynamic partition pruning > - > >

[jira] [Updated] (SPARK-11150) Dynamic partition pruning

2019-10-04 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-11150: Description: Implements dynamic partition pruning by adding a dynamic-partition-pruning filter if there

[jira] [Updated] (SPARK-11150) Dynamic partition pruning

2019-10-04 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-11150: Description: Implements dynamic partition pruning by adding a dynamic-partition-pruning filter if there

[jira] [Updated] (SPARK-11150) Dynamic partition pruning

2019-10-04 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-11150: Attachment: image-2019-10-04-11-20-02-616.png > Dynamic partition pruning > - > >

[jira] [Updated] (SPARK-11150) Dynamic partition pruning

2019-10-04 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-11150: Description: Implements dynamic partition pruning by adding a dynamic-partition-pruning filter if there

[jira] [Updated] (SPARK-11150) Dynamic partition pruning

2019-10-04 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-11150: Description: Implements dynamic partition pruning by adding a dynamic-partition-pruning filter if there

[jira] [Commented] (SPARK-29337) How to Cache Table and Pin it in Memory and should not Spill to Disk on Thrift Server

2019-10-04 Thread Srini E (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944736#comment-16944736 ] Srini E commented on SPARK-29337: - Hi Wang, We don't have cache options while we are trying to cache a

[jira] [Created] (SPARK-29358) Make unionByName optionally fill missing columns with nulls

2019-10-04 Thread Mukul Murthy (Jira)
Mukul Murthy created SPARK-29358: Summary: Make unionByName optionally fill missing columns with nulls Key: SPARK-29358 URL: https://issues.apache.org/jira/browse/SPARK-29358 Project: Spark

[jira] [Updated] (SPARK-29357) Fix the flaky test in DataFrameSuite

2019-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29357: -- Priority: Minor (was: Major) > Fix the flaky test in DataFrameSuite >

[jira] [Updated] (SPARK-29357) Fix the flaky test in DataFrameSuite

2019-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29357: -- Issue Type: Bug (was: Improvement) > Fix the flaky test in DataFrameSuite >

[jira] [Resolved] (SPARK-29357) Fix the flaky test in DataFrameSuite

2019-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29357. --- Fix Version/s: 3.0.0 Assignee: Yuanjian Li Resolution: Fixed This is

[jira] [Updated] (SPARK-29286) UnicodeDecodeError raised when running python tests on arm instance

2019-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29286: -- Affects Version/s: 2.4.4 > UnicodeDecodeError raised when running python tests on arm

[jira] [Updated] (SPARK-29286) UnicodeDecodeError raised when running python tests on arm instance

2019-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29286: -- Fix Version/s: 2.4.5 > UnicodeDecodeError raised when running python tests on arm instance >

[jira] [Resolved] (SPARK-29286) UnicodeDecodeError raised when running python tests on arm instance

2019-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29286. --- Fix Version/s: 3.0.0 Assignee: Hyukjin Kwon Resolution: Fixed This is

[jira] [Resolved] (SPARK-29355) Support timestamps subtraction

2019-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29355. --- Fix Version/s: 3.0.0 Assignee: Maxim Gekk Resolution: Fixed This is

[jira] [Commented] (SPARK-13587) Support virtualenv in PySpark

2019-10-04 Thread Furcy Pin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-13587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944564#comment-16944564 ] Furcy Pin commented on SPARK-13587: --- Hello, I don't know where to ask this, but we have been using

[jira] [Commented] (SPARK-29276) Spark job fails because of timeout to Driver

2019-10-04 Thread Jochen Hebbrecht (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944526#comment-16944526 ] Jochen Hebbrecht commented on SPARK-29276: -- Thanks, I've just send out a mail on the mailing

[jira] [Commented] (SPARK-25440) Dump query execution info to a file

2019-10-04 Thread Shasidhar E S (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944434#comment-16944434 ] Shasidhar E S commented on SPARK-25440: --- [~maxgekk] How do we use this feature? Is there an

[jira] [Created] (SPARK-29357) Fix the flaky test in DataFrameSuite

2019-10-04 Thread Yuanjian Li (Jira)
Yuanjian Li created SPARK-29357: --- Summary: Fix the flaky test in DataFrameSuite Key: SPARK-29357 URL: https://issues.apache.org/jira/browse/SPARK-29357 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-29356) Stopping Spark doesn't shut down all network connections

2019-10-04 Thread Malthe Borch (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Malthe Borch updated SPARK-29356: - Description: The Spark session's gateway client still has an open network connection after a

[jira] [Created] (SPARK-29356) Stopping Spark doesn't shut down all network connections

2019-10-04 Thread Malthe Borch (Jira)
Malthe Borch created SPARK-29356: Summary: Stopping Spark doesn't shut down all network connections Key: SPARK-29356 URL: https://issues.apache.org/jira/browse/SPARK-29356 Project: Spark

[jira] [Updated] (SPARK-28425) Add more Date/Time Operators

2019-10-04 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-28425: --- Description: ||Operator||Example||Result|| |{{+}}|{{date '2001-09-28' + interval '1

[jira] [Updated] (SPARK-29355) Support timestamps subtraction

2019-10-04 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-29355: --- Description: ||Operator||Example||Result|| |{{-}}|{{timestamp '2001-09-29 03:00' - timestamp

[jira] [Created] (SPARK-29355) Support timestamps subtraction

2019-10-04 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29355: -- Summary: Support timestamps subtraction Key: SPARK-29355 URL: https://issues.apache.org/jira/browse/SPARK-29355 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-29276) Spark job fails because of timeout to Driver

2019-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29276. -- Resolution: Invalid Let's ask questions into mailing list or stackoverflow. You would be able

[jira] [Resolved] (SPARK-29302) dynamic partition overwrite with speculation enabled

2019-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29302. -- Resolution: Invalid > dynamic partition overwrite with speculation enabled >

[jira] [Updated] (SPARK-29304) Input Bytes Metric for Datasource v2 is absent

2019-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-29304: - Target Version/s: (was: 3.0.0) > Input Bytes Metric for Datasource v2 is absent >

[jira] [Commented] (SPARK-29309) StreamingContext.binaryRecordsStream() is useless

2019-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944318#comment-16944318 ] Hyukjin Kwon commented on SPARK-29309: -- So what do you propose? >

[jira] [Resolved] (SPARK-29316) CLONE - schemaInference option not to convert strings with leading zeros to int/long

2019-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29316. -- Resolution: Won't Fix > CLONE - schemaInference option not to convert strings with leading

[jira] [Resolved] (SPARK-29039) centralize the catalog and table lookup logic

2019-10-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29039. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25747

[jira] [Resolved] (SPARK-29337) How to Cache Table and Pin it in Memory and should not Spill to Disk on Thrift Server

2019-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29337. -- Resolution: Invalid Questions should go to stackoverflow or mailing list. > How to Cache

[jira] [Commented] (SPARK-29340) Spark Sql executions do not use thread local jobgroup

2019-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944314#comment-16944314 ] Hyukjin Kwon commented on SPARK-29340: -- [~navdeepniku], is it possible to show the full reproducer?

[jira] [Resolved] (SPARK-29344) Spark application hang

2019-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29344. -- Resolution: Cannot Reproduce I haven't seen such things. Please specify the steps to

[jira] [Assigned] (SPARK-29326) ANSI store assignment policy: throw exception on insertion failure

2019-10-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29326: --- Assignee: Gengliang Wang > ANSI store assignment policy: throw exception on insertion

[jira] [Resolved] (SPARK-29326) ANSI store assignment policy: throw exception on insertion failure

2019-10-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29326. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25997

[jira] [Created] (SPARK-29354) Spark has direct dependency on jline, but binaries for 'without hadoop' don't have a jline jar file.

2019-10-04 Thread Sungpeo Kook (Jira)
Sungpeo Kook created SPARK-29354: Summary: Spark has direct dependency on jline, but binaries for 'without hadoop' don't have a jline jar file. Key: SPARK-29354 URL: