[jira] [Commented] (SPARK-24674) Spark on Kubernetes BLAS performance

2018-07-07 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535983#comment-16535983 ] Felix Cheung commented on SPARK-24674: -- kinda - there has been discussions on whether alpine is

[jira] [Commented] (SPARK-24756) Incorrect Statistics

2018-07-07 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535976#comment-16535976 ] Liang-Chi Hsieh commented on SPARK-24756: - Because seems not yet a suitable approach to estimate

[jira] [Comment Edited] (SPARK-24755) Executor loss can cause task to not be resubmitted

2018-07-07 Thread Hieu Tri Huynh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535956#comment-16535956 ] Hieu Tri Huynh edited comment on SPARK-24755 at 7/8/18 3:05 AM: Hi

[jira] [Commented] (SPARK-24755) Executor loss can cause task to not be resubmitted

2018-07-07 Thread Hieu Tri Huynh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535956#comment-16535956 ] Hieu Tri Huynh commented on SPARK-24755: Hi [~mridulm80], since fixing this might affect my

[jira] [Updated] (SPARK-24755) Executor loss can cause task to not be resubmitted

2018-07-07 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-24755: Description: As part of SPARK-22074, when an executor is lost, TSM.executorLost

[jira] [Resolved] (SPARK-23629) Building streaming-kafka-0-8-assembly or streaming-flume-assembly adds incompatible jline jar to assembly

2018-07-07 Thread Bruce Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins resolved SPARK-23629. --- Resolution: Cannot Reproduce > Building streaming-kafka-0-8-assembly or

[jira] [Commented] (SPARK-23629) Building streaming-kafka-0-8-assembly or streaming-flume-assembly adds incompatible jline jar to assembly

2018-07-07 Thread Bruce Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535944#comment-16535944 ] Bruce Robbins commented on SPARK-23629: --- Whatever was causing this, it is now gone away. Problem

[jira] [Created] (SPARK-24760) Pandas UDF does not handle NaN correctly

2018-07-07 Thread Mortada Mehyar (JIRA)
Mortada Mehyar created SPARK-24760: -- Summary: Pandas UDF does not handle NaN correctly Key: SPARK-24760 URL: https://issues.apache.org/jira/browse/SPARK-24760 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-24759) No reordering keys for broadcast hash join

2018-07-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535931#comment-16535931 ] Apache Spark commented on SPARK-24759: -- User 'gatorsmile' has created a pull request for this

[jira] [Assigned] (SPARK-24759) No reordering keys for broadcast hash join

2018-07-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24759: Assignee: Xiao Li (was: Apache Spark) > No reordering keys for broadcast hash join >

[jira] [Assigned] (SPARK-24759) No reordering keys for broadcast hash join

2018-07-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24759: Assignee: Apache Spark (was: Xiao Li) > No reordering keys for broadcast hash join >

[jira] [Updated] (SPARK-24759) No reordering keys for broadcast hash join

2018-07-07 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-24759: Issue Type: Improvement (was: New Feature) > No reordering keys for broadcast hash join >

[jira] [Created] (SPARK-24759) No reordering keys for broadcast hash join

2018-07-07 Thread Xiao Li (JIRA)
Xiao Li created SPARK-24759: --- Summary: No reordering keys for broadcast hash join Key: SPARK-24759 URL: https://issues.apache.org/jira/browse/SPARK-24759 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-24758) Create table wants to use /user/hive/warehouse in clean clone

2018-07-07 Thread Bruce Robbins (JIRA)
Bruce Robbins created SPARK-24758: - Summary: Create table wants to use /user/hive/warehouse in clean clone Key: SPARK-24758 URL: https://issues.apache.org/jira/browse/SPARK-24758 Project: Spark

[jira] [Resolved] (SPARK-24757) Improve error message for broadcast timeouts

2018-07-07 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-24757. --- Resolution: Fixed Assignee: Maxim Gekk Fix Version/s: 2.4.0 >

[jira] [Commented] (SPARK-24018) Spark-without-hadoop package fails to create or read parquet files with snappy compression

2018-07-07 Thread Jean-Francis Roy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535854#comment-16535854 ] Jean-Francis Roy commented on SPARK-24018: -- I don't think this is only related to the Spark

[jira] [Commented] (SPARK-24757) Improve error message for broadcast timeouts

2018-07-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535817#comment-16535817 ] Apache Spark commented on SPARK-24757: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24757) Improve error message for broadcast timeouts

2018-07-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24757: Assignee: (was: Apache Spark) > Improve error message for broadcast timeouts >

[jira] [Assigned] (SPARK-24757) Improve error message for broadcast timeouts

2018-07-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24757: Assignee: Apache Spark > Improve error message for broadcast timeouts >

[jira] [Created] (SPARK-24757) Improve error message for broadcast timeouts

2018-07-07 Thread Maxim Gekk (JIRA)
Maxim Gekk created SPARK-24757: -- Summary: Improve error message for broadcast timeouts Key: SPARK-24757 URL: https://issues.apache.org/jira/browse/SPARK-24757 Project: Spark Issue Type:

[jira] [Created] (SPARK-24756) Incorrect Statistics

2018-07-07 Thread Nick Jordan (JIRA)
Nick Jordan created SPARK-24756: --- Summary: Incorrect Statistics Key: SPARK-24756 URL: https://issues.apache.org/jira/browse/SPARK-24756 Project: Spark Issue Type: Bug Components: SQL

[jira] [Commented] (SPARK-24673) scala sql function from_utc_timestamp second argument could be Column instead of String

2018-07-07 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535681#comment-16535681 ] Takeshi Yamamuro commented on SPARK-24673: -- memo: not sure it is worth fixing though, other

[jira] [Commented] (SPARK-24752) date_format provides incorrect year after a timezone conversation changes the year on a timestamp

2018-07-07 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535671#comment-16535671 ] Takeshi Yamamuro commented on SPARK-24752: -- It seems the master has the same issue. Do you know

[jira] [Updated] (SPARK-24755) Executor loss can cause task to not be resubmitted

2018-07-07 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-24755: Summary: Executor loss can cause task to not be resubmitted (was: Executor loss

[jira] [Updated] (SPARK-24755) Executor loss can cause task to be not resubmitted

2018-07-07 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-24755: Description: As part of SPARK-22074, when an executor is lost, TSM.executorLost

[jira] [Created] (SPARK-24755) Executor loss can cause task to be not resubmitted

2018-07-07 Thread Mridul Muralidharan (JIRA)
Mridul Muralidharan created SPARK-24755: --- Summary: Executor loss can cause task to be not resubmitted Key: SPARK-24755 URL: https://issues.apache.org/jira/browse/SPARK-24755 Project: Spark

[jira] [Commented] (SPARK-24753) bad backslah parsing in SQL statements

2018-07-07 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535660#comment-16535660 ] Takeshi Yamamuro commented on SPARK-24753: -- you try

[jira] [Issue Comment Deleted] (SPARK-24753) bad backslah parsing in SQL statements

2018-07-07 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-24753: - Comment: was deleted (was: Your try `spark.sql.parser.quotedRegexColumnNames=true`?) >

[jira] [Commented] (SPARK-24753) bad backslah parsing in SQL statements

2018-07-07 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535659#comment-16535659 ] Takeshi Yamamuro commented on SPARK-24753: -- Your try

[jira] [Commented] (SPARK-24754) Minhash integer overflow

2018-07-07 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535657#comment-16535657 ] Kazuaki Ishizaki commented on SPARK-24754: -- In test cases, we would appreciate it if you will