[jira] [Commented] (SPARK-19317) UnsupportedOperationException: empty.reduceLeft in LinearSeqOptimized

2017-01-23 Thread Barry Becker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15834790#comment-15834790 ] Barry Becker commented on SPARK-19317: -- I figured out a workaround for this problem.

[jira] [Updated] (SPARK-19317) UnsupportedOperationException: empty.reduceLeft in LinearSeqOptimized

2017-01-23 Thread Barry Becker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Barry Becker updated SPARK-19317: - Priority: Minor (was: Major) > UnsupportedOperationException: empty.reduceLeft in LinearSeqOptim

[jira] [Updated] (SPARK-19297) Add ability for --packages tag to pull latest version

2017-01-23 Thread Steven Landes (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Landes updated SPARK-19297: -- Affects Version/s: 2.1.0 Labels: features newbie (was: ) Description:

[jira] [Updated] (SPARK-19317) UnsupportedOperationException: empty.reduceLeft in LinearSeqOptimized

2017-01-23 Thread Barry Becker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Barry Becker updated SPARK-19317: - Description: I wish I had more of a simple reproducible case to give, but I got the below except

[jira] [Commented] (SPARK-19317) UnsupportedOperationException: empty.reduceLeft in LinearSeqOptimized

2017-01-23 Thread Barry Becker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15834700#comment-15834700 ] Barry Becker commented on SPARK-19317: -- As far as I can tell, this only occurs when

[jira] [Updated] (SPARK-19317) UnsupportedOperationException: empty.reduceLeft in LinearSeqOptimized

2017-01-23 Thread Barry Becker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Barry Becker updated SPARK-19317: - Description: I wish I had more of a simple reproducible case to give, but I got the below except

[jira] [Commented] (SPARK-16101) Refactoring CSV data source to be consistent with JSON data source

2017-01-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15834522#comment-15834522 ] Apache Spark commented on SPARK-16101: -- User 'HyukjinKwon' has created a pull reques

[jira] [Commented] (SPARK-18392) LSH API, algorithm, and documentation follow-ups

2017-01-23 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15834336#comment-15834336 ] Nick Pentreath commented on SPARK-18392: [~yunn] I was wondering if you will be w

[jira] [Resolved] (SPARK-19312) Spark gives wrong error message when failes to create file due to hdfs quota limit.

2017-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19312. --- Resolution: Not A Problem > Spark gives wrong error message when failes to create file due to hdfs qu

[jira] [Resolved] (SPARK-19255) SQL Listener is causing out of memory, in case of data size is in petabytes.

2017-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19255. --- Resolution: Not A Problem I think the resolution is, if you have incredibly large numbers of partitio

[jira] [Updated] (SPARK-19214) Inconsistencies between DataFrame and Dataset APIs

2017-01-23 Thread Alexander Alexandrov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Alexandrov updated SPARK-19214: - Description: I am not sure whether this has been reported already, but there are

[jira] [Commented] (SPARK-19214) Inconsistencies between DataFrame and Dataset APIs

2017-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15834283#comment-15834283 ] Sean Owen commented on SPARK-19214: --- Yes, that one I'm less sure about. I don't immedia

[jira] [Commented] (SPARK-19214) Inconsistencies between DataFrame and Dataset APIs

2017-01-23 Thread Alexander Alexandrov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15834278#comment-15834278 ] Alexander Alexandrov commented on SPARK-19214: -- I just realized that the dis

[jira] [Resolved] (SPARK-19284) append to a existed partitioned datasource table should have no CustomPartitionLocations

2017-01-23 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-19284. - Resolution: Fixed Assignee: Song Jun Fix Version/s: 2.2.0 > append to a existed p

[jira] [Resolved] (SPARK-19146) Drop more elements when stageData.taskData.size > retainedTasks to reduce the number of times on call drop

2017-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19146. --- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16527 [https://github.co

[jira] [Updated] (SPARK-19146) Drop more elements when stageData.taskData.size > retainedTasks to reduce the number of times on call drop

2017-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-19146: -- Assignee: Yuming Wang Priority: Minor (was: Major) > Drop more elements when stageData.taskData.si

[jira] [Commented] (SPARK-19214) Inconsistencies between DataFrame and Dataset APIs

2017-01-23 Thread Alexander Alexandrov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15834263#comment-15834263 ] Alexander Alexandrov commented on SPARK-19214: -- [~sowen] I understand that a

[jira] [Resolved] (SPARK-19076) Upgrade Hive dependence to Hive 2.x

2017-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19076. --- Resolution: Duplicate > Upgrade Hive dependence to Hive 2.x > --- > >

[jira] [Resolved] (SPARK-19289) UnCache Dataset using Name

2017-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19289. --- Resolution: Not A Problem In that situation, you already have actual references to all of these objec

[jira] [Updated] (SPARK-19333) Files out of compliance with ASF policy

2017-01-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-19333: -- Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) Yes, we use RAT to check most o

[jira] [Updated] (SPARK-18704) CrossValidator should preserve more tuning statistics

2017-01-23 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath updated SPARK-18704: --- Shepherd: Nick Pentreath > CrossValidator should preserve more tuning statistics > --

[jira] [Commented] (SPARK-19071) Optimizations for ML Pipeline Tuning

2017-01-23 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15834232#comment-15834232 ] Nick Pentreath commented on SPARK-19071: Thanks [~bryanc] for the design and work

[jira] [Updated] (SPARK-19218) Fix SET command to show a result correctly and in a sorted order

2017-01-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-19218: Assignee: Dongjoon Hyun > Fix SET command to show a result correctly and in a sorted order > --

[jira] [Resolved] (SPARK-19218) Fix SET command to show a result correctly and in a sorted order

2017-01-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-19218. - Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16579 [https://github.com/ap

[jira] [Commented] (SPARK-19272) Remove the param `viewOriginalText` from `CatalogTable`

2017-01-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15834106#comment-15834106 ] Apache Spark commented on SPARK-19272: -- User 'jiangxb1987' has created a pull reques

[jira] [Assigned] (SPARK-19272) Remove the param `viewOriginalText` from `CatalogTable`

2017-01-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19272: Assignee: (was: Apache Spark) > Remove the param `viewOriginalText` from `CatalogTable

[jira] [Assigned] (SPARK-19272) Remove the param `viewOriginalText` from `CatalogTable`

2017-01-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19272: Assignee: Apache Spark > Remove the param `viewOriginalText` from `CatalogTable` > ---

[jira] [Commented] (SPARK-19209) "No suitable driver" on first try

2017-01-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15834103#comment-15834103 ] Xiao Li commented on SPARK-19209: - Based on my understanding, the problem is java.sql.Dri

[jira] [Commented] (SPARK-19209) "No suitable driver" on first try

2017-01-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15834100#comment-15834100 ] Apache Spark commented on SPARK-19209: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-19209) "No suitable driver" on first try

2017-01-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19209: Assignee: (was: Apache Spark) > "No suitable driver" on first try > --

[jira] [Assigned] (SPARK-19209) "No suitable driver" on first try

2017-01-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19209: Assignee: Apache Spark > "No suitable driver" on first try > -

[jira] [Updated] (SPARK-19155) MLlib GeneralizedLinearRegression family and link should case insensitive

2017-01-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-19155: Fix Version/s: (was: 2.0.3) > MLlib GeneralizedLinearRegression family and link should case ins