[jira] [Commented] (SPARK-9740) first/last aggregate NULL behavior

[ https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15116977#comment-15116977 ] Emlyn Corrin commented on SPARK-9740: - I've put together a minimal example to demonstrate the problem:

[jira] [Updated] (SPARK-12993) Remove usage of ADD_FILES in pyspark

[ https://issues.apache.org/jira/browse/SPARK-12993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-12993: --- Description: environment variable ADD_FILES is created for adding python files on spark context to

[jira] [Updated] (SPARK-12993) Remove usage of ADD_FILES in pyspark

[ https://issues.apache.org/jira/browse/SPARK-12993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-12993: --- Description: environment variable ADD_FILES is created for adding python files to spark context

[jira] [Resolved] (SPARK-5623) Replace an obsolete mapReduceTriplets with a new aggregateMessages in GraphSuite

[ https://issues.apache.org/jira/browse/SPARK-5623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5623. -- Resolution: Duplicate Let's call this a subset of removing the deprecated API. > Replace an obsolete

[jira] [Resolved] (SPARK-3369) Java mapPartitions Iterator->Iterable is inconsistent with Scala's Iterator->Iterator

[ https://issues.apache.org/jira/browse/SPARK-3369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3369. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10413

[jira] [Commented] (SPARK-12265) Spark calls System.exit inside driver instead of throwing exception

[ https://issues.apache.org/jira/browse/SPARK-12265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117026#comment-15117026 ] Apache Spark commented on SPARK-12265: -- User 'dragos' has created a pull request for this issue:

[jira] [Resolved] (SPARK-12961) Work around memory leak in Snappy library

[ https://issues.apache.org/jira/browse/SPARK-12961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12961. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved by pull

[jira] [Updated] (SPARK-12961) Work around memory leak in Snappy library

[ https://issues.apache.org/jira/browse/SPARK-12961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12961: -- Assignee: Liang-Chi Hsieh > Work around memory leak in Snappy library >

[jira] [Comment Edited] (SPARK-9740) first/last aggregate NULL behavior

[ https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15116977#comment-15116977 ] Emlyn Corrin edited comment on SPARK-9740 at 1/26/16 9:32 AM: -- I've put

[jira] [Comment Edited] (SPARK-9740) first/last aggregate NULL behavior

[ https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15116977#comment-15116977 ] Emlyn Corrin edited comment on SPARK-9740 at 1/26/16 9:33 AM: -- I've put

[jira] [Created] (SPARK-12998) Enable OrcRelation when connecting via spark thrift server

Rajesh Balamohan created SPARK-12998: Summary: Enable OrcRelation when connecting via spark thrift server Key: SPARK-12998 URL: https://issues.apache.org/jira/browse/SPARK-12998 Project: Spark

[jira] [Updated] (SPARK-12998) Enable OrcRelation when connecting via spark thrift server

[ https://issues.apache.org/jira/browse/SPARK-12998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated SPARK-12998: - Description: When a user connects via spark-thrift server to execute SQL, it does not

[jira] [Updated] (SPARK-12998) Enable OrcRelation when connecting via spark thrift server

[ https://issues.apache.org/jira/browse/SPARK-12998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated SPARK-12998: - Description: When a user connects via spark-thrift server to execute SQL, it does not

[jira] [Commented] (SPARK-12637) Print stage info of finished stages properly

[ https://issues.apache.org/jira/browse/SPARK-12637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117101#comment-15117101 ] Apache Spark commented on SPARK-12637: -- User 'srowen' has created a pull request for this issue:

[jira] [Commented] (SPARK-12940) Partition field in Spark SQL WHERE clause causing Exception

[ https://issues.apache.org/jira/browse/SPARK-12940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118627#comment-15118627 ] Liang-Chi Hsieh commented on SPARK-12940: - I ran your example with latest Spark build and it

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118675#comment-15118675 ] Lin Zhao commented on SPARK-12591: -- Hi [~shixi...@databricks.com], I encountered this issue and tried

[jira] [Commented] (SPARK-12850) Support bucket pruning (predicate pushdown for bucketed tables)

[ https://issues.apache.org/jira/browse/SPARK-12850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118701#comment-15118701 ] Apache Spark commented on SPARK-12850: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12850) Support bucket pruning (predicate pushdown for bucketed tables)

[ https://issues.apache.org/jira/browse/SPARK-12850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12850: Assignee: (was: Apache Spark) > Support bucket pruning (predicate pushdown for

[jira] [Assigned] (SPARK-12850) Support bucket pruning (predicate pushdown for bucketed tables)

[ https://issues.apache.org/jira/browse/SPARK-12850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12850: Assignee: Apache Spark > Support bucket pruning (predicate pushdown for bucketed tables)

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118705#comment-15118705 ] Lin Zhao commented on SPARK-12591: -- yarn-client mode and kyroserializer. Our events are kryo ready and

[jira] [Comment Edited] (SPARK-12695) java.lang.ClassCastException: [B cannot be cast to java.lang.String

[ https://issues.apache.org/jira/browse/SPARK-12695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118712#comment-15118712 ] eugeny birukov edited comment on SPARK-12695 at 1/27/16 6:14 AM: - At the

[jira] [Commented] (SPARK-12671) Improve tests for better coverage

[ https://issues.apache.org/jira/browse/SPARK-12671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118748#comment-15118748 ] Hyukjin Kwon commented on SPARK-12671: -- I do not want to make it complicated though. I think this

[jira] [Assigned] (SPARK-12988) Can't drop columns that contain dots

[ https://issues.apache.org/jira/browse/SPARK-12988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12988: Assignee: (was: Apache Spark) > Can't drop columns that contain dots >

[jira] [Commented] (SPARK-12988) Can't drop columns that contain dots

[ https://issues.apache.org/jira/browse/SPARK-12988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118772#comment-15118772 ] Apache Spark commented on SPARK-12988: -- User 'dilipbiswal' has created a pull request for this

[jira] [Assigned] (SPARK-12988) Can't drop columns that contain dots

[ https://issues.apache.org/jira/browse/SPARK-12988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12988: Assignee: Apache Spark > Can't drop columns that contain dots >

[jira] [Updated] (SPARK-13029) Logistic regression returns inaccurate results when there is a column with identical value, and fit_intercept=false

[ https://issues.apache.org/jira/browse/SPARK-13029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuo Xiang updated SPARK-13029: --- Description: This is a bug that appears while fitting a Logistic Regression model with

[jira] [Updated] (SPARK-13029) Logistic regression returns inaccurate results when there is a column with identical value, and fit_intercept=false

[ https://issues.apache.org/jira/browse/SPARK-13029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuo Xiang updated SPARK-13029: --- Description: This is a bug that appears while fitting a Logistic Regression model with

[jira] [Resolved] (SPARK-12935) Count-min sketch DataFrame API integration

[ https://issues.apache.org/jira/browse/SPARK-12935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12935. - Resolution: Fixed Fix Version/s: 2.0.0 > Count-min sketch DataFrame API integration >

[jira] [Resolved] (SPARK-12780) Inconsistency returning value of ML python models' properties

[ https://issues.apache.org/jira/browse/SPARK-12780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-12780. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10724

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118687#comment-15118687 ] Shixiong Zhu commented on SPARK-12591: -- Which mode are you using? Is it work when disabling Kryo? >

[jira] [Closed] (SPARK-12671) Improve tests for better coverage

[ https://issues.apache.org/jira/browse/SPARK-12671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-12671. --- Resolution: Invalid > Improve tests for better coverage > - > >

[jira] [Assigned] (SPARK-13029) Logistic regression returns inaccurate results when there is a column with identical value, and fit_intercept=false

[ https://issues.apache.org/jira/browse/SPARK-13029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13029: Assignee: Apache Spark (was: Shuo Xiang) > Logistic regression returns inaccurate

[jira] [Commented] (SPARK-12996) CSVRelation should be based on HadoopFsRelation

[ https://issues.apache.org/jira/browse/SPARK-12996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118731#comment-15118731 ] Reynold Xin commented on SPARK-12996: - [~hyukjin.kwon] maybe SPARK-12997? > CSVRelation should be

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118774#comment-15118774 ] Shixiong Zhu commented on SPARK-12591: -- That's weird. If it doesn't always happen, I guess it may be

[jira] [Commented] (SPARK-12988) Can't drop columns that contain dots

[ https://issues.apache.org/jira/browse/SPARK-12988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118775#comment-15118775 ] Dilip Biswal commented on SPARK-12988: -- [~marmbrus][~rxin] Thanks for your input. > Can't drop

[jira] [Updated] (SPARK-13029) Logistic regression returns inaccurate results when there is a column with identical value, and fit_intercept=false

[ https://issues.apache.org/jira/browse/SPARK-13029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuo Xiang updated SPARK-13029: --- Description: This is a bug that appears while fitting a Logistic Regression model with

[jira] [Updated] (SPARK-13029) Logistic regression returns inaccurate results when there is a column with identical value, and fit_intercept=false

[ https://issues.apache.org/jira/browse/SPARK-13029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13029: -- Shepherd: Xiangrui Meng Target Version/s: 1.5.3, 1.6.1, 2.0.0 > Logistic

[jira] [Updated] (SPARK-13029) Logistic regression returns inaccurate results when there is a column with identical value, and fit_intercept=false

[ https://issues.apache.org/jira/browse/SPARK-13029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13029: -- Assignee: Shuo Xiang > Logistic regression returns inaccurate results when there is a column

[jira] [Updated] (SPARK-13029) Logistic regression returns inaccurate results when there is a column with identical value, and fit_intercept=false

[ https://issues.apache.org/jira/browse/SPARK-13029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuo Xiang updated SPARK-13029: --- Description: This is a bug that appears while fitting a Logistic Regression model with

[jira] [Updated] (SPARK-13029) Logistic regression returns inaccurate results when there is a column with identical value, and fit_intercept=false

[ https://issues.apache.org/jira/browse/SPARK-13029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuo Xiang updated SPARK-13029: --- Description: This is a bug that appears while fitting a Logistic Regression model with

[jira] [Resolved] (SPARK-12728) Integrate SQL generation feature with native view

[ https://issues.apache.org/jira/browse/SPARK-12728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-12728. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10733

[jira] [Updated] (SPARK-12728) Integrate SQL generation feature with native view

[ https://issues.apache.org/jira/browse/SPARK-12728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12728: - Assignee: Cheng Lian > Integrate SQL generation feature with native view >

[jira] [Comment Edited] (SPARK-13004) Support Non-Volatile Data and Operations

[ https://issues.apache.org/jira/browse/SPARK-13004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118468#comment-15118468 ] Wang, Gang edited comment on SPARK-13004 at 1/27/16 5:34 AM: - Yes, That is

[jira] [Comment Edited] (SPARK-12695) java.lang.ClassCastException: [B cannot be cast to java.lang.String

[ https://issues.apache.org/jira/browse/SPARK-12695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118712#comment-15118712 ] eugeny birukov edited comment on SPARK-12695 at 1/27/16 6:09 AM: - At the

[jira] [Commented] (SPARK-12695) java.lang.ClassCastException: [B cannot be cast to java.lang.String

[ https://issues.apache.org/jira/browse/SPARK-12695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118712#comment-15118712 ] eugeny birukov commented on SPARK-12695: At the same code Java, I find a number of data derived

[jira] [Comment Edited] (SPARK-12996) CSVRelation should be based on HadoopFsRelation

[ https://issues.apache.org/jira/browse/SPARK-12996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118727#comment-15118727 ] Hyukjin Kwon edited comment on SPARK-12996 at 1/27/16 6:20 AM: --- Yes I

[jira] [Closed] (SPARK-12996) CSVRelation should be based on HadoopFsRelation

[ https://issues.apache.org/jira/browse/SPARK-12996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-12996. --- Resolution: Implemented Ah never mind. This is done already. > CSVRelation should be based on

[jira] [Assigned] (SPARK-13029) Logistic regression returns inaccurate results when there is a column with identical value, and fit_intercept=false

[ https://issues.apache.org/jira/browse/SPARK-13029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13029: Assignee: Shuo Xiang (was: Apache Spark) > Logistic regression returns inaccurate

[jira] [Commented] (SPARK-13029) Logistic regression returns inaccurate results when there is a column with identical value, and fit_intercept=false

[ https://issues.apache.org/jira/browse/SPARK-13029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118611#comment-15118611 ] Apache Spark commented on SPARK-13029: -- User 'coderxiang' has created a pull request for this issue:

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118724#comment-15118724 ] Lin Zhao commented on SPARK-12591: -- I want to add that this error happens very very rarely. One in a

[jira] [Commented] (SPARK-12695) java.lang.ClassCastException: [B cannot be cast to java.lang.String

[ https://issues.apache.org/jira/browse/SPARK-12695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118723#comment-15118723 ] Shixiong Zhu commented on SPARK-12695: -- Yes, if it's not UTF-8. You need to use the `decoder`

[jira] [Comment Edited] (SPARK-12997) Use cast expression to perform type cast in csv

[ https://issues.apache.org/jira/browse/SPARK-12997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118745#comment-15118745 ] Hyukjin Kwon edited comment on SPARK-12997 at 1/27/16 7:00 AM: --- I would

[jira] [Comment Edited] (SPARK-12997) Use cast expression to perform type cast in csv

[ https://issues.apache.org/jira/browse/SPARK-12997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118745#comment-15118745 ] Hyukjin Kwon edited comment on SPARK-12997 at 1/27/16 7:01 AM: --- I would

[jira] [Commented] (SPARK-12792) Refactor RRDD to support R UDF

[ https://issues.apache.org/jira/browse/SPARK-12792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118618#comment-15118618 ] Sun Rui commented on SPARK-12792: - working on this > Refactor RRDD to support R UDF >

[jira] [Comment Edited] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118675#comment-15118675 ] Lin Zhao edited comment on SPARK-12591 at 1/27/16 5:16 AM: --- Hi

[jira] [Updated] (SPARK-12967) NettyRPC races with SparkContext.stop() and throws exception

[ https://issues.apache.org/jira/browse/SPARK-12967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-12967: - Assignee: Nishkam Ravi > NettyRPC races with SparkContext.stop() and throws exception >

[jira] [Resolved] (SPARK-12967) NettyRPC races with SparkContext.stop() and throws exception

[ https://issues.apache.org/jira/browse/SPARK-12967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-12967. -- Resolution: Fixed Fix Version/s: 2.0.0 > NettyRPC races with SparkContext.stop() and

[jira] [Updated] (SPARK-12967) NettyRPC races with SparkContext.stop() and throws exception

[ https://issues.apache.org/jira/browse/SPARK-12967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-12967: - Affects Version/s: (was: 2.0.0) > NettyRPC races with SparkContext.stop() and throws

[jira] [Updated] (SPARK-12780) Inconsistency returning value of ML python models' properties

[ https://issues.apache.org/jira/browse/SPARK-12780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-12780: -- Assignee: Xusen Yin > Inconsistency returning value of ML python models' properties >

[jira] [Commented] (SPARK-12989) Bad interaction between StarExpansion and ExtractWindowExpressions

[ https://issues.apache.org/jira/browse/SPARK-12989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118708#comment-15118708 ] Xiao Li commented on SPARK-12989: - I will try to fix this problem tomorrow. Thanks! > Bad interaction

[jira] [Commented] (SPARK-12695) java.lang.ClassCastException: [B cannot be cast to java.lang.String

[ https://issues.apache.org/jira/browse/SPARK-12695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118728#comment-15118728 ] eugeny birukov commented on SPARK-12695: Oh, thanks! I try search something similar, but find

[jira] [Commented] (SPARK-12996) CSVRelation should be based on HadoopFsRelation

[ https://issues.apache.org/jira/browse/SPARK-12996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118727#comment-15118727 ] Hyukjin Kwon commented on SPARK-12996: -- Yes I would. But does this already extend

[jira] [Commented] (SPARK-12997) Use cast expression to perform type cast in csv

[ https://issues.apache.org/jira/browse/SPARK-12997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118745#comment-15118745 ] Hyukjin Kwon commented on SPARK-12997: -- I would like to try this; however, how about just using

[jira] [Commented] (SPARK-8697) MatchIterator not serializable exception in RegexTokenizer

[ https://issues.apache.org/jira/browse/SPARK-8697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118760#comment-15118760 ] Xiangrui Meng commented on SPARK-8697: -- [~oromank...@cardlytics.com] Thanks for confirming the bug!

[jira] [Created] (SPARK-13029) Logistic regression returns inaccurate results when there is a column with identical value, and fit_intercept=false

Shuo Xiang created SPARK-13029: -- Summary: Logistic regression returns inaccurate results when there is a column with identical value, and fit_intercept=false Key: SPARK-13029 URL:

[jira] [Commented] (SPARK-12834) Use type conversion instead of Ser/De of Pickle to transform JavaArray and JavaList

[ https://issues.apache.org/jira/browse/SPARK-12834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118685#comment-15118685 ] Apache Spark commented on SPARK-12834: -- User 'jkbradley' has created a pull request for this issue:

[jira] [Updated] (SPARK-12780) Inconsistency returning value of ML python models' properties

[ https://issues.apache.org/jira/browse/SPARK-12780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-12780: -- Target Version/s: 1.6.1, 2.0.0 > Inconsistency returning value of ML python models'

[jira] [Updated] (SPARK-12834) Use type conversion instead of Ser/De of Pickle to transform JavaArray and JavaList

[ https://issues.apache.org/jira/browse/SPARK-12834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-12834: -- Target Version/s: 1.6.1, 2.0.0 > Use type conversion instead of Ser/De of Pickle to

[jira] [Comment Edited] (SPARK-12695) java.lang.ClassCastException: [B cannot be cast to java.lang.String

[ https://issues.apache.org/jira/browse/SPARK-12695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118712#comment-15118712 ] eugeny birukov edited comment on SPARK-12695 at 1/27/16 6:17 AM: - At the

[jira] [Created] (SPARK-13030) Change OneHotEncoder to Estimator

Wojciech Jurczyk created SPARK-13030: Summary: Change OneHotEncoder to Estimator Key: SPARK-13030 URL: https://issues.apache.org/jira/browse/SPARK-13030 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-12261) pyspark crash for large dataset

[ https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15116907#comment-15116907 ] Christopher Bourez edited comment on SPARK-12261 at 1/26/16 8:11 AM: -

[jira] [Commented] (SPARK-12261) pyspark crash for large dataset

[ https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15116907#comment-15116907 ] Christopher Bourez commented on SPARK-12261: To reproduce you can follow the steps : -

[jira] [Comment Edited] (SPARK-12261) pyspark crash for large dataset

[ https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15116907#comment-15116907 ] Christopher Bourez edited comment on SPARK-12261 at 1/26/16 8:10 AM: -

[jira] [Resolved] (SPARK-12937) Bloom filter serialization

[ https://issues.apache.org/jira/browse/SPARK-12937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12937. - Resolution: Fixed Fix Version/s: 2.0.0 > Bloom filter serialization >

[jira] [Created] (SPARK-13000) Corrupted results when using LIMIT clause via JDBC connections to ThriftServer

Daniel Harper created SPARK-13000: - Summary: Corrupted results when using LIMIT clause via JDBC connections to ThriftServer Key: SPARK-13000 URL: https://issues.apache.org/jira/browse/SPARK-13000

[jira] [Updated] (SPARK-13000) Corrupted results when using LIMIT clause via JDBC connections to ThriftServer

[ https://issues.apache.org/jira/browse/SPARK-13000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Harper updated SPARK-13000: -- Description: h2. Steps to reproduce # Create table in HIVE (see below for definition) #

[jira] [Created] (SPARK-13001) Coarse-grained Mesos scheduler should reject offers for longer period of time when reached max cores

Sebastien Rainville created SPARK-13001: --- Summary: Coarse-grained Mesos scheduler should reject offers for longer period of time when reached max cores Key: SPARK-13001 URL:

[jira] [Commented] (SPARK-12989) Bad interaction between StarExpansion and ExtractWindowExpressions

[ https://issues.apache.org/jira/browse/SPARK-12989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117220#comment-15117220 ] Denton Cockburn commented on SPARK-12989: - It should be noted that it works if given: {code}

[jira] [Comment Edited] (SPARK-12989) Bad interaction between StarExpansion and ExtractWindowExpressions

[ https://issues.apache.org/jira/browse/SPARK-12989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117220#comment-15117220 ] Denton Cockburn edited comment on SPARK-12989 at 1/26/16 2:03 PM: -- It

[jira] [Commented] (SPARK-12979) Paths are resolved relative to the local file system

[ https://issues.apache.org/jira/browse/SPARK-12979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117238#comment-15117238 ] Apache Spark commented on SPARK-12979: -- User 'dragos' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12979) Paths are resolved relative to the local file system

[ https://issues.apache.org/jira/browse/SPARK-12979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12979: Assignee: (was: Apache Spark) > Paths are resolved relative to the local file system

[jira] [Assigned] (SPARK-12979) Paths are resolved relative to the local file system

[ https://issues.apache.org/jira/browse/SPARK-12979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12979: Assignee: Apache Spark > Paths are resolved relative to the local file system >

[jira] [Created] (SPARK-13002) Mesos scheduler backend does not follow the property spark.dynamicAllocation.initialExecutors

Luc Bourlier created SPARK-13002: Summary: Mesos scheduler backend does not follow the property spark.dynamicAllocation.initialExecutors Key: SPARK-13002 URL: https://issues.apache.org/jira/browse/SPARK-13002

[jira] [Commented] (SPARK-7889) Jobs progress of apps on complete page of HistoryServer shows uncompleted

[ https://issues.apache.org/jira/browse/SPARK-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117288#comment-15117288 ] Steve Loughran commented on SPARK-7889: --- I'm going to note something something problematic about

[jira] [Updated] (SPARK-12879) improve unsafe row writing framework

[ https://issues.apache.org/jira/browse/SPARK-12879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12879: -- Assignee: Wenchen Fan > improve unsafe row writing framework > >

[jira] [Updated] (SPARK-12985) Spark Hive thrift server big decimal data issue

[ https://issues.apache.org/jira/browse/SPARK-12985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12985: -- Component/s: SQL > Spark Hive thrift server big decimal data issue >

[jira] [Updated] (SPARK-12991) Establish correspondence between SparkPlan and LogicalPlan nodes

[ https://issues.apache.org/jira/browse/SPARK-12991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12991: -- Component/s: SQL > Establish correspondence between SparkPlan and LogicalPlan nodes >

[jira] [Resolved] (SPARK-12999) Guidance on adding a stopping criterion (maximul literal length or itemset count) for FPGrowth

[ https://issues.apache.org/jira/browse/SPARK-12999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12999. --- Resolution: Duplicate Questions should go to user@. I think this is a duplicate of SPARK-12163 as

[jira] [Commented] (SPARK-12695) java.lang.ClassCastException: [B cannot be cast to java.lang.String

[ https://issues.apache.org/jira/browse/SPARK-12695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117327#comment-15117327 ] e.birukov commented on SPARK-12695: --- python 2.7 I use rdd: t = sqlContext.read.json(rdd)

[jira] [Assigned] (SPARK-13001) Coarse-grained Mesos scheduler should reject offers for longer period of time when reached max cores

[ https://issues.apache.org/jira/browse/SPARK-13001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13001: Assignee: Apache Spark > Coarse-grained Mesos scheduler should reject offers for longer

[jira] [Assigned] (SPARK-13001) Coarse-grained Mesos scheduler should reject offers for longer period of time when reached max cores

[ https://issues.apache.org/jira/browse/SPARK-13001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13001: Assignee: (was: Apache Spark) > Coarse-grained Mesos scheduler should reject offers

[jira] [Commented] (SPARK-13001) Coarse-grained Mesos scheduler should reject offers for longer period of time when reached max cores

[ https://issues.apache.org/jira/browse/SPARK-13001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117341#comment-15117341 ] Apache Spark commented on SPARK-13001: -- User 'sebastienrainville' has created a pull request for

[jira] [Commented] (SPARK-12261) pyspark crash for large dataset

[ https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117345#comment-15117345 ] Christopher Bourez commented on SPARK-12261: The solution "Increase driver memory" does not

[jira] [Commented] (SPARK-2629) Improved state management for Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-2629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117404#comment-15117404 ] Rodrigo Boavida commented on SPARK-2629: Hi, I've experimented the new API method but am

[jira] [Resolved] (SPARK-10911) Executors should System.exit on clean shutdown

[ https://issues.apache.org/jira/browse/SPARK-10911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-10911. --- Resolution: Fixed Fix Version/s: 2.0.0 > Executors should System.exit on clean

[jira] [Updated] (SPARK-12682) Hive will fail if the schema of a parquet table has a very wide schema

[ https://issues.apache.org/jira/browse/SPARK-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12682: - Assignee: Sameer Agarwal > Hive will fail if the schema of a parquet table has a very wide schema >

[jira] [Resolved] (SPARK-12682) Hive will fail if the schema of a parquet table has a very wide schema

[ https://issues.apache.org/jira/browse/SPARK-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-12682. -- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved by pull request

[jira] [Commented] (SPARK-12988) Can't drop columns that contain dots

[ https://issues.apache.org/jira/browse/SPARK-12988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117509#comment-15117509 ] Dilip Biswal commented on SPARK-12988: -- I would like to work on this one. > Can't drop columns that

[jira] [Commented] (SPARK-12682) Hive will fail if the schema of a parquet table has a very wide schema

[ https://issues.apache.org/jira/browse/SPARK-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117518#comment-15117518 ] Apache Spark commented on SPARK-12682: -- User 'yhuai' has created a pull request for this issue:

[jira] [Commented] (SPARK-12850) Support bucket pruning (predicate pushdown for bucketed tables)

[ https://issues.apache.org/jira/browse/SPARK-12850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117613#comment-15117613 ] Xiao Li commented on SPARK-12850: - Will submit a PR today. Hive cannot prune buckets when the number of

  1   2   3   >