[jira] [Resolved] (SPARK-10266) Add @Since annotation to ml.tuning

2015-12-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-10266. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9338

[jira] [Updated] (SPARK-12089) [][]][][]][[[

2015-12-02 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12089: --- Summary: [][]][][]][[[ (was: java.lang.NegativeArraySizeException when growing BufferHolder) >

[jira] [Updated] (SPARK-12057) Prevent failure on corrupt JSON records

2015-12-02 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12057: - Target Version/s: 1.6.0 > Prevent failure on corrupt JSON records >

[jira] [Assigned] (SPARK-12000) `sbt publishLocal` hits a Scala compiler bug caused by `Since` annotation

2015-12-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-12000: - Assignee: Xiangrui Meng (was: Josh Rosen) > `sbt publishLocal` hits a Scala compiler

[jira] [Assigned] (SPARK-12108) Event logs are much bigger in 1.6 than in 1.5

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12108: Assignee: Andrew Or (was: Apache Spark) > Event logs are much bigger in 1.6 than in 1.5

[jira] [Commented] (SPARK-12108) Event logs are much bigger in 1.6 than in 1.5

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15036938#comment-15036938 ] Apache Spark commented on SPARK-12108: -- User 'andrewor14' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12108) Event logs are much bigger in 1.6 than in 1.5

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12108: Assignee: Apache Spark (was: Andrew Or) > Event logs are much bigger in 1.6 than in 1.5

[jira] [Updated] (SPARK-12089) java.lang.NegativeArraySizeException when growing BufferHolder

2015-12-02 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12089: - Target Version/s: 1.6.0 > java.lang.NegativeArraySizeException when growing BufferHolder

[jira] [Updated] (SPARK-12089) java.lang.NegativeArraySizeException when growing BufferHolder

2015-12-02 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12089: - Priority: Blocker (was: Critical) > java.lang.NegativeArraySizeException when growing

[jira] [Resolved] (SPARK-12095) Window function rowsBetween throws exception

2015-12-02 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-12095. -- Resolution: Invalid > Window function rowsBetween throws exception >

[jira] [Updated] (SPARK-11868) wrong results returned from dataframe create from Rows without consistent schma on pyspark

2015-12-02 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11868: - Target Version/s: 1.6.0 > wrong results returned from dataframe create from Rows without consistent >

[jira] [Resolved] (SPARK-12093) Fix the error of comment in DDLParser

2015-12-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12093. - Resolution: Fixed Assignee: Yadong Qi Fix Version/s: 1.7.0

[jira] [Updated] (SPARK-12108) Event logs are much bigger in 1.6 than in 1.5

2015-12-02 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12108: - Target Version/s: 1.6.0 (was: 1.6.1) > Event logs are much bigger in 1.6 than in 1.5 >

[jira] [Updated] (SPARK-7264) SparkR API for parallel functions

2015-12-02 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7264: Target Version/s: (was: 1.6.0) > SparkR API for parallel functions >

[jira] [Updated] (SPARK-9697) Project Tungsten (Spark 1.6)

2015-12-02 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9697: Target Version/s: (was: 1.6.0) > Project Tungsten (Spark 1.6) >

[jira] [Commented] (SPARK-12000) `sbt publishLocal` hits a Scala compiler bug caused by `Since` annotation

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15036926#comment-15036926 ] Apache Spark commented on SPARK-12000: -- User 'mengxr' has created a pull request for this issue:

[jira] [Closed] (SPARK-12092) StringIndexer failing with Unseen label exception on test data

2015-12-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang closed SPARK-12092. -- Resolution: Won't Fix > StringIndexer failing with Unseen label exception on test data >

[jira] [Commented] (SPARK-12083) java.lang.IllegalArgumentException: requirement failed: Overflowed precision (q98)

2015-12-02 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15036954#comment-15036954 ] Michael Armbrust commented on SPARK-12083: -- Can you test with 1.6-RC1? >

[jira] [Commented] (SPARK-12095) Window function rowsBetween throws exception

2015-12-02 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15036958#comment-15036958 ] Yin Huai commented on SPARK-12095: -- In DataFrame API, the syntax is different from SQL's syntax. You can

[jira] [Updated] (SPARK-12063) Group by Column Number identifier is not successfully parsed

2015-12-02 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12063: - Issue Type: New Feature (was: Bug) > Group by Column Number identifier is not

[jira] [Updated] (SPARK-12088) check connection.isClose before connection.getAutoCommit in JDBCRDD.close

2015-12-02 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12088: - Target Version/s: 1.6.0 > check connection.isClose before connection.getAutoCommit in

[jira] [Updated] (SPARK-12110) spark-1.5.1-bin-hadoop2.6; pyspark.ml.feature Exception: ("You must build Spark with Hive

2015-12-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-12110: Description: I am using spark-1.5.1-bin-hadoop2.6. I used

[jira] [Updated] (SPARK-12110) spark-1.5.1-bin-hadoop2.6; pyspark.ml.feature Exception: ("You must build Spark with Hive

2015-12-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-12110: Component/s: (was: ML) (was: SQL) (was:

[jira] [Commented] (SPARK-12110) spark-1.5.1-bin-hadoop2.6; pyspark.ml.feature Exception: ("You must build Spark with Hive

2015-12-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15036960#comment-15036960 ] Patrick Wendell commented on SPARK-12110: - Hey Andrew, could you show exactly the command you are

[jira] [Updated] (SPARK-11948) Permanent UDF not work

2015-12-02 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11948: - Summary: Permanent UDF not work (was: UDF not work) > Permanent UDF not work > -- >

[jira] [Created] (SPARK-12113) Add timing metrics to blocking phases for spark sql

2015-12-02 Thread Nong Li (JIRA)
Nong Li created SPARK-12113: --- Summary: Add timing metrics to blocking phases for spark sql Key: SPARK-12113 URL: https://issues.apache.org/jira/browse/SPARK-12113 Project: Spark Issue Type:

[jira] [Updated] (SPARK-11948) Permanent UDF not work

2015-12-02 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11948: - Target Version/s: 1.6.0 > Permanent UDF not work > -- > > Key:

[jira] [Updated] (SPARK-11868) wrong results returned from dataframe create from Rows without consistent schma on pyspark

2015-12-02 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11868: - Target Version/s: (was: 1.6.0) > wrong results returned from dataframe create from

[jira] [Assigned] (SPARK-12113) Add timing metrics to blocking phases for spark sql

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12113: Assignee: (was: Apache Spark) > Add timing metrics to blocking phases for spark sql >

[jira] [Commented] (SPARK-12113) Add timing metrics to blocking phases for spark sql

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15036985#comment-15036985 ] Apache Spark commented on SPARK-12113: -- User 'nongli' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12113) Add timing metrics to blocking phases for spark sql

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12113: Assignee: Apache Spark > Add timing metrics to blocking phases for spark sql >

[jira] [Created] (SPARK-12114) ColumnPruning rule fails in case of "Project <- Filter <- Join"

2015-12-02 Thread Min Qiu (JIRA)
Min Qiu created SPARK-12114: --- Summary: ColumnPruning rule fails in case of "Project <- Filter <- Join" Key: SPARK-12114 URL: https://issues.apache.org/jira/browse/SPARK-12114 Project: Spark Issue

[jira] [Resolved] (SPARK-12000) `sbt publishLocal` hits a Scala compiler bug caused by `Since` annotation

2015-12-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-12000. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 10114

[jira] [Resolved] (SPARK-12109) Expressions's simpleString should delegate to its toString

2015-12-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12109. - Resolution: Fixed Fix Version/s: 1.7.0 1.6.1 Target

[jira] [Created] (SPARK-12118) SparkR: Documentation change for isNaN

2015-12-02 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-12118: --- Summary: SparkR: Documentation change for isNaN Key: SPARK-12118 URL: https://issues.apache.org/jira/browse/SPARK-12118 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-7379) pickle.loads expects a string instead of bytes in Python 3.

2015-12-02 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037189#comment-15037189 ] Xusen Yin commented on SPARK-7379: -- I also hit the error in the PR:

[jira] [Updated] (SPARK-12019) SparkR.init does not support character vector for sparkJars and sparkPackages

2015-12-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-12019: - Summary: SparkR.init does not support character vector for sparkJars and sparkPackages (was:

[jira] [Commented] (SPARK-10528) spark-shell throws java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable.

2015-12-02 Thread WEI ZHU (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037296#comment-15037296 ] WEI ZHU commented on SPARK-10528: - I came to the same problem when using precompiled binaries -

[jira] [Updated] (SPARK-12117) Column Aliases are Ignored in callUDF while using struct()

2015-12-02 Thread sachin aggarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sachin aggarwal updated SPARK-12117: Description: case where this works: val TestDoc1 =

[jira] [Updated] (SPARK-12117) Column Aliases are Ignored in callUDF while using struct()

2015-12-02 Thread sachin aggarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sachin aggarwal updated SPARK-12117: Description: case where this works: val TestDoc1 =

[jira] [Commented] (SPARK-11095) Simplify Netty RPC implementation by using a separate thread pool for each endpoint

2015-12-02 Thread S Ross (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037352#comment-15037352 ] S Ross commented on SPARK-11095: How does one determine which endpoints support concurrent execution?

[jira] [Commented] (SPARK-11255) R Test build should run on R 3.1.1

2015-12-02 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037169#comment-15037169 ] shane knapp commented on SPARK-11255: - actually, we'll do this next thursday morning as there's a

[jira] [Updated] (SPARK-12114) ColumnPruning rule fails in case of "Project <- Filter <- Join"

2015-12-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12114: Description: For the query {code} SELECT c_name, c_custkey, o_orderkey, o_orderdate,

[jira] [Commented] (SPARK-12019) SparkR.init does not support character vector for sparkJars and sparkPackages

2015-12-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037221#comment-15037221 ] Felix Cheung commented on SPARK-12019: -- per PR comment, we are going to update the code to support

[jira] [Assigned] (SPARK-12104) collect() does not handle multiple columns with same name

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12104: Assignee: Apache Spark > collect() does not handle multiple columns with same name >

[jira] [Commented] (SPARK-12104) collect() does not handle multiple columns with same name

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037223#comment-15037223 ] Apache Spark commented on SPARK-12104: -- User 'sun-rui' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12104) collect() does not handle multiple columns with same name

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12104: Assignee: (was: Apache Spark) > collect() does not handle multiple columns with same

[jira] [Updated] (SPARK-12091) [PySpark] Removal of the JAVA-specific deserialized storage levels

2015-12-02 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-12091: Description: Since the data is always serialized on the Python side, the JAVA-specific deserialized levels

[jira] [Updated] (SPARK-12091) [PySpark] Removal of the JAVA-specific deserialized storage levels

2015-12-02 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-12091: Priority: Major (was: Minor) > [PySpark] Removal of the JAVA-specific deserialized storage levels >

[jira] [Updated] (SPARK-12091) [PySpark] Removal of the JAVA-specific deserialized storage levels

2015-12-02 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-12091: Summary: [PySpark] Removal of the JAVA-specific deserialized storage levels (was: [PySpark] Inconsistent

[jira] [Assigned] (SPARK-12089) java.lang.NegativeArraySizeException when growing BufferHolder

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12089: Assignee: Apache Spark > java.lang.NegativeArraySizeException when growing BufferHolder >

[jira] [Commented] (SPARK-12089) java.lang.NegativeArraySizeException when growing BufferHolder

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037275#comment-15037275 ] Apache Spark commented on SPARK-12089: -- User 'yhuai' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12089) java.lang.NegativeArraySizeException when growing BufferHolder

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12089: Assignee: (was: Apache Spark) > java.lang.NegativeArraySizeException when growing

[jira] [Commented] (SPARK-12071) Programming guide should explain NULL in JVM translate to NA in R

2015-12-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037249#comment-15037249 ] Felix Cheung commented on SPARK-12071: -- Also see discussion in

[jira] [Updated] (SPARK-12117) Column Aliases are Ignored in callUDF while using struct()

2015-12-02 Thread sachin aggarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sachin aggarwal updated SPARK-12117: Description: case where this works: val TestDoc1 = sqlContext.createDataFrame(Seq(("sachin

[jira] [Updated] (SPARK-12117) Column Aliases are Ignored in callUDF while using struct()

2015-12-02 Thread sachin aggarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sachin aggarwal updated SPARK-12117: Description: case where this works: val TestDoc1 =

[jira] [Updated] (SPARK-12000) `sbt publishLocal` hits a Scala compiler bug caused by `Since` annotation

2015-12-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-12000: -- Fix Version/s: (was: 1.6.0) 1.6.1 > `sbt publishLocal` hits a Scala

[jira] [Updated] (SPARK-10266) Add @Since annotation to ml.tuning

2015-12-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10266: -- Fix Version/s: (was: 1.6.0) 1.6.1 > Add @Since annotation to ml.tuning

[jira] [Commented] (SPARK-11940) Python API for ml.clustering.LDA

2015-12-02 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037410#comment-15037410 ] Yanbo Liang commented on SPARK-11940: - [~zjffdu] AFAIK, there is Scala API for ml.LDA, please refer

[jira] [Assigned] (SPARK-12114) ColumnPruning rule fails in case of "Project <- Filter <- Join"

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12114: Assignee: (was: Apache Spark) > ColumnPruning rule fails in case of "Project <-

[jira] [Commented] (SPARK-12114) ColumnPruning rule fails in case of "Project <- Filter <- Join"

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037139#comment-15037139 ] Apache Spark commented on SPARK-12114: -- User 'flyson' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12114) ColumnPruning rule fails in case of "Project <- Filter <- Join"

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12114: Assignee: Apache Spark > ColumnPruning rule fails in case of "Project <- Filter <- Join"

[jira] [Commented] (SPARK-12110) spark-1.5.1-bin-hadoop2.6; pyspark.ml.feature Exception: ("You must build Spark with Hive

2015-12-02 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037349#comment-15037349 ] Davies Liu commented on SPARK-12110: [~aedwip] How do you launch the EC2 cluster using ec2/spark-ec2?

[jira] [Commented] (SPARK-12115) Change numPartitions() in RDD to be "getNumPartitions" to be consistent with pyspark/scala

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037368#comment-15037368 ] Apache Spark commented on SPARK-12115: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12115) Change numPartitions() in RDD to be "getNumPartitions" to be consistent with pyspark/scala

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12115: Assignee: (was: Apache Spark) > Change numPartitions() in RDD to be

[jira] [Assigned] (SPARK-12115) Change numPartitions() in RDD to be "getNumPartitions" to be consistent with pyspark/scala

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12115: Assignee: Apache Spark > Change numPartitions() in RDD to be "getNumPartitions" to be

[jira] [Commented] (SPARK-10523) SparkR formula syntax to turn strings/factors into numerics

2015-12-02 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037387#comment-15037387 ] Yanbo Liang commented on SPARK-10523: - SPARK-11349 has solved the issue that supporting label with

[jira] [Commented] (SPARK-11940) Python API for ml.clustering.LDA

2015-12-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037391#comment-15037391 ] Jeff Zhang commented on SPARK-11940: Looks like there's even no scala api under ml for LDA. Will

[jira] [Updated] (SPARK-12118) SparkR: Documentation change for isNaN

2015-12-02 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12118: Labels: releasenotes (was: ) > SparkR: Documentation change for isNaN >

[jira] [Commented] (SPARK-8855) Python API for Association Rules

2015-12-02 Thread Caique Rodrigues Marques (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037211#comment-15037211 ] Caique Rodrigues Marques commented on SPARK-8855: - I am working on this, but I found a

[jira] [Commented] (SPARK-11940) Python API for ml.clustering.LDA

2015-12-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037413#comment-15037413 ] Jeff Zhang commented on SPARK-11940: Thanks [~yanboliang] didn't rebase my repository :) > Python

[jira] [Commented] (SPARK-11095) Simplify Netty RPC implementation by using a separate thread pool for each endpoint

2015-12-02 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037415#comment-15037415 ] Shixiong Zhu commented on SPARK-11095: -- Right. > Simplify Netty RPC implementation by using a

[jira] [Updated] (SPARK-12114) ColumnPruning rule fails in case of "Project <- Filter <- Join"

2015-12-02 Thread Min Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Min Qiu updated SPARK-12114: External issue URL: (was: https://github.com/apache/spark/pull/10087) > ColumnPruning rule fails in case

[jira] [Resolved] (SPARK-12082) NettyBlockTransferSecuritySuite "security mismatch auth off on client" test is flaky

2015-12-02 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12082. - Resolution: Fixed Fix Version/s: 1.7.0 1.6.1 >

[jira] [Updated] (SPARK-12071) Programming guide should explain NULL in JVM translate to NA in R

2015-12-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-12071: - Labels: releasenotes (was: ) > Programming guide should explain NULL in JVM translate to NA in

[jira] [Assigned] (SPARK-12116) Document workaround when method conflicts with another R package, like dplyr

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12116: Assignee: (was: Apache Spark) > Document workaround when method conflicts with

[jira] [Commented] (SPARK-12116) Document workaround when method conflicts with another R package, like dplyr

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037252#comment-15037252 ] Apache Spark commented on SPARK-12116: -- User 'felixcheung' has created a pull request for this

[jira] [Assigned] (SPARK-12116) Document workaround when method conflicts with another R package, like dplyr

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12116: Assignee: Apache Spark > Document workaround when method conflicts with another R

[jira] [Commented] (SPARK-12089) java.lang.NegativeArraySizeException when growing BufferHolder

2015-12-02 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037276#comment-15037276 ] Yin Huai commented on SPARK-12089: -- [~tyro89] Can you reproduce it? I am trying to add some logs and see

[jira] [Comment Edited] (SPARK-10528) spark-shell throws java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable.

2015-12-02 Thread WEI ZHU (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037296#comment-15037296 ] WEI ZHU edited comment on SPARK-10528 at 12/3/15 5:43 AM: -- I came to the same

[jira] [Commented] (SPARK-12115) Change numPartitions() in RDD to be "getNumPartitions" to be consistent with pyspark/scala

2015-12-02 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037313#comment-15037313 ] Yanbo Liang commented on SPARK-12115: - I can work on it. > Change numPartitions() in RDD to be

[jira] [Commented] (SPARK-7379) pickle.loads expects a string instead of bytes in Python 3.

2015-12-02 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037312#comment-15037312 ] Xusen Yin commented on SPARK-7379: -- [~mengxr] If you look at here:

[jira] [Issue Comment Deleted] (SPARK-11940) Python API for ml.clustering.LDA

2015-12-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-11940: --- Comment: was deleted (was: Thanks [~yanboliang] didn't rebase my repository :)) > Python API for

[jira] [Commented] (SPARK-11940) Python API for ml.clustering.LDA

2015-12-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037414#comment-15037414 ] Jeff Zhang commented on SPARK-11940: Thanks [~yanboliang] didn't rebase my repository :) > Python

[jira] [Commented] (SPARK-11886) R function name conflicts with base or stats package ones

2015-12-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037251#comment-15037251 ] Felix Cheung commented on SPARK-11886: -- Created SPARK-12116 for dplyr conflicts > R function name

[jira] [Created] (SPARK-12116) Document workaround when method conflicts with another R package, like dplyr

2015-12-02 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-12116: Summary: Document workaround when method conflicts with another R package, like dplyr Key: SPARK-12116 URL: https://issues.apache.org/jira/browse/SPARK-12116

[jira] [Comment Edited] (SPARK-11886) R function name conflicts with base or stats package ones

2015-12-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037251#comment-15037251 ] Felix Cheung edited comment on SPARK-11886 at 12/3/15 4:51 AM: --- Created

[jira] [Updated] (SPARK-12116) Document workaround when method conflicts with another R package, like dplyr

2015-12-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-12116: - Description: See https://issues.apache.org/jira/browse/SPARK-11886 > Document workaround when

[jira] [Created] (SPARK-12117) Column Aliases are Ignored in callUDF while using struct()

2015-12-02 Thread sachin aggarwal (JIRA)
sachin aggarwal created SPARK-12117: --- Summary: Column Aliases are Ignored in callUDF while using struct() Key: SPARK-12117 URL: https://issues.apache.org/jira/browse/SPARK-12117 Project: Spark

[jira] [Created] (SPARK-12112) Upgrade to SBT 0.13.9

2015-12-02 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-12112: -- Summary: Upgrade to SBT 0.13.9 Key: SPARK-12112 URL: https://issues.apache.org/jira/browse/SPARK-12112 Project: Spark Issue Type: Bug Components:

[jira] [Assigned] (SPARK-12112) Upgrade to SBT 0.13.9

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12112: Assignee: Josh Rosen (was: Apache Spark) > Upgrade to SBT 0.13.9 > -

[jira] [Commented] (SPARK-12112) Upgrade to SBT 0.13.9

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15036903#comment-15036903 ] Apache Spark commented on SPARK-12112: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12112) Upgrade to SBT 0.13.9

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12112: Assignee: Apache Spark (was: Josh Rosen) > Upgrade to SBT 0.13.9 > -

[jira] [Commented] (SPARK-12082) NettyBlockTransferSecuritySuite "security mismatch auth off on client" test is flaky

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15036911#comment-15036911 ] Apache Spark commented on SPARK-12082: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12109) Expressions's simpleString should delegate to its toString

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12109: Assignee: Yin Huai (was: Apache Spark) > Expressions's simpleString should delegate to

[jira] [Commented] (SPARK-12109) Expressions's simpleString should delegate to its toString

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15036833#comment-15036833 ] Apache Spark commented on SPARK-12109: -- User 'yhuai' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12109) Expressions's simpleString should delegate to its toString

2015-12-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12109: Assignee: Apache Spark (was: Yin Huai) > Expressions's simpleString should delegate to

[jira] [Updated] (SPARK-12089) java.lang.NegativeArraySizeException when growing BufferHolder

2015-12-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12089: -- Summary: java.lang.NegativeArraySizeException when growing BufferHolder (was: [][]][][]][[[) >

[jira] [Resolved] (SPARK-12111) need upgrade instruction

2015-12-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12111. --- Resolution: Invalid This is better started as a question on u...@spark.apache.org. This would be

[jira] [Commented] (SPARK-9686) Spark Thrift server doesn't return correct JDBC metadata

2015-12-02 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15036837#comment-15036837 ] Yin Huai commented on SPARK-9686: - [~lian cheng] I think it is pretty hard to workaround this problem. I

<    1   2   3   >