[jira] [Updated] (SPARK-9034) Reflect field names defined in GenericUDTF

2015-11-02 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-9034: Assignee: Navis > Reflect field names defined in GenericUDTF > -- >

[jira] [Resolved] (SPARK-9034) Reflect field names defined in GenericUDTF

2015-11-02 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-9034. - Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8456 [https://github.com/apac

[jira] [Assigned] (SPARK-11399) Include_example should support labels to cut out different parts in one example code

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11399: Assignee: Apache Spark > Include_example should support labels to cut out different parts

[jira] [Commented] (SPARK-11399) Include_example should support labels to cut out different parts in one example code

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986834#comment-14986834 ] Apache Spark commented on SPARK-11399: -- User 'yinxusen' has created a pull request f

[jira] [Assigned] (SPARK-11399) Include_example should support labels to cut out different parts in one example code

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11399: Assignee: (was: Apache Spark) > Include_example should support labels to cut out diffe

[jira] [Updated] (SPARK-11398) unnecessary def dialectClassName in HiveContext, and misleading dialect conf at the start of spark-sql

2015-11-02 Thread Zhenhua Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenhua Wang updated SPARK-11398: - Description: 1. def dialectClassName in HiveContext is unnecessary. In HiveContext, if conf.dia

[jira] [Updated] (SPARK-11398) unnecessary def dialectClassName in HiveContext, and misleading dialect conf at the start of spark-sql

2015-11-02 Thread Zhenhua Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenhua Wang updated SPARK-11398: - Description: 1. def dialectClassName in HiveContext is unnecessary. In HiveContext, if conf.dia

[jira] [Updated] (SPARK-11398) unnecessary def dialectClassName in HiveContext, and misleading dialect conf at the start of spark-sql

2015-11-02 Thread Zhenhua Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenhua Wang updated SPARK-11398: - Summary: unnecessary def dialectClassName in HiveContext, and misleading dialect conf at the star

[jira] [Updated] (SPARK-11398) misleading dialect conf at the start of spark-sql

2015-11-02 Thread Zhenhua Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenhua Wang updated SPARK-11398: - Description: 1. def dialectClassName in HiveContext is unnecessary. In HiveContext, if conf.dial

[jira] [Commented] (SPARK-11275) [SQL] Incorrect results when using rollup/cube

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986764#comment-14986764 ] Apache Spark commented on SPARK-11275: -- User 'aray' has created a pull request for t

[jira] [Resolved] (SPARK-11469) Initial implementation

2015-11-02 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-11469. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9393 [https://github.com/a

[jira] [Commented] (SPARK-11439) Optiomization of creating sparse feature without dense one

2015-11-02 Thread Nakul Jindal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986684#comment-14986684 ] Nakul Jindal commented on SPARK-11439: -- [~holdenk] [~lewuathe] - A couple of places

[jira] [Resolved] (SPARK-11432) Personalized PageRank shouldn't use uniform initialization

2015-11-02 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-11432. - Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9386 [https://github.com/apa

[jira] [Updated] (SPARK-11329) Expand Star when creating a struct

2015-11-02 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11329: - Assignee: Nong Li > Expand Star when creating a struct > -- > >

[jira] [Resolved] (SPARK-11329) Expand Star when creating a struct

2015-11-02 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-11329. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9343 [https://github.com/a

[jira] [Resolved] (SPARK-5354) Set InMemoryColumnarTableScan's outputPartitioning and outputOrdering

2015-11-02 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-5354. - Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9404 [https://github.com/apac

[jira] [Updated] (SPARK-5354) Set InMemoryColumnarTableScan's outputPartitioning and outputOrdering

2015-11-02 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-5354: Assignee: Nong Li > Set InMemoryColumnarTableScan's outputPartitioning and outputOrdering >

[jira] [Assigned] (SPARK-11469) Initial implementation

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11469: Assignee: Yin Huai (was: Apache Spark) > Initial implementation > --

[jira] [Commented] (SPARK-11469) Initial implementation

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986578#comment-14986578 ] Apache Spark commented on SPARK-11469: -- User 'yhuai' has created a pull request for

[jira] [Assigned] (SPARK-11469) Initial implementation

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11469: Assignee: Apache Spark (was: Yin Huai) > Initial implementation > --

[jira] [Created] (SPARK-11470) Figure out a good name for the public API

2015-11-02 Thread Yin Huai (JIRA)
Yin Huai created SPARK-11470: Summary: Figure out a good name for the public API Key: SPARK-11470 URL: https://issues.apache.org/jira/browse/SPARK-11470 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-11469) Initial implementation

2015-11-02 Thread Yin Huai (JIRA)
Yin Huai created SPARK-11469: Summary: Initial implementation Key: SPARK-11469 URL: https://issues.apache.org/jira/browse/SPARK-11469 Project: Spark Issue Type: Sub-task Components: SQL

[jira] [Commented] (SPARK-11438) Allow users to define nondeterministic UDFs

2015-11-02 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986570#comment-14986570 ] Yin Huai commented on SPARK-11438: -- [~piccolbo] Thank you for your comments! As mentione

[jira] [Commented] (SPARK-11447) Null comparison requires type information but type extraction fails for complex types

2015-11-02 Thread Kapil Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986552#comment-14986552 ] Kapil Singh commented on SPARK-11447: - Hi Kevin, My bad, should have been more expli

[jira] [Commented] (SPARK-8582) Optimize checkpointing to avoid computing an RDD twice

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986474#comment-14986474 ] Apache Spark commented on SPARK-8582: - User 'zsxwing' has created a pull request for t

[jira] [Updated] (SPARK-9103) Tracking spark's memory usage

2015-11-02 Thread Zhang, Liye (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhang, Liye updated SPARK-9103: --- Attachment: Tracking Spark Memory Usage - Phase 1.pdf > Tracking spark's memory usage > --

[jira] [Updated] (SPARK-9103) Tracking spark's memory usage

2015-11-02 Thread Zhang, Liye (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhang, Liye updated SPARK-9103: --- Attachment: (was: Tracking Spark Memory Usage - Phase 1.pdf) > Tracking spark's memory usage > ---

[jira] [Updated] (SPARK-11236) Upgrade Tachyon dependency to 0.8.0

2015-11-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-11236: Assignee: Calvin Jia > Upgrade Tachyon dependency to 0.8.0 > --

[jira] [Resolved] (SPARK-11236) Upgrade Tachyon dependency to 0.8.0

2015-11-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-11236. - Resolution: Fixed Fix Version/s: 1.6.0 > Upgrade Tachyon dependency to 0.8.0 > ---

[jira] [Commented] (SPARK-11293) Spillable collections leak shuffle memory

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986413#comment-14986413 ] Apache Spark commented on SPARK-11293: -- User 'JoshRosen' has created a pull request

[jira] [Updated] (SPARK-11293) Spillable collections leak shuffle memory

2015-11-02 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11293: --- Target Version/s: 1.5.3, 1.6.0 (was: 1.6.0) > Spillable collections leak shuffle memory > --

[jira] [Updated] (SPARK-11293) Spillable collections leak shuffle memory

2015-11-02 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11293: --- Fix Version/s: 1.6.0 This was fixed for Spark 1.6.0 via a different patch (memory manager consolidat

[jira] [Comment Edited] (SPARK-11438) Allow users to define nondeterministic UDFs

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986390#comment-14986390 ] Xiangrui Meng edited comment on SPARK-11438 at 11/3/15 12:47 AM: --

[jira] [Commented] (SPARK-11438) Allow users to define nondeterministic UDFs

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986390#comment-14986390 ] Xiangrui Meng commented on SPARK-11438: --- [~piccolbo] `nondeterministic` means that

[jira] [Commented] (SPARK-11438) Allow users to define nondeterministic UDFs

2015-11-02 Thread Antonio Piccolboni (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986377#comment-14986377 ] Antonio Piccolboni commented on SPARK-11438: The problem with nondeterminism

[jira] [Updated] (SPARK-10592) deprecate weights and use coefficients instead in ML models

2015-11-02 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-10592: Affects Version/s: (was: 1.5.1) > deprecate weights and use coefficients instead in ML models > ---

[jira] [Commented] (SPARK-11466) FsHistoryProviderSuite breaks hadoop1 test

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986361#comment-14986361 ] Apache Spark commented on SPARK-11466: -- User 'vanzin' has created a pull request for

[jira] [Assigned] (SPARK-11466) FsHistoryProviderSuite breaks hadoop1 test

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11466: Assignee: Apache Spark (was: Marcelo Vanzin) > FsHistoryProviderSuite breaks hadoop1 test

[jira] [Assigned] (SPARK-11466) FsHistoryProviderSuite breaks hadoop1 test

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11466: Assignee: Marcelo Vanzin (was: Apache Spark) > FsHistoryProviderSuite breaks hadoop1 test

[jira] [Updated] (SPARK-10592) deprecate weights and use coefficients instead in ML models

2015-11-02 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-10592: Fix Version/s: (was: 1.6.1) 1.6.0 > deprecate weights and use coefficients instead i

[jira] [Updated] (SPARK-10592) deprecate weights and use coefficients instead in ML models

2015-11-02 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-10592: Assignee: Kai Jiang > deprecate weights and use coefficients instead in ML models > ---

[jira] [Updated] (SPARK-10592) deprecate weights and use coefficients instead in ML models

2015-11-02 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-10592: Affects Version/s: (was: 1.6.0) 1.5.1 > deprecate weights and use coefficients i

[jira] [Assigned] (SPARK-11467) Add Python API stddev/variance

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11467: Assignee: Apache Spark (was: Davies Liu) > Add Python API stddev/variance > -

[jira] [Resolved] (SPARK-10592) deprecate weights and use coefficients instead in ML models

2015-11-02 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-10592. - Resolution: Fixed Fix Version/s: 1.6.1 Issue resolved by pull request 9311 [https://github.com/apa

[jira] [Assigned] (SPARK-11467) Add Python API stddev/variance

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11467: Assignee: Davies Liu (was: Apache Spark) > Add Python API stddev/variance > -

[jira] [Commented] (SPARK-11467) Add Python API stddev/variance

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986341#comment-14986341 ] Apache Spark commented on SPARK-11467: -- User 'davies' has created a pull request for

[jira] [Resolved] (SPARK-11343) Regression Imposes doubles on prediction/label columns

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11343. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9296 [https://gi

[jira] [Updated] (SPARK-11343) Regression Imposes doubles on prediction/label columns

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11343: -- Assignee: Dominik Dahlem > Regression Imposes doubles on prediction/label columns > ---

[jira] [Updated] (SPARK-10286) Add @since annotation to pyspark.ml.param and pyspark.ml.*

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10286: -- Assignee: lidinghao > Add @since annotation to pyspark.ml.param and pyspark.ml.* >

[jira] [Created] (SPARK-11468) Add R API for stddev/variance

2015-11-02 Thread Davies Liu (JIRA)
Davies Liu created SPARK-11468: -- Summary: Add R API for stddev/variance Key: SPARK-11468 URL: https://issues.apache.org/jira/browse/SPARK-11468 Project: Spark Issue Type: New Feature

[jira] [Resolved] (SPARK-10286) Add @since annotation to pyspark.ml.param and pyspark.ml.*

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-10286. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9275 [https://gi

[jira] [Created] (SPARK-11467) Add Python API stddev/variance

2015-11-02 Thread Davies Liu (JIRA)
Davies Liu created SPARK-11467: -- Summary: Add Python API stddev/variance Key: SPARK-11467 URL: https://issues.apache.org/jira/browse/SPARK-11467 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-11424) Guard against MAPREDUCE-5918 by ensuring RecordReader is only closed once in *HadoopRDD

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986319#comment-14986319 ] Apache Spark commented on SPARK-11424: -- User 'JoshRosen' has created a pull request

[jira] [Commented] (SPARK-11466) FsHistoryProviderSuite breaks hadoop1 test

2015-11-02 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986316#comment-14986316 ] Marcelo Vanzin commented on SPARK-11466: Actually nevermind. That error is part o

[jira] [Commented] (SPARK-10727) Dataframe count is zero after 'except' operation

2015-11-02 Thread Rick Hillegas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986311#comment-14986311 ] Rick Hillegas commented on SPARK-10727: --- Can this issue be resolved now? Thanks. >

[jira] [Updated] (SPARK-10840) SparkSQL doesn't work well with JSON

2015-11-02 Thread Jordan Sarraf (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jordan Sarraf updated SPARK-10840: -- Priority: Minor (was: Trivial) > SparkSQL doesn't work well with JSON > --

[jira] [Commented] (SPARK-11466) FsHistoryProviderSuite breaks hadoop1 test

2015-11-02 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986304#comment-14986304 ] Marcelo Vanzin commented on SPARK-11466: More useful error is in the log file: {

[jira] [Created] (SPARK-11466) FsHistoryProviderSuite breaks hadoop1 test

2015-11-02 Thread Yin Huai (JIRA)
Yin Huai created SPARK-11466: Summary: FsHistoryProviderSuite breaks hadoop1 test Key: SPARK-11466 URL: https://issues.apache.org/jira/browse/SPARK-11466 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-10785) Scale QuantileDiscretizer using distributed binning

2015-11-02 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986293#comment-14986293 ] holdenk commented on SPARK-10785: - ping [~josephkb]for clarification :) > Scale Quantile

[jira] [Commented] (SPARK-8547) xgboost exploration

2015-11-02 Thread Meihua Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986288#comment-14986288 ] Meihua Wu commented on SPARK-8547: -- I have created a Spark Package to implement the XGBoo

[jira] [Updated] (SPARK-10304) Partition discovery does not throw an exception if the dir structure is invalid

2015-11-02 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-10304: --- Assignee: Liang-Chi Hsieh (was: Zhan Zhang) > Partition discovery does not throw an exception if the

[jira] [Commented] (SPARK-10785) Scale QuantileDiscretizer using distributed binning

2015-11-02 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986270#comment-14986270 ] holdenk commented on SPARK-10785: - Do we still want to sample the input? Looking at the p

[jira] [Updated] (SPARK-6441) Add Deflation/Schur Complement to Power Iteration Clustering for improved resilience to inter-class collisions

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6441: - Assignee: (was: Stephen Boesch) > Add Deflation/Schur Complement to Power Iteration Clustering

[jira] [Created] (SPARK-11465) Support multiple eigenvectors in power iteration clustering

2015-11-02 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-11465: - Summary: Support multiple eigenvectors in power iteration clustering Key: SPARK-11465 URL: https://issues.apache.org/jira/browse/SPARK-11465 Project: Spark

[jira] [Assigned] (SPARK-10429) MutableProjection should evaluate all expressions first and then update the mutable row

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10429: Assignee: Apache Spark (was: Davies Liu) > MutableProjection should evaluate all expressi

[jira] [Commented] (SPARK-10429) MutableProjection should evaluate all expressions first and then update the mutable row

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986238#comment-14986238 ] Apache Spark commented on SPARK-10429: -- User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-10429) MutableProjection should evaluate all expressions first and then update the mutable row

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10429: Assignee: Davies Liu (was: Apache Spark) > MutableProjection should evaluate all expressi

[jira] [Updated] (SPARK-11464) Flaky test: Streaming CheckpointSuite

2015-11-02 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout updated SPARK-11464: --- Summary: Flaky test: Streaming CheckpointSuite (was: Flaky test: Streaming Checkpoint Suite)

[jira] [Updated] (SPARK-11464) Flaky test: Streaming Checkpoint Suite

2015-11-02 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout updated SPARK-11464: --- Description: This test failed recently on an unrelated PR: https://amplab.cs.berkeley.edu/je

[jira] [Created] (SPARK-11464) Flaky test: Streaming Checkpoint Suite

2015-11-02 Thread Kay Ousterhout (JIRA)
Kay Ousterhout created SPARK-11464: -- Summary: Flaky test: Streaming Checkpoint Suite Key: SPARK-11464 URL: https://issues.apache.org/jira/browse/SPARK-11464 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-10429) MutableProjection should evaluate all expressions first and then update the mutable row

2015-11-02 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-10429: -- Assignee: Davies Liu (was: Wenchen Fan) > MutableProjection should evaluate all expressions f

[jira] [Updated] (SPARK-11262) Unit test for gradient, loss layers, memory management for multilayer perceptron

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11262: -- Target Version/s: 1.6.0 > Unit test for gradient, loss layers, memory management for multilayer

[jira] [Updated] (SPARK-11262) Unit test for gradient, loss layers, memory management for multilayer perceptron

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11262: -- Assignee: Alexander Ulanov > Unit test for gradient, loss layers, memory management for multila

[jira] [Updated] (SPARK-11336) Include a link to the source file in generated example code

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11336: -- Parent Issue: SPARK-11337 (was: SPARK-11137) > Include a link to the source file in generated

[jira] [Assigned] (SPARK-11359) Kinesis receiver does not checkpoint to DynamoDB if there is no new data.

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11359: Assignee: Burak Yavuz (was: Apache Spark) > Kinesis receiver does not checkpoint to Dynam

[jira] [Resolved] (SPARK-11383) Replace example code in mllib-naive-bayes.md/mllib-isotonic-regression.md using include_example

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11383. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9353 [https://gi

[jira] [Commented] (SPARK-11359) Kinesis receiver does not checkpoint to DynamoDB if there is no new data.

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986137#comment-14986137 ] Apache Spark commented on SPARK-11359: -- User 'brkyvz' has created a pull request for

[jira] [Updated] (SPARK-11383) Replace example code in mllib-naive-bayes.md/mllib-isotonic-regression.md using include_example

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11383: -- Assignee: Rishabh Bhardwaj > Replace example code in mllib-naive-bayes.md/mllib-isotonic-regres

[jira] [Assigned] (SPARK-11359) Kinesis receiver does not checkpoint to DynamoDB if there is no new data.

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11359: Assignee: Apache Spark (was: Burak Yavuz) > Kinesis receiver does not checkpoint to Dynam

[jira] [Updated] (SPARK-11336) Include a link to the source file in generated example code

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11336: -- Shepherd: Xiangrui Meng > Include a link to the source file in generated example code > ---

[jira] [Updated] (SPARK-11371) Make "mean" an alias for "avg" operator

2015-11-02 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11371: - Assignee: Ted Yu > Make "mean" an alias for "avg" operator > --- > >

[jira] [Resolved] (SPARK-11371) Make "mean" an alias for "avg" operator

2015-11-02 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-11371. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9332 [https://github.com/a

[jira] [Issue Comment Deleted] (SPARK-11337) Make example code in user guide testable

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11337: -- Comment: was deleted (was: I totally forgot I already made one ...) > Make example code in use

[jira] [Issue Comment Deleted] (SPARK-11337) Make example code in user guide testable

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11337: -- Comment: was deleted (was: I totally forgot I already made one ...) > Make example code in use

[jira] [Issue Comment Deleted] (SPARK-11337) Make example code in user guide testable

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11337: -- Comment: was deleted (was: I totally forgot I already made one ...) > Make example code in use

[jira] [Updated] (SPARK-11336) Include a link to the source file in generated example code

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11336: -- Issue Type: Sub-task (was: New Feature) Parent: SPARK-11137 > Include a link to the so

[jira] [Issue Comment Deleted] (SPARK-11337) Make example code in user guide testable

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11337: -- Comment: was deleted (was: I totally forgot I already made one ...) > Make example code in use

[jira] [Issue Comment Deleted] (SPARK-11337) Make example code in user guide testable

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11337: -- Comment: was deleted (was: I totally forgot I already made one ...) > Make example code in use

[jira] [Issue Comment Deleted] (SPARK-11337) Make example code in user guide testable

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11337: -- Comment: was deleted (was: I totally forgot I already made one ...) > Make example code in use

[jira] [Issue Comment Deleted] (SPARK-11337) Make example code in user guide testable

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11337: -- Comment: was deleted (was: I totally forgot I already made one ...) > Make example code in use

[jira] [Updated] (SPARK-11445) Replace example code in mllib-ensembles.md using include_example

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11445: -- Component/s: MLlib > Replace example code in mllib-ensembles.md using include_example > ---

[jira] [Updated] (SPARK-11445) Replace example code in mllib-ensembles.md using include_example

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11445: -- Target Version/s: 1.6.0 > Replace example code in mllib-ensembles.md using include_example > --

[jira] [Resolved] (SPARK-11358) Deprecate `runs` in k-means

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11358. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9322 [https://gi

[jira] [Updated] (SPARK-11445) Replace example code in mllib-ensembles.md using include_example

2015-11-02 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11445: -- Shepherd: Xusen Yin > Replace example code in mllib-ensembles.md using include_example > --

[jira] [Assigned] (SPARK-11462) Add JavaStreamingListener

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11462: Assignee: (was: Apache Spark) > Add JavaStreamingListener > -

[jira] [Commented] (SPARK-11462) Add JavaStreamingListener

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986106#comment-14986106 ] Apache Spark commented on SPARK-11462: -- User 'zsxwing' has created a pull request fo

[jira] [Assigned] (SPARK-11462) Add JavaStreamingListener

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11462: Assignee: Apache Spark > Add JavaStreamingListener > - > >

[jira] [Created] (SPARK-11463) SparkContext fail to create in non-main thread in Python

2015-11-02 Thread Davies Liu (JIRA)
Davies Liu created SPARK-11463: -- Summary: SparkContext fail to create in non-main thread in Python Key: SPARK-11463 URL: https://issues.apache.org/jira/browse/SPARK-11463 Project: Spark Issue Ty

[jira] [Commented] (SPARK-4557) Spark Streaming' foreachRDD method should accept a VoidFunction<...>, not a Function<..., Void>

2015-11-02 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986101#comment-14986101 ] Bryan Cutler commented on SPARK-4557: - Hi [~somi...@us.ibm.com], the right way to mak

[jira] [Created] (SPARK-11462) Add JavaStreamingListener

2015-11-02 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-11462: Summary: Add JavaStreamingListener Key: SPARK-11462 URL: https://issues.apache.org/jira/browse/SPARK-11462 Project: Spark Issue Type: Improvement C

  1   2   3   >