[jira] [Commented] (SPARK-4378) Make ALS more Java-friendly

[ https://issues.apache.org/jira/browse/SPARK-4378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209453#comment-14209453 ] Apache Spark commented on SPARK-4378: - User 'mengxr' has created a pull request for th

[jira] [Created] (SPARK-4378) Make ALS more Java-friendly

Xiangrui Meng created SPARK-4378: Summary: Make ALS more Java-friendly Key: SPARK-4378 URL: https://issues.apache.org/jira/browse/SPARK-4378 Project: Spark Issue Type: Improvement C

[jira] [Commented] (SPARK-4375) Assembly built with Maven is missing most of repl classes

[ https://issues.apache.org/jira/browse/SPARK-4375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209433#comment-14209433 ] Apache Spark commented on SPARK-4375: - User 'sryza' has created a pull request for thi

[jira] [Commented] (SPARK-2624) Datanucleus jars not accessible in yarn-cluster mode

[ https://issues.apache.org/jira/browse/SPARK-2624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209429#comment-14209429 ] Apache Spark commented on SPARK-2624: - User 'jimjh' has created a pull request for thi

[jira] [Commented] (SPARK-4375) Assembly built with Maven is missing most of repl classes

[ https://issues.apache.org/jira/browse/SPARK-4375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209416#comment-14209416 ] Patrick Wendell commented on SPARK-4375: So my favorite option now is just moving

[jira] [Commented] (SPARK-2468) Netty-based block server / client module

[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209407#comment-14209407 ] Aaron Davidson commented on SPARK-2468: --- My test was significantly less strict in it

[jira] [Commented] (SPARK-4341) Spark need to set num-executors automatically

[ https://issues.apache.org/jira/browse/SPARK-4341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209393#comment-14209393 ] Hong Shen commented on SPARK-4341: -- Hi, Sean Owen. Even spark can increasing/decreasing t

[jira] [Commented] (SPARK-4375) Assembly built with Maven is missing most of repl classes

[ https://issues.apache.org/jira/browse/SPARK-4375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209389#comment-14209389 ] Prashant Sharma commented on SPARK-4375: I was inclined towards not removing that

[jira] [Commented] (SPARK-4375) Assembly built with Maven is missing most of repl classes

[ https://issues.apache.org/jira/browse/SPARK-4375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209388#comment-14209388 ] Sandy Ryza commented on SPARK-4375: --- This all makes sense to me. Will put up a patch.

[jira] [Commented] (SPARK-4371) Spark crashes with JBoss Logging 3.6.1

[ https://issues.apache.org/jira/browse/SPARK-4371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209384#comment-14209384 ] Florent Pellerin commented on SPARK-4371: - Hello Sean, thank you for your message!

[jira] [Commented] (SPARK-3717) DecisionTree, RandomForest: Partition by feature

[ https://issues.apache.org/jira/browse/SPARK-3717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209377#comment-14209377 ] SUMANTH B B N commented on SPARK-3717: -- [~josephkb] [~manishamde] [~codedeft] archi

[jira] [Commented] (SPARK-1296) Make RDDs Covariant

[ https://issues.apache.org/jira/browse/SPARK-1296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209361#comment-14209361 ] Patrick Wendell commented on SPARK-1296: Because it's not possible to do without b

[jira] [Commented] (SPARK-1296) Make RDDs Covariant

[ https://issues.apache.org/jira/browse/SPARK-1296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209360#comment-14209360 ] Mohit Jaggi commented on SPARK-1296: Why is this a WONTFIX? Making RDDs covariant seem

[jira] [Updated] (SPARK-2450) Provide link to YARN executor logs on UI

[ https://issues.apache.org/jira/browse/SPARK-2450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2450: --- Assignee: Kostas Sakellis > Provide link to YARN executor logs on UI > ---

[jira] [Commented] (SPARK-2450) Provide link to YARN executor logs on UI

[ https://issues.apache.org/jira/browse/SPARK-2450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209350#comment-14209350 ] Kostas Sakellis commented on SPARK-2450: I'll pick up the work on this. > Provide

[jira] [Resolved] (SPARK-4256) MLLib BinaryClassificationMetricComputers try to divide by zero

[ https://issues.apache.org/jira/browse/SPARK-4256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-4256. -- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 3118 [https://githu

[jira] [Updated] (SPARK-4256) MLLib BinaryClassificationMetricComputers try to divide by zero

[ https://issues.apache.org/jira/browse/SPARK-4256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4256: - Assignee: Andrew Bullen > MLLib BinaryClassificationMetricComputers try to divide by zero > --

[jira] [Commented] (SPARK-4377) ZooKeeperPersistenceEngine: java.lang.IllegalStateException: Trying to deserialize a serialized ActorRef without an ActorSystem in scope.

[ https://issues.apache.org/jira/browse/SPARK-4377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209341#comment-14209341 ] Josh Rosen commented on SPARK-4377: --- I re-ran my suite on v1.1.0 and it passed, so this

[jira] [Commented] (SPARK-4267) Failing to launch jobs on Spark on YARN with Hadoop 2.5.0 or later

[ https://issues.apache.org/jira/browse/SPARK-4267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209325#comment-14209325 ] Matthew Daniel commented on SPARK-4267: --- My searches for {{ERROR}} didn't yield anyt

[jira] [Created] (SPARK-4377) ZooKeeperPersistenceEngine: java.lang.IllegalStateException: Trying to deserialize a serialized ActorRef without an ActorSystem in scope.

Josh Rosen created SPARK-4377: - Summary: ZooKeeperPersistenceEngine: java.lang.IllegalStateException: Trying to deserialize a serialized ActorRef without an ActorSystem in scope. Key: SPARK-4377 URL: https://issues.a

[jira] [Commented] (SPARK-4375) Assembly built with Maven is missing most of repl classes

[ https://issues.apache.org/jira/browse/SPARK-4375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209314#comment-14209314 ] Patrick Wendell commented on SPARK-4375: One thing we could add onto that to make

[jira] [Commented] (SPARK-4375) Assembly built with Maven is missing most of repl classes

[ https://issues.apache.org/jira/browse/SPARK-4375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209305#comment-14209305 ] Patrick Wendell commented on SPARK-4375: Hey Sandy, What about the following solu

[jira] [Comment Edited] (SPARK-4375) Assembly built with Maven is missing most of repl classes

[ https://issues.apache.org/jira/browse/SPARK-4375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209305#comment-14209305 ] Patrick Wendell edited comment on SPARK-4375 at 11/13/14 5:37 AM: --

[jira] [Commented] (SPARK-2620) case class cannot be used as key for reduce

[ https://issues.apache.org/jira/browse/SPARK-2620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209255#comment-14209255 ] Derrick Burns commented on SPARK-2620: -- I also hit the bug when running Spark 1.1.0 i

[jira] [Commented] (SPARK-4267) Failing to launch jobs on Spark on YARN with Hadoop 2.5.0 or later

[ https://issues.apache.org/jira/browse/SPARK-4267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209239#comment-14209239 ] Kousuke Saruta commented on SPARK-4267: --- Hi [~bugzi...@mdaniel.scdi.com]. The NPE is

[jira] [Commented] (SPARK-4326) unidoc is broken on master

[ https://issues.apache.org/jira/browse/SPARK-4326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209242#comment-14209242 ] Aaron Davidson commented on SPARK-4326: --- [~mengxr] perhaps you pointed to the wrong

[jira] [Commented] (SPARK-4267) Failing to launch jobs on Spark on YARN with Hadoop 2.5.0 or later

[ https://issues.apache.org/jira/browse/SPARK-4267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209231#comment-14209231 ] Matthew Daniel commented on SPARK-4267: --- I rebuilt the assembly using {{./sbt/sbt -D

[jira] [Commented] (SPARK-4375) Assembly built with Maven is missing most of repl classes

[ https://issues.apache.org/jira/browse/SPARK-4375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209217#comment-14209217 ] Sandy Ryza commented on SPARK-4375: --- The issue here is that the activeByDefault Maven op

[jira] [Updated] (SPARK-4294) UnionDStream stream should express the requirements in the same way as TransformedDStream

[ https://issues.apache.org/jira/browse/SPARK-4294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-4294: - Summary: UnionDStream stream should express the requirements in the same way as TransformedDStream

[jira] [Assigned] (SPARK-4294) The same function should have the same realization.

[ https://issues.apache.org/jira/browse/SPARK-4294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das reassigned SPARK-4294: Assignee: Tathagata Das > The same function should have the same realization. > ---

[jira] [Commented] (SPARK-4267) Failing to launch jobs on Spark on YARN with Hadoop 2.5.0 or later

[ https://issues.apache.org/jira/browse/SPARK-4267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209183#comment-14209183 ] Matthew Daniel commented on SPARK-4267: --- Apologies, I don't know if we want log verb

[jira] [Commented] (SPARK-750) LocalSparkContext should be included in Spark JAR

[ https://issues.apache.org/jira/browse/SPARK-750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209167#comment-14209167 ] Nathan M commented on SPARK-750: +1 This shouldnt be hard, in maven its a plugin to add in

[jira] [Commented] (SPARK-4326) unidoc is broken on master

[ https://issues.apache.org/jira/browse/SPARK-4326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209170#comment-14209170 ] Marcelo Vanzin commented on SPARK-4326: --- Hmm, but core/pom.xml defines an explicit d

[jira] [Updated] (SPARK-4375) Assembly built with Maven is missing most of repl classes

[ https://issues.apache.org/jira/browse/SPARK-4375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated SPARK-4375: -- Summary: Assembly built with Maven is missing most of repl classes (was: assembly built with Maven is m

[jira] [Resolved] (SPARK-4370) Limit cores used by Netty transfer service based on executor size

[ https://issues.apache.org/jira/browse/SPARK-4370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-4370. Resolution: Fixed Fix Version/s: 1.2.0 > Limit cores used by Netty transfer service based on

[jira] [Resolved] (SPARK-4373) MLlib unit tests failed maven test

[ https://issues.apache.org/jira/browse/SPARK-4373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-4373. --- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 3235 [https://github.com/

[jira] [Closed] (SPARK-4364) Some variable types in org.apache.spark.streaming.JavaAPISuite are wrong

[ https://issues.apache.org/jira/browse/SPARK-4364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu closed SPARK-4364. --- Resolution: Duplicate Sorry. Didn't notice SPARK-4297 > Some variable types in org.apache.spark.strea

[jira] [Commented] (SPARK-3325) Add a parameter to the method print in class DStream.

[ https://issues.apache.org/jira/browse/SPARK-3325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209153#comment-14209153 ] Apache Spark commented on SPARK-3325: - User 'watermen' has created a pull request for

[jira] [Created] (SPARK-4376) Put external modules behind build profiles

Patrick Wendell created SPARK-4376: -- Summary: Put external modules behind build profiles Key: SPARK-4376 URL: https://issues.apache.org/jira/browse/SPARK-4376 Project: Spark Issue Type: Impr

[jira] [Closed] (SPARK-4179) Streaming Linear Regression example has type mismatch

[ https://issues.apache.org/jira/browse/SPARK-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng closed SPARK-4179. Resolution: Not a Problem Assignee: Xiangrui Meng (was: Anant Daksh Asthana) I'm closing this

[jira] [Updated] (SPARK-4326) unidoc is broken on master

[ https://issues.apache.org/jira/browse/SPARK-4326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4326: - Priority: Critical (was: Major) > unidoc is broken on master > -- > >

[jira] [Commented] (SPARK-4326) unidoc is broken on master

[ https://issues.apache.org/jira/browse/SPARK-4326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209058#comment-14209058 ] Xiangrui Meng commented on SPARK-4326: -- [~vanzin] Thanks for looking into this issue!

[jira] [Updated] (SPARK-4375) assembly built with Maven is missing most of repl classes

[ https://issues.apache.org/jira/browse/SPARK-4375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated SPARK-4375: -- Description: In particular, the ones in the split scala-2.10/scala-2.11 directories aren't being added

[jira] [Created] (SPARK-4375) assembly built with Maven is missing most of repl classes

Sandy Ryza created SPARK-4375: - Summary: assembly built with Maven is missing most of repl classes Key: SPARK-4375 URL: https://issues.apache.org/jira/browse/SPARK-4375 Project: Spark Issue Type:

[jira] [Commented] (SPARK-4326) unidoc is broken on master

[ https://issues.apache.org/jira/browse/SPARK-4326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208998#comment-14208998 ] Marcelo Vanzin commented on SPARK-4326: --- So, this is really weird. Unidoc is run by

[jira] [Deleted] (SPARK-4374) LibraryClientSuite has been flaky

[ https://issues.apache.org/jira/browse/SPARK-4374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin deleted SPARK-4374: --- > LibraryClientSuite has been flaky > - > > Key: SPARK-43

[jira] [Resolved] (SPARK-2672) Support compression in wholeFile()

[ https://issues.apache.org/jira/browse/SPARK-2672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-2672. --- Resolution: Fixed Fix Version/s: 1.3.0 1.2.0 Issue resolved by pull request

[jira] [Commented] (SPARK-3630) Identify cause of Kryo+Snappy PARSING_ERROR

[ https://issues.apache.org/jira/browse/SPARK-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208938#comment-14208938 ] Ryan Williams commented on SPARK-3630: -- hrm, OK, I do recall some confusion about whe

[jira] [Created] (SPARK-4374) LibraryClientSuite has been flaky

Reynold Xin created SPARK-4374: -- Summary: LibraryClientSuite has been flaky Key: SPARK-4374 URL: https://issues.apache.org/jira/browse/SPARK-4374 Project: Spark Issue Type: Bug Repor

[jira] [Commented] (SPARK-3665) Java API for GraphX

[ https://issues.apache.org/jira/browse/SPARK-3665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208916#comment-14208916 ] Apache Spark commented on SPARK-3665: - User 'ankurdave' has created a pull request for

[jira] [Updated] (SPARK-3665) Java API for GraphX

[ https://issues.apache.org/jira/browse/SPARK-3665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-3665: -- Description: The Java API will wrap the Scala API in a similar manner as JavaRDD. Components will inclu

[jira] [Commented] (SPARK-4373) MLlib unit tests failed maven test

[ https://issues.apache.org/jira/browse/SPARK-4373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208909#comment-14208909 ] Apache Spark commented on SPARK-4373: - User 'mengxr' has created a pull request for th

[jira] [Commented] (SPARK-3630) Identify cause of Kryo+Snappy PARSING_ERROR

[ https://issues.apache.org/jira/browse/SPARK-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208908#comment-14208908 ] Josh Rosen commented on SPARK-3630: --- Hi [~rdub], Thanks for posting those extra logs; I

[jira] [Updated] (SPARK-4373) MLlib unit tests failed maven test

[ https://issues.apache.org/jira/browse/SPARK-4373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4373: - Priority: Critical (was: Major) > MLlib unit tests failed maven test > --

[jira] [Created] (SPARK-4373) MLlib unit tests failed maven test

Xiangrui Meng created SPARK-4373: Summary: MLlib unit tests failed maven test Key: SPARK-4373 URL: https://issues.apache.org/jira/browse/SPARK-4373 Project: Spark Issue Type: Bug Co

[jira] [Commented] (SPARK-3630) Identify cause of Kryo+Snappy PARSING_ERROR

[ https://issues.apache.org/jira/browse/SPARK-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208876#comment-14208876 ] Ryan Williams commented on SPARK-3630: -- [~joshrosen] can you see [this dropbox folde

[jira] [Commented] (SPARK-3630) Identify cause of Kryo+Snappy PARSING_ERROR

[ https://issues.apache.org/jira/browse/SPARK-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208863#comment-14208863 ] Ryan Williams commented on SPARK-3630: -- [~joshrosen] I do have access to the logs, th

[jira] [Commented] (SPARK-3630) Identify cause of Kryo+Snappy PARSING_ERROR

[ https://issues.apache.org/jira/browse/SPARK-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208857#comment-14208857 ] Ryan Williams commented on SPARK-3630: -- I ran a few more instances of this job, toggl

[jira] [Resolved] (SPARK-3667) Deprecate Graph#unpersistVertices and document how to correctly unpersist graphs

[ https://issues.apache.org/jira/browse/SPARK-3667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave resolved SPARK-3667. --- Resolution: Won't Fix Target Version/s: (was: 1.2.0) > Deprecate Graph#unpersistVertices a

[jira] [Updated] (SPARK-4369) TreeModel.predict does not work with RDD

[ https://issues.apache.org/jira/browse/SPARK-4369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4369: - Assignee: Davies Liu > TreeModel.predict does not work with RDD >

[jira] [Resolved] (SPARK-4369) TreeModel.predict does not work with RDD

[ https://issues.apache.org/jira/browse/SPARK-4369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-4369. -- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 3230 [https://githu

[jira] [Commented] (SPARK-2996) Standalone and Yarn have different settings for adding the user classpath first

[ https://issues.apache.org/jira/browse/SPARK-2996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208767#comment-14208767 ] Apache Spark commented on SPARK-2996: - User 'vanzin' has created a pull request for th

[jira] [Commented] (SPARK-3630) Identify cause of Kryo+Snappy PARSING_ERROR

[ https://issues.apache.org/jira/browse/SPARK-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208766#comment-14208766 ] Josh Rosen commented on SPARK-3630: --- Hi [~rdub], Thanks for the detailed logs. Do you

[jira] [Resolved] (SPARK-3666) Extract interfaces for EdgeRDD and VertexRDD

[ https://issues.apache.org/jira/browse/SPARK-3666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-3666. Resolution: Fixed Fix Version/s: 1.2.0 > Extract interfaces for EdgeRDD and VertexRDD > -

[jira] [Updated] (SPARK-3660) Initial RDD for updateStateByKey transformation

[ https://issues.apache.org/jira/browse/SPARK-3660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-3660: - Priority: Major (was: Minor) > Initial RDD for updateStateByKey transformation >

[jira] [Resolved] (SPARK-3660) Initial RDD for updateStateByKey transformation

[ https://issues.apache.org/jira/browse/SPARK-3660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-3660. -- Resolution: Fixed Fix Version/s: 1.3.0 > Initial RDD for updateStateByKey transformation

[jira] [Commented] (SPARK-4372) Make LR and SVM's default parameters consistent in Scala and Python

[ https://issues.apache.org/jira/browse/SPARK-4372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208597#comment-14208597 ] Apache Spark commented on SPARK-4372: - User 'mengxr' has created a pull request for th

[jira] [Comment Edited] (SPARK-4267) Failing to launch jobs on Spark on YARN with Hadoop 2.5.0 or later

[ https://issues.apache.org/jira/browse/SPARK-4267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208595#comment-14208595 ] Kousuke Saruta edited comment on SPARK-4267 at 11/12/14 8:07 PM: ---

[jira] [Commented] (SPARK-4267) Failing to launch jobs on Spark on YARN with Hadoop 2.5.0 or later

[ https://issues.apache.org/jira/browse/SPARK-4267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208595#comment-14208595 ] Kousuke Saruta commented on SPARK-4267: --- Hi [~ozawa], On my YARN-2.5.1(JDK 1.7.0_60)

[jira] [Updated] (SPARK-3039) Spark assembly for new hadoop API (hadoop 2) contains avro-mapred for hadoop 1 API

[ https://issues.apache.org/jira/browse/SPARK-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3039: - Fix Version/s: (was: 1.1.1) > Spark assembly for new hadoop API (hadoop 2) contains avro-mapred for ha

[jira] [Reopened] (SPARK-3039) Spark assembly for new hadoop API (hadoop 2) contains avro-mapred for hadoop 1 API

[ https://issues.apache.org/jira/browse/SPARK-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-3039: -- > Spark assembly for new hadoop API (hadoop 2) contains avro-mapred for hadoop > 1 API > --

[jira] [Created] (SPARK-4372) Make LR and SVM's default parameters consistent in Scala and Python

Xiangrui Meng created SPARK-4372: Summary: Make LR and SVM's default parameters consistent in Scala and Python Key: SPARK-4372 URL: https://issues.apache.org/jira/browse/SPARK-4372 Project: Spark

[jira] [Commented] (SPARK-4371) Spark crashes with JBoss Logging 3.6.1

[ https://issues.apache.org/jira/browse/SPARK-4371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208525#comment-14208525 ] Sean Owen commented on SPARK-4371: -- SLF4J is pretty backwards compatible. The right thing

[jira] [Comment Edited] (SPARK-3717) DecisionTree, RandomForest: Partition by feature

[ https://issues.apache.org/jira/browse/SPARK-3717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208472#comment-14208472 ] Manish Amde edited comment on SPARK-3717 at 11/12/14 7:02 PM: --

[jira] [Commented] (SPARK-3717) DecisionTree, RandomForest: Partition by feature

[ https://issues.apache.org/jira/browse/SPARK-3717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208472#comment-14208472 ] Manish Amde commented on SPARK-3717: [~bbnsumanth] Look forward to your details of you

[jira] [Closed] (SPARK-3315) Support hyperparameter tuning

[ https://issues.apache.org/jira/browse/SPARK-3315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng closed SPARK-3315. Resolution: Fixed Fix Version/s: 1.2.0 CrossValidator and ParamGridBuilder were included in t

[jira] [Created] (SPARK-4371) Spark crashes with JBoss Logging 3.6.1

Florent Pellerin created SPARK-4371: --- Summary: Spark crashes with JBoss Logging 3.6.1 Key: SPARK-4371 URL: https://issues.apache.org/jira/browse/SPARK-4371 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-3530) Pipeline and Parameters

[ https://issues.apache.org/jira/browse/SPARK-3530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-3530. -- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 3099 [https://githu

[jira] [Commented] (SPARK-4370) Limit cores used by Netty transfer service based on executor size

[ https://issues.apache.org/jira/browse/SPARK-4370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208391#comment-14208391 ] Apache Spark commented on SPARK-4370: - User 'aarondav' has created a pull request for

[jira] [Commented] (SPARK-4369) TreeModel.predict does not work with RDD

[ https://issues.apache.org/jira/browse/SPARK-4369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208377#comment-14208377 ] Apache Spark commented on SPARK-4369: - User 'davies' has created a pull request for th

[jira] [Commented] (SPARK-3633) Fetches failure observed after SPARK-2711

[ https://issues.apache.org/jira/browse/SPARK-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208378#comment-14208378 ] Cristian Opris commented on SPARK-3633: --- At first sight (haven't tested this) the pr

[jira] [Created] (SPARK-4370) Limit cores used by Netty transfer service based on executor size

Aaron Davidson created SPARK-4370: - Summary: Limit cores used by Netty transfer service based on executor size Key: SPARK-4370 URL: https://issues.apache.org/jira/browse/SPARK-4370 Project: Spark

[jira] [Commented] (SPARK-1014) MultilogisticRegressionWithSGD

[ https://issues.apache.org/jira/browse/SPARK-1014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208352#comment-14208352 ] Kun Yang commented on SPARK-1014: - I am not sure if you can find the pr on the repository.

[jira] [Created] (SPARK-4369) TreeModel.predict does not work with RDD

Davies Liu created SPARK-4369: - Summary: TreeModel.predict does not work with RDD Key: SPARK-4369 URL: https://issues.apache.org/jira/browse/SPARK-4369 Project: Spark Issue Type: Bug Co

[jira] [Comment Edited] (SPARK-3633) Fetches failure observed after SPARK-2711

[ https://issues.apache.org/jira/browse/SPARK-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208318#comment-14208318 ] Cristian Opris edited comment on SPARK-3633 at 11/12/14 5:48 PM: ---

[jira] [Commented] (SPARK-3633) Fetches failure observed after SPARK-2711

[ https://issues.apache.org/jira/browse/SPARK-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208318#comment-14208318 ] Cristian Opris commented on SPARK-3633: --- This looks like a memory leak in Connection

[jira] [Created] (SPARK-4368) Ceph integration?

Serge Smertin created SPARK-4368: Summary: Ceph integration? Key: SPARK-4368 URL: https://issues.apache.org/jira/browse/SPARK-4368 Project: Spark Issue Type: Bug Components: Input/O

[jira] [Commented] (SPARK-1867) Spark Documentation Error causes java.lang.IllegalStateException: unread block data

[ https://issues.apache.org/jira/browse/SPARK-1867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208258#comment-14208258 ] Anson Abraham commented on SPARK-1867: -- I'm running 1.1 (standalone) w/o yarn on CDH

[jira] [Resolved] (SPARK-1245) Can't read EMR HBase cluster from properly built Cloudera Spark Cluster.

[ https://issues.apache.org/jira/browse/SPARK-1245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1245. -- Resolution: Not a Problem I'm guessing this is now either obsolete, or, a case of matching HBase / Hadoo

[jira] [Commented] (SPARK-1014) MultilogisticRegressionWithSGD

[ https://issues.apache.org/jira/browse/SPARK-1014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208226#comment-14208226 ] Sean Owen commented on SPARK-1014: -- I'm curious if this is still active -- where was the

[jira] [Comment Edited] (SPARK-3633) Fetches failure observed after SPARK-2711

[ https://issues.apache.org/jira/browse/SPARK-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208028#comment-14208028 ] Cristian Opris edited comment on SPARK-3633 at 11/12/14 3:36 PM: ---

[jira] [Updated] (SPARK-3056) Sort-based Aggregation

[ https://issues.apache.org/jira/browse/SPARK-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-3056: - Issue Type: Sub-task (was: Improvement) Parent: SPARK-4366 > Sort-based Aggregation > ---

[jira] [Comment Edited] (SPARK-3633) Fetches failure observed after SPARK-2711

[ https://issues.apache.org/jira/browse/SPARK-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208028#comment-14208028 ] Cristian Opris edited comment on SPARK-3633 at 11/12/14 3:20 PM: ---

[jira] [Updated] (SPARK-4367) Process the "distinct" value before shuffling for aggregation

[ https://issues.apache.org/jira/browse/SPARK-4367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-4367: - Issue Type: Sub-task (was: Improvement) Parent: SPARK-4366 > Process the "distinct" value before

[jira] [Updated] (SPARK-4233) Simplify the Aggregation Function implementation

[ https://issues.apache.org/jira/browse/SPARK-4233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-4233: - Issue Type: Sub-task (was: Improvement) Parent: SPARK-4366 > Simplify the Aggregation Function im

[jira] [Created] (SPARK-4367) Process the "distinct" value before shuffling for aggregation

Cheng Hao created SPARK-4367: Summary: Process the "distinct" value before shuffling for aggregation Key: SPARK-4367 URL: https://issues.apache.org/jira/browse/SPARK-4367 Project: Spark Issue Ty

[jira] [Created] (SPARK-4366) Aggregation Optimization

Cheng Hao created SPARK-4366: Summary: Aggregation Optimization Key: SPARK-4366 URL: https://issues.apache.org/jira/browse/SPARK-4366 Project: Spark Issue Type: Improvement Components:

[jira] [Commented] (SPARK-4320) JavaPairRDD should supply a saveAsNewHadoopDataset which takes a Job object

[ https://issues.apache.org/jira/browse/SPARK-4320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208084#comment-14208084 ] Corey J. Nolet commented on SPARK-4320: --- Since this is a simple change, I wanted to

[jira] [Commented] (SPARK-4365) Remove unnecessary filter call on records returned from parquet library

[ https://issues.apache.org/jira/browse/SPARK-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208068#comment-14208068 ] Apache Spark commented on SPARK-4365: - User 'saucam' has created a pull request for th

[jira] [Created] (SPARK-4365) Remove unnecessary filter call on records returned from parquet library

Yash Datta created SPARK-4365: - Summary: Remove unnecessary filter call on records returned from parquet library Key: SPARK-4365 URL: https://issues.apache.org/jira/browse/SPARK-4365 Project: Spark

  1   2   >