[jira] [Commented] (SPARK-10518) Update code examples in spark.ml user guide to use LIBSVM data source instead of MLUtils

2015-09-11 Thread shimizu yoshihiro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741922#comment-14741922 ] shimizu yoshihiro commented on SPARK-10518: --- [~mengxr] Thank you for review on

[jira] [Updated] (SPARK-10574) HashingTF should use MurmurHash3

2015-09-11 Thread Simeon Simeonov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simeon Simeonov updated SPARK-10574: Description: {{HashingTF}} uses the Scala native hashing {{##}} implementation. There are

[jira] [Created] (SPARK-10574) HashingTF should use MurmurHash3

2015-09-11 Thread Simeon Simeonov (JIRA)
Simeon Simeonov created SPARK-10574: --- Summary: HashingTF should use MurmurHash3 Key: SPARK-10574 URL: https://issues.apache.org/jira/browse/SPARK-10574 Project: Spark Issue Type: Improvemen

[jira] [Created] (SPARK-10573) IndexToString transformSchema adds output field as DoubleType

2015-09-11 Thread Nick Pritchard (JIRA)
Nick Pritchard created SPARK-10573: -- Summary: IndexToString transformSchema adds output field as DoubleType Key: SPARK-10573 URL: https://issues.apache.org/jira/browse/SPARK-10573 Project: Spark

[jira] [Commented] (SPARK-10267) Add @Since annotation to ml.util

2015-09-11 Thread Ehsan Mohyedin Kermani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741823#comment-14741823 ] Ehsan Mohyedin Kermani commented on SPARK-10267: I don't think, util can

[jira] [Commented] (SPARK-8571) spark streaming hanging processes upon build exit

2015-09-11 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741824#comment-14741824 ] Tathagata Das commented on SPARK-8571: -- Is this still an issue? > spark streaming ha

[jira] [Commented] (SPARK-7122) KafkaUtils.createDirectStream - unreasonable processing time in absence of load

2015-09-11 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741822#comment-14741822 ] Tathagata Das commented on SPARK-7122: -- Now that Spark 1.5.0 been release, could you

[jira] [Resolved] (SPARK-8755) Streaming application from checkpoint will fail to load in security mode.

2015-09-11 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-8755. -- Resolution: Duplicate > Streaming application from checkpoint will fail to load in security mode

[jira] [Resolved] (SPARK-3283) Receivers sometimes do not get spread out to multiple nodes

2015-09-11 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-3283. -- Resolution: Fixed Fix Version/s: 1.5.0 > Receivers sometimes do not get spread out to mul

[jira] [Resolved] (SPARK-3553) Spark Streaming app streams files that have already been streamed in an endless loop

2015-09-11 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-3553. -- Resolution: Won't Fix > Spark Streaming app streams files that have already been streamed in an

[jira] [Commented] (SPARK-3553) Spark Streaming app streams files that have already been streamed in an endless loop

2015-09-11 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741817#comment-14741817 ] Tathagata Das commented on SPARK-3553: -- Because of the absence of any activity, I am

[jira] [Commented] (SPARK-3449) Akka-based receiver can't find messages defined in uploaded jar

2015-09-11 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741815#comment-14741815 ] Tathagata Das commented on SPARK-3449: -- This should be taken care of in the refactori

[jira] [Assigned] (SPARK-10266) Add @Since annotation to ml.tuning

2015-09-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10266: Assignee: (was: Apache Spark) > Add @Since annotation to ml.tuning > -

[jira] [Commented] (SPARK-3210) Flume Polling Receiver must be more tolerant to connection failures.

2015-09-11 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741809#comment-14741809 ] Tathagata Das commented on SPARK-3210: -- Is this still a relevant issue? > Flume Poll

[jira] [Commented] (SPARK-10266) Add @Since annotation to ml.tuning

2015-09-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741808#comment-14741808 ] Apache Spark commented on SPARK-10266: -- User 'ehsanmok' has created a pull request f

[jira] [Resolved] (SPARK-2803) add Kafka stream feature for fetch messages from specified starting offset position

2015-09-11 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-2803. -- Resolution: Fixed Fix Version/s: 1.3.0 This feature request has been satisfied by the new

[jira] [Assigned] (SPARK-10266) Add @Since annotation to ml.tuning

2015-09-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10266: Assignee: Apache Spark > Add @Since annotation to ml.tuning >

[jira] [Commented] (SPARK-7872) Transaction stack trace with Spark Streaming and Flume

2015-09-11 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741804#comment-14741804 ] Tathagata Das commented on SPARK-7872: -- Is this still a problem? > Transaction stack

[jira] [Resolved] (SPARK-7942) Receiver's life cycle is inconsistent with streaming job.

2015-09-11 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-7942. -- Resolution: Fixed Fix Version/s: 1.5.0 > Receiver's life cycle is inconsistent with strea

[jira] [Commented] (SPARK-7942) Receiver's life cycle is inconsistent with streaming job.

2015-09-11 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741800#comment-14741800 ] Tathagata Das commented on SPARK-7942: -- This has been resolved in Spark 1.5.0 where w

[jira] [Resolved] (SPARK-7385) Add RDD.foreachPartitionWithIndex to allow the index to be used in transactions in streaming apps

2015-09-11 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-7385. -- Resolution: Won't Fix > Add RDD.foreachPartitionWithIndex to allow the index to be used in > tr

[jira] [Resolved] (SPARK-8591) Block failed to unroll to memory should not be replicated for MEMORY_ONLY_2 StorageLevel

2015-09-11 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-8591. -- Resolution: Won't Fix > Block failed to unroll to memory should not be replicated for MEMORY_ONL

[jira] [Commented] (SPARK-3982) receiverStream in Python API

2015-09-11 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741796#comment-14741796 ] Tathagata Das commented on SPARK-3982: -- This is not currently in the roadmap, so I am

[jira] [Resolved] (SPARK-3982) receiverStream in Python API

2015-09-11 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-3982. -- Resolution: Won't Fix > receiverStream in Python API > > >

[jira] [Commented] (SPARK-7040) Explore receiver-less DStream for Flume

2015-09-11 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741791#comment-14741791 ] Tathagata Das commented on SPARK-7040: -- Is this still relevant? If not, let close thi

[jira] [Assigned] (SPARK-10265) Add @Since annotation to ml.regression

2015-09-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10265: Assignee: Apache Spark > Add @Since annotation to ml.regression >

[jira] [Assigned] (SPARK-10265) Add @Since annotation to ml.regression

2015-09-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10265: Assignee: (was: Apache Spark) > Add @Since annotation to ml.regression > -

[jira] [Commented] (SPARK-10265) Add @Since annotation to ml.regression

2015-09-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741755#comment-14741755 ] Apache Spark commented on SPARK-10265: -- User 'ehsanmok' has created a pull request f

[jira] [Commented] (SPARK-10564) ThreadingSuite: assertions in threads don't fail the test

2015-09-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741752#comment-14741752 ] Apache Spark commented on SPARK-10564: -- User 'andrewor14' has created a pull request

[jira] [Comment Edited] (SPARK-10528) spark-shell throws java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable.

2015-09-11 Thread Bill Chambers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741715#comment-14741715 ] Bill Chambers edited comment on SPARK-10528 at 9/11/15 11:17 PM: --

[jira] [Commented] (SPARK-10528) spark-shell throws java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable.

2015-09-11 Thread Bill Chambers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741715#comment-14741715 ] Bill Chambers commented on SPARK-10528: --- This came up for me when I used the spark_

[jira] [Resolved] (SPARK-6803) [SparkR] Support SparkR Streaming

2015-09-11 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-6803. -- Resolution: Won't Fix > [SparkR] Support SparkR Streaming > - >

[jira] [Commented] (SPARK-6803) [SparkR] Support SparkR Streaming

2015-09-11 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741701#comment-14741701 ] Tathagata Das commented on SPARK-6803: -- I am closing this issue as this is not in the

[jira] [Assigned] (SPARK-10543) Peak Execution Memory Quantile should be Per-task Basis

2015-09-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10543: Assignee: (was: Apache Spark) > Peak Execution Memory Quantile should be Per-task Basi

[jira] [Commented] (SPARK-10543) Peak Execution Memory Quantile should be Per-task Basis

2015-09-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741692#comment-14741692 ] Apache Spark commented on SPARK-10543: -- User 'saurfang' has created a pull request f

[jira] [Assigned] (SPARK-10543) Peak Execution Memory Quantile should be Per-task Basis

2015-09-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10543: Assignee: Apache Spark > Peak Execution Memory Quantile should be Per-task Basis > ---

[jira] [Commented] (SPARK-10569) Kryo serialization fails on sortByKey operation on registered RDDs

2015-09-11 Thread Glenn Strycker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741638#comment-14741638 ] Glenn Strycker commented on SPARK-10569: Note that I am still using 1.3.0. I not

[jira] [Commented] (SPARK-10251) Some internal spark classes are not registered with kryo

2015-09-11 Thread Glenn Strycker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741639#comment-14741639 ] Glenn Strycker commented on SPARK-10251: I opened a ticket earlier today that mig

[jira] [Commented] (SPARK-10569) Kryo serialization fails on sortByKey operation on registered RDDs

2015-09-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741633#comment-14741633 ] Josh Rosen commented on SPARK-10569: This actually sounds like an instance of SPARK-1

[jira] [Commented] (SPARK-10569) Kryo serialization fails on sortByKey operation on registered RDDs

2015-09-11 Thread Glenn Strycker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741627#comment-14741627 ] Glenn Strycker commented on SPARK-10569: It looks very similar to this thread: h

[jira] [Resolved] (SPARK-9014) Allow Python spark API to use built-in exponential operator

2015-09-11 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-9014. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8658 [https://github.com/

[jira] [Commented] (SPARK-10568) Error thrown in stopping one component in SparkContext.stop() doesn't allow other components to be stopped

2015-09-11 Thread Jian Feng Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741621#comment-14741621 ] Jian Feng Zhang commented on SPARK-10568: - Make sense to ensure each individual c

[jira] [Commented] (SPARK-8345) Add an SQL node as a feature transformer

2015-09-11 Thread Simeon Simeonov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741618#comment-14741618 ] Simeon Simeonov commented on SPARK-8345: This would be very nice, especially as it

[jira] [Resolved] (SPARK-10564) ThreadingSuite: assertions in threads don't fail the test

2015-09-11 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10564. --- Resolution: Fixed Fix Version/s: 1.5.1 1.6.0 > ThreadingSuite: assertions i

[jira] [Resolved] (SPARK-9998) Create local intersect operator

2015-09-11 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-9998. -- Resolution: Fixed Fix Version/s: 1.6.0 Target Version/s: 1.6.0 > Create local intersect

[jira] [Resolved] (SPARK-9994) Create local TopK operator

2015-09-11 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-9994. -- Resolution: Fixed Fix Version/s: 1.6.0 > Create local TopK operator > --

[jira] [Resolved] (SPARK-9992) Create local sample operator

2015-09-11 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-9992. -- Resolution: Fixed Fix Version/s: 1.6.0 > Create local sample operator > -

[jira] [Commented] (SPARK-10569) Kryo serialization fails on sortByKey operation on registered RDDs

2015-09-11 Thread Glenn Strycker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741582#comment-14741582 ] Glenn Strycker commented on SPARK-10569: Is this issue related to HIVE-7540 or SP

[jira] [Commented] (SPARK-7012) Add support for NOT NULL modifier for column definitions on DDLParser

2015-09-11 Thread Sudhakar Thota (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741558#comment-14741558 ] Sudhakar Thota commented on SPARK-7012: --- Sameer, I am not working on this. Please pr

[jira] [Commented] (SPARK-10569) Kryo serialization fails on sortByKey operation on registered RDDs

2015-09-11 Thread Glenn Strycker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741554#comment-14741554 ] Glenn Strycker commented on SPARK-10569: I'm also seeing the occasional "User cla

[jira] [Commented] (SPARK-10442) select cast('false' as boolean) returns true

2015-09-11 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741550#comment-14741550 ] Yin Huai commented on SPARK-10442: -- We need to document this behavior change in our rele

[jira] [Updated] (SPARK-10442) select cast('false' as boolean) returns true

2015-09-11 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-10442: - Assignee: Wenchen Fan > select cast('false' as boolean) returns true > --

[jira] [Updated] (SPARK-10442) select cast('false' as boolean) returns true

2015-09-11 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-10442: - Labels: release_notes releasenotes (was: releasenotes) > select cast('false' as boolean) returns true >

[jira] [Updated] (SPARK-10442) select cast('false' as boolean) returns true

2015-09-11 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-10442: - Labels: releasenotes (was: ) > select cast('false' as boolean) returns true > --

[jira] [Updated] (SPARK-10442) select cast('false' as boolean) returns true

2015-09-11 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-10442: - Target Version/s: 1.6.0 (was: 1.6.0, 1.5.1) > select cast('false' as boolean) returns true > ---

[jira] [Resolved] (SPARK-10442) select cast('false' as boolean) returns true

2015-09-11 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-10442. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8698 [https://github.com/a

[jira] [Commented] (SPARK-10568) Error thrown in stopping one component in SparkContext.stop() doesn't allow other components to be stopped

2015-09-11 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741526#comment-14741526 ] Matt Cheah commented on SPARK-10568: Also I think the YARN issue is something more su

[jira] [Commented] (SPARK-10568) Error thrown in stopping one component in SparkContext.stop() doesn't allow other components to be stopped

2015-09-11 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741525#comment-14741525 ] Matt Cheah commented on SPARK-10568: I'm more concerned about the general case which

[jira] [Comment Edited] (SPARK-10568) Error thrown in stopping one component in SparkContext.stop() doesn't allow other components to be stopped

2015-09-11 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741525#comment-14741525 ] Matt Cheah edited comment on SPARK-10568 at 9/11/15 8:56 PM: -

[jira] [Closed] (SPARK-10017) ML model broadcasts should be stored in private vars: mllib NaiveBayes

2015-09-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-10017. - Resolution: Invalid Closing per discussion on parent JIRA > ML model broadcasts should b

[jira] [Updated] (SPARK-10546) Check partitionId's range in ExternalSorter#spill()

2015-09-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10546: -- Priority: Trivial (was: Minor) > Check partitionId's range in ExternalSorter#spill() > ---

[jira] [Resolved] (SPARK-10546) Check partitionId's range in ExternalSorter#spill()

2015-09-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10546. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8703 [https://github.com

[jira] [Updated] (SPARK-10546) Check partitionId's range in ExternalSorter#spill()

2015-09-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10546: -- Assignee: Ted Yu > Check partitionId's range in ExternalSorter#spill() > --

[jira] [Closed] (SPARK-10020) ML model broadcasts should be stored in private vars: mllib GeneralizedLinearModel

2015-09-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-10020. - Resolution: Invalid Closing per discussion on parent JIRA > ML model broadcasts should b

[jira] [Closed] (SPARK-10015) ML model broadcasts should be stored in private vars: spark.ml tree ensembles

2015-09-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-10015. - Resolution: Invalid Closing per discussion on parent JIRA > ML model broadcasts should b

[jira] [Created] (SPARK-10572) Investigate the contentions bewteen tasks in the same executor

2015-09-11 Thread Davies Liu (JIRA)
Davies Liu created SPARK-10572: -- Summary: Investigate the contentions bewteen tasks in the same executor Key: SPARK-10572 URL: https://issues.apache.org/jira/browse/SPARK-10572 Project: Spark I

[jira] [Closed] (SPARK-10019) ML model broadcasts should be stored in private vars: mllib IDFModel

2015-09-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-10019. - Resolution: Invalid Closing per discussion on parent JIRA > ML model broadcasts should b

[jira] [Closed] (SPARK-10018) ML model broadcasts should be stored in private vars: mllib clustering

2015-09-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-10018. - Resolution: Invalid Closing per discussion on parent JIRA > ML model broadcasts should b

[jira] [Closed] (SPARK-10016) ML model broadcasts should be stored in private vars: spark.ml Word2Vec

2015-09-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-10016. - Resolution: Invalid Closing per discussion on parent JIRA > ML model broadcasts should b

[jira] [Closed] (SPARK-10014) ML model broadcasts should be stored in private vars

2015-09-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-10014. - Resolution: Invalid Closing per discussion > ML model broadcasts should be stored in pri

[jira] [Created] (SPARK-10571) Spark REST / JSON API mixes up application names and application ids

2015-09-11 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-10571: -- Summary: Spark REST / JSON API mixes up application names and application ids Key: SPARK-10571 URL: https://issues.apache.org/jira/browse/SPARK-10571 Project: Spark

[jira] [Commented] (SPARK-7770) Should GBT validationTol be relative tolerance?

2015-09-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741505#comment-14741505 ] Joseph K. Bradley commented on SPARK-7770: -- I had intended for us to discuss this

[jira] [Commented] (SPARK-10570) Add Spark version endpoint to standalone JSON API

2015-09-11 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741502#comment-14741502 ] Matt Cheah commented on SPARK-10570: The master web UI has it I think, but only in th

[jira] [Commented] (SPARK-10570) Add Spark version endpoint to standalone JSON API

2015-09-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741501#comment-14741501 ] Josh Rosen commented on SPARK-10570: This should actually be added to the Master web

[jira] [Issue Comment Deleted] (SPARK-10570) Add Spark version endpoint to standalone JSON API

2015-09-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-10570: --- Comment: was deleted (was: This should actually be added to the Master web UI, no?) > Add Spark vers

[jira] [Updated] (SPARK-10570) Add Spark version endpoint to standalone JSON API

2015-09-11 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Cheah updated SPARK-10570: --- Labels: api (was: ) > Add Spark version endpoint to standalone JSON API > --

[jira] [Updated] (SPARK-10570) Add Spark version endpoint to standalone JSON API

2015-09-11 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Cheah updated SPARK-10570: --- Component/s: Web UI > Add Spark version endpoint to standalone JSON API > ---

[jira] [Updated] (SPARK-10570) Add Spark version endpoint to standalone JSON API

2015-09-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10570: -- Component/s: Spark Core Issue Type: Improvement (was: Bug) (set type / component please) > Add S

[jira] [Updated] (SPARK-10570) Add Spark version endpoint to standalone JSON API

2015-09-11 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Cheah updated SPARK-10570: --- Issue Type: New Feature (was: Improvement) > Add Spark version endpoint to standalone JSON API > ---

[jira] [Commented] (SPARK-10550) SQLListener error constructing extended SQLContext

2015-09-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741493#comment-14741493 ] Sean Owen commented on SPARK-10550: --- Hm, but that's not going to be guaranteed to work

[jira] [Created] (SPARK-10570) Add Spark version endpoint to standalone JSON API

2015-09-11 Thread Matt Cheah (JIRA)
Matt Cheah created SPARK-10570: -- Summary: Add Spark version endpoint to standalone JSON API Key: SPARK-10570 URL: https://issues.apache.org/jira/browse/SPARK-10570 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-10568) Error thrown in stopping one component in SparkContext.stop() doesn't allow other components to be stopped

2015-09-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741488#comment-14741488 ] Sean Owen commented on SPARK-10568: --- I think this is a duplicate of SPARK-10554? at lea

[jira] [Commented] (SPARK-10569) Kryo serialization fails on sortByKey operation on registered RDDs

2015-09-11 Thread Glenn Strycker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741486#comment-14741486 ] Glenn Strycker commented on SPARK-10569: Playing around with adding additional re

[jira] [Created] (SPARK-10569) Kryo serialization fails on sortByKey operation on registered RDDs

2015-09-11 Thread Glenn Strycker (JIRA)
Glenn Strycker created SPARK-10569: -- Summary: Kryo serialization fails on sortByKey operation on registered RDDs Key: SPARK-10569 URL: https://issues.apache.org/jira/browse/SPARK-10569 Project: Spark

[jira] [Assigned] (SPARK-10566) SnappyCompressionCodec init exception handling masks important error information

2015-09-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10566: Assignee: (was: Apache Spark) > SnappyCompressionCodec init exception handling masks i

[jira] [Assigned] (SPARK-10566) SnappyCompressionCodec init exception handling masks important error information

2015-09-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10566: Assignee: Apache Spark > SnappyCompressionCodec init exception handling masks important er

[jira] [Commented] (SPARK-10566) SnappyCompressionCodec init exception handling masks important error information

2015-09-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741478#comment-14741478 ] Apache Spark commented on SPARK-10566: -- User 'dimfeld' has created a pull request fo

[jira] [Commented] (SPARK-6417) Add Linear Programming algorithm

2015-09-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741463#comment-14741463 ] Joseph K. Bradley commented on SPARK-6417: -- Have you contributed to Spark before?

[jira] [Updated] (SPARK-10568) Error thrown in stopping one component in SparkContext.stop() doesn't allow other components to be stopped

2015-09-11 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Cheah updated SPARK-10568: --- Description: When I shut down a Java process that is running a SparkContext, it invokes a shutdown h

[jira] [Created] (SPARK-10568) Error thrown in stopping one component in SparkContext.stop() doesn't allow other components to be stopped

2015-09-11 Thread Matt Cheah (JIRA)
Matt Cheah created SPARK-10568: -- Summary: Error thrown in stopping one component in SparkContext.stop() doesn't allow other components to be stopped Key: SPARK-10568 URL: https://issues.apache.org/jira/browse/SPARK-1

[jira] [Commented] (SPARK-10550) SQLListener error constructing extended SQLContext

2015-09-11 Thread shao lo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741408#comment-14741408 ] shao lo commented on SPARK-10550: - I am subclassing to gain access to some non-public dat

[jira] [Commented] (SPARK-10566) SnappyCompressionCodec init exception handling masks important error information

2015-09-11 Thread Daniel Imfeld (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741395#comment-14741395 ] Daniel Imfeld commented on SPARK-10566: --- Oh, didn't know that Java can chain except

[jira] [Commented] (SPARK-6417) Add Linear Programming algorithm

2015-09-11 Thread Ehsan Mohyedin Kermani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741389#comment-14741389 ] Ehsan Mohyedin Kermani commented on SPARK-6417: --- I'd like to implement LP, (

[jira] [Closed] (SPARK-10552) Connection String for SparkR to Cassandra

2015-09-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen closed SPARK-10552. - > Connection String for SparkR to Cassandra > - > > K

[jira] [Commented] (SPARK-10566) SnappyCompressionCodec init exception handling masks important error information

2015-09-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741386#comment-14741386 ] Sean Owen commented on SPARK-10566: --- Sure, or chain the exception -- do you want to mak

[jira] [Commented] (SPARK-9610) Class and instance weighting for ML

2015-09-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741376#comment-14741376 ] Joseph K. Bradley commented on SPARK-9610: -- I see. I have not seen many use case

[jira] [Commented] (SPARK-10014) ML model broadcasts should be stored in private vars

2015-09-11 Thread Sameer Abhyankar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741359#comment-14741359 ] Sameer Abhyankar commented on SPARK-10014: -- Cool. I will close the PRs associate

[jira] [Commented] (SPARK-10564) ThreadingSuite: assertions in threads don't fail the test

2015-09-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741349#comment-14741349 ] Apache Spark commented on SPARK-10564: -- User 'andrewor14' has created a pull request

[jira] [Assigned] (SPARK-10564) ThreadingSuite: assertions in threads don't fail the test

2015-09-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10564: Assignee: Andrew Or (was: Apache Spark) > ThreadingSuite: assertions in threads don't fai

[jira] [Assigned] (SPARK-10564) ThreadingSuite: assertions in threads don't fail the test

2015-09-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10564: Assignee: Apache Spark (was: Andrew Or) > ThreadingSuite: assertions in threads don't fai

  1   2   3   >