[jira] [Commented] (SPARK-3147) Implement A/B testing

[ https://issues.apache.org/jira/browse/SPARK-3147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14333086#comment-14333086 ] Xiangrui Meng commented on SPARK-3147: -- Done:) > Implement A/B testing > ---

[jira] [Updated] (SPARK-3147) Implement A/B testing

[ https://issues.apache.org/jira/browse/SPARK-3147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-3147: - Assignee: Feynman Liang > Implement A/B testing > - > > Key: S

[jira] [Commented] (SPARK-4289) Creating an instance of Hadoop Job fails in the Spark shell when toString() is called on the instance.

[ https://issues.apache.org/jira/browse/SPARK-4289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14333118#comment-14333118 ] Alexander Bezzubov commented on SPARK-4289: --- Could you please tell how exactly "

[jira] [Commented] (SPARK-4289) Creating an instance of Hadoop Job fails in the Spark shell when toString() is called on the instance.

[ https://issues.apache.org/jira/browse/SPARK-4289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14333127#comment-14333127 ] Sean Owen commented on SPARK-4289: -- [~bzz] Just type {{:silent}} into the shell at the st

[jira] [Commented] (SPARK-4289) Creating an instance of Hadoop Job fails in the Spark shell when toString() is called on the instance.

[ https://issues.apache.org/jira/browse/SPARK-4289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14333142#comment-14333142 ] Alexander Bezzubov commented on SPARK-4289: --- [~sowen] Thanks, that's what I thou

[jira] [Comment Edited] (SPARK-4289) Creating an instance of Hadoop Job fails in the Spark shell when toString() is called on the instance.

[ https://issues.apache.org/jira/browse/SPARK-4289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14333142#comment-14333142 ] Alexander Bezzubov edited comment on SPARK-4289 at 2/23/15 9:26 AM:

[jira] [Comment Edited] (SPARK-4289) Creating an instance of Hadoop Job fails in the Spark shell when toString() is called on the instance.

[ https://issues.apache.org/jira/browse/SPARK-4289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14333142#comment-14333142 ] Alexander Bezzubov edited comment on SPARK-4289 at 2/23/15 9:39 AM:

[jira] [Comment Edited] (SPARK-4289) Creating an instance of Hadoop Job fails in the Spark shell when toString() is called on the instance.

[ https://issues.apache.org/jira/browse/SPARK-4289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14333142#comment-14333142 ] Alexander Bezzubov edited comment on SPARK-4289 at 2/23/15 9:39 AM:

[jira] [Comment Edited] (SPARK-4289) Creating an instance of Hadoop Job fails in the Spark shell when toString() is called on the instance.

[ https://issues.apache.org/jira/browse/SPARK-4289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14333142#comment-14333142 ] Alexander Bezzubov edited comment on SPARK-4289 at 2/23/15 9:39 AM:

[jira] [Resolved] (SPARK-5943) Update the API to remove several warns in building for Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-5943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5943. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4722 [https://github.com/ap

[jira] [Updated] (SPARK-5943) Update the API to remove several warns in building for Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-5943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5943: - Affects Version/s: (was: 1.3.0) Assignee: Saisai Shao > Update the API to remove several

[jira] [Resolved] (SPARK-5724) misconfiguration in Akka system

[ https://issues.apache.org/jira/browse/SPARK-5724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5724. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 4512 [https://github.com/ap

[jira] [Updated] (SPARK-5724) misconfiguration in Akka system

[ https://issues.apache.org/jira/browse/SPARK-5724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5724: - Priority: Minor (was: Major) Target Version/s: (was: 1.3.0) Assignee: Nan Zhu >

[jira] [Created] (SPARK-5947) First class partitioning support in data sources API

Cheng Lian created SPARK-5947: - Summary: First class partitioning support in data sources API Key: SPARK-5947 URL: https://issues.apache.org/jira/browse/SPARK-5947 Project: Spark Issue Type: Impr

[jira] [Created] (SPARK-5948) Support writing to partitioned table for the Parquet data source

Cheng Lian created SPARK-5948: - Summary: Support writing to partitioned table for the Parquet data source Key: SPARK-5948 URL: https://issues.apache.org/jira/browse/SPARK-5948 Project: Spark Iss

[jira] [Commented] (SPARK-5940) Graph Loader: refactor + add more formats

[ https://issues.apache.org/jira/browse/SPARK-5940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14333265#comment-14333265 ] lukovnikov commented on SPARK-5940: --- Probably it's better to involve core Spark/GraphX d

[jira] [Created] (SPARK-5949) Driver program has to register roaring bitmap classes used by spark with Kryo when number of partitions is greater than 2000

Peter Torok created SPARK-5949: -- Summary: Driver program has to register roaring bitmap classes used by spark with Kryo when number of partitions is greater than 2000 Key: SPARK-5949 URL: https://issues.apache.org/ji

[jira] [Updated] (SPARK-5949) Driver program has to register roaring bitmap classes used by spark with Kryo when number of partitions is greater than 2000

[ https://issues.apache.org/jira/browse/SPARK-5949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Torok updated SPARK-5949: --- Description: When more than 2000 partitions are being used with Kryo, the following classes need to b

[jira] [Commented] (SPARK-5905) Improve RowMatrix user guide and doc.

[ https://issues.apache.org/jira/browse/SPARK-5905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14333417#comment-14333417 ] Mike Beyer commented on SPARK-5905: --- ok, then we have the same understanding on naming t

[jira] [Updated] (SPARK-5939) Make FPGrowth example app take parameters

[ https://issues.apache.org/jira/browse/SPARK-5939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5939: - Assignee: Jacky Li > Make FPGrowth example app take parameters > -

[jira] [Resolved] (SPARK-5939) Make FPGrowth example app take parameters

[ https://issues.apache.org/jira/browse/SPARK-5939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5939. -- Resolution: Fixed Issue resolved by pull request 4714 [https://github.com/apache/spark/pull/4714

[jira] [Commented] (SPARK-5944) Python release docs say SNAPSHOT + Author is missing

[ https://issues.apache.org/jira/browse/SPARK-5944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14333496#comment-14333496 ] Nicholas Chammas commented on SPARK-5944: - I'm not sure, but I think [here in the

[jira] [Updated] (SPARK-5944) Python release docs say SNAPSHOT + Author is missing

[ https://issues.apache.org/jira/browse/SPARK-5944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5944: Target Version/s: 1.2.2 > Python release docs say SNAPSHOT + Author is missing > ---

[jira] [Updated] (SPARK-5944) Python release docs say SNAPSHOT + Author is missing

[ https://issues.apache.org/jira/browse/SPARK-5944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-5944: -- Target Version/s: 1.3.0, 1.2.2 (was: 1.2.2) > Python release docs say SNAPSHOT + Author is missing > --

[jira] [Created] (SPARK-5950) Insert array into table saved as parquet should work when using datasource api

Liang-Chi Hsieh created SPARK-5950: -- Summary: Insert array into table saved as parquet should work when using datasource api Key: SPARK-5950 URL: https://issues.apache.org/jira/browse/SPARK-5950 Proj

[jira] [Commented] (SPARK-5950) Insert array into table saved as parquet should work when using datasource api

[ https://issues.apache.org/jira/browse/SPARK-5950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14333532#comment-14333532 ] Apache Spark commented on SPARK-5950: - User 'viirya' has created a pull request for th

[jira] [Commented] (SPARK-5951) Remove unreachable driver memory properties in yarn client mode (YarnClientSchedulerBackend)

[ https://issues.apache.org/jira/browse/SPARK-5951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14333568#comment-14333568 ] Apache Spark commented on SPARK-5951: - User 'zuxqoj' has created a pull request for th

[jira] [Created] (SPARK-5951) Remove unreachable driver memory properties in yarn client mode (YarnClientSchedulerBackend)

Shekhar Bansal created SPARK-5951: - Summary: Remove unreachable driver memory properties in yarn client mode (YarnClientSchedulerBackend) Key: SPARK-5951 URL: https://issues.apache.org/jira/browse/SPARK-5951

[jira] [Resolved] (SPARK-3511) Create a RELEASE-NOTES.txt file in the repo

[ https://issues.apache.org/jira/browse/SPARK-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3511. Resolution: Won't Fix Never ended up doing this. It's stale so I'm just gonna remove it. >

[jira] [Updated] (SPARK-5463) Fix Parquet filter push-down

[ https://issues.apache.org/jira/browse/SPARK-5463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5463: --- Priority: Critical (was: Blocker) > Fix Parquet filter push-down > --

[jira] [Updated] (SPARK-3650) Triangle Count handles reverse edges incorrectly

[ https://issues.apache.org/jira/browse/SPARK-3650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3650: --- Priority: Critical (was: Blocker) > Triangle Count handles reverse edges incorrectly > --

[jira] [Resolved] (SPARK-5904) DataFrame methods with varargs do not work in Java

[ https://issues.apache.org/jira/browse/SPARK-5904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5904. Resolution: Fixed Fix Version/s: 1.3.0 I think rxin just forgot to close this. It was

[jira] [Commented] (SPARK-5463) Fix Parquet filter push-down

[ https://issues.apache.org/jira/browse/SPARK-5463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14333608#comment-14333608 ] Patrick Wendell commented on SPARK-5463: Bumping to critical. Per our offline disc

[jira] [Commented] (SPARK-765) Test suite should run Spark example programs

[ https://issues.apache.org/jira/browse/SPARK-765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14333682#comment-14333682 ] Josh Rosen commented on SPARK-765: -- Yep, this still needs to be done. It's more of an iss

[jira] [Commented] (SPARK-5750) Document that ordering of elements in shuffled partitions is not deterministic across runs

[ https://issues.apache.org/jira/browse/SPARK-5750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14333685#comment-14333685 ] Ilya Ganelin commented on SPARK-5750: - Hi Josh - I can knock this out. Thanks. > Docu

[jira] [Commented] (SPARK-5845) Time to cleanup intermediate shuffle files not included in shuffle write time

[ https://issues.apache.org/jira/browse/SPARK-5845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14333691#comment-14333691 ] Ilya Ganelin commented on SPARK-5845: - Hi Kay - I can knock this one out. Thanks. >

[jira] [Commented] (SPARK-5944) Python release docs say SNAPSHOT + Author is missing

[ https://issues.apache.org/jira/browse/SPARK-5944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14333699#comment-14333699 ] Apache Spark commented on SPARK-5944: - User 'davies' has created a pull request for th

[jira] [Updated] (SPARK-5845) Time to cleanup intermediate shuffle files not included in shuffle write time

[ https://issues.apache.org/jira/browse/SPARK-5845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout updated SPARK-5845: -- Assignee: Ilya Ganelin > Time to cleanup intermediate shuffle files not included in shuffle writ

[jira] [Resolved] (SPARK-5912) Programming guide for feature selection

[ https://issues.apache.org/jira/browse/SPARK-5912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-5912. -- Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Alexander Ulanov > Prog

[jira] [Commented] (SPARK-5079) Detect failed jobs / batches in Spark Streaming unit tests

[ https://issues.apache.org/jira/browse/SPARK-5079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14333743#comment-14333743 ] Ilya Ganelin commented on SPARK-5079: - Hi [~joshrosen] - I'm trying to wrap my head ar

[jira] [Created] (SPARK-5952) Failure to lock metastore client in tableExists()

Michael Armbrust created SPARK-5952: --- Summary: Failure to lock metastore client in tableExists() Key: SPARK-5952 URL: https://issues.apache.org/jira/browse/SPARK-5952 Project: Spark Issue T

[jira] [Created] (SPARK-5953) NoSuchMethodException with a Kafka input stream and custom decoder in Scala

Aleksandar Stojadinovic created SPARK-5953: -- Summary: NoSuchMethodException with a Kafka input stream and custom decoder in Scala Key: SPARK-5953 URL: https://issues.apache.org/jira/browse/SPARK-5953

[jira] [Updated] (SPARK-5953) NoSuchMethodException with a Kafka input stream and custom decoder in Scala

[ https://issues.apache.org/jira/browse/SPARK-5953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aleksandar Stojadinovic updated SPARK-5953: --- Description: When using a Kafka input stream, and setting a custom Kafka Decod

[jira] [Updated] (SPARK-5953) NoSuchMethodException with a Kafka input stream and custom decoder in Scala

[ https://issues.apache.org/jira/browse/SPARK-5953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aleksandar Stojadinovic updated SPARK-5953: --- Description: When using a Kafka input stream, and setting a custom Kafka Decod

[jira] [Commented] (SPARK-5953) NoSuchMethodException with a Kafka input stream and custom decoder in Scala

[ https://issues.apache.org/jira/browse/SPARK-5953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14333799#comment-14333799 ] Sean Owen commented on SPARK-5953: -- Dumb question, is it on the classpath? in your app JA

[jira] [Updated] (SPARK-5953) NoSuchMethodException with a Kafka input stream and custom decoder in Scala

[ https://issues.apache.org/jira/browse/SPARK-5953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aleksandar Stojadinovic updated SPARK-5953: --- Description: When using a Kafka input stream, and setting a custom Kafka Decod

[jira] [Updated] (SPARK-5953) NoSuchMethodException with a Kafka input stream and custom decoder in Scala

[ https://issues.apache.org/jira/browse/SPARK-5953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aleksandar Stojadinovic updated SPARK-5953: --- Description: When using a Kafka input stream, and setting a custom Kafka Decod

[jira] [Commented] (SPARK-5953) NoSuchMethodException with a Kafka input stream and custom decoder in Scala

[ https://issues.apache.org/jira/browse/SPARK-5953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14333808#comment-14333808 ] Aleksandar Stojadinovic commented on SPARK-5953: The decoder? Yes, it's a

[jira] [Commented] (SPARK-5953) NoSuchMethodException with a Kafka input stream and custom decoder in Scala

[ https://issues.apache.org/jira/browse/SPARK-5953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14333818#comment-14333818 ] Sean Owen commented on SPARK-5953: -- YARN or standalone? Did you look into spark.yarn.user

[jira] [Commented] (SPARK-5953) NoSuchMethodException with a Kafka input stream and custom decoder in Scala

[ https://issues.apache.org/jira/browse/SPARK-5953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14333828#comment-14333828 ] Aleksandar Stojadinovic commented on SPARK-5953: Standalone, in local, in

[jira] [Commented] (SPARK-4144) Support incremental model training of Naive Bayes classifier

[ https://issues.apache.org/jira/browse/SPARK-4144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14333830#comment-14333830 ] Xiangrui Meng commented on SPARK-4144: -- [~freeman-lab] I've assigned this ticket to y

[jira] [Updated] (SPARK-4144) Support incremental model training of Naive Bayes classifier

[ https://issues.apache.org/jira/browse/SPARK-4144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4144: - Assignee: Jeremy Freeman (was: Liquan Pei) > Support incremental model training of Naive Bayes cl

[jira] [Updated] (SPARK-4144) Support incremental model training of Naive Bayes classifier

[ https://issues.apache.org/jira/browse/SPARK-4144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4144: - Target Version/s: 1.4.0 > Support incremental model training of Naive Bayes classifier > -

[jira] [Commented] (SPARK-5912) Programming guide for feature selection

[ https://issues.apache.org/jira/browse/SPARK-5912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14333832#comment-14333832 ] Apache Spark commented on SPARK-5912: - User 'jkbradley' has created a pull request for

[jira] [Created] (SPARK-5954) Add topByKey to pair RDDs

Xiangrui Meng created SPARK-5954: Summary: Add topByKey to pair RDDs Key: SPARK-5954 URL: https://issues.apache.org/jira/browse/SPARK-5954 Project: Spark Issue Type: New Feature Com

[jira] [Commented] (SPARK-5922) Add diff(other: RDD[VertexId, VD]) in VertexRDD

[ https://issues.apache.org/jira/browse/SPARK-5922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14333875#comment-14333875 ] Apache Spark commented on SPARK-5922: - User 'brennonyork' has created a pull request f

[jira] [Commented] (SPARK-3355) Allow running maven tests in run-tests

[ https://issues.apache.org/jira/browse/SPARK-3355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14333887#comment-14333887 ] Apache Spark commented on SPARK-3355: - User 'brennonyork' has created a pull request f

[jira] [Created] (SPARK-5955) Add checkpointInterval to ALS

Xiangrui Meng created SPARK-5955: Summary: Add checkpointInterval to ALS Key: SPARK-5955 URL: https://issues.apache.org/jira/browse/SPARK-5955 Project: Spark Issue Type: New Feature

[jira] [Closed] (SPARK-1006) MLlib ALS gets stack overflow with too many iterations

[ https://issues.apache.org/jira/browse/SPARK-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng closed SPARK-1006. Resolution: Duplicate > MLlib ALS gets stack overflow with too many iterations > ---

[jira] [Closed] (SPARK-3080) ArrayIndexOutOfBoundsException in ALS for Large datasets

[ https://issues.apache.org/jira/browse/SPARK-3080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng closed SPARK-3080. Resolution: Fixed I'm closing this issue since the only way that I can re-produce this bug is the h

[jira] [Closed] (SPARK-3403) NaiveBayes crashes with blas/lapack native libraries for breeze (netlib-java)

[ https://issues.apache.org/jira/browse/SPARK-3403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng closed SPARK-3403. Resolution: Not a Problem [~avulanov] Did you try OpenBLAS 0.2.12, as suggested by xianyi on https:

[jira] [Reopened] (SPARK-3080) ArrayIndexOutOfBoundsException in ALS for Large datasets

[ https://issues.apache.org/jira/browse/SPARK-3080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reopened SPARK-3080: -- > ArrayIndexOutOfBoundsException in ALS for Large datasets > ---

[jira] [Closed] (SPARK-3080) ArrayIndexOutOfBoundsException in ALS for Large datasets

[ https://issues.apache.org/jira/browse/SPARK-3080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng closed SPARK-3080. Resolution: Cannot Reproduce > ArrayIndexOutOfBoundsException in ALS for Large datasets > --

[jira] [Updated] (SPARK-3436) Streaming SVM

[ https://issues.apache.org/jira/browse/SPARK-3436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-3436: - Assignee: (was: Liquan Pei) > Streaming SVM > -- > > Key: SPARK-3

[jira] [Commented] (SPARK-5541) Allow running Maven or SBT in run-tests

[ https://issues.apache.org/jira/browse/SPARK-5541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14333991#comment-14333991 ] Brennon York commented on SPARK-5541: - Just pushed up a PR for [SPARK-3355|https://is

[jira] [Closed] (SPARK-3435) Distributed matrix multiplication

[ https://issues.apache.org/jira/browse/SPARK-3435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng closed SPARK-3435. Resolution: Duplicate I'm closing this JIRA because it is hard to control data locality. We impleme

[jira] [Closed] (SPARK-3436) Streaming SVM

[ https://issues.apache.org/jira/browse/SPARK-3436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng closed SPARK-3436. Resolution: Duplicate > Streaming SVM > -- > > Key: SPARK-3436 >

[jira] [Updated] (SPARK-5673) Implement Streaming wrapper for all linear methos

[ https://issues.apache.org/jira/browse/SPARK-5673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5673: - Assignee: Kirill A. Korinskiy > Implement Streaming wrapper for all linear methos > --

[jira] [Commented] (SPARK-4039) KMeans support sparse cluster centers

[ https://issues.apache.org/jira/browse/SPARK-4039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14333997#comment-14333997 ] Xiangrui Meng commented on SPARK-4039: -- I changed the JIRA title to be more descripti

[jira] [Updated] (SPARK-4039) KMeans support sparse cluster centers

[ https://issues.apache.org/jira/browse/SPARK-4039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4039: - Summary: KMeans support sparse cluster centers (was: KMeans support HashingTF vectors) > KMeans

[jira] [Closed] (SPARK-4284) BinaryClassificationMetrics precision-recall method names should correspond to return types

[ https://issues.apache.org/jira/browse/SPARK-4284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng closed SPARK-4284. Resolution: Won't Fix I'm closing this JIRA per discussion on the Github PR page. > BinaryClassific

[jira] [Updated] (SPARK-4510) Add k-medoids Partitioning Around Medoids (PAM) algorithm

[ https://issues.apache.org/jira/browse/SPARK-4510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4510: - Labels: clustering features (was: features) > Add k-medoids Partitioning Around Medoids (PAM) alg

[jira] [Closed] (SPARK-4956) Vector Initialization error when initialize a Sparse Vector by calling Vectors.sparse(size, indices, values)

[ https://issues.apache.org/jira/browse/SPARK-4956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng closed SPARK-4956. Resolution: Won't Fix I'm closing this PR per discussion on the PR page. > Vector Initialization er

[jira] [Closed] (SPARK-5010) native openblas library doesn't work: undefined symbol: cblas_dscal

[ https://issues.apache.org/jira/browse/SPARK-5010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng closed SPARK-5010. Resolution: Not a Problem I'm closing this PR because it is a upstream issue with the native BLAS li

[jira] [Commented] (SPARK-5940) Graph Loader: refactor + add more formats

[ https://issues.apache.org/jira/browse/SPARK-5940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14334013#comment-14334013 ] Magellanea commented on SPARK-5940: --- [~lukovnikov] Thanks a lot for the reply, Do you kn

[jira] [Updated] (SPARK-5226) Add DBSCAN Clustering Algorithm to MLlib

[ https://issues.apache.org/jira/browse/SPARK-5226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5226: - Labels: DBSCAN clustering (was: DBSCAN) > Add DBSCAN Clustering Algorithm to MLlib >

[jira] [Commented] (SPARK-794) Remove sleep() in ClusterScheduler.stop

[ https://issues.apache.org/jira/browse/SPARK-794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14334020#comment-14334020 ] Brennon York commented on SPARK-794: [~srowen] [~joshrosen] bump on this. Would assume

[jira] [Commented] (SPARK-5261) In some cases ,The value of word's vector representation is too big

[ https://issues.apache.org/jira/browse/SPARK-5261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14334021#comment-14334021 ] Xiangrui Meng commented on SPARK-5261: -- Could you try a larger minCount to reduce the

[jira] [Updated] (SPARK-5405) Spark clusterer should support high dimensional data

[ https://issues.apache.org/jira/browse/SPARK-5405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5405: - Labels: clustering (was: ) > Spark clusterer should support high dimensional data > -

[jira] [Closed] (SPARK-4039) KMeans support sparse cluster centers

[ https://issues.apache.org/jira/browse/SPARK-4039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng closed SPARK-4039. Resolution: Duplicate > KMeans support sparse cluster centers >

[jira] [Reopened] (SPARK-4039) KMeans support sparse cluster centers

[ https://issues.apache.org/jira/browse/SPARK-4039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reopened SPARK-4039: -- > KMeans support sparse cluster centers > - > >

[jira] [Commented] (SPARK-1182) Sort the configuration parameters in configuration.md

[ https://issues.apache.org/jira/browse/SPARK-1182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14334025#comment-14334025 ] Brennon York commented on SPARK-1182: - Given [~joshrosen]'s comments on the PR making

[jira] [Commented] (SPARK-5405) Spark clusterer should support high dimensional data

[ https://issues.apache.org/jira/browse/SPARK-5405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14334027#comment-14334027 ] Xiangrui Meng commented on SPARK-5405: -- Dimension reduction should be separated from

[jira] [Commented] (SPARK-5490) KMeans costs can be incorrect if tasks need to be rerun

[ https://issues.apache.org/jira/browse/SPARK-5490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14334030#comment-14334030 ] Xiangrui Meng commented on SPARK-5490: -- [~sandyr] This is a bug in core. Could you li

[jira] [Updated] (SPARK-5490) KMeans costs can be incorrect if tasks need to be rerun

[ https://issues.apache.org/jira/browse/SPARK-5490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5490: - Target Version/s: 1.4.0 > KMeans costs can be incorrect if tasks need to be rerun > --

[jira] [Updated] (SPARK-5832) Add Affinity Propagation clustering algorithm

[ https://issues.apache.org/jira/browse/SPARK-5832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5832: - Labels: clustering (was: ) > Add Affinity Propagation clustering algorithm >

[jira] [Closed] (SPARK-5927) Modify FPGrowth's partition strategy to reduce transactions in partitions

[ https://issues.apache.org/jira/browse/SPARK-5927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng closed SPARK-5927. Resolution: Won't Fix I'm closing this JIRA per discussion on the PR page. > Modify FPGrowth's part

[jira] [Commented] (SPARK-5405) Spark clusterer should support high dimensional data

[ https://issues.apache.org/jira/browse/SPARK-5405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14334037#comment-14334037 ] Derrick Burns commented on SPARK-5405: -- Agreed. On Mon, Feb 23, 2015 at 2:48 PM, Xia

[jira] [Updated] (SPARK-5016) GaussianMixtureEM should distribute matrix inverse for large numFeatures, k

[ https://issues.apache.org/jira/browse/SPARK-5016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5016: - Labels: clustering (was: ) > GaussianMixtureEM should distribute matrix inverse for large numFeat

[jira] [Updated] (SPARK-5490) KMeans costs can be incorrect if tasks need to be rerun

[ https://issues.apache.org/jira/browse/SPARK-5490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5490: - Labels: clustering (was: ) > KMeans costs can be incorrect if tasks need to be rerun > --

[jira] [Updated] (SPARK-5272) Refactor NaiveBayes to support discrete and continuous labels,features

[ https://issues.apache.org/jira/browse/SPARK-5272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5272: - Labels: clustering (was: ) > Refactor NaiveBayes to support discrete and continuous labels,featur

[jira] [Updated] (SPARK-4039) KMeans support sparse cluster centers

[ https://issues.apache.org/jira/browse/SPARK-4039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4039: - Labels: clustering (was: ) > KMeans support sparse cluster centers >

[jira] [Updated] (SPARK-2429) Hierarchical Implementation of KMeans

[ https://issues.apache.org/jira/browse/SPARK-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-2429: - Labels: clustering (was: ) > Hierarchical Implementation of KMeans >

[jira] [Updated] (SPARK-3439) Add Canopy Clustering Algorithm

[ https://issues.apache.org/jira/browse/SPARK-3439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-3439: - Labels: clustering (was: ) > Add Canopy Clustering Algorithm > --- >

[jira] [Updated] (SPARK-3218) K-Means clusterer can fail on degenerate data

[ https://issues.apache.org/jira/browse/SPARK-3218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-3218: - Labels: clustering (was: ) > K-Means clusterer can fail on degenerate data >

[jira] [Updated] (SPARK-3220) K-Means clusterer should perform K-Means initialization in parallel

[ https://issues.apache.org/jira/browse/SPARK-3220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-3220: - Labels: clustering (was: ) > K-Means clusterer should perform K-Means initialization in parallel

[jira] [Commented] (SPARK-3850) Scala style: disallow trailing spaces

[ https://issues.apache.org/jira/browse/SPARK-3850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14334038#comment-14334038 ] Brennon York commented on SPARK-3850: - This made it into the [master branch|https://g

[jira] [Updated] (SPARK-3219) K-Means clusterer should support Bregman distance functions

[ https://issues.apache.org/jira/browse/SPARK-3219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-3219: - Labels: clustering (was: ) > K-Means clusterer should support Bregman distance functions > --

[jira] [Updated] (SPARK-3504) KMeans optimization: track distances and unmoved cluster centers across iterations

[ https://issues.apache.org/jira/browse/SPARK-3504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-3504: - Labels: clustering (was: ) > KMeans optimization: track distances and unmoved cluster centers acr

[jira] [Updated] (SPARK-2336) Approximate k-NN Models for MLLib

[ https://issues.apache.org/jira/browse/SPARK-2336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-2336: - Labels: clustering features newbie (was: features newbie) > Approximate k-NN Models for MLLib > -

  1   2   >