[jira] [Commented] (SPARK-2429) Hierarchical Implementation of KMeans

2014-11-27 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14227371#comment-14227371 ] Yu Ishikawa commented on SPARK-2429: Hi [~rnowling], Thank you for replying.

[jira] [Commented] (SPARK-4628) Put all external projects behind a build flag

2014-11-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14227372#comment-14227372 ] Sean Owen commented on SPARK-4628: -- Here are all the non-Central repos currently used:

[jira] [Commented] (SPARK-4315) PySpark pickling of pyspark.sql.Row objects is extremely inefficient

2014-11-27 Thread Lv, Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14227376#comment-14227376 ] Lv, Qi commented on SPARK-4315: --- I'm interested in this issue, but I can't reproduce your

[jira] [Commented] (SPARK-4632) Upgrade MQTT dependency to use latest mqtt-client

2014-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14227380#comment-14227380 ] Apache Spark commented on SPARK-4632: - User 'prabeesh' has created a pull request for

[jira] [Commented] (SPARK-4170) Closure problems when running Scala app that extends App

2014-11-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14227385#comment-14227385 ] Sean Owen commented on SPARK-4170: -- Thanks [~boyork], I will propose a PR that resolves

[jira] [Created] (SPARK-4636) Cluster By Distribute By output different with Hive

2014-11-27 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-4636: Summary: Cluster By Distribute By output different with Hive Key: SPARK-4636 URL: https://issues.apache.org/jira/browse/SPARK-4636 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-4631) Add real unit test for MQTT

2014-11-27 Thread Prabeesh K (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14227402#comment-14227402 ] Prabeesh K edited comment on SPARK-4631 at 11/27/14 8:49 AM: -

[jira] [Commented] (SPARK-4636) Cluster By Distribute By output different with Hive

2014-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14227401#comment-14227401 ] Apache Spark commented on SPARK-4636: - User 'chenghao-intel' has created a pull

[jira] [Commented] (SPARK-4631) Add real unit test for MQTT

2014-11-27 Thread Prabeesh K (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14227402#comment-14227402 ] Prabeesh K commented on SPARK-4631: --- MQTT is know as protocol of IoT(Internet of

[jira] [Created] (SPARK-4637) spark-1.1.0 does not compile any more

2014-11-27 Thread Olaf Flebbe (JIRA)
Olaf Flebbe created SPARK-4637: -- Summary: spark-1.1.0 does not compile any more Key: SPARK-4637 URL: https://issues.apache.org/jira/browse/SPARK-4637 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-4315) PySpark pickling of pyspark.sql.Row objects is extremely inefficient

2014-11-27 Thread Adam Davison (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14227427#comment-14227427 ] Adam Davison commented on SPARK-4315: - Sure, will try to say what I can. Unfortunately

[jira] [Resolved] (SPARK-4637) spark-1.1.0 does not compile any more

2014-11-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4637. -- Resolution: Duplicate spark-1.1.0 does not compile any more -

[jira] [Commented] (SPARK-4632) Upgrade MQTT dependency to use latest mqtt-client

2014-11-27 Thread Olaf Flebbe (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14227432#comment-14227432 ] Olaf Flebbe commented on SPARK-4632: The patch uses a SNAPSHOT dependency which is a

[jira] [Commented] (SPARK-4170) Closure problems when running Scala app that extends App

2014-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14227431#comment-14227431 ] Apache Spark commented on SPARK-4170: - User 'srowen' has created a pull request for

[jira] [Commented] (SPARK-4631) Add real unit test for MQTT

2014-11-27 Thread Jinesh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14227433#comment-14227433 ] Jinesh commented on SPARK-4631: --- MQTT is the one of the most popular queuing protcol in

[jira] [Comment Edited] (SPARK-4632) Upgrade MQTT dependency to use latest mqtt-client

2014-11-27 Thread Olaf Flebbe (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14227432#comment-14227432 ] Olaf Flebbe edited comment on SPARK-4632 at 11/27/14 9:34 AM: --

[jira] [Commented] (SPARK-4637) spark-1.1.0 does not compile any more

2014-11-27 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-4637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14227441#comment-14227441 ] Benjamin Cabé commented on SPARK-4637: -- bq. I did not find a different repository

[jira] [Commented] (SPARK-4631) Add real unit test for MQTT

2014-11-27 Thread Prabeesh K (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14227472#comment-14227472 ] Prabeesh K commented on SPARK-4631: --- They fixed the issue now we have data in the

[jira] [Commented] (SPARK-4632) Upgrade MQTT dependency to use latest mqtt-client

2014-11-27 Thread Prabeesh K (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14227473#comment-14227473 ] Prabeesh K commented on SPARK-4632: --- They fixed the issue now we have data in the

[jira] [Commented] (SPARK-4631) Add real unit test for MQTT

2014-11-27 Thread Prabeesh K (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14227506#comment-14227506 ] Prabeesh K commented on SPARK-4631: --- [~tdas] refer [this

[jira] [Created] (SPARK-4638) Spark's MLlib SVM classification to include Kernels like Gaussian / (RBF) to find non linear boundaries

2014-11-27 Thread madankumar s (JIRA)
madankumar s created SPARK-4638: --- Summary: Spark's MLlib SVM classification to include Kernels like Gaussian / (RBF) to find non linear boundaries Key: SPARK-4638 URL:

[jira] [Updated] (SPARK-4638) Spark's MLlib SVM classification to include Kernels like Gaussian / (RBF) to find non linear boundaries

2014-11-27 Thread madankumar s (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] madankumar s updated SPARK-4638: Description: SPARK MLlib Classification Module: Add Kernel functionalities to SVM Classifier to

[jira] [Created] (SPARK-4639) Pass maxIterations in as a parameter in Analyzer

2014-11-27 Thread Jacky Li (JIRA)
Jacky Li created SPARK-4639: --- Summary: Pass maxIterations in as a parameter in Analyzer Key: SPARK-4639 URL: https://issues.apache.org/jira/browse/SPARK-4639 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-4639) Pass maxIterations in as a parameter in Analyzer

2014-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14227744#comment-14227744 ] Apache Spark commented on SPARK-4639: - User 'jackylk' has created a pull request for

[jira] [Created] (SPARK-4640) FixedRangePartitioner for partitioning items with a known range

2014-11-27 Thread Kevin Mader (JIRA)
Kevin Mader created SPARK-4640: -- Summary: FixedRangePartitioner for partitioning items with a known range Key: SPARK-4640 URL: https://issues.apache.org/jira/browse/SPARK-4640 Project: Spark

[jira] [Commented] (SPARK-4640) FixedRangePartitioner for partitioning items with a known range

2014-11-27 Thread Kevin Mader (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14227754#comment-14227754 ] Kevin Mader commented on SPARK-4640: I have code for both, that I could merge in, if

[jira] [Resolved] (SPARK-4170) Closure problems when running Scala app that extends App

2014-11-27 Thread Aaron Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Davidson resolved SPARK-4170. --- Resolution: Fixed Assignee: Sean Owen Closure problems when running Scala app that

[jira] [Commented] (SPARK-4598) Paginate stage page to avoid OOM with 100,000 tasks

2014-11-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14227842#comment-14227842 ] Patrick Wendell commented on SPARK-4598: Having sorting with pagination seems very

[jira] [Commented] (SPARK-4634) Enable metrics for each application to be gathered in one node

2014-11-27 Thread Masayoshi TSUZUKI (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14227848#comment-14227848 ] Masayoshi TSUZUKI commented on SPARK-4634: -- Sorry, GraphiteSink has already got

[jira] [Closed] (SPARK-4634) Enable metrics for each application to be gathered in one node

2014-11-27 Thread Masayoshi TSUZUKI (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masayoshi TSUZUKI closed SPARK-4634. Resolution: Not a Problem GraphiteSink has already got the option prefix and it works fine.

[jira] [Updated] (SPARK-4626) NoSuchElementException in CoarseGrainedSchedulerBackend

2014-11-27 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-4626: --- Description: {code} 26 Nov 2014 06:38:21,330 ERROR [spark-akka.actor.default-dispatcher-22]

[jira] [Resolved] (SPARK-4626) NoSuchElementException in CoarseGrainedSchedulerBackend

2014-11-27 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-4626. Resolution: Fixed Fix Version/s: 1.2.0 NoSuchElementException in

[jira] [Updated] (SPARK-4626) NoSuchElementException in CoarseGrainedSchedulerBackend

2014-11-27 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-4626: --- Description: {code} 26 Nov 2014 06:38:21,330 ERROR [spark-akka.actor.default-dispatcher-22]

[jira] [Created] (SPARK-4641) A FileNotFoundException happened in Hash Shuffle Manager

2014-11-27 Thread hzw (JIRA)
hzw created SPARK-4641: -- Summary: A FileNotFoundException happened in Hash Shuffle Manager Key: SPARK-4641 URL: https://issues.apache.org/jira/browse/SPARK-4641 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-4642) Documents about running-on-YARN needs update

2014-11-27 Thread Masayoshi TSUZUKI (JIRA)
Masayoshi TSUZUKI created SPARK-4642: Summary: Documents about running-on-YARN needs update Key: SPARK-4642 URL: https://issues.apache.org/jira/browse/SPARK-4642 Project: Spark Issue

[jira] [Commented] (SPARK-4642) Documents about running-on-YARN needs update

2014-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14228017#comment-14228017 ] Apache Spark commented on SPARK-4642: - User 'tsudukim' has created a pull request for

[jira] [Resolved] (SPARK-4613) Make JdbcRDD easier to use from Java

2014-11-27 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia resolved SPARK-4613. -- Resolution: Fixed Fix Version/s: 1.2.0 Make JdbcRDD easier to use from Java

[jira] [Updated] (SPARK-4613) Make JdbcRDD easier to use from Java

2014-11-27 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-4613: - Issue Type: Improvement (was: Bug) Make JdbcRDD easier to use from Java

[jira] [Commented] (SPARK-4598) Paginate stage page to avoid OOM with 100,000 tasks

2014-11-27 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14228043#comment-14228043 ] meiyoula commented on SPARK-4598: - Yearh, optimize the use of memory maybe can resolve the

[jira] [Updated] (SPARK-4533) SchemaRDD Api error: Can only subtract another SchemaRDD

2014-11-27 Thread Shawn Guo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shawn Guo updated SPARK-4533: - Summary: SchemaRDD Api error: Can only subtract another SchemaRDD (was: Can only subtract another

[jira] [Updated] (SPARK-4533) SchemaRDD API error: Can only subtract another SchemaRDD

2014-11-27 Thread Shawn Guo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shawn Guo updated SPARK-4533: - Summary: SchemaRDD API error: Can only subtract another SchemaRDD (was: SchemaRDD Api error: Can only

[jira] [Commented] (SPARK-4626) NoSuchElementException in CoarseGrainedSchedulerBackend

2014-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14228105#comment-14228105 ] Apache Spark commented on SPARK-4626: - User 'roxchkplusony' has created a pull request

[jira] [Commented] (SPARK-4626) NoSuchElementException in CoarseGrainedSchedulerBackend

2014-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14228103#comment-14228103 ] Apache Spark commented on SPARK-4626: - User 'roxchkplusony' has created a pull request

[jira] [Commented] (SPARK-4643) spark staging repository location outdated

2014-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14228108#comment-14228108 ] Apache Spark commented on SPARK-4643: - User 'adrian-wang' has created a pull request

[jira] [Created] (SPARK-4644) Implement skewed join

2014-11-27 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-4644: --- Summary: Implement skewed join Key: SPARK-4644 URL: https://issues.apache.org/jira/browse/SPARK-4644 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-4644) Implement skewed join

2014-11-27 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-4644: Attachment: Skewed Join Design Doc.pdf The design doc of skewed join Implement skewed join

[jira] [Commented] (SPARK-4644) Implement skewed join

2014-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14228113#comment-14228113 ] Apache Spark commented on SPARK-4644: - User 'zsxwing' has created a pull request for

[jira] [Resolved] (SPARK-4641) A FileNotFoundException happened in Hash Shuffle Manager

2014-11-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4641. -- Resolution: Duplicate A FileNotFoundException happened in Hash Shuffle Manager

[jira] [Created] (SPARK-4645) Asynchronous execution in HiveThriftServer2 with Hive 0.13.1 doesn't play well with Simba ODBC driver

2014-11-27 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-4645: - Summary: Asynchronous execution in HiveThriftServer2 with Hive 0.13.1 doesn't play well with Simba ODBC driver Key: SPARK-4645 URL: https://issues.apache.org/jira/browse/SPARK-4645

[jira] [Created] (SPARK-4646) Replace Scala.util.Sorting.quickSort with Sorter(TimSort) in Spark

2014-11-27 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-4646: --- Summary: Replace Scala.util.Sorting.quickSort with Sorter(TimSort) in Spark Key: SPARK-4646 URL: https://issues.apache.org/jira/browse/SPARK-4646 Project:

[jira] [Commented] (SPARK-4646) Replace Scala.util.Sorting.quickSort with Sorter(TimSort) in Spark

2014-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14228129#comment-14228129 ] Apache Spark commented on SPARK-4646: - User 'maropu' has created a pull request for

[jira] [Commented] (SPARK-4645) Asynchronous execution in HiveThriftServer2 with Hive 0.13.1 doesn't play well with Simba ODBC driver

2014-11-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14228130#comment-14228130 ] Apache Spark commented on SPARK-4645: - User 'liancheng' has created a pull request for