Re: A proposal for Spark 2.0

2015-11-12 Thread witgo
Who has the idea of machine learning? Spark missing some features for machine learning, For example, the parameter server. > 在 2015年11月12日,05:32,Matei Zaharia 写道: > > I like the idea of popping out Tachyon to an optional component too to reduce > the number of

?????? is Branch-1.1 SBT build broken for yarn-alpha ?

2014-08-21 Thread witgo
There's a related discussion https://issues.apache.org/jira/browse/SPARK-2815 -- -- ??: Chester Chenches...@alpinenow.com; : 2014??8??21??(??) 7:42 ??: devdev@spark.apache.org; : Re: is Branch-1.1 SBT build broken for

?????? [SNAPSHOT] Snapshot1 of Spark 1.1.0 has been posted

2014-08-08 Thread witgo
Need a parameter -Phadoop-2.3 eg: ./make-distribution.sh -Dhadoop.version=2.3.0-cdh5.0.2 -Dyarn.version=2.3.0-cdh5.0.2 -Phadoop-2.3 -Pyarn -- -- ??: Debasish Dasdebasish.da...@gmail.com; : 2014??8??8??(??) 3:18 ??:

Re:How to run specific sparkSQL test with maven

2014-08-01 Thread witgo
You can try these commands‍ ./sbt/sbt assembly‍./sbt/sbt test-only *.HiveCompatibilitySuite -Phive‍ ‍ -- Original -- From: 田毅;tia...@asiainfo.com; Date: Fri, Aug 1, 2014 05:00 PM To: devdev@spark.apache.org; Subject: How to run specific sparkSQL test

Re:[VOTE] Release Apache Spark 1.0.2 (RC1)

2014-07-27 Thread witgo
-1 The following bug should be fixed: https://issues.apache.org/jira/browse/SPARK-2677‍ -- Original -- From: Tathagata Das;tathagata.das1...@gmail.com; Date: Sat, Jul 26, 2014 07:08 AM To: dev@spark.apache.orgdev@spark.apache.org; Subject: [VOTE] Release

Re: Add my JIRA username (hsaputra) to Spark's contributor's list

2014-06-04 Thread witgo
Uh,write my name wrong, right should be Guoqiang Li rather than Guoquiang Li -- Original -- From: Kan Zhang;kzh...@apache.org; Date: Wed, Jun 4, 2014 03:00 AM To: devdev@spark.apache.org; Subject: Re: Add my JIRA username (hsaputra) to Spark's

Re:MLlib ALS-- Errors communicating with MapOutputTracker

2014-05-21 Thread witgo
Lack of hard disk space? If yes, you can try https://github.com/apache/spark/pull/828 -- Original -- From: Sue Cai;cai.qian...@hotmail.co.uk; Date: Wed, May 21, 2014 03:31 PM To: devd...@spark.incubator.apache.org; Subject: MLlib ALS-- Errors

Re: [VOTE] Release Apache Spark 1.0.0 (rc5)

2014-05-14 Thread witgo
You need to set: spark.akka.frameSize 5 spark.default.parallelism1 -- Original -- From: Madhu;ma...@madhu.com; Date: Wed, May 14, 2014 09:15 AM To: devd...@spark.incubator.apache.org; Subject: Re: [VOTE] Release Apache Spark 1.0.0 (rc5) I

Re: [VOTE] Release Apache Spark 1.0.0 (rc5)

2014-05-13 Thread witgo
-1 The following bug should be fixed: https://issues.apache.org/jira/browse/SPARK-1817 https://issues.apache.org/jira/browse/SPARK-1712 -- Original -- From: Patrick Wendell;pwend...@gmail.com; Date: Wed, May 14, 2014 04:07 AM To:

[GitHub] spark pull request: SPARK-1254. Consolidate, order, and harmonize ...

2014-03-14 Thread witgo
Github user witgo commented on the pull request: https://github.com/apache/spark/pull/145#issuecomment-37713958 Well done, the PR can fix [ SPARK-1248](https://spark-project.atlassian.net/browse/SPARK-1248) --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request: SPARK-1125: When using a http proxy,the maven ...

2014-03-10 Thread witgo
Github user witgo commented on the pull request: https://github.com/apache/spark/pull/25#issuecomment-37157952 Building the current master using Maven has the same compiler error git checkout 5d98cfc1c8fb17fbbeacc7192ac21c0b038cbd16 mvn -U -Pyarn

[GitHub] spark pull request: Fix #SPARK-1149 Bad partitioners can cause Spa...

2014-03-06 Thread witgo
Github user witgo commented on a diff in the pull request: https://github.com/apache/spark/pull/44#discussion_r10370902 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -847,6 +847,8 @@ class SparkContext( partitions: Seq[Int

[GitHub] spark pull request: fix #SPARK-1149 Bad partitioners can cause Spa...

2014-03-04 Thread witgo
Github user witgo commented on a diff in the pull request: https://github.com/apache/spark/pull/44#discussion_r10284698 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -847,6 +847,8 @@ class SparkContext( partitions: Seq[Int

[GitHub] spark pull request: Update building-with-maven.md

2014-03-03 Thread witgo
GitHub user witgo opened a pull request: https://github.com/apache/spark/pull/70 Update building-with-maven.md mvn -Dhadoop.version=... -Dsuites=spark.repl.ReplSuite test to mvn -Dhadoop.version=... -Dsuites=org.apache.spark.repl.ReplSuite test You can

[GitHub] spark pull request: fix #SPARK-1149 Bad partitioners can cause Spa...

2014-03-03 Thread witgo
Github user witgo commented on a diff in the pull request: https://github.com/apache/spark/pull/44#discussion_r10243090 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -847,6 +847,7 @@ class SparkContext( partitions: Seq[Int

[GitHub] spark pull request: fix #SPARK-1149 Bad partitioners can cause Spa...

2014-03-03 Thread witgo
Github user witgo commented on a diff in the pull request: https://github.com/apache/spark/pull/44#discussion_r10243307 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -847,6 +847,7 @@ class SparkContext( partitions: Seq[Int

[GitHub] spark pull request: fix #SPARK-1149 Bad partitioners can cause Spa...

2014-03-02 Thread witgo
Github user witgo commented on a diff in the pull request: https://github.com/apache/spark/pull/44#discussion_r10199454 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -950,6 +952,8 @@ class SparkContext( resultHandler: (Int, U) = Unit

[GitHub] spark pull request: fix #SPARK-1149 Bad partitioners can cause Spa...

2014-03-01 Thread witgo
Github user witgo commented on a diff in the pull request: https://github.com/apache/spark/pull/44#discussion_r10193837 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -847,6 +847,8 @@ class SparkContext( partitions: Seq[Int

[GitHub] spark pull request: fix #SPARK-1149 Bad partitioners can cause Spa...

2014-02-28 Thread witgo
GitHub user witgo opened a pull request: https://github.com/apache/spark/pull/44 fix #SPARK-1149 Bad partitioners can cause Spark to hang You can merge this pull request into a Git repository by running: $ git pull https://github.com/witgo/spark SPARK-1149 Alternatively you

[GitHub] spark pull request: fix #SPARK-1149 Bad partitioners can cause Spa...

2014-02-28 Thread witgo
Github user witgo commented on a diff in the pull request: https://github.com/apache/spark/pull/44#discussion_r10166854 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -847,6 +847,8 @@ class SparkContext( partitions: Seq[Int

[GitHub] spark pull request: SPARK-1125: When using a http proxy,the maven ...

2014-02-26 Thread witgo
Github user witgo commented on the pull request: https://github.com/apache/spark/pull/25#issuecomment-36218375 Perhaps no one encountered the same problem.Well, let me close this PR. --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request: SPARK-1125: When using a http proxy,the maven ...

2014-02-26 Thread witgo
Github user witgo closed the pull request at: https://github.com/apache/spark/pull/25 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature