Github user ScrapCodes commented on a diff in the pull request:
https://github.com/apache/spark/pull/552#discussion_r12320653
--- Diff:
examples/src/main/scala/org/apache/spark/examples/GroupByTest.scala ---
@@ -19,24 +19,18 @@ package org.apache.spark.examples
import java.util.Random
-import org.apache.spark.SparkContext
+import org.apache.spark.{SparkConf, SparkContext}
import org.apache.spark.SparkContext._
object GroupByTest {
def main(args: Array[String]) {
- if (args.length == 0) {
- System.err.println(
- "Usage: GroupByTest <master> [numMappers] [numKVPairs] [KeySize]
[numReducers]")
- System.exit(1)
- }
-
- var numMappers = if (args.length > 1) args(1).toInt else 2
- var numKVPairs = if (args.length > 2) args(2).toInt else 1000
- var valSize = if (args.length > 3) args(3).toInt else 1000
- var numReducers = if (args.length > 4) args(4).toInt else numMappers
-
- val sc = new SparkContext(args(0), "GroupBy Test",
- System.getenv("SPARK_HOME"),
SparkContext.jarOfClass(this.getClass).toSeq)
+ val sparkConf = new SparkConf().setAppName("GroupBy Test")
+ var numMappers = if (args.length > 0) args(0).toInt else 2
--- End diff --
Here as well !
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
