Dongjoon Hyun created SPARK-15773: ------------------------------------- Summary: Avoid creating local variable `sc` in examples Key: SPARK-15773 URL: https://issues.apache.org/jira/browse/SPARK-15773 Project: Spark Issue Type: Task Components: Examples Reporter: Dongjoon Hyun Priority: Minor
Instead of using local variable `sc` like the following example, this issue uses `spark.sparkContext`. This makes examples more concise, and also fixes some misleading, i.e., creating SparkContext from SparkSession. {code} - println("Creating SparkContext") - val sc = spark.sparkContext - println("Writing local file to DFS") val dfsFilename = dfsDirPath + "/dfs_read_write_test" - val fileRDD = sc.parallelize(fileContents) + val fileRDD = spark.sparkContext.parallelize(fileContents) {code} This will change 12 files (+30 lines, -52 lines). -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org