[ https://issues.apache.org/jira/browse/SPARK-15773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dongjoon Hyun updated SPARK-15773: ---------------------------------- Summary: Avoid creating local variable `sc` in examples if possible (was: Avoid creating local variable `sc` in examples) > Avoid creating local variable `sc` in examples if possible > ---------------------------------------------------------- > > Key: SPARK-15773 > URL: https://issues.apache.org/jira/browse/SPARK-15773 > Project: Spark > Issue Type: Task > Components: Examples > Reporter: Dongjoon Hyun > Priority: Minor > > Instead of using local variable `sc` like the following example, this issue > uses `spark.sparkContext`. This makes examples more concise, and also fixes > some misleading, i.e., creating SparkContext from SparkSession. > {code} > - println("Creating SparkContext") > - val sc = spark.sparkContext > - > println("Writing local file to DFS") > val dfsFilename = dfsDirPath + "/dfs_read_write_test" > - val fileRDD = sc.parallelize(fileContents) > + val fileRDD = spark.sparkContext.parallelize(fileContents) > {code} > This will change 12 files (+30 lines, -52 lines). -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org