Re: TestSQLContext compilation error when run SparkPi in Intellij ?
I am not sure other people's spark debugging environment ( I mean for the master branch) , Anyone can share his experience ? On Sun, Aug 16, 2015 at 10:40 AM, canan chen wrote: > I import the spark source code to intellij, and want to run SparkPi in > intellij, but meet the folliwing weird compilation error? I googled it and > sbt clean doesn't work for me. I am not sure whether anyone else has meet > this issue also, any help is appreciated > > Error:scalac: > while compiling: > /Users/root/github/spark/sql/core/src/main/scala/org/apache/spark/sql/test/TestSQLContext.scala > during phase: jvm > library version: version 2.10.4 > compiler version: version 2.10.4 > reconstructed args: -nobootcp -javabootclasspath : -deprecation -feature > -classpath >
Re: TestSQLContext compilation error when run SparkPi in Intellij ?
Hi Canan, TestSQLContext is no longer a singleton but now a class. It is never meant to be a fully public API, but if you wish to use it you can just instantiate a new one: val sqlContext = new TestSQLContext or just create a new SQLContext from a SparkContext. -Andrew 2015-08-15 20:33 GMT-07:00 canan chen : > I am not sure other people's spark debugging environment ( I mean for the > master branch) , Anyone can share his experience ? > > > On Sun, Aug 16, 2015 at 10:40 AM, canan chen wrote: > >> I import the spark source code to intellij, and want to run SparkPi in >> intellij, but meet the folliwing weird compilation error? I googled it and >> sbt clean doesn't work for me. I am not sure whether anyone else has meet >> this issue also, any help is appreciated >> >> Error:scalac: >> while compiling: >> /Users/root/github/spark/sql/core/src/main/scala/org/apache/spark/sql/test/TestSQLContext.scala >> during phase: jvm >> library version: version 2.10.4 >> compiler version: version 2.10.4 >> reconstructed args: -nobootcp -javabootclasspath : -deprecation >> -feature -classpath >> > >
Re: TestSQLContext compilation error when run SparkPi in Intellij ?
Thanks Andrew. On Sun, Aug 16, 2015 at 1:53 PM, Andrew Or wrote: > Hi Canan, TestSQLContext is no longer a singleton but now a class. It is > never meant to be a fully public API, but if you wish to use it you can > just instantiate a new one: > > val sqlContext = new TestSQLContext > > or just create a new SQLContext from a SparkContext. > > -Andrew > > 2015-08-15 20:33 GMT-07:00 canan chen : > >> I am not sure other people's spark debugging environment ( I mean for the >> master branch) , Anyone can share his experience ? >> >> >> On Sun, Aug 16, 2015 at 10:40 AM, canan chen wrote: >> >>> I import the spark source code to intellij, and want to run SparkPi in >>> intellij, but meet the folliwing weird compilation error? I googled it and >>> sbt clean doesn't work for me. I am not sure whether anyone else has meet >>> this issue also, any help is appreciated >>> >>> Error:scalac: >>> while compiling: >>> /Users/root/github/spark/sql/core/src/main/scala/org/apache/spark/sql/test/TestSQLContext.scala >>> during phase: jvm >>> library version: version 2.10.4 >>> compiler version: version 2.10.4 >>> reconstructed args: -nobootcp -javabootclasspath : -deprecation >>> -feature -classpath >>> >> >> >
