Re: sessionState could not be accessed in spark-shell command line
I am examined the code and found lazy val is added recently in 2.2.0 2017-09-07 14:34 GMT+08:00 ChenJun Zou <stephen@gmail.com>: > thanks, > my mistake > > 2017-09-07 14:21 GMT+08:00 sujith chacko <sujithchacko.2...@gmail.com>: > >> If your intention is to just view the logical plan in spark shell then I >> think you can follow the query which I mentioned in previous mail. In >> spark 2.1.0 sessionState is a private member which you cannot access. >> >> Thanks. >> >> >> On Thu, 7 Sep 2017 at 11:39 AM, ChenJun Zou <stephen@gmail.com> >> wrote: >> >>> spark-2.1.1 I use >>> >>> >>> >>> 2017-09-07 14:00 GMT+08:00 sujith chacko <sujithchacko.2...@gmail.com>: >>> >>>> Hi, >>>> may I know which version of spark you are using, in 2.2 I tried >>>> with below query in spark-shell for viewing the logical plan and it's >>>> working fine >>>> >>>> spark.sql("explain extended select * from table1") >>>> >>>> The above query you can use for seeing logical plan. >>>> >>>> Thanks, >>>> Sujith >>>> >>>> On Thu, 7 Sep 2017 at 11:03 AM, ChenJun Zou <stephen@gmail.com> >>>> wrote: >>>> >>>>> Hi, >>>>> >>>>> when I use spark-shell to get the logical plan of sql, an error >>>>> occurs >>>>> >>>>> scala> spark.sessionState >>>>> :30: error: lazy value sessionState in class SparkSession >>>>> cannot be accessed in org.apache.spark.sql.SparkSession >>>>>spark.sessionState >>>>> ^ >>>>> >>>>> But if I use spark-submit to access the "sessionState" variable, It's >>>>> OK. >>>>> >>>>> Is there a way to access it in spark-shell? >>>>> >>>> >>> >
Re: sessionState could not be accessed in spark-shell command line
thanks, my mistake 2017-09-07 14:21 GMT+08:00 sujith chacko <sujithchacko.2...@gmail.com>: > If your intention is to just view the logical plan in spark shell then I > think you can follow the query which I mentioned in previous mail. In > spark 2.1.0 sessionState is a private member which you cannot access. > > Thanks. > > > On Thu, 7 Sep 2017 at 11:39 AM, ChenJun Zou <stephen@gmail.com> wrote: > >> spark-2.1.1 I use >> >> >> >> 2017-09-07 14:00 GMT+08:00 sujith chacko <sujithchacko.2...@gmail.com>: >> >>> Hi, >>> may I know which version of spark you are using, in 2.2 I tried with >>> below query in spark-shell for viewing the logical plan and it's working >>> fine >>> >>> spark.sql("explain extended select * from table1") >>> >>> The above query you can use for seeing logical plan. >>> >>> Thanks, >>> Sujith >>> >>> On Thu, 7 Sep 2017 at 11:03 AM, ChenJun Zou <stephen@gmail.com> >>> wrote: >>> >>>> Hi, >>>> >>>> when I use spark-shell to get the logical plan of sql, an error occurs >>>> >>>> scala> spark.sessionState >>>> :30: error: lazy value sessionState in class SparkSession >>>> cannot be accessed in org.apache.spark.sql.SparkSession >>>>spark.sessionState >>>> ^ >>>> >>>> But if I use spark-submit to access the "sessionState" variable, It's >>>> OK. >>>> >>>> Is there a way to access it in spark-shell? >>>> >>> >>
Re: sessionState could not be accessed in spark-shell command line
spark-2.1.1 I use 2017-09-07 14:00 GMT+08:00 sujith chacko <sujithchacko.2...@gmail.com>: > Hi, > may I know which version of spark you are using, in 2.2 I tried with > below query in spark-shell for viewing the logical plan and it's working > fine > > spark.sql("explain extended select * from table1") > > The above query you can use for seeing logical plan. > > Thanks, > Sujith > > On Thu, 7 Sep 2017 at 11:03 AM, ChenJun Zou <stephen@gmail.com> wrote: > >> Hi, >> >> when I use spark-shell to get the logical plan of sql, an error occurs >> >> scala> spark.sessionState >> :30: error: lazy value sessionState in class SparkSession cannot >> be accessed in org.apache.spark.sql.SparkSession >>spark.sessionState >> ^ >> >> But if I use spark-submit to access the "sessionState" variable, It's OK. >> >> Is there a way to access it in spark-shell? >> >
sessionState could not be accessed in spark-shell command line
Hi, when I use spark-shell to get the logical plan of sql, an error occurs scala> spark.sessionState :30: error: lazy value sessionState in class SparkSession cannot be accessed in org.apache.spark.sql.SparkSession spark.sessionState ^ But if I use spark-submit to access the "sessionState" variable, It's OK. Is there a way to access it in spark-shell?