Setting maxPrintString in Spark Repl to view SQL query plans
Hi, I want to increase the maxPrintString the Spark repl to look at SQL query plans, as they are truncated by default at 800 chars, but don't know how to set this. You don't seem to be able to do it in the same way as you would with with Scala repl. Anyone know how to set this? Also anyone know a good document describing the interpretation of Spark SQL query plans? Thanks Mick -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Setting-maxPrintString-in-Spark-Repl-to-view-SQL-query-plans-tp21476.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
Re: Setting maxPrintString in Spark Repl to view SQL query plans
You should be able to do something like: sbt -Dscala.repl.maxprintstring=64000 hive/console Here's an overview of catalyst: https://docs.google.com/a/databricks.com/document/d/1Hc_Ehtr0G8SQUg69cmViZsMi55_Kf3tISD9GPGU5M1Y/edit#heading=h.vp2tej73rtm2 On Tue, Feb 3, 2015 at 1:37 AM, Mick Davies wrote: > Hi, > > I want to increase the maxPrintString the Spark repl to look at SQL query > plans, as they are truncated by default at 800 chars, but don't know how to > set this. You don't seem to be able to do it in the same way as you would > with with Scala repl. > > > Anyone know how to set this? > > Also anyone know a good document describing the interpretation of Spark SQL > query plans? > > > Thanks Mick > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Setting-maxPrintString-in-Spark-Repl-to-view-SQL-query-plans-tp21476.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > - > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > >
Re: Setting maxPrintString in Spark Repl to view SQL query plans
I'll add i usually just do println(query.queryExecution) On Tue, Feb 3, 2015 at 11:34 AM, Michael Armbrust wrote: > You should be able to do something like: > > sbt -Dscala.repl.maxprintstring=64000 hive/console > > Here's an overview of catalyst: > https://docs.google.com/a/databricks.com/document/d/1Hc_Ehtr0G8SQUg69cmViZsMi55_Kf3tISD9GPGU5M1Y/edit#heading=h.vp2tej73rtm2 > > On Tue, Feb 3, 2015 at 1:37 AM, Mick Davies > wrote: > >> Hi, >> >> I want to increase the maxPrintString the Spark repl to look at SQL query >> plans, as they are truncated by default at 800 chars, but don't know how >> to >> set this. You don't seem to be able to do it in the same way as you would >> with with Scala repl. >> >> >> Anyone know how to set this? >> >> Also anyone know a good document describing the interpretation of Spark >> SQL >> query plans? >> >> >> Thanks Mick >> >> >> >> -- >> View this message in context: >> http://apache-spark-user-list.1001560.n3.nabble.com/Setting-maxPrintString-in-Spark-Repl-to-view-SQL-query-plans-tp21476.html >> Sent from the Apache Spark User List mailing list archive at Nabble.com. >> >> - >> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >> For additional commands, e-mail: user-h...@spark.apache.org >> >> >
