You can also run it on REPL and test to see if you are getting the expected result.
Thank You, Irving Duran On Tue, Feb 21, 2017 at 8:01 AM, Yong Zhang <java8...@hotmail.com> wrote: > You can always use explain method to validate your DF or SQL, before any > action. > > > Yong > > > ------------------------------ > *From:* Jacek Laskowski <ja...@japila.pl> > *Sent:* Tuesday, February 21, 2017 4:34 AM > *To:* Linyuxin > *Cc:* user > *Subject:* Re: [SparkSQL] pre-check syntex before running spark job? > > Hi, > > Never heard about such a tool before. You could use Antlr to parse SQLs > (just as Spark SQL does while parsing queries). I think it's a one-hour > project. > > Jacek > > On 21 Feb 2017 4:44 a.m., "Linyuxin" <linyu...@huawei.com> wrote: > > Hi All, > Is there any tool/api to check the sql syntax without running spark job > actually? > > Like the siddhiQL on storm here: > SiddhiManagerService. validateExecutionPlan > https://github.com/wso2/siddhi/blob/master/modules/siddhi- > core/src/main/java/org/wso2/siddhi/core/SiddhiManagerService.java > it can validate the syntax before running the sql on storm > > this is very useful for exposing sql string as a DSL of the platform. > > --------------------------------------------------------------------- > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > > >
