I think you should investigate apache zeppelin and livy 崔苗(数据与人工智能产品开发部) <0049003...@znv.com>于2018年11月2日 周五11:01写道:
> > Hi, > we want to execute spark code with out submit application.jar,like this > code: > > public static void main(String args[]) throws Exception{ > SparkSession spark = SparkSession > .builder() > .master("local[*]") > .appName("spark test") > .getOrCreate(); > > Dataset<Row> testData = > spark.read().csv(".\\src\\main\\java\\Resources\\no_schema_iris.scv"); > testData.printSchema(); > testData.show(); > } > > the above code can work well with idea , do not need to generate jar file > and submit , but if we replace master("local[*]") with master("yarn") , > it can't work , so is there a way to use cluster sparkSession like local > sparkSession ? we need to dynamically execute spark code in web server > according to the different request , such as filter request will call > dataset.filter() , so there is no application.jar to submit . > > 0049003208 > 0049003...@znv.com > > <https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=0049003208&uid=0049003208%40znv.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%220049003208%40znv.com%22%5D> > 签名由 网易邮箱大师 <https://mail.163.com/dashi/dlpro.html?from=mail81> 定制 > --------------------------------------------------------------------- To > unsubscribe e-mail: user-unsubscr...@spark.apache.org