Does the path /home/njoshi/dev/outputs/test_/plots/ exist on the driver ? Best Regards, Sonal Founder, Nube Technologies <http://www.nubetech.co> Reifier at Strata Hadoop World <https://www.youtube.com/watch?v=eD3LkpPQIgM> Reifier at Spark Summit 2015 <https://spark-summit.org/2015/events/real-time-fuzzy-matching-with-spark-and-elastic-search/>
<http://in.linkedin.com/in/sonalgoyal> On Wed, May 25, 2016 at 2:07 AM, njoshi <nikhil.jo...@teamaol.com> wrote: > For an analysis app, I have to make ROC curves on the fly and save to > disc. I > am using scala-chart for this purpose and doing the following in my Spark > app: > > > val rocs = performances.map{case (id, (auRoc, roc)) => (id, > roc.collect().toList)} > XYLineChart(rocs.toSeq, title = "Pooled Data Performance: > AuROC").saveAsPNG(outputpath + "/plots/global.png") > > > However, I am getting the following exception. Does anyone have idea of the > cause? > > > Exception in thread "main" java.io.FileNotFoundException: > file:/home/njoshi/dev/outputs/test_/plots/global.png (No such file or > directory) > at java.io.FileOutputStream.open(Native Method) > at java.io.FileOutputStream.<init>(FileOutputStream.java:213) > at java.io.FileOutputStream.<init>(FileOutputStream.java:101) > at > > scalax.chart.exporting.PNGExporter$.saveAsPNG$extension(exporting.scala:138) > at > > com.aol.advertising.ml.globaldata.EvaluatorDriver$.main(EvaluatorDriver.scala:313) > at > > com.aol.advertising.ml.globaldata.EvaluatorDriver.main(EvaluatorDriver.scala) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:483) > at > > org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:731) > at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181) > at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206) > at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121) > at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) > > > Thanks in advance, > > Nikhil > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Error-while-saving-plots-tp27016.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > >
