Re: history-server does't read logs which are on FS

2015-04-20 Thread Serega Sheypak
Thanks, it helped. We can't use Spark 1.3 because Cassandra DSE doesn't support it. 2015-04-17 21:48 GMT+02:00 Imran Rashid : > are you calling sc.stop() at the end of your applications? > > The history server only displays completed applications, but if you don't > call sc.stop(), it doesn't kno

Re: history-server does't read logs which are on FS

2015-04-17 Thread Imran Rashid
are you calling sc.stop() at the end of your applications? The history server only displays completed applications, but if you don't call sc.stop(), it doesn't know that those applications have been stopped. Note that in spark 1.3, the history server can also display running applications (includi

history-server does't read logs which are on FS

2015-04-17 Thread Serega Sheypak
Hi, started history-server Here is UI output: - *Event log directory:* file:/var/log/spark/applicationHistory/ No completed applications found! Did you specify the correct logging directory? Please verify your setting of spark.history.fs.logDirectory and whether you have the permissions to a