This would require a special HDFS log4j appender. Alternatively try the flume log4j appender
> On 08 Dec 2015, at 13:00, sunil m <260885smanik...@gmail.com> wrote: > > Hi! > I configured log4j.properties file in conf folder of spark with following > values... > > log4j.appender.file.File=hdfs://<path_to_log_file> > > I expected all log files to log output to the file in HDFS. > Instead files are created locally. > > Has anybody tried logging to HDFS by configuring log4j.properties? > > Warm regards, > Sunil M --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
