Re: How to stop system info output in spark shell

[Eduardo Costa Alfaia]

Have you already tried in conf/log4j.properties?
log4j.rootCategory=OFF

Em 4/3/14, 13:46, weida xu escreveu:

Hi, alll

When I start spark in the shell. It automatically output some system info every minute, see below. Can I stop or block the output of these info? I tried the ":silent" comnond, but the automatical output remains.

14/04/03 19:34:30 INFO MetadataCleaner: Ran metadata cleaner for SHUFFLE_BLOCK_MANAGER 14/04/03 19:34:30 INFO BlockManager: Dropping non broadcast blocks older than 1396524270698 14/04/03 19:34:30 INFO MetadataCleaner: Ran metadata cleaner for BLOCK_MANAGER 14/04/03 19:34:30 INFO BlockManager: Dropping broadcast blocks older than 1396524270701 14/04/03 19:34:30 INFO MetadataCleaner: Ran metadata cleaner for BROADCAST_VARS 14/04/03 19:34:30 INFO MetadataCleaner: Ran metadata cleaner for HTTP_BROADCAST 14/04/03 19:34:30 INFO MetadataCleaner: Ran metadata cleaner for MAP_OUTPUT_TRACKER 14/04/03 19:34:31 INFO MetadataCleaner: Ran metadata cleaner for SPARK_CONTEXT

14/04/03 19:34:31 INFO DAGScheduler: shuffleToMapStage 0 --> 0
14/04/03 19:34:31 INFO DAGScheduler: stageIdToStage 0 --> 0
14/04/03 19:34:31 INFO DAGScheduler: stageIdToJobIds 0 --> 0
14/04/03 19:34:31 INFO DAGScheduler: pendingTasks 0 --> 0
14/04/03 19:34:31 INFO DAGScheduler: jobIdToStageIds 0 --> 0
14/04/03 19:34:31 INFO DAGScheduler: stageToInfos 0 --> 0

14/04/03 19:34:31 INFO MetadataCleaner: Ran metadata cleaner for DAG_SCHEDULER

--
Informativa sulla Privacy: http://www.unibs.it/node/8155