Hi Lewis, Regarding the log4j warnings you're seeing, it sounds like there may be some configuration required. I suggest checking the Hadoop docs for log4j configuration, as that should help you resolve the issue. Or adding log4j2 into your own Hadoop distribution might be a solution.
Regards, Ethan Feng lewis john mcgibbney <lewi...@apache.org> 于2023年10月19日周四 12:37写道： > > Hi user@, > > I am making progress in my experiments integrating Nutch > 1.20-SNAPSHOT, Hadoop 3.3.4 and Celeborn 0.4.0-SNAPSHOT-incubating! > > In both the Hadoop work count example and with all of the Nutch > MapReduce jobs I run, I see the following output present in the YARN > container stderr log output > > log4j:WARN No appenders could be found for logger > (org.apache.celeborn.mapreduce.v2.app.MRAppMasterWithCeleborn). > log4j:WARN Please initialize the log4j system properly. > log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig > for more info. > > Looking into the Celeborn source [0] I see that Celeborn uses Slf4j > over Log4j2 but I am not sure how that plays with the above Hadoop > distribution. I think some further configuration is required... > > lewismc > > [0] > https://github.com/apache/incubator-celeborn/blob/a5dfd67d5b9bcb7d5da59f441ed1d60b4bc27cd3/client-mr/mr/src/main/java/org/apache/celeborn/mapreduce/v2/app/MRAppMasterWithCeleborn.java#L50 > > -- > http://home.apache.org/~lewismc/ > http://people.apache.org/keys/committer/lewismc
