Re: No appenders could be found for logger (org.apache.celeborn.mapreduce.v2.app.MRAppMasterWithCeleborn)
Hi Lewis, Is there any progress to share about running MapReduce jobs with the Celeborn? Regards, Ethan Feng Ethan Feng 于2023年10月19日周四 18:43写道： > > Hi Lewis, > > Regarding the log4j warnings you're seeing, it sounds like there may > be some configuration required. I suggest checking the Hadoop docs for > log4j configuration, as that should help you resolve the issue. Or > adding log4j2 into your own Hadoop distribution might be a solution. > > Regards, > Ethan Feng > > lewis john mcgibbney 于2023年10月19日周四 12:37写道： > > > > Hi user@, > > > > I am making progress in my experiments integrating Nutch > > 1.20-SNAPSHOT, Hadoop 3.3.4 and Celeborn 0.4.0-SNAPSHOT-incubating! > > > > In both the Hadoop work count example and with all of the Nutch > > MapReduce jobs I run, I see the following output present in the YARN > > container stderr log output > > > > log4j:WARN No appenders could be found for logger > > (org.apache.celeborn.mapreduce.v2.app.MRAppMasterWithCeleborn). > > log4j:WARN Please initialize the log4j system properly. > > log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig > > for more info. > > > > Looking into the Celeborn source [0] I see that Celeborn uses Slf4j > > over Log4j2 but I am not sure how that plays with the above Hadoop > > distribution. I think some further configuration is required... > > > > lewismc > > > > [0] > > https://github.com/apache/incubator-celeborn/blob/a5dfd67d5b9bcb7d5da59f441ed1d60b4bc27cd3/client-mr/mr/src/main/java/org/apache/celeborn/mapreduce/v2/app/MRAppMasterWithCeleborn.java#L50 > > > > -- > > http://home.apache.org/~lewismc/ > > http://people.apache.org/keys/committer/lewismc
Re: No appenders could be found for logger (org.apache.celeborn.mapreduce.v2.app.MRAppMasterWithCeleborn)
Hi Lewis, Regarding the log4j warnings you're seeing, it sounds like there may be some configuration required. I suggest checking the Hadoop docs for log4j configuration, as that should help you resolve the issue. Or adding log4j2 into your own Hadoop distribution might be a solution. Regards, Ethan Feng lewis john mcgibbney 于2023年10月19日周四 12:37写道： > > Hi user@, > > I am making progress in my experiments integrating Nutch > 1.20-SNAPSHOT, Hadoop 3.3.4 and Celeborn 0.4.0-SNAPSHOT-incubating! > > In both the Hadoop work count example and with all of the Nutch > MapReduce jobs I run, I see the following output present in the YARN > container stderr log output > > log4j:WARN No appenders could be found for logger > (org.apache.celeborn.mapreduce.v2.app.MRAppMasterWithCeleborn). > log4j:WARN Please initialize the log4j system properly. > log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig > for more info. > > Looking into the Celeborn source [0] I see that Celeborn uses Slf4j > over Log4j2 but I am not sure how that plays with the above Hadoop > distribution. I think some further configuration is required... > > lewismc > > [0] > https://github.com/apache/incubator-celeborn/blob/a5dfd67d5b9bcb7d5da59f441ed1d60b4bc27cd3/client-mr/mr/src/main/java/org/apache/celeborn/mapreduce/v2/app/MRAppMasterWithCeleborn.java#L50 > > -- > http://home.apache.org/~lewismc/ > http://people.apache.org/keys/committer/lewismc
No appenders could be found for logger (org.apache.celeborn.mapreduce.v2.app.MRAppMasterWithCeleborn)
Hi user@, I am making progress in my experiments integrating Nutch 1.20-SNAPSHOT, Hadoop 3.3.4 and Celeborn 0.4.0-SNAPSHOT-incubating! In both the Hadoop work count example and with all of the Nutch MapReduce jobs I run, I see the following output present in the YARN container stderr log output log4j:WARN No appenders could be found for logger (org.apache.celeborn.mapreduce.v2.app.MRAppMasterWithCeleborn). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. Looking into the Celeborn source [0] I see that Celeborn uses Slf4j over Log4j2 but I am not sure how that plays with the above Hadoop distribution. I think some further configuration is required... lewismc [0] https://github.com/apache/incubator-celeborn/blob/a5dfd67d5b9bcb7d5da59f441ed1d60b4bc27cd3/client-mr/mr/src/main/java/org/apache/celeborn/mapreduce/v2/app/MRAppMasterWithCeleborn.java#L50 -- http://home.apache.org/~lewismc/ http://people.apache.org/keys/committer/lewismc
