Which image are you using ? On Tue, Mar 10, 2020, 16:27 Eyal Pe'er <eyal.p...@startapp.com> wrote:
> Hi Rafi, > > The file exists (and is the file from the official imageJ, please see > below). > > The user is root and it has permission. I am running in HA mode using > docker. > > > > cat /opt/flink/conf/log4j-console.properties > > > > > ################################################################################ > > # Licensed to the Apache Software Foundation (ASF) under one > > # or more contributor license agreements. See the NOTICE file > > # distributed with this work for additional information > > # regarding copyright ownership. The ASF licenses this file > > # to you under the Apache License, Version 2.0 (the > > # "License"); you may not use this file except in compliance > > # with the License. You may obtain a copy of the License at > > # > > # http://www.apache.org/licenses/LICENSE-2.0 > > # > > # Unless required by applicable law or agreed to in writing, software > > # distributed under the License is distributed on an "AS IS" BASIS, > > # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. > > # See the License for the specific language governing permissions and > > # limitations under the License. > > > ################################################################################ > > > > # This affects logging for both user code and Flink > > rootLogger.level = INFO > > rootLogger.appenderRef.console.ref = ConsoleAppender > > > > # Uncomment this if you want to _only_ change Flink's logging > > #log4j.logger.org.apache.flink=INFO > > > > # The following lines keep the log level of common libraries/connectors on > > # log level INFO. The root logger does not override this. You have to > manually > > # change the log levels here. > > logger.akka.name = akka > > logger.akka.level = INFO > > logger.kafka.name= org.apache.kafka > > logger.kafka.level = INFO > > logger.hadoop.name = org.apache.hadoop > > logger.hadoop.level = INFO > > logger.zookeeper.name = org.apache.zookeeper > > logger.zookeeper.level = INFO > > > > # Log all infos to the console > > appender.console.name = ConsoleAppender > > appender.console.type = CONSOLE > > appender.console.layout.type = PatternLayout > > appender.console.layout.pattern = %d{yyyy-MM-dd HH:mm:ss,SSS} %-5p %-60c > %x - %m%n > > > > # Suppress the irrelevant (wrong) warnings from the Netty channel handler > > logger.netty.name = > org.apache.flink.shaded.akka.org.jboss.netty.channel.DefaultChannelPipeline > > logger.netty.level = OFF > > > > Best regards > > Eyal Peer */ *Data Platform Developer > > [image: cid:image003.png@01D32C73.C785C410] > > > > *From:* Rafi Aroch <rafi.ar...@gmail.com> > *Sent:* Tuesday, March 10, 2020 3:55 PM > *To:* Eyal Pe'er <eyal.p...@startapp.com> > *Cc:* user <user@flink.apache.org>; StartApp R&D Data Platform < > startapprnd...@startapp.com> > *Subject:* Re: Setting app Flink logger > > > > Hi Eyal, > > > > Sounds trivial, but can you verify that the file actually exists in > /opt/flink/conf/log4j-console.properties? Also, verify that the user > running the process has read permissions to that file. > > You said you use Flink in YARN mode, but the the example above you run > inside a docker image so this is a bit confusing. Notice that the official > docker images run as "flink" user and group ids. > > > > If you wish to try to use Logback instead, you can place you logback.xml > file as part of your project resources folder to include it in the > classpath. That should automatically get detected on startup. > > > > Hope this helps, > > Rafi > > > > > > On Tue, Mar 10, 2020 at 1:42 PM Eyal Pe'er <eyal.p...@startapp.com> wrote: > > Hi, > > I am running Flink in YARN mode using the official image with few > additional files. > > I’ve noticed that my logger failed to initialize: > > > > root:~# docker logs flink-task-manager > > Starting taskexecutor as a console application on host ***. > > log4j:WARN No appenders could be found for logger > (org.apache.flink.runtime.taskexecutor.TaskManagerRunner). > > log4j:WARN Please initialize the log4j system properly. > > log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for > more info. > > > > I followed the documentation > <https://ci.apache.org/projects/flink/flink-docs-stable/monitoring/logging.html> > and seems like all related configuration files exist. > > Currently, I am using the default files from the official image > https://github.com/apache/flink/tree/master/flink-dist/src/main/flink-bin/conf > > > > In addition, seems like the process got the right parameters: > > root 21892 21866 1 08:29 ? 00:02:06 > /usr/local/openjdk-8/bin/java -XX:+UseG1GC > -Dlog4j.configuration=file:/opt/flink/conf/log4j-console.properties > -Dlogback.configurationFile=file:/opt/flink/conf/logback-console.xml > -classpath > /opt/flink/lib/flink-metrics-prometheus-1.9.2.jar:/opt/flink/lib/flink-table-blink_2.11-1.9.2.jar:/opt/flink/lib/flink-table_2.11-1.9.2.jar:/opt/flink/lib/log4j-1.2.17.jar:/opt/flink/lib/slf4j-log4j12-1.7.15.jar:/opt/flink/lib/flink-dist_2.11-1.9.2.jar::: > org.apache.flink.runtime.taskexecutor.TaskManagerRunner --configDir > /opt/flink/conf > > > > What am I doing wrong ? How can I turn logger on? > > Best regards > > Eyal Peer > >
