RE: Flink logging

2022-01-25 Thread Oran Shuster
It's hard for me to see the issue from what you posted, However i can post how i added that jar to my flink pods and you can compare Instead of creating a custom image i loaded the JAR as a config map You can create a configMap easily from a file: 1.Download the jar you want 2.Create the configMap

Re: Flink Logging on EMR

2021-01-05 Thread Arvid Heise
Hi KristoffSC, taskmanager.out should only show the output of the process starting the taskmanager. In most cases, you probably want to look into taskmanager.log. On Tue, Dec 29, 2020 at 3:42 PM KristoffSC wrote: > Hi Mars, > Were you able to solve this problem? > > I'm facing exact same issue.

Re: Flink Logging on EMR

2020-12-29 Thread KristoffSC
Hi Mars, Were you able to solve this problem? I'm facing exact same issue. I dont see logs from taskmanager from my operators (taskmnager.out file) on EMR although running this locally from IDE logs are printed. -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: Flink Logging on EMR

2020-07-02 Thread Ken Krugler
Hi Sateesh, Note that there are three classes of log files, when running Flink on EMR: 1. The output from the main class. Since I typically run the job by sshing onto the master and using the CLI from there, I have control over where that output goes. E.g. nohup bin/flink run -m yarn-cluster -

Re: Flink logging issue with logback

2020-01-09 Thread Maximilian Michels
>> Thanks again, >> >> Abhinav Bajaj >> >> _PS_: Ahh. I see how my email was confusing the first time. >> Hopefully this one is better :P >> >> *From: *Dawid Wysakowicz > <mailto:dwys

Re: Flink logging issue with logback

2020-01-08 Thread Bajaj, Abhinav
gback in Flink. >> >> Is this expected or a known difference? >> >> Thanks again, >> >> Abhinav Bajaj >> >> _PS_: Ahh. I see how my email was confusing the first time. >> Hopefully this one is b

Re: Flink logging issue with logback

2020-01-08 Thread Maximilian Michels
..@here.com>>, "user@flink.apache.org <mailto:user@flink.apache.org>" mailto:user@flink.apache.org>> *Subject: *Re: Flink logging issue with logback Hi Bajaj, I am not entirely sure what is the actual issue you are seeking help, but let me comment on

Re: Flink logging issue with logback

2020-01-07 Thread Dawid Wysakowicz
Bajaj > >   > >   > > _PS_: Ahh. I see how my email was confusing the first time. > Hopefully this one is better :P > >   > >   > > *From: *Dawid Wysakowicz <mailto:dwysakow...@apache.org>> > *Date: *Monday, Janua

Re: Flink logging issue with logback

2020-01-07 Thread Dawid Wysakowicz
> Hopefully this one is better :P > >   > >   > > *From: *Dawid Wysakowicz <mailto:dwysakow...@apache.org>> > *Date: *Monday, January 6, 2020 at 5:13 AM > *Cc: *"Bajaj, Abhinav" <mailto:abhinav.ba...@here.com>>

Re: Flink logging issue with logback

2020-01-06 Thread Yang Wang
back in Flink. > > Is this expected or a known difference? > > > > Thanks again, > > Abhinav Bajaj > > > > > > *PS*: Ahh. I see how my email was confusing the first time. Hopefully > this one is better :P > > > > > > *From: *Dawid Wysakowicz > *Date

Re: Flink logging issue with logback

2020-01-06 Thread Bajaj, Abhinav
k. Is this expected or a known difference? Thanks again, Abhinav Bajaj PS: Ahh. I see how my email was confusing the first time. Hopefully this one is better :P From: Dawid Wysakowicz Date: Monday, January 6, 2020 at 5:13 AM Cc: "Bajaj, Abhinav" , "user@flink.apache.org&q

Re: Flink logging issue with logback

2020-01-06 Thread Dawid Wysakowicz
Hi Bajaj, I am not entirely sure what is the actual issue you are seeking help, but let me comment on your observations. Ad. 1 If you log to the console from the main method this is an expected behavior in both cases (log4j, logback). The std out is being overwritten for the execution of the mai

Re: Flink logging issue with logback

2020-01-05 Thread vino yang
Hi Bajaj, >> Logs from main method(outside of job graph) do not show up in jobmanager logs. IMO, it's normal phenomena. Other ideas, please check the JVM options mentioned by Yang. Best, Vino Yang Wang 于2020年1月6日周一 上午11:18写道: > Hi Bajaj, Abhinav, > > Could you share the start-command of job

Re: Flink logging issue with logback

2020-01-05 Thread Yang Wang
Hi Bajaj, Abhinav, Could you share the start-command of jobmanager and taskmanager. If it is started correctly, we will have a the following jvm options. -Dlog.file=/path/of/taskmanager.log -Dlogback.configurationFile=file:///path/of/logback.xml Best, Yang Bajaj, Abhinav 于2020年1月4日周六 上午7:23写