Re: Flink Memory analyze on AWS EMR

2020-05-13 Thread Jacky D
gt;>>(to execute a class) >>>>>>>>or java [-options] -jar jarfile [args...] >>>>>>>>(to execute a jar file) >>>>>>>> where options include: >>>>>>>> -d32 use a

Re: Flink Memory analyze on AWS EMR

2020-05-12 Thread Xintong Song
gt;>>>> >>>>>>> -cp >>>>>>> -classpath >>>>>>> A : separated list of directories, JAR archives, >>>>>>> and ZIP archives to search for class files. >>&

Re: Flink Memory analyze on AWS EMR

2020-05-12 Thread Jacky D
nt product version and exit >>>>>> -version: >>>>>> Warning: this feature is deprecated and will be >>>>>> removed >>>>>> in a future release. >>>>>> require the specified version to ru

Re: Flink Memory analyze on AWS EMR

2020-05-12 Thread Arvid Heise
;>>>> include/exclude user private JREs in the version >>>>> search >>>>> -? -help print this help message >>>>> -Xprint help on non-standard options >>>>> -ea[:...|:] >>>>

Re: Flink Memory analyze on AWS EMR

2020-05-12 Thread Jacky D
ertions >>>> enable system assertions >>>> -dsa | -disablesystemassertions >>>> disable system assertions >>>> -agentlib:[=] >>>> load native agent library , e.g. >>>

Re: Flink Memory analyze on AWS EMR

2020-05-11 Thread Xintong Song
>>> load native agent library by full pathname >>> -javaagent:[=] >>> load Java programming language agent, see >>> java.lang.instrument >>> -splash: >>> show splash screen with sp

Re: Flink Memory analyze on AWS EMR

2020-05-11 Thread Jacky D
anguage agent, see >> java.lang.instrument >> -splash: >> show splash screen with specified image >> See >> http://www.oracle.com/technetwork/java/javase/documentation/index.html >> for more details. >> >> Thanks >> Jacky &g

Re: Flink Memory analyze on AWS EMR

2020-05-11 Thread Robert Metzger
> >> Hey Jacky, >> >> The error says "The YARN application unexpectedly switched to state >> FAILED during deployment.". >> Have you tried retrieving the YARN application logs? >> Does the YARN UI / resource manager logs reveal anything on the r

Re: Flink Memory analyze on AWS EMR

2020-05-11 Thread Jacky D
arded message - >> 发件人: Jacky D >> Date: 2020年5月11日周一 下午3:12 >> Subject: Re: Flink Memory analyze on AWS EMR >> To: Khachatryan Roman >> >> >> Hi, Roman >> >> Thanks for quick response , I tried without logFIle option b

Re: Flink Memory analyze on AWS EMR

2020-05-11 Thread Robert Metzger
y 11, 2020 at 9:34 PM Jacky D wrote: > > > -- Forwarded message - > 发件人: Jacky D > Date: 2020年5月11日周一 下午3:12 > Subject: Re: Flink Memory analyze on AWS EMR > To: Khachatryan Roman > > > Hi, Roman > > Thanks for quick response , I tried witho

Fwd: Flink Memory analyze on AWS EMR

2020-05-11 Thread Jacky D
-- Forwarded message - 发件人: Jacky D Date: 2020年5月11日周一 下午3:12 Subject: Re: Flink Memory analyze on AWS EMR To: Khachatryan Roman Hi, Roman Thanks for quick response , I tried without logFIle option but failed with same error , I'm currently using flink 1.6 https

Re: Flink Memory analyze on AWS EMR

2020-05-11 Thread Khachatryan Roman
Hi Jacky, Did you try it without -XX:LogFile=${FLINK_LOG_PREFIX}.jit ? Probably, Flink can't write to this location. Also, you can try other tools described at https://ci.apache.org/projects/flink/flink-docs-stable/monitoring/application_profiling.html Regards, Roman On Mon, May 11, 2020 at

Flink Memory analyze on AWS EMR

2020-05-11 Thread Jacky D
hi, All I'm encounter a memory issue with my flink job on AWS EMR(current flink version 1.6.2) , I would like to find the root cause so I'm trying JITWatch on my local standalone cluster but I can not use it on EMR . after I add following config on flink-conf.yaml : env.java.opts: