Re: How to specify "verbose GC" in Spark submit?

2017-02-06 Thread Md. Rezaul Karim
Thanks, Bryan. Got your point. Regards, _ *Md. Rezaul Karim*, BSc, MSc PhD Researcher, INSIGHT Centre for Data Analytics National University of Ireland, Galway IDA Business Park, Dangan, Galway, Ireland Web: http://www.reza-analytics.eu/index.html

Re: How to specify "verbose GC" in Spark submit?

2017-02-06 Thread Bryan Jeffrey
Hello. When specifying GC options for Spark you must determine where you want the GC options specified - on the executors or on the driver. When you submit your job, for the driver, specify '--driver-java-options "-XX:+PrintFlagsFinal -verbose:gc", etc. For the executor specify --conf

How to specify "verbose GC" in Spark submit?

2017-02-06 Thread Md. Rezaul Karim
Dear All, Is there any way to specify verbose GC -i.e. “-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps” in Spark submit? Regards, _ *Md. Rezaul Karim*, BSc, MSc PhD Researcher, INSIGHT Centre for Data Analytics National University of Ireland, Galway IDA