Hello. When specifying GC options for Spark you must determine where you want the GC options specified - on the executors or on the driver. When you submit your job, for the driver, specify '--driver-java-options "-XX:+PrintFlagsFinal -verbose:gc", etc. For the executor specify --conf "spark.executor.extraJavaOptions=-XX:+PrintFlagsFinal -verbose:gc", etc.
Bryan Jeffrey On Mon, Feb 6, 2017 at 8:02 AM, Md. Rezaul Karim < rezaul.ka...@insight-centre.org> wrote: > Dear All, > > Is there any way to specify verbose GC -i.e. “-verbose:gc > -XX:+PrintGCDetails -XX:+PrintGCTimeStamps” in Spark submit? > > > > Regards, > _________________________________ > *Md. Rezaul Karim*, BSc, MSc > PhD Researcher, INSIGHT Centre for Data Analytics > National University of Ireland, Galway > IDA Business Park, Dangan, Galway, Ireland > Web: http://www.reza-analytics.eu/index.html > <http://139.59.184.114/index.html> >
