Re: How to specify "verbose GC" in Spark submit?

[Md. Rezaul Karim]

Thanks, Bryan. Got your point.

Regards,
_
*Md. Rezaul Karim*, BSc, MSc
PhD Researcher, INSIGHT Centre for Data Analytics
National University of Ireland, Galway
IDA Business Park, Dangan, Galway, Ireland
Web: http://www.reza-analytics.eu/index.html


On 6 February 2017 at 13:21, Bryan Jeffrey  wrote:

> Hello.
>
> When specifying GC options for Spark you must determine where you want the
> GC options specified - on the executors or on the driver. When you submit
> your job, for the driver, specify '--driver-java-options
> "-XX:+PrintFlagsFinal  -verbose:gc", etc.  For the executor specify --conf
> "spark.executor.extraJavaOptions=-XX:+PrintFlagsFinal  -verbose:gc", etc.
>
> Bryan Jeffrey
>
> On Mon, Feb 6, 2017 at 8:02 AM, Md. Rezaul Karim <
> rezaul.ka...@insight-centre.org> wrote:
>
>> Dear All,
>>
>> Is there any way to specify verbose GC -i.e. “-verbose:gc
>> -XX:+PrintGCDetails -XX:+PrintGCTimeStamps” in Spark submit?
>>
>>
>>
>> Regards,
>> _
>> *Md. Rezaul Karim*, BSc, MSc
>> PhD Researcher, INSIGHT Centre for Data Analytics
>> National University of Ireland, Galway
>> IDA Business Park, Dangan, Galway, Ireland
>> Web: http://www.reza-analytics.eu/index.html
>> 
>>
>
>

Re: How to specify "verbose GC" in Spark submit?

[Bryan Jeffrey]

Hello.

When specifying GC options for Spark you must determine where you want the
GC options specified - on the executors or on the driver. When you submit
your job, for the driver, specify '--driver-java-options
"-XX:+PrintFlagsFinal  -verbose:gc", etc.  For the executor specify --conf
"spark.executor.extraJavaOptions=-XX:+PrintFlagsFinal  -verbose:gc", etc.

Bryan Jeffrey

On Mon, Feb 6, 2017 at 8:02 AM, Md. Rezaul Karim <
rezaul.ka...@insight-centre.org> wrote:

> Dear All,
>
> Is there any way to specify verbose GC -i.e. “-verbose:gc
> -XX:+PrintGCDetails -XX:+PrintGCTimeStamps” in Spark submit?
>
>
>
> Regards,
> _
> *Md. Rezaul Karim*, BSc, MSc
> PhD Researcher, INSIGHT Centre for Data Analytics
> National University of Ireland, Galway
> IDA Business Park, Dangan, Galway, Ireland
> Web: http://www.reza-analytics.eu/index.html
> 
>

How to specify "verbose GC" in Spark submit?

[Md. Rezaul Karim]

Dear All,

Is there any way to specify verbose GC -i.e. “-verbose:gc
-XX:+PrintGCDetails -XX:+PrintGCTimeStamps” in Spark submit?



Regards,
_
*Md. Rezaul Karim*, BSc, MSc
PhD Researcher, INSIGHT Centre for Data Analytics
National University of Ireland, Galway
IDA Business Park, Dangan, Galway, Ireland
Web: http://www.reza-analytics.eu/index.html