Re: Running spark with javaagent configuration

2019-05-15 Thread Akshay Bhardwaj
Hi Anton, Do you have the option of storing the JAR file on HDFS, which can be accessed via spark in your cluster? Akshay Bhardwaj +91-97111-33849 On Thu, May 16, 2019 at 12:04 AM Oleg Mazurov wrote: > You can see what Uber JVM does at > https://github.com/uber-common/jvm-profiler : > > --con

Re: Running spark with javaagent configuration

2019-05-15 Thread Oleg Mazurov
You can see what Uber JVM does at https://github.com/uber-common/jvm-profiler : --conf spark.jars=hdfs://hdfs_url/lib/jvm-profiler-1.0.0.jar > --conf spark.executor.extraJavaOptions=-javaagent:jvm-profiler-1.0.0.jar -- Oleg On Wed, May 15, 2019 at 6:28 AM Anton Puzanov wrote: > Hi everyon

Running spark with javaagent configuration

2019-05-15 Thread Anton Puzanov
Hi everyone, I want to run my spark application with javaagent, specifically I want to use newrelic with my application. When I run spark-submit I must pass --conf "spark.driver.extraJavaOptions=-javaagent=" My problem is that I can't specify the full path as I run in cluster mode and I don't kn