packaged as part of my main
>>> jar. It worked well both on driver and locally, but not on executors.
>>>
>>> Regards,
>>>
>>> Bryan Jeffrey
>>>
>>> Get Outlook for Android <https://aka.ms/ghei36>
>>>
>>> --
>&g
June 27, 2020 1:23:24 AM
>
> *To:* Bryan Jeffrey
> *Cc:* user
> *Subject:* Re: Metrics Problem
>
> One option is to create your main jar included with metrics jar like a fat
> jar.
>
> On Sat, Jun 27, 2020 at 8:04 AM Bryan Jeffrey
> wrote:
>
> Srinivas,
>
>
, June 27, 2020 1:23:24 AM
To: Bryan Jeffrey
Cc: user
Subject: Re: Metrics Problem
One option is to create your main jar included with metrics jar like a fat jar.
On Sat, Jun 27, 2020 at 8:04 AM Bryan Jeffrey
mailto:bryan.jeff...@gmail.com>> wrote:
Srinivas,
Thanks for the in
6>
>
> --
> *From:* Srinivas V
> *Sent:* Friday, June 26, 2020 9:47:52 PM
> *To:* Bryan Jeffrey
> *Cc:* user
> *Subject:* Re: Metrics Problem
>
> It should work when you are giving hdfs path as long as your jar exists in
> the path.
> Your
providers which appear to work.
Regards,
Bryan
Get Outlook for Android<https://aka.ms/ghei36>
From: Srinivas V
Sent: Friday, June 26, 2020 9:47:52 PM
To: Bryan Jeffrey
Cc: user
Subject: Re: Metrics Problem
It should work when you are giving hdfs path a
It should work when you are giving hdfs path as long as your jar exists in
the path.
Your error is more security issue (Kerberos) or Hadoop dependencies missing
I think, your error says :
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation
On Fri, Jun 26, 2020 at 8:44 PM
It may be helpful to note that I'm running in Yarn cluster mode. My goal
is to avoid having to manually distribute the JAR to all of the various
nodes as this makes versioning deployments difficult.
On Thu, Jun 25, 2020 at 5:32 PM Bryan Jeffrey
wrote:
> Hello.
>
> I am running Spark 2.4.4. I
Hello.
I am running Spark 2.4.4. I have implemented a custom metrics producer. It
works well when I run locally, or specify the metrics producer only for the
driver. When I ask for executor metrics I run into ClassNotFoundExceptions
*Is it possible to pass a metrics JAR via --jars? If so what
