I thought we could see this on the Spark Web UI storage tab. May be I was
looking at something else too.
On Sep 11, 2014, at 8:47 PM, Sandy Ryza wrote:
> Hmm, well I can't find it now, must have been hallucinating. Do you know
> off the top of your head where I'd be able to find the size to lo
It is in the dag scheduler. Look for broadcast.
On Thursday, September 11, 2014, Sandy Ryza wrote:
> Hmm, well I can't find it now, must have been hallucinating. Do you know
> off the top of your head where I'd be able to find the size to log it?
>
> On Thu, Sep 11, 2014 at 6:33 PM, Reynold Xin
Hmm, well I can't find it now, must have been hallucinating. Do you know
off the top of your head where I'd be able to find the size to log it?
On Thu, Sep 11, 2014 at 6:33 PM, Reynold Xin wrote:
> I didn't know about that
>
> On Thu, Sep 11, 2014 at 6:29 PM, Sandy Ryza
> wrote:
>
>> It u
I didn't know about that
On Thu, Sep 11, 2014 at 6:29 PM, Sandy Ryza wrote:
> It used to be available on the UI, no?
>
> On Thu, Sep 11, 2014 at 6:26 PM, Reynold Xin wrote:
>
> > I don't think so. We should probably add a line to log it.
> >
> >
> > On Thursday, September 11, 2014, Sandy R
It used to be available on the UI, no?
On Thu, Sep 11, 2014 at 6:26 PM, Reynold Xin wrote:
> I don't think so. We should probably add a line to log it.
>
>
> On Thursday, September 11, 2014, Sandy Ryza
> wrote:
>
>> After the change to broadcast all task data, is there any easy way to
>> discov
I don't think so. We should probably add a line to log it.
On Thursday, September 11, 2014, Sandy Ryza wrote:
> After the change to broadcast all task data, is there any easy way to
> discover the serialized size of the data getting sent down for a task?
>
> thanks,
> -Sandy
>
After the change to broadcast all task data, is there any easy way to
discover the serialized size of the data getting sent down for a task?
thanks,
-Sandy
