> Chris,
> Are you referring to TEZ-2237, or is there some additional work that isn't
> reported yet ?
> 2237 isn't related to Broadcast edges (not just yet anyway); I don't think
> memory is causing issues either - increasing it is an optimization.
>
> If you're running into additional issues o
> they are also HashJoins, so memory concerns are being looked at (the
>logs seem to be shouting something about that).
>
> but I wanted to double check if broadcasting to two vertices from a
>single has known issues.
Hive has multi-output hash-join plans.
http://people.apache.org/~gopalv/union-
to MR; we definitely want to help
> getting to the point we can compare the outputs.
>
> -- Cyrille
>
> Message transféré
>
>
> *Reply-To: *user@tez.apache.org
> *Subject: **Re: BufferTooSmallException*
> *From: *Hitesh Shah
> *Da
h...@wensel.net>]
> Sent: Friday, April 03, 2015 12:52 PM
> To: user@tez.apache.org <mailto:user@tez.apache.org>
> Subject: Re: BufferTooSmallException
>
> a quick update.
>
> we have been working to identify red herrings throughout the logs (one of
> which i
s we make improvements under the covers.
In the specific case below you could use
UnorderedKVEdgeConfig#createDefaultBroadcastEdgeProperty()
Bikas
From: Chris K Wensel [mailto:ch...@wensel.net]
Sent: Friday, April 03, 2015 12:52 PM
To: user@tez.apache.org
Subject: Re: BufferTooSmallException
a qui
t speedups compared to MR; we definitely want to help getting to
> the point we can compare the outputs.
>
> -- Cyrille
>
> Message transféré
>>
>> Reply-To: user@tez.apache.org <mailto:user@tez.apache.org>
>> Subject: Re: BufferToo
che.org <mailto:user@tez.apache.org>
*Subject: **Re: BufferTooSmallException*
*From: *Hitesh Shah mailto:hit...@apache.org>>
*Date: *March 23, 2015 at 1:11:45 PM PDT
*To: *user@tez.apache.org <mailto:user@tez.apache.org>
Hi Chris,
I don’t believe this issue has been seen before. Co
ve a user running Scalding, on Cascading3, on Tez. This exception tends
> to crop up for DAGs that hang indefinitely (this DAG has 140 vertices).
>
> It looks like the flag exception BufferTooSmallException isn’t being caught
> and forcing the buffer to reset. Nor is the exception,
Hey all
We have a user running Scalding, on Cascading3, on Tez. This exception tends to
crop up for DAGs that hang indefinitely (this DAG has 140 vertices).
It looks like the flag exception BufferTooSmallException isn’t being caught and
forcing the buffer to reset. Nor is the exception, when
