This is a question probably better suited for the pig mailing list. thanks — Hitesh
On Nov 5, 2015, at 4:41 AM, Gal Vinograd <g...@crosswise.com> wrote: > Hey all, > > I'm experiencing a weird behaviour, when I run the script it freeze 2 out of > 3 times, and when it doesn't it takes slightly longer then Yarn. I found that > if I remove the following part from the end of the script it significantly > faster and do not freezes. > > ```pig > a1 = FOREACH metrics GENERATE ...; > a2 = FOREACH metrics GENERATE ...; > ... > a20 = FOREACH metrics GENERATE ...; > u = UNION a1, a2, ..., a20; > STORE u INTO ... Using PigStorage('\t'); > ``` > > I use Tez 0.7.0, Pig 0.15.0, Hadoop 2.6.0. The setting pig.tez.opt.union is > disabled, an internal exception is thrown otherwise. I've attached a dump of > a frozen job, what could be the problem? > > Thanks :) > <worker_jstack.txt><am_jstack.txt>