Hmm…. I'm out of time for trying to help find the root cause, but I have an idea that would probably make it work - you can try putting "exec;" statements between the stores. Good luck!
On Thu, May 5, 2016 at 10:40 AM, <lics...@sina.com> wrote: > I rewrite the code. but the error is the same. > > > r = load 'test.txt' as (id: chararray, val: long); > > > t1 = filter r by val >= 12 and val < 20; > > grpd_t1 = group t1 by val; > > t1_cnt_tmp = foreach grpd_t1 generate group as name, COUNT(t1) as value; > > t1_cnt = foreach t1_cnt_tmp generate (chararray)name, value; > > grpd_t1_all = group t1 all; > > t1_cnt_total = foreach grpd_t1_all generate 't1' as name, COUNT(t1) as > value; > > > t2 = filter r by val >= 20 and val < 30; > > grpd_t2 = group t2 by val; > > t2_cnt = foreach grpd_t2 generate group as name, COUNT(t2) as value; > > --t2_cnt = foreach t2_cnt generate (chararray)name, value; > > grpd_t2_all = group t2 all; > > t2_cnt_total = foreach grpd_t2_all generate 't2' as name, COUNT(t2) as > value; > > > store t1_cnt into 'outx/3'; > > store t2_cnt into 'outx/4'; > > store t1_cnt_total into 'outx/5'; > > store t2_cnt_total into 'outx/6'; > > > ----------------------------------- > > I duplicated your problem. This is just a hunch, but try rewriting the Pig > script without re-using the same alias name repeatedly and see if you get > different results. (grpd, t1_cnt) . Since each store trigger a different > MR job (I think), and the MR jobs may run in an uncontrolled order, maybe > Pig is getting confused. Then reply with the results and the new script. > Thanks, > Steve > On Thu, May 5, 2016 at 1:38 AM, <lics...@sina.com> wrote: > > Thanks a lot.the most minimal input (test.txt) contains one line "c > > 12".You may visit this link ( > > https://issues.apache.org/jira/browse/PIG-4883) for a more clear > version. > > > > ----- --- ----- > > From: Steve Terrell <sterr...@oculus360.us> > > To:user@pig.apache.org, lics...@sina.com > > Subj: Re: exception when use multiple "store"s > > Date 2016-05-04 23:09 > > > > Please provide the the most minimal input (test.txt) required to > reproduce > > the error. > > On Wed, May 4, 2016 at 8:28 AM, <lics...@sina.com> wrote: > > > The following code and data will raise an exception.However, if I > remove > > > any of the four "store"s, the code will be fine.test.pigr = load > > 'test.txt' > > > as (id: chararray, val: long); > > > > > > t1 = filter r by val >= 12 and val < 20; > > > grpd = group t1 by val; > > > t1_cnt = foreach grpd generate group as name, COUNT(t1) as value; > > > t1_cnt = foreach t1_cnt generate (chararray)name, value; > > > grpd = group t1 all; > > > t1_cnt_total = foreach grpd generate 't1' as name, COUNT(t1) as value; > > > > > > t2 = filter r by val >= 20 and val < 30; > > > grpd = group t2 by val; > > > t2_cnt = foreach grpd generate group as name, COUNT(t2) as value; > > > --t2_cnt = foreach t2_cnt generate (chararray)name, value; > > > grpd = group t2 all; > > > t2_cnt_total = foreach grpd generate 't2' as name, COUNT(t2) as value; > > > > > > store t1_cnt into 'outx/3'; > > > store t2_cnt into 'outx/4'; > > > store t1_cnt_total into 'outx/5'; > > > store t2_cnt_total into 'outx/6'; > > > andtest.txtc 12 > > > will cause error: > > > Caused by: java.lang.ClassCastException: > > org.apache.pig.data.BinSedesTuple > > > cannot be cast to java.lang.Long > > > at > > > > > > org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POCast.getNextString(POCast.java:1167) > > > at > > > > > > org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.getNext(PhysicalOperator.java:343) > > > ... 14 more > > > I don't know why the code need to cast a BinSedesTuple to Long.The same > > > exception will be caused if I union the four results.jira link: > > > https://issues.apache.org/jira/browse/PIG-4883 > > >
