Can you send along the error log from your failing reduce task? That
will have the actual error.
I am guessing this has something to do with the fact that you are
using cfs (Brisk?)
D
On Tue, Jul 5, 2011 at 10:15 PM, Colin Taylor <colin.tay...@gmail.com> wrote:
> Ok so this works if I run in local mode but not map-reduce mode.
> Can someone enlighten me?
>
> On Wed, Jul 6, 2011 at 5:01 PM, Colin Taylor <colin.tay...@gmail.com> wrote:
>> grunt> describe policies_by_type;
>> policies_by_type: {group: chararray,policies: {columns::udm_field:
>> chararray,columns::udm_value: chararray}}
>>
>> grunt> dump policies_by_type;
>>
>> (POLICY-29,{(policy,POLICY-29)})
>> (POLICY-71,{(policy,POLICY-71),(policy,POLICY-71),(policy,POLICY-71)})
>>
>> grunt> policy_counts = FOREACH policies_by_type GENERATE
>> COUNT(policies);
>> grunt> describe policy_counts;
>> policy_counts: {long}
>>
>> All looks good but when I
>> grunt> dump policy_counts;
>>
>> I get:
>>
>> 2011-07-06 04:15:03,539 [main] ERROR
>> org.apache.pig.tools.pigstats.PigStats - ERROR 2997: Unable to
>> recreate exception from backed error: Error initializing
>> attempt_201107010359_0160_m_000000_3:
>> 2011-07-06 04:15:03,539 [main] ERROR
>> org.apache.pig.tools.pigstats.PigStatsUtil - 1 map reduce job(s)
>> failed!
>> 2011-07-06 04:15:03,540 [main] INFO
>> org.apache.pig.tools.pigstats.PigStats - Script Statistics:
>>
>> Input(s):
>> Successfully read 5 records from: "cassandra://SPC/UDM"
>>
>> Output(s):
>> Failed to produce result in "cfs://null/tmp/temp-1373091145/tmp-1591506274"
>>
>> org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable
>> to open iterator for alias policy_counts. Backend error : Unable to
>> recreate exception from backed error
>>
>
