Re: Should AvroMapWrapper be implememting Map ?

2015-03-20 Thread RD
Friendly bump. On Thu, Mar 19, 2015 at 3:06 PM, RD wrote: > Hi Folks, >I see that com.linkedin.dali.pig.avro.AvroMapWrapper implements a > Map . I'm wondering if this can cause problems and > class-cast exceptions in the pig processing pipeline. As Map keys are > supposed to be of String t

Re: newbie question regarding sorted data process, and sequential match of records

2015-03-20 Thread Arvind S
i am not an expert ..learning just like you .. but i will attempt to answer and provide some justification .. imo ..depending on the sorted file naming/ sorted data would restrict your processing logic. What you want to leverage is "parallelism" so let the digest and process logic be generic so th