Hi Ram, Can you please suggest , how would I add another variable (like 'directory') while creating multiple partitions of AbstractFileInputOperator in the define partition method.
I have currently added variables in the AbstractFileInputOperator , which I guess not a better way. These variables are basically used to scan directories in parallel differently. Regards, Surya Vamshi _______________________________________________________________________ If you received this email in error, please advise the sender (by return email or otherwise) immediately. You have consented to receive the attached electronically at the above-noted email address; please retain a copy of this confirmation for future reference. Si vous recevez ce courriel par erreur, veuillez en aviser l'expéditeur immédiatement, par retour de courriel ou par un autre moyen. Vous avez accepté de recevoir le(s) document(s) ci-joint(s) par voie électronique à l'adresse courriel indiquée ci-dessus; veuillez conserver une copie de cette confirmation pour les fins de reference future.
