pig on tez NoSuchMethodError decodeBase64

Hi, I tried to run pig on TEZ pig -Dpig.additional.jars=... -useHCatalog -x TEZ load_u.pig But I got an exception Error cause TezChild exit.:java.lang.NoSuchMethodError: org.apache.commons.codec.binary.Base64.decodeBase64(Ljava/lang/String;)[B It seems the problem is from

Re: pig on tez NoSuchMethodError decodeBase64

Sounds like a commons-codec version conflict. Tez is using commons-codec 1.4. Do you see another version of commons-codec.jar in your Hadoop lib or CLASSPATH? Thanks, Daniel On 3/9/15, 5:28 AM, Patcharee Thongtra patcharee.thong...@uni.no wrote: Hi, I tried to run pig on TEZ pig

Re: Loading multiple files, each file as a record

while loading file you can attempt to use PigStorage(',','-tagFile') then regex on each line of the file .. then group by file name https://pig.apache.org/docs/r0.14.0/api/org/apache/pig/builtin/PigStorage.html *Cheers !!* Arvind On Fri, Mar 6, 2015 at 2:26 AM, Daniel Dai da...@hortonworks.com