java.lang.NoClassDefFoundError: org/apache/pig/LoadMetadata
bashrc file settings:
export HADOOP_HOME=/usr/local/hadoop
export PIG_HOME=/usr/local/pig
export PATH="$HADOOP_HOME/bin:$PIG_HOME/bin:$PATH"
export PIG_CLASSPATH=/usr/local/hadoop/conf
Thanks
Haider
Hi Daniel
I need help so badly , I hope you would understand my situation
The use case is, I have one folder which has multiple XML files and I need
to write a PIG script which recursively parse all the files and generate
one flat file.
The XML looks like this and each XML file has differe
GENERATE FLATTEN(REGEX_EXTRACT_ALL(y,
'\\n\\s*(.*)\\n\\s*(.*)\\n\\s*'))
as (agency: chararray,agency_class: chararray);D = foreach B1 GENERATE
CONCAT('1$',CONCAT(CONCAT(agency,'$'),agency_class));STORE D into
'piglab/result2';data1 = load 'piglab/result2' USING PigStorage('$') as
(b1: int,b2: chararray,b3: chararray);result= JOIN data by a1,data1 by b1
;store result into 'piglab/result' USING PigStorage('$');If you can give me
one sample PIG script which parses such nested XML file then I can go
forward with that.*
Any help on this would be greatly appreciable.
Thanks
Haider
>
>
;STORE C into
'piglab/result1';data = load 'piglab/result1' USING PigStorage('$') as (a1:
int,a2: chararray,a3: chararray);A1 = load 'piglab/NCT0611.xml' using
org.apache.pig.piggybank.storage.XMLLoader('lead_sponsor')as (y:
chararray);B1 = foreac
> Thanks,
> Daniel
>
>
> On Wed, Nov 20, 2013 at 10:50 PM, Haider wrote:
>
> > Hi I am new to PIG scripting.
> >
> > I am trying to parse XML values through a pig script but getting the
> error.
> >
> > ERROR org.
XML file is this
hadoop developer
Haider
india
Deloitte
10.90
2013
and my pig script is
REGISTER '/home/hdmaster/Downloads/piggybank.jar';
A = LOAD '/home/hdmaster/Downloads/sample.xml' USING
org.apache.pig.piggybank.storage.XMLLoader('CD')
AS (x:chara
