Hi,
Thanks Dmitriy, I wasn't aware of these changes, would make life much
easier, given that users do not always have the permissions to add jars to
the $PIG_HOME/lib dirs or classpaths.
In any case I've been planning to make a major update on the
hadoop-gpl-packaging rpms to include all of the l
Actually pig does some class loader magic for finding classes in registered
classes on the front end.
We recently added that to Elephant bird so that it works when the proto or
thrift classes aren't already on the classpath and are only registered -- I
believe I merged that into the 8 branch, so if
Pig has a backend and front end.
I.e.
Front End:
Pig JVM instance.
Back End
Pig classes running your M/R job on hadoop.
When pig instantiates the same loader in the front and back end to get
different information on loading the job files. e.g. Which files to Load?
This is decided i
Here we go:
META-INF/
META-INF/MANIFEST.MF
com/work/logs/LogFormat$1.class
com/work/logs/LogFormat$Apa$Builder.class
com/work/logs/LogFormat$Apa.class
com/work/logs/LogFormat.class
com/work/logs/LogFormat$Cpu$Builder.class
com/work/logs/LogFormat$Cpu.class
com/work/logs/LogFormat$Evt$Builder.clas
and the contents of '/home/kris/swineflu/logformats-0.1.2.jar' (jar -tf)
D
On Fri, Apr 29, 2011 at 1:15 PM, Kris Coward wrote:
>
> Well I'll send up to the point where it fails and exits, since the rest
> seems kinda superfluous.. here it is:
>
> REGISTER '/usr/local/hadoopgpl/lib/slf4j-api-1.
Well I'll send up to the point where it fails and exits, since the rest
seems kinda superfluous.. here it is:
REGISTER '/usr/local/hadoopgpl/lib/slf4j-api-1.5.8.jar'
REGISTER '/usr/local/hadoopgpl/lib/slf4j-log4j12-1.5.10.jar'
REGISTER '/usr/local/pig/lib/elephant-bird.jar'
REGISTER '/usr/local/p
Odd.. can you send the full pig script including the register statements?
On Fri, Apr 29, 2011 at 11:38 AM, Kris Coward wrote:
>
> So I've recently added a protocol/schema to a collection I got from
> someone else, recompiled it, and added it to my scripts and am having
> problems.
>
> More spec
So I've recently added a protocol/schema to a collection I got from
someone else, recompiled it, and added it to my scripts and am having
problems.
More specifically, it built just fine, and when REGISTERed in the script
that uses it to store a relation, it seems to work fine, but when I try
to u