Re: Problem with a protobuf in EB

2011-05-02 Thread Gerrit Jansen van Vuuren
Hi, Thanks Dmitriy, I wasn't aware of these changes, would make life much easier, given that users do not always have the permissions to add jars to the $PIG_HOME/lib dirs or classpaths. In any case I've been planning to make a major update on the hadoop-gpl-packaging rpms to include all of the l

Re: Problem with a protobuf in EB

2011-05-01 Thread Dmitriy Ryaboy
Actually pig does some class loader magic for finding classes in registered classes on the front end. We recently added that to Elephant bird so that it works when the proto or thrift classes aren't already on the classpath and are only registered -- I believe I merged that into the 8 branch, so if

Re: Problem with a protobuf in EB

2011-04-29 Thread Gerrit Jansen van Vuuren
Pig has a backend and front end. I.e. Front End: Pig JVM instance. Back End Pig classes running your M/R job on hadoop. When pig instantiates the same loader in the front and back end to get different information on loading the job files. e.g. Which files to Load? This is decided i

Re: Problem with a protobuf in EB

2011-04-29 Thread Kris Coward
Here we go: META-INF/ META-INF/MANIFEST.MF com/work/logs/LogFormat$1.class com/work/logs/LogFormat$Apa$Builder.class com/work/logs/LogFormat$Apa.class com/work/logs/LogFormat.class com/work/logs/LogFormat$Cpu$Builder.class com/work/logs/LogFormat$Cpu.class com/work/logs/LogFormat$Evt$Builder.clas

Re: Problem with a protobuf in EB

2011-04-29 Thread Dmitriy Ryaboy
and the contents of '/home/kris/swineflu/logformats-0.1.2.jar' (jar -tf) D On Fri, Apr 29, 2011 at 1:15 PM, Kris Coward wrote: > > Well I'll send up to the point where it fails and exits, since the rest > seems kinda superfluous.. here it is: > > REGISTER '/usr/local/hadoopgpl/lib/slf4j-api-1.

Re: Problem with a protobuf in EB

2011-04-29 Thread Kris Coward
Well I'll send up to the point where it fails and exits, since the rest seems kinda superfluous.. here it is: REGISTER '/usr/local/hadoopgpl/lib/slf4j-api-1.5.8.jar' REGISTER '/usr/local/hadoopgpl/lib/slf4j-log4j12-1.5.10.jar' REGISTER '/usr/local/pig/lib/elephant-bird.jar' REGISTER '/usr/local/p

Re: Problem with a protobuf in EB

2011-04-29 Thread Dmitriy Ryaboy
Odd.. can you send the full pig script including the register statements? On Fri, Apr 29, 2011 at 11:38 AM, Kris Coward wrote: > > So I've recently added a protocol/schema to a collection I got from > someone else, recompiled it, and added it to my scripts and am having > problems. > > More spec

Problem with a protobuf in EB

2011-04-29 Thread Kris Coward
So I've recently added a protocol/schema to a collection I got from someone else, recompiled it, and added it to my scripts and am having problems. More specifically, it built just fine, and when REGISTERed in the script that uses it to store a relation, it seems to work fine, but when I try to u