Re: Working with MapFiles

2012-04-02 Thread Ioan Eugen Stan
use case so think carefully or just go ahead and test it. Thanks On 03/30/2012 12:49 PM, Ioan Eugen Stan wrote: Hello Ondrej, Pe 29.03.2012 18:05, Ondřej Klimpera a scris: Hello, I have a MapFile as a product of MapReduce job, and what I need to do is: 1. If MapReduce produced more

Re: Working with MapFiles

2012-04-02 Thread Ioan Eugen Stan
= DistributedCache.getCacheFiles(job); } will the distCacheFileUris variable contain only URIs for this job, or for any job running on Hadoop cluster? Hope it's understandable. Thanks. It's -- Ioan Eugen Stan http://ieugen.blogspot.com

Re: Working with MapFiles

2012-03-30 Thread Ioan Eugen Stan
:) Ondrej Klimpera [1] http://hadoop.apache.org/common/docs/current/api/org/apache/hadoop/io/MapFile.html [2] http://hadoop.apache.org/common/docs/current/api/org/apache/hadoop/filecache/DistributedCache.html -- Ioan Eugen Stan http://ieugen.blogspot.com

Re: how to get rid of -libjars ?

2012-03-06 Thread Ioan Eugen Stan
adding a lot of jars and some got on the job classpath (2), some didn't (most of them). I got over this by including all the jars in a lib directory inside the main jar. Cheers, -- Ioan Eugen Stan http://ieugen.blogspot.com

Re: ClassNotFoundException: -libjars not working?

2012-02-28 Thread Ioan Eugen Stan
-libraries-in-your-map-reduce-job/ Cheers, -- Ioan Eugen Stan http://ieugen.blogspot.com

Re: LZO with sequenceFile

2012-02-26 Thread Ioan Eugen Stan
, SequenceFile.CompressionType.BLOCK); job.setOutputFormatClass(org.apache.hadoop.mapreduce.lib.outpu t.SequenceFileOutputFormat.class); Shi -- Ioan Eugen Stan http://ieugen.blogspot.com/

ClassNotFoundException: -libjars not working?

2012-02-22 Thread Ioan Eugen Stan
) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127) at org.apache.hadoop.mapred.Child.main(Child.java:264) Regards, -- Ioan Eugen Stan http://ieugen.blogspot.com

Re: Best Linux Operating system used for Hadoop

2012-01-30 Thread Ioan Eugen Stan
- Hortonwork (not sure about them providing a Hadoop distribution) They offer installation instructions on different platforms for their products. Maybe you can check them out to see if they are good for you. Cheers, -- Ioan Eugen Stan http://ieugen.blogspot.com

Re: missing job history and strange MR job output

2012-01-16 Thread Ioan Eugen Stan
of TaskTrackers and JobTrackers, etc. Removing the local maven repository finally solved the issue and now I can happily continue with coding. It seems that periodically cleaning maven repo is a must these days. Thanks for the support, -- Ioan Eugen Stan http://ieugen.blogspot.com

missing job history and strange MR job output

2012-01-12 Thread Ioan Eugen Stan
know, but the code that reads the hbase table seems ok. I'm doing a small scan before to count some stuff to pass to the job. -- Ioan Eugen Stan http://ieugen.blogspot.com/

Re: some guidance needed

2011-05-19 Thread Ioan Eugen Stan
the source :). [1] http://vimeo.com/3591321 Thanks, -- Ioan-Eugen Stan

some guidance needed

2011-05-18 Thread Ioan Eugen Stan
). Also, any development resources to get me started are welcomed. [1] http://james.apache.org/mailbox/ [2] https://issues.apache.org/jira/browse/MAILBOX-44 Regards, -- Ioan Eugen Stan