use case so think carefully or just go ahead and test it.
Thanks
On 03/30/2012 12:49 PM, Ioan Eugen Stan wrote:
Hello Ondrej,
Pe 29.03.2012 18:05, Ondřej Klimpera a scris:
Hello,
I have a MapFile as a product of MapReduce job, and what I need to
do is:
1. If MapReduce produced more
= DistributedCache.getCacheFiles(job);
}
will the distCacheFileUris variable contain only URIs for this job, or
for any job running on Hadoop cluster?
Hope it's understandable.
Thanks.
It's
--
Ioan Eugen Stan
http://ieugen.blogspot.com
:)
Ondrej Klimpera
[1]
http://hadoop.apache.org/common/docs/current/api/org/apache/hadoop/io/MapFile.html
[2]
http://hadoop.apache.org/common/docs/current/api/org/apache/hadoop/filecache/DistributedCache.html
--
Ioan Eugen Stan
http://ieugen.blogspot.com
adding a lot of jars and some got on the job classpath
(2), some didn't (most of them).
I got over this by including all the jars in a lib directory inside the
main jar.
Cheers,
--
Ioan Eugen Stan
http://ieugen.blogspot.com
-libraries-in-your-map-reduce-job/
Cheers,
--
Ioan Eugen Stan
http://ieugen.blogspot.com
,
SequenceFile.CompressionType.BLOCK);
job.setOutputFormatClass(org.apache.hadoop.mapreduce.lib.outpu
t.SequenceFileOutputFormat.class);
Shi
--
Ioan Eugen Stan
http://ieugen.blogspot.com/
)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
at org.apache.hadoop.mapred.Child.main(Child.java:264)
Regards,
--
Ioan Eugen Stan
http://ieugen.blogspot.com
- Hortonwork (not sure about them providing a Hadoop distribution)
They offer installation instructions on different platforms for their
products. Maybe you can check them out to see if they are good for you.
Cheers,
--
Ioan Eugen Stan
http://ieugen.blogspot.com
of TaskTrackers and JobTrackers, etc.
Removing the local maven repository finally solved the issue and now I
can happily continue with coding.
It seems that periodically cleaning maven repo is a must these days.
Thanks for the support,
--
Ioan Eugen Stan
http://ieugen.blogspot.com
know, but the
code that reads the hbase table seems ok. I'm doing a small scan
before to count some stuff to pass to the job.
--
Ioan Eugen Stan
http://ieugen.blogspot.com/
the source :).
[1] http://vimeo.com/3591321
Thanks,
--
Ioan-Eugen Stan
).
Also, any development resources to get me started are welcomed.
[1] http://james.apache.org/mailbox/
[2] https://issues.apache.org/jira/browse/MAILBOX-44
Regards,
--
Ioan Eugen Stan
12 matches
Mail list logo