Hi, Azuryy.
Thanks for your reply.
Is there any way which does not require to copy the snappy libs? I mean is
there any environment variable that I can configure so that I don't have to
copy the snappy libs. I have tried JAVA_LIBRARY_PATH and LD_LIBRARY_PATH. But
they didn't work.
---
Hi,
please :
run "cp -a /opt/snappy/lib/libsnappy.* /opt/hadoop/hadoophome/lib/native"
on each datanode. also you need to install Snappy on each datanode firstly.
On Sat, Mar 7, 2015 at 6:57 PM, donhoff_h <165612...@qq.com> wrote:
> Hi, experts.
>
> I meet the following problem when configu
Hi,
If you write custom partitioner, just call them to confrim the key match
with which partition.
You can get the number of reduer from mapcontext.getNumReduceTasks(). then,
get reducer number from Partitioner.getPartition(key, value, numReduc).
Finally, just write wanted records to the reducers
