Re: Something about the Snappy Compression Tool

2015-03-24 Thread Tsuyoshi Ozawa
Sometimes compiled native libraries included in tar ball doesn't work correctly - how about recompiling library on your environment? Thanks, - Tsuyoshi On Tue, Mar 24, 2015 at 6:18 PM, 王鹏飞 wpf5...@gmail.com wrote: I noticed a map-reduce job encountered an

Unsubscribe

2015-03-24 Thread Cnewtonne

Re: Unsubscribe

2015-03-24 Thread Ted Yu
Please send email to user-unsubscr...@hadoop.apache.org On Tue, Mar 24, 2015 at 4:56 PM, Cnewtonne cnewto...@gmail.com wrote:

Re: Something about the Snappy Compression Tool

2015-03-24 Thread 王鹏飞
How to recompiling library?Cause my hadoop was built from tar ball and in /lib/native there exist files like *.a and *.so.Does I need build from source code to recompiling library? On Tue, Mar 24, 2015 at 6:35 PM, Tsuyoshi Ozawa oz...@apache.org wrote: Sometimes compiled native libraries

Something about the Snappy Compression Tool

2015-03-24 Thread 王鹏飞
I noticed a map-reduce job encountered an Exception:java.lang.UnsatisfiedLinkError:org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy()Z I googled it and released that it was lack of snappy tool.I Installed the snappy and copied libsnappy.so* to $HADOOP_HOME/lib/native

Re: Can Pseudo-Distributed Mode take advantage of multi-core structure?

2015-03-24 Thread Michael Segel
Short answer yes. On Mar 24, 2015, at 11:53 AM, Xuzhan Sun sunxuz...@outlook.com wrote: Hello, I want to do some test on my single node cluster for Speed. I know it is easy to set up the Pseudo-Distributed Mode, and Hadoop will start one Java process for each single map/reduce. My

Can Pseudo-Distributed Mode take advantage of multi-core structure?

2015-03-24 Thread Xuzhan Sun
Hello, I want to do some test on my single node cluster for Speed. I know it is easy to set up the Pseudo-Distributed Mode, and Hadoop will start one Java process for each single map/reduce. My question is: is it parallel enough on multi-core CPU? I mean if I have 4 mappers at the same time

答复: Can Pseudo-Distributed Mode take advantage of multi-core structure?

2015-03-24 Thread Xuzhan Sun
So I can set up the pseudo distributed mode without virtual machine and get the same performance? Am I right? Sent from my Windows Phone 发件人: Michael Segelmailto:msegel_had...@hotmail.com 发送时间: ‎2015/‎3/‎25 1:17 收件人:

Re: Trusted-realm vs default-realm kerberos issue

2015-03-24 Thread Michael Segel
So… If I understand, you’re saying you have a one way trust set up so that the cluster’s AD trusts the Enterprise AD? And by AD you really mean KDC? On Mar 17, 2015, at 2:22 PM, John Lilley john.lil...@redpoint.net wrote: AD The opinions expressed here are mine, while they may reflect

one problem about datanode remove

2015-03-24 Thread 刘翠
Hi, I am sorry to bother you , because I have a problem which I faced for a long time. When I remove the datanode, It aways stop at the time. And I don’t know why. Can you give me some clues? Jade

Re: Tell which reduce task run which partition

2015-03-24 Thread Harsh J
Your example is the reality case. The reducer ID matches its partition integer. On Fri, Mar 20, 2015 at 5:14 PM, xeonmailinglist-gmail xeonmailingl...@gmail.com wrote: Hi, Is there a way to tell which Reduce tasks will run which partition? E.g, I want that reduce task 0 will read

Best tests for CPU or network bounded executions in hadoop-gridmix-2.6.0.jar

2015-03-24 Thread xeonmailinglist-gmail
Hi, I am trying to see what are the current tests that the Gridmix2 package do in MapReduce2.x. I see that the Gridmix jar |hadoop-gridmix-2.6.0.jar|does not have anymore the WebDataSort, WebDataScan, MonsterQuery, Combiner, and Streaming tests. The current tests are in [1]. From all of