Re: Using Slider as a default mechanism for HBase on HDP 2.2

Hi I was wondering the same, the following post suggests that HBase+Slider integration in Ambari should be delivered with HDP 2.3 or even 2.2.1 http://hortonworks.com/blog/discover-hdp-2-2-apache-hbase-yarn-slider-fast-nosql-access/ It also contains a link to a doc on how to install HBase over

unscubscribe

unsubscribe

Default Block Size in HDFS

Hi, I have read somewhere that default block size in Hadoop 2.4 is 256MB . Is it correct ? In which version default block size was 128MB ? Thanks Krish

unsubscribe

unsubscribe.

Re: Default Block Size in HDFS

Sorry forgot that as of meant starting with :-) Actually 128 MB started around 2.2.0 2.0.5-alpha was still 64MB In any case it's just a default, it is often raised on production Le 22/02/2015 20:51, Ted Yu a écrit : As of Hadoop 2.6, default blocksize is 128 MB (look for dfs.blocksize)

Re: Default Block Size in HDFS

As of Hadoop 2.6, default blocksize is 128 MB (look for dfs.blocksize) https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/hdfs-default.xml Cheers On Sun, Feb 22, 2015 at 11:11 AM, Krish Donald gotomyp...@gmail.com wrote: Hi, I have read somewhere that default block size

java.net.UnknownHostException on one node only

I am getting java.net.UnknownHost exception continuously on one node Hadoop MApReduce execution. That node is accessible via SSH. This node is shown in yarn node -list and hadfs dfsadmin -report queries. Below is the log from execution 15/02/22 20:17:42 INFO mapreduce.Job: Task Id :

Re: java.net.UnknownHostException on one node only

Important is, that the canonical name must be the FQDN of the server, see the example. 1.1.1.1 one.one.org one namenode 1.1.1.2 two.one.og two datanode If DNS is used the system’s hostname must match the FQDN in forward as well as reverse name resolution. BR, Alex On 22 Feb 2015, at

Re: recombining split files after data is processed

Thanks Alex. where would that command be placed in a mapper or reducer or run as a command. Here at work we are looking to use Amazon EMR to do our number crunching and we have access to the master node, but not really the rest of the cluster. Can this be added as a step to be run after initial

Re: unsubscribe

Check http://hadoop.apache.org/mailing_lists.html#User Regards, Ramkumar Bashyam On Sun, Feb 22, 2015 at 1:48 PM, Mainak Bandyopadhyay mainak.bandyopadh...@gmail.com wrote: unsubscribe.

Re: unscubscribe

Check http://hadoop.apache.org/mailing_lists.html#User Regards, Ramkumar Bashyam On Mon, Feb 23, 2015 at 12:29 AM, Umesh Reddy ur2...@yahoo.com wrote: unsubscribe

RE: Hadoop - HTTPS communication between nodes - How to Confirm ?

Thanks for the help Ulul/Daemeon, Problem has sorted using lsof –p datanode pid command. Thanks, S.RagavendraGanesh ViSolve Hadoop Support Team ViSolve Inc. | San Jose, California Website: www.visolve.com http://www.visolve.com Email: servi...@visolve.com mailto:servi...@visolve.com

Re: writing mappers and reducers question

I suggest Standalone mode for developing mapper or reducer. But in case of partitioner or combiner, you need to setup Pseudo-Distributed mode. Drake 민영근 Ph.D kt NexR On Fri, Feb 20, 2015 at 3:18 PM, unmesha sreeveni unmeshab...@gmail.com wrote: You can write MapReduce jobs in eclipse also for

Re: Get method in Writable

Thanks Drake. That was the point.It was my mistake. On Mon, Feb 23, 2015 at 6:34 AM, Drake민영근 drake@nexr.com wrote: Hi, unmesha. I think this is a gson problem. you mentioned like this: But parsing canot be done in *MR2*. * TreeInfoWritable info = gson.toJson(setupData,

Re: java.net.UnknownHostException on one node only

Hi Tariq, Issues looks like DNS configuration issue. On Sun, Feb 22, 2015 at 3:51 PM, tesm...@gmail.com tesm...@gmail.com wrote: I am getting java.net.UnknownHost exception continuously on one node Hadoop MApReduce execution. That node is accessible via SSH. This node is shown in yarn node