Yes, you are right.
Skip mode is not supported in YARN.
Thanks,
-Nirmal
From: Rob Golkosky
Sent: Thursday, April 17, 2014 8:52 PM
To: user@hadoop.apache.org
Subject: skip mode with yarn?
Howdy -
I'm running 2.3.0 with yarn and was trying to experiment
All,
IMHO, Streaming data access is like reading data continuously rather than in
packets\chunks in traditional FS involving seek time for small blocks.
You can consider it as a Spout which emits water continuously.
Since in HDFS the data blocks are very large compared to the traditional FS the
information has caused concerns to
anybody.
Please also note that all information and opinions shared in this user list are
my own and not a representation of my employers opinion or thought process in
any way.
Thanks,
-Nirmal
From: Nirmal Kumar
Sent: Saturday, February 15, 2014 1:44 PM
To
All,
Apologies for any inconvenience caused.
Request kindly to *ignore* the below info provided by me.
From: Nirmal Kumar
Sent: Friday, February 14, 2014 6:01 PM
To: Hadoop User Mailer List
Cc: 'vjshal...@gmail.com'
Subject: RE: Bigdata - MapR, Cloudera, Hortonworks, OracleBigdata
Nirmal Kumar would like to recall the message, "Bigdata - MapR, Cloudera,
Hortonworks, OracleBigdata appliances".
NOTE: This message may contain information that is confidential, proprietary,
privileged or otherwise protected by law. The
FYI
From: VJ Shalish [mailto:vjshal...@gmail.com]
Sent: Friday, February 14, 2014 5:20 PM
To: Hadoop User Mailer List
Subject: Bigdata - MapR, Cloudera, Hortonworks, OracleBigdata appliances
Can anyone send me valid comparison points or links taking into consideration
Bigdata - MapR, Cloudera, Ho
You can load data into existing tables from the Hive CLI using the commands:
1. LOAD DATA LOCAL INPATH '/home/guest/input/test_order.dat' OVERWRITE INTO
TABLE orders;
If the data is in the local file system
2. LOAD DATA INPATH '/user/guestuser/lineitem.dat' INTO table line_item;
I
Hi All,
Any thoughts to share?
-Nirmal
From: Nirmal Kumar
Sent: Thursday, January 16, 2014 5:44 PM
To: user@hadoop.apache.org
Subject: Hadoop migration downtime: Hadoop 1.x to 2.x
All,
I want to know while upgrading\migrating from Apache Hadoop 1.x to
2.x(MRv2+YARN) in a production cluster of
Thanks a lot for the help.
-Nirmal
From: Arun C Murthy [mailto:a...@hortonworks.com]
Sent: Friday, January 17, 2014 9:09 PM
To: user@hadoop.apache.org
Subject: Re: Doubts: Deployment and Configuration of YARN cluster
On Jan 16, 2014, at 9:14 PM, Nirmal Kumar
mailto:nirmal.ku...@impetus.co.in
Hi All,
I am trying to build Hadoop 2.2.0 On Windows 7 64-bit env.
Can you let me know what else is needed for building Hadoop 2.2.0 On Windows
platform?
I am getting the following error building *hadoop-common* project:
[INFO] --
ainer size is 1G, the RM will allocate 10 containers to Node A
and 12 containers to Node B.
hth,
Arun
On Jan 15, 2014, at 11:03 PM, Nirmal Kumar
mailto:nirmal.ku...@impetus.co.in>> wrote:
Hi German,
I went through the links for memory configuration settings/best-practices.
It considers the
All,
I want to know while upgrading\migrating from Apache Hadoop 1.x to
2.x(MRv2+YARN) in a production cluster of several nodes is there any
*anticipated downtime* that one needs to be aware of?
I am asking this since this will hamper the *HA (High Availability)*.
IMHO as with any other upgrade
cluster* with varying RAM, disks , cores?
Thanks,
-Nirmal
From: Nirmal Kumar
Sent: Wednesday, January 15, 2014 8:22 PM
To: user@hadoop.apache.org
Subject: RE: Doubts: Deployment and Configuration of YARN cluster
Thanks a lot German.
Will go through the links and see if that answers my questions
/bk_installing_manually_book/content/rpm-chap1-11.html
-A good intro to YARN configuration is this:
http://www.thecloudavenue.com/2012/01/getting-started-with-nextgen-mapreduce_11.html
Regards
.g
From: Nirmal Kumar [mailto:nirmal.ku...@impetus.co.in]
Sent: Wednesday, January 15, 2014 7:22 AM
To
Surely you don't have to set *mapreduce.jobtracker.address* in mapred-site.xml
In mapred-site.xml you just have to mention:
mapreduce.framework.name
yarn
-Nirmal
From: Ashish Jain [mailto:ashja...@gmail.com]
Sent: Wednesday, January 15, 2014 6:44 PM
To: user@hadoop.apache.org
Subject: Re: Distr
All,
I am new to YARN and have certain doubts regarding the deployment and
configuration of YARN on a cluster.
As per my understanding to deploy Hadoop 2.x using YARN on a cluster we need to
distribute the below files to all the slave nodes in the cluster:
* conf/core-site.xml
*
Hi All,
hadoop dfsadmin -help
DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.
hadoop dfsadmin is the command to execute DFS administrative commands.
The full syntax is:
hadoop dfsadmin [-report] [-safemode ]
[-saveNamespace]
Hi All,
Apache Hadoop includes HDFS Federation.
Does anyone know how to migrate Apache Hadoop 1.x HDFS to Apache Hadoop 2.x
HDFS?
I am getting the following error:
[cloud@Impetus-942 hadoop-2.0.6-alpha]$ bin/hdfs start namenode --config
$HADOOP_CONF_DIR -upgrade -clusterId
Error: Could not fin
: Nirmal Kumar
Sent: Wednesday, November 27, 2013 2:56 PM
To: user@hadoop.apache.org; rd...@iastate.edu
Subject: RE: Any reference for upgrade hadoop from 1.x to 2.2
Hello Sandy,
The post was useful and gave an insight of the migration.
I am doing a test migration from Apache Hadoop-1.2.0 to Apache
and YARN, we recently published a couple blog posts on migrating:
http://blog.cloudera.com/blog/2013/11/migrating-to-mapreduce-2-on-yarn-for-users/
http://blog.cloudera.com/blog/2013/11/migrating-to-mapreduce-2-on-yarn-for-operators/
hope that helps,
Sandy
On Fri, Nov 22, 2013 at 3:03 AM, Nirmal Ku
Hi All,
I am also looking into migrating\upgrading from Apache Hadoop 1.x to Apache
Hadoop 2.x.
I didn’t find any doc\guide\blogs for the same.
Although there are guides\docs for the CDH and HDP migration\upgradation from
Hadoop 1.x to Hadoop 2.x
Would referring those be of some use?
I am looki
http://stackoverflow.com/questions/11479600/how-do-i-build-run-this-simple-mahout-program-without-getting-exceptions
From: Apurv Khare
To: "mahout-u...@apache.org" ; "user@hadoop.apache.org"
Sent: Sunday, 9 June 2013, 17:26
Subject: How to run MIA Kmean Code
22 matches
Mail list logo
