Re: can't submit remote job

2015-05-18 Thread Gopy Krishna
REMOVE On Mon, May 18, 2015 at 6:54 AM, xeonmailinglist-gmail xeonmailingl...@gmail.com wrote: Hi, I am trying to submit a remote job in Yarn MapReduce, but I can’t because I get the error [1]. I don’t have more exceptions in the other logs. My Mapreduce runtime have 1 *ResourceManager*

Re: can't submit remote job

2015-05-18 Thread xeonmailinglist-gmail
Shabab, I think so, but the Hadoop’s site says |The user@ mailing list is the preferred mailing list for end-user questions and discussion.|So I am using the right mailing list. Back to my problem, I think that this is a problem about HDFS security. But the strangest thing is that I have

Re: Jr. to Mid Level Big Data jobs in Bay Area

2015-05-18 Thread Rich Haase
Hi Adam, Questions about employment and career advice aren’t appropriate for this, or any, Apache mailing list . However, there are a number of forums on Linkedin where this question will be much better received. The Hadoop mailing lists get bombarded with questions from all over the

Re: can't submit remote job

2015-05-18 Thread Billy Watson
Netflix Genie is what we use for submitting jobs. William Watson Software Engineer (904) 705-7056 PCS On Mon, May 18, 2015 at 7:07 AM, xeonmailinglist-gmail xeonmailingl...@gmail.com wrote: I also can't find a good site/book that explains well how to submit remote jobs. Also, can anyone

Re: can't submit remote job

2015-05-18 Thread Shahab Yunus
I think that poster wanted to unsubscribe from the mailing list? Gopy, if that is the case then please see this for that: https://hadoop.apache.org/mailing_lists.html Regards, Shahab On Mon, May 18, 2015 at 9:42 AM, xeonmailinglist-gmail xeonmailingl...@gmail.com wrote: Why Remove? On

Re: can't submit remote job

2015-05-18 Thread xeonmailinglist-gmail
Why Remove? On 05/18/2015 02:25 PM, Gopy Krishna wrote: REMOVE On Mon, May 18, 2015 at 6:54 AM, xeonmailinglist-gmail xeonmailingl...@gmail.com mailto:xeonmailingl...@gmail.com wrote: Hi, I am trying to submit a remote job in Yarn MapReduce, but I can’t because I get the error

hadoop.tmp.dir?

2015-05-18 Thread Caesar Samsi
Hello, Hadoop.tmp.dir seems to be the root of all storage directories. I'd like for data to be stored in separate locations. Is there a list of directories and how they can be specified? Thank you, Caesar. (.tmp seems to indicate a temporary condition and yet it's used by HDFS,

Has bug HDFS-8179 been fixed for 2.7.0? Is there a patch?

2015-05-18 Thread Caesar Samsi
Hello, DFSClient#getServerDefaults returns null within 1 hour of system start https://issues.apache.org/jira/browse/HDFS-8179 I'm coming across this within 5 minutes of start and having to use -skipTrash. Is there a configuration option to always use -skipTrash and avoid the bug

Re: hadoop.tmp.dir?

2015-05-18 Thread Rajesh Kartha
Hello, The 3 main settings in hdfs-site.xml are: - * dfs.name.dir*: directory where namenode stores its metadata, default value ${hadoop.tmp.dir}/dfs/name. - *dfs.data.dir:* directory where HDFS data blocks are stored, default value ${hadoop.tmp.dir}/dfs/data. -

Re: Has bug HDFS-8179 been fixed for 2.7.0? Is there a patch?

2015-05-18 Thread Ted Yu
The fix is in the upcoming 2.7.1 release. See this thread: http://search-hadoop.com/m/uOzYt0soQDrSOkY On Mon, May 18, 2015 at 3:46 PM, Caesar Samsi caesarsa...@mac.com wrote: Hello, *DFSClient#getServerDefaults returns null within 1 hour of system start*

Verifying distributed clusters are working?

2015-05-18 Thread Caesar Samsi
Hello, How would I verify that HDFS, MapReduce, and Yarn are working across the cluster? Puspose is at least 2: 1. Make sure the computations are distributed 2. Ascertain the nodes are healthy (by an external monitoring/management software). Thank you, Caesar. Hadoop

can't submit remote job

2015-05-18 Thread xeonmailinglist-gmail
Hi, I am trying to submit a remote job in Yarn MapReduce, but I can’t because I get the error [1]. I don’t have more exceptions in the other logs. My Mapreduce runtime have 1 /ResourceManager/ and 3 /NodeManagers/, and the HDFS is running properly (all nodes are alive). I have looked to

Fwd: can't submit remote job

2015-05-18 Thread xeonmailinglist-gmail
I also can't find a good site/book that explains well how to submit remote jobs. Also, can anyone know where can I get more useful info? Forwarded Message Subject:can't submit remote job Date: Mon, 18 May 2015 11:54:56 +0100 From: xeonmailinglist-gmail

Re: Jr. to Mid Level Big Data jobs in Bay Area

2015-05-18 Thread mark charts
I agree.   I think its OK. But be advised there are jerks even in sheep's clothing. Humans are good at complaining for no reason at all. Simply to hears their own voice, I suppose. On Sunday, May 17, 2015 9:15 PM, Juan Suero juan.su...@gmail.com wrote: Hes a human asking for human