Re: tracking remote reads in datanode logs

2015-02-25 Thread Igor Bogomolov
Thanks a lot! Igor On Tue, Feb 24, 2015 at 11:46 PM, Drake민영근 drake@nexr.com wrote: Hi, Igor The AM logs are in the Hdfs if you set log aggregation property. Otherwise, they are in the container log directory. See this:

Re: java.net.UnknownHostException on one node only

2015-02-25 Thread tesm...@gmail.com
Thanks Varun, Where shall I check to resolve it? Regards, Tariq On Mon, Feb 23, 2015 at 4:07 AM, Varun Kumar varun@gmail.com wrote: Hi Tariq, Issues looks like DNS configuration issue. On Sun, Feb 22, 2015 at 3:51 PM, tesm...@gmail.com tesm...@gmail.com wrote: I am getting

HDFS data after nodes become unavailable?

2015-02-25 Thread tesm...@gmail.com
Dear all, I have transferred the data from local storage to HDFS in my 10 nodes Hadoop cluster. The relication facotr is 3. Some nodes, say 3, are not available after some time. I can't use those nodes for computation or storage of data. What will happen to the data stored on HDFS of those

NodeManager was not connected to its ResourceManager

2015-02-25 Thread Manoj Venkatesh
Dear Hadoop experts, Firstly, thank you all for answering my previous question(s). Now, I have a hadoop cluster of 8 nodes, we use YARN The information transmitted in this email is intended only for the person or entity to which it is addressed, and may contain material confidential to Xoom

Re: video stream as input to sequence files

2015-02-25 Thread daemeon reiydelle
Can you explain your use case? *...* *“Life should not be a journey to the grave with the intention of arriving safely in apretty and well preserved body, but rather to skid in broadside in a cloud of smoke,thoroughly used up, totally worn out, and loudly proclaiming “Wow! What a

Re: Hadoop Handy Commands

2015-02-25 Thread Jagat Singh
This should be good start https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/CommandsManual.html On Thu, Feb 26, 2015 at 9:19 AM, Krish Donald gotomyp...@gmail.com wrote: Hi, Does anybody ahs Hadoop related commands list which comes really handy when needed? If yes,

video stream as input to sequence files

2015-02-25 Thread tesm...@gmail.com
Hi, How can I make my video data files as input for sequence file or to HDFS directly. Regards, Tariq

Re: HDFS data after nodes become unavailable?

2015-02-25 Thread Rajesh Kartha
Do you know why the 3 nodes are down ? With replication, the copy of data that were hosted on those failed nodes will not be available. However, the data will still be served by the hosts having the other 2 copies - so I don't think you need to copy the data again. Unless for some reason the 3

Re: video stream as input to sequence files

2015-02-25 Thread tesm...@gmail.com
Dear Daemeon, Thanks for your rpely. Here is my flow. I am processing video frames using MapReduce. Presently, I convert the video files to individual framess, make a sequence file out of them and transfer the sequence file to HDFS. This flow is not optimized and I need to optimize it. On Thu,