Re: how to store video,audio files into hdfs through java program

Hi, Think storing is not much of an issue, as much as some thought would be required in processing. Think you can, to the basic be able to use SequenceFileInputFormat, ByteArrayInputStream (and corresponding output) for the binary files. There are some experiments on audio, video here - Audio

Re: SVM implementaion

where can i get a large file for checking svm .with classes 1 and -1 around 1 GB file On Fri, Nov 8, 2013 at 11:14 AM, unmesha sreeveni unmeshab...@gmail.comwrote: thx Mirko Kampf On Fri, Nov 8, 2013 at 10:48 AM, Mirko Kämpf mirko.kae...@gmail.comwrote: There are three Jira issues about

Re: SVM implementaion

You could try having a look at some of the competition data sets on http://www.kaggle.com. Many of them are 1/0 classification problems Sent from my iPhone On 8 Nov 2013, at 10:10, unmesha sreeveni unmeshab...@gmail.com wrote: where can i get a large file for checking svm .with classes 1 and

Re: Any reference for upgrade hadoop from 1.x to 2.2

I am looking for the same thing if anyone can point us to a good direction please. Thank you. (Currently running Hadoop 1.2.1) 2013/11/1 YouPeng Yang yypvsxf19870...@gmail.com Hi users Are there any reference docs to introduce how to upgrade hadoop from 1.x to 2.2. Regards

Hadoop 2.2.0: Cannot run PI in under YARN

When I tried the PI example, I got File does not exist error. The mapreduce frame work is set to yarn. Any idea what's wrong? .Failing this attempt.. Failing the application. 13/11/07 18:13:02 INFO mapreduce.Job: Counters: 0 Job Finished in 104.852 seconds java.io.FileNotFoundException: File

Could not obtain block?

Hi, I have a situation here that I'm wondering where it's coming from. I know that I'm using a pretty old version... 1.0.3 When I fsck a file, I can see tha there is one block but when I try to get the file, I'm not able to retrieve this block. I tought it was because the file was opened, so I

HDFS-NFS Windows

Is it possible to export using HDFS-NFS on Windows 7?

Re: Hadoop 2.2.0: Cannot run PI in under YARN

This is just a symptom not the root cause. Please check the YARN web UI at 8088 on ResourceManager machine and browse to the application page. It should give you more details. Thanks, +Vinod On Nov 8, 2013, at 8:57 AM, Ping Luo wrote: java.io.FileNotFoundException: File does not exist --

Re: Hadoop 2.2.0: Cannot run PI in under YARN

The problem is resolved. The resource manager address was not configured correctly. Thanks, Ping From: Vinod Kumar Vavilapalli vino...@hortonworks.com To: user@hadoop.apache.org; Ping Luo luop0...@yahoo.com Sent: Friday, November 8, 2013 1:26 PM Subject:

Hadoop 2.02 multiple merges in map phase

Hi All, In my map logs I see the Merging 2 sorted segments message twice and after each message it takes time to merge. Why is it merging twice? And where does the merge sizes 69954754 and 69631730 come from? My expected result would be a singe merge of 2 sorted segments with a total size of

Re: Hadoop 2.02 multiple merges in map phase

Correction*: version is 2.2.0 Thanks! On Friday, November 8, 2013 4:03 PM, - commodor...@ymail.com wrote: Hi All, In my map logs I see the Merging 2 sorted segments message twice and after each message it takes time to merge. Why is it merging twice? And where does the merge sizes

scp files from Hadoop to different linux box

Hi All, I am having a scenario where I need to scp files from HDFS to another linux box. I use oozie and hive for generating the data. I know I can run shell from local and get files from hadoop and scp, but I would want it to be part of oozie action. I tried creating a shell action but it failed

scp files from hadoop to another linux box

Hi All, I have one scenario where I need to send files from HDFS to another linux box(local) , I know rfom local I can run shell command and get file from hadoop but I want it to be part of my oozie action. Please help, thanks in advance. thx Krishnan.