Update or Workaround for HDFS-1312

2015-09-10 Thread Vineet Mishra
Hi All, I am having a 10 node Hadoop 2.5 cluster with Cloudera distribution 5.3.2 and the datanodes having the multiple disk partitions associated with them. Since the time its been observed that the disk space consumption in some of the partition is growing tremendously while the other partition

Data upload

2015-09-10 Thread Oliver Schmidt
Hi all, I am new in using hadoop, and have a very basich question. We just downloaded the sandbox, and it is up and running. But where can we now upload data for processing? This is the view I have - am I missing something? [cid:image003.jpg@01D0EBB8.59F08870] Thanks for your help. Oliver

Re: Data upload

2015-09-10 Thread Olivier Renault
There is multiple way of loading data into Hadoop ( Flume, SQOOP, WebHDFS, … ). If you would like to use a UI, you can click on the icons next to admin and click on File. You will be shown a file browser, you can also use it for loading files. Olivier From: Oliver Schmidt Reply-To: "user@ha

hadoop command line reading input issue

2015-09-10 Thread mehdi benchoufi
Hi all, I have some issue with java.lang.NoClassDefFoundError type exception. SO I need to add -libjars flag. When running hadoop jar main.jar -libjars some.jar input_file output_file I have this message Input path does not exist: gs://metamap_hd/-libjars I tried every combination, I added -inpu

Avro C++ without schema generation

2015-09-10 Thread Marius
Hey, i have avro files that as of yet are only used with Python to decode and encode. To do some performance evaluations i want to use the C++ implementation of avro to read the files but the use case does not allow the schema to be around so i cant perform code generation. Is there any way t

Re: Update or Workaround for HDFS-1312

2015-09-10 Thread Anu Engineer
Hi Vineet, Unfortunately we have not made any effective progress on that JIRA(HDFS-1312). I intend to work on it and I will post a proposal on that JIRA soon. Thanks for your patience. —Anu From: Vineet Mishra Reply-To: "user@hadoop.apache.org" Date: Thursday, Se

Re: Fwd: Properties file not loaded with hadoop jar command

2015-09-10 Thread Nishanth S
Thanks.Yep its a java issue.using Thread.contextclassloader would solve this. -Nishanth On Fri, Jul 17, 2015 at 8:17 AM, Shahab Yunus wrote: > This seems to be a Java issue rather than Hadoop? > > Have you seen these below, regarding intricacies involved in reading a > resource file in Java ja