Re: Utility to push data into HDFS

I am guessing this should work - https://stackoverflow.com/questions/9722257/building-jar-that-includes-all-its-dependencies On Sun, Nov 1, 2015 at 8:15 PM, Shashi Vishwakarma wrote: > Hi Chris, > > Thanks for your reply. I agree WebHDFS is one of the option to

Re: How to backup and Restore Hadoop 2.x ?

One way is to create a backup cluster or a secondary cluster. 1. Ingest data in both clusters in "parallel", basically run jobs in both the clusters. This will kind of help you in backup and also make sure that you can switch over to the back up cluster when you have troubles with the Primary

Re: Unable to run mapr-reduce pi example (hadoop 2.2.0)

Looks like its not able to connect to the Resource Manager. Check if your Resource Manager is configured properly, Resource Manager address. Thanks, Ashwin On Tue, Aug 4, 2015 at 10:35 AM, Ravikant Dindokar ravikant.i...@gmail.com wrote: Hi I am using hadoop 2.2.0. When I am trying to run pi

Re: Hadoop 1.2.1 Source file

Did you get to look at this? https://wiki.apache.org/hadoop/HowToContribute and this https://git-wip-us.apache.org/repos/asf?p=hadoop.git;a=blob;f=BUILDING.txt Question: What are you trying to do here? Are you trying to contribute or are you trying to learn? On Sat, Jul 18, 2015 at 5:29 PM,

Re: sqoop export query error out..

(Sqoop.java:236) Thanks Jay On Wed, Jul 15, 2015 at 9:12 PM, James Bond bond.b...@gmail.com wrote: This clearly says its an oracle error. Try checking for the following - 1. If the user TESTUSER has Read/write privileges. 2. If the table TEST_DIMESION is the same schema as TESTUSER

Re: sqoop export query error out..

This clearly says its an oracle error. Try checking for the following - 1. If the user TESTUSER has Read/write privileges. 2. If the table TEST_DIMESION is the same schema as TESTUSER, if not try appending the schema name to the table - schema/owner.TEST_DIMENSION. 3. Make sure you are connecting

Re: sqoop export query error out..

This clearly says its an oracle error. Try checking for the following - 1. If the user TESTUSER has Read/write privileges. 2. If the table TEST_DIMESION is the same schema as TESTUSER, if not try appending the schema name to the table - schema/owner.TEST_DIMENSION. 3. Make sure you are connecting

Re: how to write custom log loader and store in JSON format

I am not sure about Pig, but its easily achievable in MapReduce. We had a similar requirement, we had to convert logs from RFC syslog format (5424) into JSON. We have a MR job which does this for us. The reason why we chose MR was mainly for Error Handling - like missing fields in some records,