6/how-do-i-read-a-resource-file-from-a-java-jar-file?rq=1
>
> Regards,
> Shahab
>
> On Fri, Jul 17, 2015 at 10:09 AM, Harshit Mathur <mathursh...@gmail.com>
> wrote:
>
>> Are you reading the file in map or reduce task?
>> On Jul 17, 2015 2:51 AM, "Nisha
in the custom
input format and return splits ordered anyway your like.
On Wed, Jul 22, 2015 at 12:06 PM, Nishanth S chinchu2...@gmail.com
wrote:
Hey folks,
Is their a way to sort the input splits in map reduce.We have a case
where there are two files file1 and file2 in the input directory.Since
Hey folks,
Is their a way to sort the input splits in map reduce.We have a case where
there are two files file1 and file2 in the input directory.Since we have
custominputformat which has issplittable return false always each of
these files would be processed by a different mapper.How could
Hello,
I have to output multiple avro files with different schemas as the output
of a mapreduce job.Currently I am achieving this by doing a union of all
the schemas in the driver and then by using Avromultipleoutputs to
output two files.
AvroMultipleOutputs.addNamedOutput(job, a,
Hello,
I have built a jar file with maven as build tool which reads properties
from a file.I am doing this like InputStream is =
ClassLoader.getSystemResourceAsStream((hadoop.properties)) on start
iup.No qonce the jar is built I could see that the properties get loaded
when I do java -jar
Hi All,
I have a map reduce job which reads a binary file and needs to output
multiple avro files and a textformat file.I was able to output multiplle
avro files using (Avromultipleouts).How would I modify the job to output
textformat as well along with these avro files.Is it possible.
for eg: hadoop jar myJar.jar my.testapp.code1.MyMain1 arg1 arg2
hadoop jar myJar.jar my.testapp.code2.MyMain2 arg1
arg2
BR,
Harshit
On Wed, Jul 1, 2015 at 3:51 AM, Nishanth S chinchu2...@gmail.com wrote:
Hello,
Is there a way I can package multiple
Hello,
Is there a way I can package multiple map reduce jobs into one jar file
and then invoke them using hadoop jar.I am using maven as the build
tool.What should be the main class in the manifest file in this case?.
Thanks,
Nishan
Hello All,
We are using avro 1.7.7 and hadoop 2.5.1 in our project.We need to process
a mixed mode binary file using map reduce and have the output as multiple
avro files and each of these avro files would have different avro schemas.I
looked at AvroMultipleOutputs class but did not completely
Hello All,
We are using avro 1.7.7 and hadoop 2.5.1 in our project.We need to process
a mixed mode binary file using map reduce and have the output as multiple
avro files and each of these avro files would have different avro schemas.I
looked at AvroMultipleOutputs class but did not completely
Hey friends.
I build hadoop 2.5.2 on my pc and I am able to run map reduce jobs
locally after setting hadoop_home.I am trying to set this up in another
machine by using the same tar file that i built in mine but getting the
below error. Can you please help
Exception in thread main
.
Original message
From: Nishanth S chinchu2...@gmail.com
Date:05/05/2015 6:33 PM (GMT-05:00)
To: user@hadoop.apache.org
Subject: Re: Help with Kerberos
Thanks Chris.I checked the configuration files and see that these
properties are in place.I am trying to connect to hadoop cluster
the secure mode documentation. It has more
details on this and other relevant configuration properties.
http://hadoop.apache.org/docs/r2.7.0/hadoop-project-dist/hadoop-common/Secu
reMode.html
I hope this helps.
--Chris Nauroth
From: Nishanth S chinchu2...@gmail.com
Reply-To: user
Hello ,
I am getting the below exception when trying to run a simple map reduce
from a machine outside the hadoop cluster.This is the kerberos code I am
using.Please help
org.apache.hadoop.conf.Configuration conf = new
org.apache.hadoop.conf.Configuration();
Hello All,
I am looking to write a map only program in java .The output of which are
two avro files.There can be two types of records in the input file(let us
say lion and tiger) and based on an identifier they are processed and
written to two different avro files using
This is a vast topic.Can you tell what components are there in your data
pipe line and how data flows in to system and the way its processed.There
are several inbuilt tests like testDFSIO and terasort that you can run.
-Nishan
On Sun, Mar 1, 2015 at 9:45 PM, Krish Donald gotomyp...@gmail.com
16 matches
Mail list logo
