Re: dynamic configuration

ReconfigurationServlet is utility for changing a node's configuration.it Reloads the configuration file, verifies whether changes are possible and asks the admin to approve the change. look at the source code available in hadoop bianries. Raj K Singh http

Re: 答复: Passing an object in mapper

Thanks guys :) On Wed, Aug 14, 2013 at 9:13 PM, Francis.Hu wrote: > hi, > > ** ** > > what I did when data need to be saved into DB : > > ** ** > > //configure DB connection info. > > DBConfiguration.*configureDB*(config, > > HadoopJobConfigParser.*getProper

答复: Passing an object in mapper

hi, what I did when data need to be saved into DB : //configure DB connection info. DBConfiguration.configureDB(config, HadoopJobConfigParser.getProperty(DB_DRIVER), HadoopJobConfigParser.getProperty(DB_URL), HadoopJobConfigPa

dynamic configuration

There is ReconfigurationServlet class in hadoop-2.0.5. How I to use the function for NameNode and DataNode? Thanks, LiuLei

Re: Passing an object in mapper

Hi, In the Configuration object in your driver class you can set the properties as key value pair. This configuration object will be set in the Job Object. The same properties can be accessed in the mapper/reducer using the Context Object -> getConfiguration() -> get(propertyName). Hope this help

Passing an object in mapper

Hi, I am initializing an object in driver code. For sake of argument let say I want to save data to some database.. say: Connection con = new Connection(host, db); Now, in reducer I want to do something like con.write(key,value) So, how do i pass this object from driver to mapper / reducer/? An

RE: Machine hangs from time to time

I doubt this is related to hadoop / java code, since you mention there is no keyboard / console response and only on specific DN. You may want to enable or check Linux abrtd, (base Linux tool) to help troubleshoot system level crashes (if any) Find out if this is related to hardware, such has t

Re: Machine hangs from time to time

How many map/reduce slots are you running per TT? How much memory is available per node? Did you enable memory management? - See http://hadoop.apache.org/docs/stable/cluster_setup.html#Memory+monitoring Thanks, +Vinod On Aug 14, 2013, at 6:34 PM, Chun-fan Ivan Liao wrote: > Hi, > > We are u

Machine hangs from time to time

Hi, We are using Hadoop 1.0.3 on Ubuntu 12.04.2 LTS. Hadoop servers include 1 NN/JT, 1 SNN/DN & several DNs. >From time to time, some of the servers just hanged, cannot be pinged, screen blackened out, not responding to keyboard input and lost connection with the NN. Lately, one DN was hanged eve

Re: Calling a MATLAB library in map reduce program

To add to that, if you want to take advantage of MapReduce, e.g. you need to do a distributed grouping or sort, pipes or streaming would be the way to go. If you're mainly interested in running your code in parallel on a cluster, distributed shell, a YARN application outside of MapReduce, could be

Re: updated to 1.2.1, map completed percentage keeps oscillating

Thanks for the hint, thou I am not sure if this is exactly the case. when I checked the log files, among other things, I did get these two memory errors which I wanted to ask you if you could tell me the difference between them: 2013-08-13 19:17:51,401 ERROR org.apache.nutch.protocol.httpclien

Re: Calling a MATLAB library in map reduce program

Can you take a look at distributed shell example? It will be helpful. Thanks, Omkar Joshi *Hortonworks Inc.* On Tue, Aug 13, 2013 at 9:35 PM, Chandra Mohan, Ananda Vel Murugan < ananda.muru...@honeywell.com> wrote: > Hi, > > ** ** > > I have to run some analyti

Re: Reduce Task Clarification

Also Sam, following are is a link giving example about how to implement secondary sort and what it is... http://codingjunkie.net/secondary-sort/ Regards, Shahab On Tue, Aug 13, 2013 at 3:51 PM, Sam Garrett wrote: > I am working on a MapReduce job where I would like to have the output > sorted

Re: Reduce Task Clarification

Implement raw comparator for your emitted keys to sort the output at the reducer. Raj K Singh http://www.rajkrrsingh.blogspot.com Mobile Tel: +91 (0)9899821370 On Wed, Aug 14, 2013 at 1:21 AM, Sam Garrett wrote: > I am working on a MapReduce job where

Re: Maven Cloudera Configuration problem

there is no way to specify conf settings in the maven pom.xml,instead you can build your project based on the profile and specify the properties into up property file. for setting the conf properties its better to create a shell script to run your jar, in which you need to provide the conf paramet

Re: Maven Cloudera Configuration problem

Here are the log details when i run the jar file: 08:10:29,738 INFO ZooKeeper:438 - Initiating client connection, connectString=localhost:2181 sessionTimeout=18 watcher=hconnection 08:10:29,777 INFO RecoverableZooKeeper:104 - The identifier of this process is 12...@xx--xxx-xx.eu-west- 1

Re: How exactly Oozie works internally?

Moved the general user group to Bcc. Hi Kasa, Did you check this  link? http://oozie.apache.org/docs/3.2.0-incubating/DG_SshActionExtension.html Can you please elaborate the problem? You can also use user@oozie email (in To) to get the answer. Regards, Mohammad ___

if i use MPv1 api write job ,can i track it on web ui http://resourcemanager:8088 ?

ATT