Re: Query against different data types within HDFS using Map/Reduce

2008-05-05 Thread Kayla Jay
Awesome. Thanks for the replies. Do you mind sharing your code or providing high-level details on the implementation? - Original Message From: Jason Venner <[EMAIL PROTECTED]> To: core-user@hadoop.apache.org Sent: Monday, May 5, 2008 12:41:26 PM Subject: Re: Query against dif

Re: Query against different data types within HDFS using Map/Reduce

2008-05-05 Thread Jason Venner
core-user@hadoop.apache.org Subject: Query against different data types within HDFS using Map/Reduce Has anyone come across this scenario and if not, does anyone have any suggestions? What if you store different types of data within HDFS. You store XML, text, binary, sequence files, etc. You now wan

RE: Query against different data types within HDFS using Map/Reduce

2008-05-05 Thread Ted Dunning
ssage- From: Kayla Jay [mailto:[EMAIL PROTECTED] Sent: Mon 5/5/2008 6:18 AM To: core-user@hadoop.apache.org Subject: Query against different data types within HDFS using Map/Reduce Has anyone come across this scenario and if not, does anyone have any suggestions? What if you store different typ

Query against different data types within HDFS using Map/Reduce

2008-05-05 Thread Kayla Jay
Has anyone come across this scenario and if not, does anyone have any suggestions? What if you store different types of data within HDFS. You store XML, text, binary, sequence files, etc. You now want to run a query against ALL of the data stored within HDFS via a map/reduce job. How do you

RE: regarding a query on the support of hadoop on windows.

2008-04-22 Thread dhruba Borthakur
an [mailto:[EMAIL PROTECTED] Sent: Tuesday, April 22, 2008 12:38 AM To: core-user@hadoop.apache.org Subject: RE: regarding a query on the support of hadoop on windows. hello Akshar, I would want to know if we get use hadoop without cygwin and if we use cygwin, what kind of impact will it h

RE: regarding a query on the support of hadoop on windows.

2008-04-22 Thread Anish Damodaran
@hadoop.apache.org Subject: Re: regarding a query on the support of hadoop on windows. Please see the 'Windows Users' section on http://wiki.apache.org/hadoop/QuickStart. On Mon, Apr 21, 2008 at 11:48 PM, Anish Damodaran < [EMAIL PROTECTED]> wrote: > > Hello Sir, > I'm c

Re: regarding a query on the support of hadoop on windows.

2008-04-22 Thread Akshar
Please see the 'Windows Users' section on http://wiki.apache.org/hadoop/QuickStart. On Mon, Apr 21, 2008 at 11:48 PM, Anish Damodaran < [EMAIL PROTECTED]> wrote: > > Hello Sir, > I'm currently evaluating hadoop for windows. I would like to know the > following > 1. It is possible for us to use ha

regarding a query on the support of hadoop on windows.

2008-04-21 Thread Anish Damodaran
Hello Sir, I'm currently evaluating hadoop for windows. I would like to know the following 1. It is possible for us to use hadoop without Cygwin as of now? If not, how feasible is it to use modify the scripts to support windows? 2. Does the efficiently decrease on account of the fact that hadoop

Re: Query

2008-04-17 Thread Prerna Manaktala
hey thanks but I am still not able to figure out. Please help On Thu, Apr 17, 2008 at 8:00 PM, Edward J. Yoon <[EMAIL PROTECTED]> wrote: > It wasn't too difficult though I do not remember the details. > Maybe searching the WWW does reveal the details > > http://www.google.com/search?q=dyndns+and

Re: Query

2008-04-17 Thread Edward J. Yoon
It wasn't too difficult though I do not remember the details. Maybe searching the WWW does reveal the details http://www.google.com/search?q=dyndns+and+ssh -Edward On Fri, Apr 18, 2008 at 8:43 AM, Prerna Manaktala <[EMAIL PROTECTED]> wrote: > how to do that? > > > On Thu, Apr 17, 2008 at 7:35 PM

Re: Query

2008-04-17 Thread Prerna Manaktala
how to do that? On Thu, Apr 17, 2008 at 7:35 PM, Edward J. Yoon <[EMAIL PROTECTED]> wrote: > Your ISP may be blocking access to critical ports behind their > routers. Can you access any ports on your router? You may want to try > setting up your router to forward some other port (80?) to your >

Re: Query

2008-04-17 Thread Edward J. Yoon
Your ISP may be blocking access to critical ports behind their routers. Can you access any ports on your router? You may want to try setting up your router to forward some other port (80?) to your server's port 22. Thanks, Edward. On Fri, Apr 18, 2008 at 8:26 AM, Prerna Manaktala <[EMAIL PROTECTE

Re: Query

2008-04-17 Thread Prerna Manaktala
yes this thing I already tried and in working fine but as I told u I am not able to ssh to any host I created at the site dyndns On Thu, Apr 17, 2008 at 7:13 PM, Edward J. Yoon <[EMAIL PROTECTED]> wrote: > [EMAIL PROTECTED] ~ > $ ssh > usage: ssh [-1246AaCfgKkMNnqsTtVvXxY] [-b bind_address] [-c

Re: Query

2008-04-17 Thread Edward J. Yoon
[EMAIL PROTECTED] ~ $ ssh usage: ssh [-1246AaCfgKkMNnqsTtVvXxY] [-b bind_address] [-c cipher_spec] [-D [bind_address:]port] [-e escape_char] [-F configfile] [-i identity_file] [-L [bind_address:]port:host:hostport] [-l login_name] [-m mac_spec] [-O ctl_cmd] [-o opti

Re: Query

2008-04-17 Thread Prerna Manaktala
thanks Already installed. but still ssh to the newly created host in dyndns site is not working ssh -i path to id_rsa prerna.dyndns.org.. it says connection to port 22 refused Prerna On Wed, Apr 16, 2008 at 9:17 PM, Edward J. Yoon <[EMAIL PROTECTED]> wrote: > I didn't try to run on cygwin, but y

Re: Query

2008-04-16 Thread Edward J. Yoon
I didn't try to run on cygwin, but you may need to install a ssh. http://pigtail.net/LRP/printsrv/cygwin-sshd.html On Tue, Apr 15, 2008 at 11:54 PM, Prerna Manaktala <[EMAIL PROTECTED]> wrote: > I tried to set up hadoop with cygwin according to the > > paper:http://developer.amazonwebservices.c

Query

2008-04-15 Thread Prerna Manaktala
I tried to set up hadoop with cygwin according to the paper:http://developer.amazonwebservices.com/connect/entry.jspa?externalID=873 But I had problems working with dyndns.I created a new host there:prerna.dyndns.org and gave the ip address of it in hadoop-ec2-env.sh as a value of MASTER_HOST. But

Re: Query regarding hadoop

2008-03-23 Thread Owen O'Malley
On Mar 22, 2008, at 1:13 PM, Prerna Manaktala wrote: but how should I run bin/hadoop using this ant? I am working on the EC2 of Amazon,wanted to run bin/hadoop -ec2 run. How should I proceed? I would actually suggest starting a single node cluster to gain familiarity first. From the hadoop

Query regarding hadoop

2008-03-22 Thread Prerna Manaktala
Hi I tried to run the command bin/hadoop on command prompt but couldnt.Then I downloaded ant as given in the FAQ. I was successful in doing ant -l build.log -Dtest.output=yes test-contrib but how should I run bin/hadoop using this ant? I am working on the EC2 of Amazon,wanted to run bin/hadoop -ec

Re: How can one query the mapreduce results from the dfs files ? - Newbee

2008-02-05 Thread Ted Dunning
job and created an index of Names which is duly > stored in the dfs. My question is, if we have to query the index by a > certain name, how can I do it ? Is there any sql-like mechanism for doing it > ? Would I need to use another apache-developed-application on top of Hadoop > for the

How can one query the mapreduce results from the dfs files ? - Newbee

2008-02-05 Thread rajarsi
Hi, I have run the mapreduce job and created an index of Names which is duly stored in the dfs. My question is, if we have to query the index by a certain name, how can I do it ? Is there any sql-like mechanism for doing it ? Would I need to use another apache-developed-application on top of