When will hadoop version 0.18 be released?

2008-08-13 Thread 11 Nov.
Hi colleagues, As you know, the append writer will be available in version 0.18. We are here waiting for the feature and want to know the rough time of release. Thanks!

Re: When will hadoop version 0.18 be released?

2008-08-13 Thread Arun C Murthy
On Aug 12, 2008, at 11:51 PM, 11 Nov. wrote: Hi colleagues, As you know, the append writer will be available in version 0.18. We are here waiting for the feature and want to know the rough time of release. It's currently under vote, it should be released by the end of the week if it

problem accessing web monitoring tools

2008-08-13 Thread James Casbon
Hello Everyone, I'm having a little problem accessing the web monitoring URLs. I start the server, and the logs dutifully report: 2008-08-13 10:11:47,031 INFO org.mortbay.util.Container: Started [EMAIL PROTECTED] 2008-08-13 10:11:47,064 INFO org.mortbay.util.Container: Started

issues with hadoop in AIX

2008-08-13 Thread Arun Venugopal
Hi, I am evaluating Hadoop's Portability Across Heterogeneous Hardware and Software Platforms. For this I am trying to setup a grid (Hadoop 0.17) having Linux ( RHEL5 / FC 9), Solaris (SunOS 5) and AIX (5.3). I was able to setup a grid with 10 Linux machines and run some basic grid jobs on it. I

Get the pairs of all row key combinations w/o repetition

2008-08-13 Thread Edward J. Yoon
Hi communities, Do you have any idea how to get the pairs of all row key combinations w/o repetition on Map/Reduce as describe below? Input : (MapFile or Hbase Table) Key1, Value or RowResult Key2, Value or RowResult Key3, Value or RowResult Key4, Value or RowResult Output : Key1, Key2 Key1,

Re: Get the pairs of all row key combinations w/o repetition

2008-08-13 Thread Amar Kamat
Edward J. Yoon wrote: Hi communities, Do you have any idea how to get the pairs of all row key combinations w/o repetition on Map/Reduce as describe below? Input : (MapFile or Hbase Table) Key1, Value or RowResult Key2, Value or RowResult Key3, Value or RowResult Key4, Value or RowResult

Re: Get the pairs of all row key combinations w/o repetition

2008-08-13 Thread Amar Kamat
Edward J. Yoon wrote: Hi communities, Do you have any idea how to get the pairs of all row key combinations w/o repetition on Map/Reduce as describe below? Input : (MapFile or Hbase Table) Key1, Value or RowResult Key2, Value or RowResult Key3, Value or RowResult Key4, Value or RowResult

Re: Get the pairs of all row key combinations w/o repetition

2008-08-13 Thread Amar Kamat
Amar Kamat wrote: Edward J. Yoon wrote: Hi communities, Do you have any idea how to get the pairs of all row key combinations w/o repetition on Map/Reduce as describe below? Input : (MapFile or Hbase Table) Key1, Value or RowResult Key2, Value or RowResult Key3, Value or RowResult Key4,

Re: Get the pairs of all row key combinations w/o repetition

2008-08-13 Thread Edward J. Yoon
Yes, but then, as the i grows, the task to workload ratio gets larger and larger. Is It Right? -Edward On Wed, Aug 13, 2008 at 9:23 PM, Amar Kamat [EMAIL PROTECTED] wrote: Edward J. Yoon wrote: Hi communities, Do you have any idea how to get the pairs of all row key combinations w/o

Re: Get the pairs of all row key combinations w/o repetition

2008-08-13 Thread Edward J. Yoon
Is there another option? or a efficient workload balancing algorithm for this case? If so, please, let me know. Thanks, Ed On Wed, Aug 13, 2008 at 9:55 PM, Edward J. Yoon [EMAIL PROTECTED] wrote: Yes, but then, as the i grows, the task to workload ratio gets larger and larger. Is It Right?

Re: Difference between Hadoop Streaming and Normal mode

2008-08-13 Thread Adam SI
Will coding computational intensive algorithms using c/c++ and using them with streaming mode improve the performance ? Just curiosity. Xiance On Aug 13, 2008, at 10:56 AM, Gaurav Veda wrote: Thank you all for the replies. They do clarify things! Cheers, Gaurav On Tue, Aug 12, 2008 at

Re: When will hadoop version 0.18 be released?

2008-08-13 Thread Konstantin Shvachko
But you won't get append in 0.18. It was committed for 0.19. --konstantin Arun C Murthy wrote: On Aug 12, 2008, at 11:51 PM, 11 Nov. wrote: Hi colleagues, As you know, the append writer will be available in version 0.18. We are here waiting for the feature and want to know the rough

Re: MR use case where each reducer/mapper receives different parameters

2008-08-13 Thread Ashish Venugopal
Also, just to clarify a couple of points: I am using Hadoop On Demand, which means that to run a job, I first have to allocate a cluster, I am using the hod script mechanism, where the cluster is allocated for running time of my hod script. If my script could schedule multiple MR jobs, but then

Problem with installation of 0.17.0: things start but tests fail

2008-08-13 Thread Joel Welling
I'm new to Hadoop, and am doing an installation of 0.17.1 on a small system. The only thing that I know is unusual about the system is that the underlying filesystem is in fact shared- a single Lustre filesystem is visible to all the nodes, and individual nodes all seem to be storing their blocks

task execution environment clarification

2008-08-13 Thread Frank Singleton
Hi, I have an observation about the task execution environment. Its a little long but here we go .. I have read http://hadoop.apache.org/core/docs/current/mapred_tutorial.html#Task+Execution+%26+Environment but wanted a clarification. I have a mapper written in python that does some

Re: task execution environment clarification

2008-08-13 Thread Frank Singleton
Allen Wittenauer wrote: On 8/13/08 9:25 PM, Frank Singleton [EMAIL PROTECTED] wrote: Perhaps this is just the consequence of the abstracted view hadoop [job] has of /tmp etc and that i need to keep this in mind when unittesting mappers/reducers and mappers creating tmp resources on the

Re: task execution environment clarification

2008-08-13 Thread Frank Singleton
Allen Wittenauer wrote: On 8/13/08 9:25 PM, Frank Singleton [EMAIL PROTECTED] wrote: Perhaps this is just the consequence of the abstracted view hadoop [job] has of /tmp etc and that i need to keep this in mind when unittesting mappers/reducers and mappers creating tmp resources on the