how to create namenode

2007-11-14 Thread Ipraveen
hi i am runnig hadoop but i am unable to create a name node and data node so pls give me step by step solution to careate namenode and datanode -- View this message in context: http://www.nabble.com/how-to-create-namenode-tf4803422.html#a13742344 Sent from the Hadoop Dev mailing list archive

[jira] Issue Comment Edited: (HADOOP-2171) [Hbase Shell] Socket Sever for executing the hql query in other applications.

2007-11-14 Thread Edward Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542082 ] udanax edited comment on HADOOP-2171 at 11/14/07 2:02 AM: --- - Echo test between a java

Re: Building good XML parsing library Hadoop

2007-11-14 Thread Alan Ho
Thanks everyone. I've done a first cut at the parser. I've made the following assumptions: 1. The input is a sequence of XML elements 2. There is no "recursion" of elements 3. Fixed depth of 1 My design is fairly simple - it simply reads records 1 by 1 and puts them into Strings (almost id

[jira] Updated: (HADOOP-2171) [Hbase Shell] Socket Sever for executing the hql query in other applications.

2007-11-14 Thread Edward Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Yoon updated HADOOP-2171: Description: To support (non-java) client, protocols will be defined and developed in socket serv

[jira] Commented: (HADOOP-1648) Add contrib jars to general hadoop CLASSPATH

2007-11-14 Thread Edward Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542394 ] Edward Yoon commented on HADOOP-1648: - When should I expect you commit? > Add contrib jars to general hadoop CL

[jira] Commented: (HADOOP-1288) missing userlogs

2007-11-14 Thread Enis Soztutar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542401 ] Enis Soztutar commented on HADOOP-1288: --- bq. wonder whether it has to do with the default value of 12 hours fo

[jira] Updated: (HADOOP-1347) Configuration XML bug: empty values

2007-11-14 Thread Rajagopal Natarajan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajagopal Natarajan updated HADOOP-1347: Status: Open (was: Patch Available) > Configuration XML bug: empty values > -

[jira] Updated: (HADOOP-1347) Configuration XML bug: empty values

2007-11-14 Thread Rajagopal Natarajan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajagopal Natarajan updated HADOOP-1347: Status: Patch Available (was: Open) > Configuration XML bug: empty values > -

hadoop site update

2007-11-14 Thread Enis Soztutar
After HADOOP-1917 the web site is not updated, is it intentional? Otherwise I will update it.

Re: hadoop site update

2007-11-14 Thread Enis Soztutar
Well once again me *smile* Arun I think you have to generate and copy all the .html files since src/docs/src/documentation/content/xdocs/site.xml has changed. New files in the left menu does not appear in the unchanged files. Enis Soztutar wrote: Ok, now I see it, it must have been a cache i

Re: hadoop site update

2007-11-14 Thread Arun C Murthy
On Wed, Nov 14, 2007 at 05:14:26PM +0200, Enis Soztutar wrote: >After HADOOP-1917 the web site is not updated, is it intentional? >Otherwise I will update it. It has been updated, don't you see the following... http://lucene.apache.org/hadoop/quickstart.html http://lucene.apache.org/hadoop/cluste

[jira] Created: (HADOOP-2205) Regenerate entire hadoop website since site.xml was changed by HADOOP-1917

2007-11-14 Thread Arun C Murthy (JIRA)
Regenerate entire hadoop website since site.xml was changed by HADOOP-1917 -- Key: HADOOP-2205 URL: https://issues.apache.org/jira/browse/HADOOP-2205 Project: Hadoop Iss

Re: hadoop site update

2007-11-14 Thread Arun C Murthy
On Wed, Nov 14, 2007 at 05:58:10PM +0200, Enis Soztutar wrote: >Well once again me *smile* > >Arun I think you have to generate and copy all the .html files since >src/docs/src/documentation/content/xdocs/site.xml has changed. New files >in the left menu does not appear in the unchanged files. >

[jira] Commented: (HADOOP-2205) Regenerate entire hadoop website since site.xml was changed by HADOOP-1917

2007-11-14 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542495 ] Arun C Murthy commented on HADOOP-2205: --- I'd also like to use this jira to fix 2 minor typos in the website in

Re: hadoop site update

2007-11-14 Thread Enis Soztutar
Ok, now I see it, it must have been a cache issue. Sorry for the noise. Arun C Murthy wrote: On Wed, Nov 14, 2007 at 05:14:26PM +0200, Enis Soztutar wrote: After HADOOP-1917 the web site is not updated, is it intentional? Otherwise I will update it. It has been updated, don't you see

Re: Building good XML parsing library Hadoop

2007-11-14 Thread Arkady Borkovsky
The "restricted XML" described by Alan is very common. It would be good to to have an InputFormat that -- given a top level tag T splits the input into chunks with one T element in each chunk. -- takes care about encoding, character-entity references, and CDATA -- puts a record into a hashtabl

[jira] Updated: (HADOOP-2205) Regenerate entire hadoop website since site.xml was changed by HADOOP-1917

2007-11-14 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HADOOP-2205: -- Status: Patch Available (was: Open) > Regenerate entire hadoop website since site.xml was cha

[jira] Updated: (HADOOP-2205) Regenerate entire hadoop website since site.xml was changed by HADOOP-1917

2007-11-14 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HADOOP-2205: -- Attachment: HADOOP-2205_1_20071114.patch Attached patch fixes some typos and broken links intr

[jira] Commented: (HADOOP-2104) clover description attribute suppresses all other targets in -projecthelp

2007-11-14 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542526 ] dhruba borthakur commented on HADOOP-2104: -- +1. Code changes look good. > clover description attribute sup

[jira] Updated: (HADOOP-2141) speculative execution start up condition based on completion time

2007-11-14 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milind Bhandarkar updated HADOOP-2141: -- Fix Version/s: (was: 0.16.0) 0.15.1 Priorit

[jira] Commented: (HADOOP-2141) speculative execution start up condition based on completion time

2007-11-14 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542528 ] Milind Bhandarkar commented on HADOOP-2141: --- +1 We have started seeing this on more and more jobs. I am c

[jira] Commented: (HADOOP-1900) the heartbeat and task event queries interval should be set dynamically by the JobTracker

2007-11-14 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542530 ] Devaraj Das commented on HADOOP-1900: - Owen, by what you suggested, it appears that the heartbeat interval would

[jira] Commented: (HADOOP-1900) the heartbeat and task event queries interval should be set dynamically by the JobTracker

2007-11-14 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542535 ] Owen O'Malley commented on HADOOP-1900: --- Oops, clearly I meant max instead of min. I still think an adaptive r

[jira] Assigned: (HADOOP-2141) speculative execution start up condition based on completion time

2007-11-14 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das reassigned HADOOP-2141: --- Assignee: Arun C Murthy > speculative execution start up condition based on completion time

[jira] Commented: (HADOOP-1900) the heartbeat and task event queries interval should be set dynamically by the JobTracker

2007-11-14 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542539 ] Devaraj Das commented on HADOOP-1900: - I think in my last proposal, the adaptiveness is not going to be that muc

[jira] Commented: (HADOOP-1900) the heartbeat and task event queries interval should be set dynamically by the JobTracker

2007-11-14 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542547 ] Doug Cutting commented on HADOOP-1900: -- I don't see why finding an optimal heartbeat time is critical. Scaling

[jira] Updated: (HADOOP-2063) Command to pull corrupted files

2007-11-14 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated HADOOP-2063: - Fix Version/s: 0.16.0 > Command to pull corrupted files > --- > >

[jira] Updated: (HADOOP-2065) Replication policy for corrupted block

2007-11-14 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated HADOOP-2065: - Fix Version/s: 0.16.0 > Replication policy for corrupted block > --

[jira] Updated: (HADOOP-2204) DFSTestUtil.waitReplication does not wait.

2007-11-14 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-2204: - Resolution: Fixed Status: Resolved (was: Patch Available) I just committed this

[jira] Created: (HADOOP-2206) Design/implement a general log-aggregation framework for Hadoop

2007-11-14 Thread Arun C Murthy (JIRA)
Design/implement a general log-aggregation framework for Hadoop --- Key: HADOOP-2206 URL: https://issues.apache.org/jira/browse/HADOOP-2206 Project: Hadoop Issue Type: New Feature

[jira] Commented: (HADOOP-2201) TestCrcCorruption sometimes fails

2007-11-14 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542563 ] dhruba borthakur commented on HADOOP-2201: -- Like we discussed, the MiniDFSCluster.waitActive() should wait

[jira] Updated: (HADOOP-1989) Add support for simulated Data Nodes - helpful for testing and performance benchmarking of the Name Node without having a large cluster

2007-11-14 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-1989: - Status: Open (was: Patch Available) This patch is not merging cleanly with trunk. Can y

[jira] Updated: (HADOOP-2206) Design/implement a general log-aggregation framework for Hadoop

2007-11-14 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HADOOP-2206: -- Description: I'd like to propose a log-aggregation framework which facilitates collection, ag

[jira] Commented: (HADOOP-2184) RPC Support for user permissions and authentication.

2007-11-14 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542567 ] Doug Cutting commented on HADOOP-2184: -- > are there cases, where same client RPC connection is used both by >

[jira] Commented: (HADOOP-2184) RPC Support for user permissions and authentication.

2007-11-14 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542568 ] Arun C Murthy commented on HADOOP-2184: --- bq. So, under this approach, the JobTracker and TaskTracker would nev

[jira] Commented: (HADOOP-713) dfs list operation is too expensive

2007-11-14 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542573 ] Doug Cutting commented on HADOOP-713: - > This would be significantly lower RPC load than an invocation per file.

[jira] Commented: (HADOOP-2184) RPC Support for user permissions and authentication.

2007-11-14 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542572 ] Tsz Wo (Nicholas), SZE commented on HADOOP-2184: Is it possible to have a situation that a RPC socke

[jira] Commented: (HADOOP-2025) Instantiating a FileSystem object should guarantee the existence of the working directory

2007-11-14 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542566 ] Chris Douglas commented on HADOOP-2025: --- The changes to the test code were to accommodate the Trash- which att

[jira] Commented: (HADOOP-2184) RPC Support for user permissions and authentication.

2007-11-14 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542577 ] Raghu Angadi commented on HADOOP-2184: -- So the summery is that Map/Reduce kernel and user code should use diff

[jira] Commented: (HADOOP-1984) some reducer stuck at copy phase and progress extremely slowly

2007-11-14 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542552 ] Devaraj Das commented on HADOOP-1984: - After some corridor discussion between me, Arun and Amar, here are some

[jira] Commented: (HADOOP-2184) RPC Support for user permissions and authentication.

2007-11-14 Thread Christophe Taton (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542578 ] Christophe Taton commented on HADOOP-2184: -- > Is it possible to have a situation that a RPC socket is share

[jira] Commented: (HADOOP-2184) RPC Support for user permissions and authentication.

2007-11-14 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542584 ] Raghu Angadi commented on HADOOP-2184: -- bq. In fact, this issue might ease HADOOP-1298 a bit, as it would not r

[jira] Commented: (HADOOP-2184) RPC Support for user permissions and authentication.

2007-11-14 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542586 ] Raghu Angadi commented on HADOOP-2184: -- > Should we also bring up 2 sets of RPC servers for kernel and user >

[jira] Commented: (HADOOP-2184) RPC Support for user permissions and authentication.

2007-11-14 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542576 ] Arun C Murthy commented on HADOOP-2184: --- bq. Is it possible to have a situation that a RPC socket is shared by

Re: Building good XML parsing library Hadoop

2007-11-14 Thread Arun C Murthy
On Wed, Nov 14, 2007 at 12:25:05PM -0800, Alan Ho wrote: >OK, I'll be finished with a tutorial and tests by end of this week or next. >I've decided to stuff each record into a String, so that its up to the person >who writes the map class on how they want to parse it. My intention is that >"powe

[jira] Issue Comment Edited: (HADOOP-2184) RPC Support for user permissions and authentication.

2007-11-14 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542577 ] rangadi edited comment on HADOOP-2184 at 11/14/07 12:19 PM: - So the summery is that

[jira] Commented: (HADOOP-2025) Instantiating a FileSystem object should guarantee the existence of the working directory

2007-11-14 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542589 ] Doug Cutting commented on HADOOP-2025: -- > Do you prefer throwing an IOException to an IllegalArgumentException

Re: Building good XML parsing library Hadoop

2007-11-14 Thread Alan Ho
How do I add an extra dependency to Hadoop. Specifically I'd like to put a dependency on J2EE 5, specifically to classes that relate to JAXP and JAXB. Regards, Alan Ho - Original Message From: Arun C Murthy <[EMAIL PROTECTED]> To: hadoop-dev@lucene.apache.org Sent: Wednesday, November

[jira] Commented: (HADOOP-2184) RPC Support for user permissions and authentication.

2007-11-14 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542582 ] Arun C Murthy commented on HADOOP-2184: --- bq. So the summery is that Map/Reduce kernel and user code should use

Re: Building good XML parsing library Hadoop

2007-11-14 Thread Alan Ho
OK, I'll be finished with a tutorial and tests by end of this week or next. I've decided to stuff each record into a String, so that its up to the person who writes the map class on how they want to parse it. My intention is that "power users" will use JAXB to bind String to Java classes. Not so

[jira] Commented: (HADOOP-2184) RPC Support for user permissions and authentication.

2007-11-14 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542607 ] Raghu Angadi commented on HADOOP-2184: -- Looking at the RPC client code, the connections are established on dema

Path Handling and URIs

2007-11-14 Thread Dennis Kubes
I can't really tell if this is a bug or a *feature*. Path is meant to handle various file systems, DFS, S3, Local, etc. Path has a toURI method. I don't think the current behavior of toURI is consistent, especially with local file handling. Take the following code: Path path = new Path("/h

[jira] Commented: (HADOOP-1900) the heartbeat and task event queries interval should be set dynamically by the JobTracker

2007-11-14 Thread Sameer Paranjpye (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542599 ] Sameer Paranjpye commented on HADOOP-1900: -- > But I don't see the importance of faster heartbeats on faster

[jira] Commented: (HADOOP-2187) FileSystem should return location information with byte ranges

2007-11-14 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542626 ] Konstantin Shvachko commented on HADOOP-2187: - I agree, especially since hdfs already calls getBlockLoca

[jira] Commented: (HADOOP-713) dfs list operation is too expensive

2007-11-14 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542627 ] dhruba borthakur commented on HADOOP-713: - I was assuming that we cannot add a new API in a point release. If

[jira] Commented: (HADOOP-713) dfs list operation is too expensive

2007-11-14 Thread Sameer Paranjpye (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542628 ] Sameer Paranjpye commented on HADOOP-713: - > If not, we could bump the protocol version, which we normally tr

[jira] Commented: (HADOOP-2206) Design/implement a general log-aggregation framework for Hadoop

2007-11-14 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542629 ] Doug Cutting commented on HADOOP-2206: -- A few thoughts: - do we worry about security? is anyone allowed to re

[jira] Commented: (HADOOP-713) dfs list operation is too expensive

2007-11-14 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542630 ] Doug Cutting commented on HADOOP-713: - > I was assuming that we cannot add a new API in a point release. Well, i

Re: Path Handling and URIs

2007-11-14 Thread Dennis Kubes
Doug Cutting wrote: Dennis Kubes wrote: If I call Path.toURI is essentially prints out the path without a scheme. That's right. You've provided no scheme, and so have a scheme-independent path, a kind of relative path. On the other hand if I create a file and call its toURI method I get

[jira] Updated: (HADOOP-2172) PositionCache was removed from FSDataInputStream, causes extremely bad MapFile performance

2007-11-14 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HADOOP-2172: - Resolution: Fixed Status: Resolved (was: Patch Available) I just committed this. > Pos

[jira] Commented: (HADOOP-713) dfs list operation is too expensive

2007-11-14 Thread Sameer Paranjpye (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542623 ] Sameer Paranjpye commented on HADOOP-713: - > A "lsr /" on the same cluster took 13 minutes. The CPU on the na

[jira] Updated: (HADOOP-1648) Add contrib jars to general hadoop CLASSPATH

2007-11-14 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HADOOP-1648: -- Resolution: Won't Fix Status: Resolved (was: Patch Available) After discussion up on the #hadoop IRC

[jira] Commented: (HADOOP-2186) DFS Upgrade should process dfs.data.dirs in parallel

2007-11-14 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542617 ] Konstantin Shvachko commented on HADOOP-2186: - I agree the upgrade should benefit from multi-threaded li

[jira] Commented: (HADOOP-713) dfs list operation is too expensive

2007-11-14 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542616 ] dhruba borthakur commented on HADOOP-713: - We experimented on a system that has 6 million files. A "du /" wit

[jira] Created: (HADOOP-2207) Add 'package' target to contrib/build-contrib.xml

2007-11-14 Thread stack (JIRA)
Add 'package' target to contrib/build-contrib.xml - Key: HADOOP-2207 URL: https://issues.apache.org/jira/browse/HADOOP-2207 Project: Hadoop Issue Type: Improvement Reporter: stack

[jira] Commented: (HADOOP-2184) RPC Support for user permissions and authentication.

2007-11-14 Thread Christophe Taton (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542618 ] Christophe Taton commented on HADOOP-2184: -- > So when client invokes an RPC call, current RPC client intern

[jira] Resolved: (HADOOP-2196) [hbase] Fix how hbase sits in hadoop 'package' product

2007-11-14 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HADOOP-2196. --- Resolution: Duplicate This issue will be satisfied by the more general proposal in HADOOP-2207. > [hbase] F

[jira] Commented: (HADOOP-2186) DFS Upgrade should process dfs.data.dirs in parallel

2007-11-14 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542621 ] Raghu Angadi commented on HADOOP-2186: -- I don't have data but some time back for essentially random accesses, 5

Re: Path Handling and URIs

2007-11-14 Thread Doug Cutting
Dennis Kubes wrote: If I call Path.toURI is essentially prints out the path without a scheme. That's right. You've provided no scheme, and so have a scheme-independent path, a kind of relative path. On the other hand if I create a file and call its toURI method I get a scheme. Right, the

[jira] Commented: (HADOOP-713) dfs list operation is too expensive

2007-11-14 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542624 ] Doug Cutting commented on HADOOP-713: - There are back-compatibility issues with this patch. If servers are upgra

[jira] Updated: (HADOOP-713) dfs list operation is too expensive

2007-11-14 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-713: Attachment: optimizeComputeContentLen2.patch Here is a patch that introduces a new API in t

[jira] Issue Comment Edited: (HADOOP-713) dfs list operation is too expensive

2007-11-14 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542635 ] dhruba edited comment on HADOOP-713 at 11/14/07 4:21 PM: --- Here is a patch that intr

[jira] Updated: (HADOOP-1989) Add support for simulated Data Nodes - helpful for testing and performance benchmarking of the Name Node without having a large cluster

2007-11-14 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia updated HADOOP-1989: - Attachment: SimulatedStoragePatchSubmit8.txt My last patch had a conflict. Updated > Add suppor

[jira] Commented: (HADOOP-2185) Server ports: to roll or not to roll.

2007-11-14 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542640 ] Allen Wittenauer commented on HADOOP-2185: -- The primary issue is that hadoop isn't predictable. The random

[jira] Updated: (HADOOP-496) Expose HDFS as a WebDAV store

2007-11-14 Thread Michael Bieniosek (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Bieniosek updated HADOOP-496: - Attachment: hadoop-496-3.patch I implemented the DFSDavResource.spool method. This allow

[jira] Updated: (HADOOP-1989) Add support for simulated Data Nodes - helpful for testing and performance benchmarking of the Name Node without having a large cluster

2007-11-14 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-1989: - Status: Patch Available (was: Open) > Add support for simulated Data Nodes - helpful f

[jira] Reopened: (HADOOP-2196) [hbase] Fix how hbase sits in hadoop 'package' product

2007-11-14 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack reopened HADOOP-2196: --- Assignee: stack Reopen. Use this issue to cover clean up of hbase to sit nicely in a hadoop package only

Re: data loss after power recovery

2007-11-14 Thread Konstantin Shvachko
Hi Enis, Could you please verify what was the storage id for the node ..15.233 before and after you restarted it. Storage id is the string that starts from DS followed by digits. There was an old bug, that if you configure a data-node with multiple directories, then it would take the storag

Network Topology in Hadoop

2007-11-14 Thread Stu Hood
Hey guys, I've been reading up on DHTs quite a bit recently, and have come across the Vivaldi "topology-aware structured overlay" in a few places. Vivaldi uses hash functions to define a node's distance from other nodes in a 2 or 3 dimensional space. Every time a node communicates with another

[jira] Updated: (HADOOP-2113) Add "-text" command to FsShell to decode SequenceFile to stdout

2007-11-14 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-2113: - Status: Open (was: Patch Available) It would be really good if we can have a test case.

[jira] Updated: (HADOOP-2207) Add 'package' target to contrib/build-contrib.xml

2007-11-14 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HADOOP-2207: -- Attachment: 2207.patch Changed build.xml to forward the 'package' target down into the src/contrib dir rather

[jira] Updated: (HADOOP-2207) Add 'package' target to contrib/build-contrib.xml

2007-11-14 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HADOOP-2207: -- Fix Version/s: 0.16.0 Status: Patch Available (was: Open) Trying against hudson. > Add 'package'

[jira] Commented: (HADOOP-1989) Add support for simulated Data Nodes - helpful for testing and performance benchmarking of the Name Node without having a large cluster

2007-11-14 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542648 ] dhruba borthakur commented on HADOOP-1989: -- I still get a merge failure on DataChecksum.java. I managed to

[jira] Updated: (HADOOP-496) Expose HDFS as a WebDAV store

2007-11-14 Thread Michael Bieniosek (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Bieniosek updated HADOOP-496: - Attachment: hadoop-496-spool-cleanup.patch Here's a cleaner version of the patch. > Expo

[jira] Created: (HADOOP-2208) Reduce frequency of Counter updates in the task tracker status

2007-11-14 Thread Amareshwari Sri Ramadasu (JIRA)
Reduce frequency of Counter updates in the task tracker status -- Key: HADOOP-2208 URL: https://issues.apache.org/jira/browse/HADOOP-2208 Project: Hadoop Issue Type: Improvement

[jira] Commented: (HADOOP-1900) the heartbeat and task event queries interval should be set dynamically by the JobTracker

2007-11-14 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542670 ] Devaraj Das commented on HADOOP-1900: - One of the requirements that this issue is supposed to address is the Jo

[jira] Updated: (HADOOP-2040) [hbase] Hudson hangs AFTER test has finished

2007-11-14 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HADOOP-2040: -- Status: In Progress (was: Patch Available) > [hbase] Hudson hangs AFTER test has finished > -

[jira] Updated: (HADOOP-2040) [hbase] Hudson hangs AFTER test has finished

2007-11-14 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HADOOP-2040: -- Attachment: thr.patch hudson was hung just now for 7 hours in TestHRegion. TestHRegion is unorthodox -- inte

[jira] Updated: (HADOOP-2040) [hbase] Hudson hangs AFTER test has finished

2007-11-14 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HADOOP-2040: -- Fix Version/s: 0.16.0 Status: Patch Available (was: In Progress) Builds locally. Trying hudson.

[jira] Commented: (HADOOP-1347) Configuration XML bug: empty values

2007-11-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542679 ] Hadoop QA commented on HADOOP-1347: --- +1 overall. Here are the results of testing the latest attachment http://is

[jira] Updated: (HADOOP-2196) [hbase] Fix how hbase sits in hadoop 'package' product

2007-11-14 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HADOOP-2196: -- Attachment: 2196.patch Install lib, bin, conf, and webapps into contrib/hbase when 'package' target is called

[jira] Commented: (HADOOP-2068) [hbase] RESTful interface

2007-11-14 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542682 ] stack commented on HADOOP-2068: --- Bryan Duxbury added http://wiki.apache.org/lucene-hadoop/Hbase/HbaseRest. > [hbase]

[jira] Commented: (HADOOP-1608) [Hbase Shell] Relational Algrebra Operators

2007-11-14 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542691 ] stack commented on HADOOP-1608: --- Edward, can you say which of my comments from 05/Nov/07 02:04 PM above have been add

[jira] Updated: (HADOOP-2196) [hbase] Fix how hbase sits in hadoop 'package' product

2007-11-14 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HADOOP-2196: -- Fix Version/s: 0.16.0 Status: Patch Available (was: Reopened) Getting +1 from hudson (should still

[jira] Commented: (HADOOP-2040) [hbase] Hudson hangs AFTER test has finished

2007-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542696 ] Hudson commented on HADOOP-2040: Integrated in Hadoop-Nightly #303 (See [http://lucene.zones.apache.org:8080/hudson

[jira] Commented: (HADOOP-2204) DFSTestUtil.waitReplication does not wait.

2007-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542697 ] Hudson commented on HADOOP-2204: Integrated in Hadoop-Nightly #303 (See [http://lucene.zones.apache.org:8080/hudson

[jira] Commented: (HADOOP-2172) PositionCache was removed from FSDataInputStream, causes extremely bad MapFile performance

2007-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542698 ] Hudson commented on HADOOP-2172: Integrated in Hadoop-Nightly #303 (See [http://lucene.zones.apache.org:8080/hudson