[jira] Commented: (HADOOP-1876) Persisting completed jobs status

2008-01-08 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557173#action_12557173 ] Alejandro Abdelnur commented on HADOOP-1876: The JobHistory has a log file per

[jira] Commented: (HADOOP-2558) [hbase] fixes for build up on hudson

2008-01-08 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557160#action_12557160 ] stack commented on HADOOP-2558: --- Committed 2558.patch so TestTableMapReduce test failures ov

[jira] Updated: (HADOOP-2558) [hbase] fixes for build up on hudson

2008-01-08 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HADOOP-2558: -- Attachment: 2558.patch Add sleep between retries to HTable getting scanners. Should fix one of the failure m

[jira] Updated: (HADOOP-2557) [Hbase Shell] Count function

2008-01-08 Thread Edward Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Yoon updated HADOOP-2557: Attachment: 2557.patch Here's a patch for count function. {code} hql > select * from movieLog_tab

[jira] Updated: (HADOOP-2557) [Hbase Shell] Count function

2008-01-08 Thread Edward Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Yoon updated HADOOP-2557: Status: Patch Available (was: Open) submitting. > [Hbase Shell] Count function > ---

[jira] Created: (HADOOP-2558) [hbase] fixes for build up on hudson

2008-01-08 Thread stack (JIRA)
[hbase] fixes for build up on hudson Key: HADOOP-2558 URL: https://issues.apache.org/jira/browse/HADOOP-2558 Project: Hadoop Issue Type: Bug Components: contrib/hbase Reporter: stack

[jira] Commented: (HADOOP-2116) Job.local.dir to be exposed to tasks

2008-01-08 Thread Amareshwari Sri Ramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557149#action_12557149 ] Amareshwari Sri Ramadasu commented on HADOOP-2116: -- I propose the followi

[jira] Commented: (HADOOP-2557) [Hbase Shell] Count function

2008-01-08 Thread Edward Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557142#action_12557142 ] Edward Yoon commented on HADOOP-2557: - Hbase table's column is variable as a movieLog_

[jira] Created: (HADOOP-2557) [Hbase Shell] Count function

2008-01-08 Thread Edward Yoon (JIRA)
[Hbase Shell] Count function Key: HADOOP-2557 URL: https://issues.apache.org/jira/browse/HADOOP-2557 Project: Hadoop Issue Type: New Feature Components: contrib/hbase Affects Versions: 0.16.0

[jira] Commented: (HADOOP-2555) Refactor the HTable#get and HTable#getRow methods to avoid repetition of retry-on-failure logic

2008-01-08 Thread Edward Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557123#action_12557123 ] Edward Yoon commented on HADOOP-2555: - : ) > Refactor the HTable#get and HTable#getRo

[jira] Created: (HADOOP-2556) [Hbase Shell] Addition of Help Output Formatter

2008-01-08 Thread Edward Yoon (JIRA)
[Hbase Shell] Addition of Help Output Formatter --- Key: HADOOP-2556 URL: https://issues.apache.org/jira/browse/HADOOP-2556 Project: Hadoop Issue Type: Improvement Components: contrib/hba

[jira] Commented: (HADOOP-2552) enable hdfs permission checking by default

2008-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557113#action_12557113 ] Hadoop QA commented on HADOOP-2552: --- -1 overall. Here are the results of testing the la

[jira] Updated: (HADOOP-2092) Pipes C++ task does not die even if the Java tasks die

2008-01-08 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2092: -- Status: Open (was: Patch Available) A couple of things bother me: 1. There is no locking of

[jira] Commented: (HADOOP-2404) HADOOP-2185 breaks compatibility with hadoop-0.15.0

2008-01-08 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557109#action_12557109 ] Konstantin Shvachko commented on HADOOP-2404: - It sounds like you are under th

[jira] Commented: (HADOOP-2385) Validate configuration parameters

2008-01-08 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557108#action_12557108 ] Konstantin Shvachko commented on HADOOP-2385: - We already have JobConf derived

[jira] Updated: (HADOOP-2446) TestHDFSServerPorts fails.

2008-01-08 Thread Nigel Daley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nigel Daley updated HADOOP-2446: Resolution: Fixed Status: Resolved (was: Patch Available) I just committed this. > TestH

[jira] Updated: (HADOOP-2547) remove use of 'magic number' in build.xml

2008-01-08 Thread Nigel Daley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nigel Daley updated HADOOP-2547: Resolution: Fixed Fix Version/s: 0.16.0 Assignee: Hrishikesh Status: Res

[jira] Updated: (HADOOP-2406) Micro-benchmark to measure read/write times through InputFormats

2008-01-08 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-2406: -- Status: Patch Available (was: Open) > Micro-benchmark to measure read/write times through Inp

[jira] Updated: (HADOOP-2369) Representative mix of jobs for large cluster throughput benchmarking

2008-01-08 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-2369: -- Resolution: Fixed Status: Resolved (was: Patch Available) I just committed this. Than

[jira] Commented: (HADOOP-2546) PHP class for Rest Interface

2008-01-08 Thread Billy Pearson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557097#action_12557097 ] Billy Pearson commented on HADOOP-2546: --- This would make it easy for reads but for p

[jira] Commented: (HADOOP-2555) Refactor the HTable#get and HTable#getRow methods to avoid repetition of retry-on-failure logic

2008-01-08 Thread Peter Dolan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557096#action_12557096 ] Peter Dolan commented on HADOOP-2555: - Ok, I'm taking this one. I own it. No Touchy!

[jira] Commented: (HADOOP-2551) hadoop-env.sh needs finer granularity

2008-01-08 Thread Nigel Daley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557095#action_12557095 ] Nigel Daley commented on HADOOP-2551: - {quote} Additionally, it might be useful to spl

[jira] Updated: (HADOOP-2233) General example for modeling m/r load in Java

2008-01-08 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-2233: -- Resolution: Fixed Status: Resolved (was: Patch Available) I just committed this. > G

[jira] Updated: (HADOOP-2549) hdfs does not honor dfs.du.reserved setting

2008-01-08 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HADOOP-2549: -- Attachment: diskfull.patch The patches takes the option 3. Regarding Raghu's comments. Alghou

[jira] Updated: (HADOOP-2464) Test permissions related shell commands with DFS

2008-01-08 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated HADOOP-2464: - Attachment: HADOOP-2464.patch chmod is tested both on LocalFS and DFS. chgrp and chown are test

[jira] Updated: (HADOOP-2490) [hbase] Failure in nightly #346

2008-01-08 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HADOOP-2490: -- Resolution: Fixed Status: Resolved (was: Patch Available) Committed v5 without waiting on test -- sch

[jira] Commented: (HADOOP-2447) HDFS should be capable of limiting the total number of inodes in the system

2008-01-08 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557087#action_12557087 ] Konstantin Shvachko commented on HADOOP-2447: - +1 > HDFS should be capable of

[jira] Updated: (HADOOP-2490) [hbase] Failure in nightly #346

2008-01-08 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HADOOP-2490: -- Attachment: 2490-v5.patch Add more logging. > [hbase] Failure in nightly #346 > -

[jira] Commented: (HADOOP-2549) hdfs does not honor dfs.du.reserved setting

2008-01-08 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557075#action_12557075 ] Raghu Angadi commented on HADOOP-2549: -- '>' does make sense even if we implement othe

[jira] Commented: (HADOOP-2554) Add a HTable get method that retrieves all versions of a particular column and row between two timestamps

2008-01-08 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557083#action_12557083 ] stack commented on HADOOP-2554: --- I was going to ask if following works: {code} public byt

[jira] Commented: (HADOOP-2510) Map-Reduce 2.0

2008-01-08 Thread Edward Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557077#action_12557077 ] Edward Yoon commented on HADOOP-2510: - Wow, nice! > Map-Reduce 2.0 > -- >

[jira] Commented: (HADOOP-2555) Refactor the HTable#get and HTable#getRow methods to avoid repetition of retry-on-failure logic

2008-01-08 Thread Peter Dolan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557076#action_12557076 ] Peter Dolan commented on HADOOP-2555: - Sure thing, who's in charge of assigning issues

[jira] Assigned: (HADOOP-2536) MapReduce for MySQL

2008-01-08 Thread Edward Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Yoon reassigned HADOOP-2536: --- Assignee: (was: Edward Yoon) > MapReduce for MySQL > --- > >

[jira] Commented: (HADOOP-2536) MapReduce for MySQL

2008-01-08 Thread Edward Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557080#action_12557080 ] Edward Yoon commented on HADOOP-2536: - Oh.. Sorry, I was just about to watch it. (mis

[jira] Updated: (HADOOP-2094) DFS should not use round robin policy in determing on which volume (file system partition) to allocate for the next block

2008-01-08 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-2094: - Attachment: randomDatanodePartition.patch This makes the DataNode pick a disk randomly f

[jira] Assigned: (HADOOP-2536) MapReduce for MySQL

2008-01-08 Thread Edward Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Yoon reassigned HADOOP-2536: --- Assignee: Edward Yoon > MapReduce for MySQL > --- > > Key: H

[jira] Updated: (HADOOP-2553) [hbase] Don't make Long objects calculating hbase type hash codes

2008-01-08 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HADOOP-2553: -- Attachment: white-v2.patch Remove unnecessary HStoreKey creation > [hbase] Don't make Long objects calculatin

[jira] Issue Comment Edited: (HADOOP-2549) hdfs does not honor dfs.du.reserved setting

2008-01-08 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557068#action_12557068 ] rangadi edited comment on HADOOP-2549 at 1/8/08 3:28 PM: -- "re

[jira] Commented: (HADOOP-2285) TextInputFormat is slow compared to reading files.

2008-01-08 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557074#action_12557074 ] Chris Douglas commented on HADOOP-2285: --- I just committed this. Thanks Owen! > Text

[jira] Updated: (HADOOP-2285) TextInputFormat is slow compared to reading files.

2008-01-08 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-2285: -- Resolution: Fixed Status: Resolved (was: Patch Available) > TextInputFormat is slow c

[jira] Commented: (HADOOP-2555) Refactor the HTable#get and HTable#getRow methods to avoid repetition of retry-on-failure logic

2008-01-08 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557073#action_12557073 ] stack commented on HADOOP-2555: --- Looks great Peter. Mind flushing this out to make a real p

[jira] Commented: (HADOOP-2549) hdfs does not honor dfs.du.reserved setting

2008-01-08 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557072#action_12557072 ] Raghu Angadi commented on HADOOP-2549: -- or change '>=' to '>' in {code} if (volume.g

[jira] Commented: (HADOOP-2547) remove use of 'magic number' in build.xml

2008-01-08 Thread Nigel Daley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557071#action_12557071 ] Nigel Daley commented on HADOOP-2547: - failed contrib tests have nothing to do with th

[jira] Commented: (HADOOP-2144) Data node process consumes 180% cpu

2008-01-08 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557070#action_12557070 ] Raghu Angadi commented on HADOOP-2144: -- Datanode does quite a bit of more work while

[jira] Commented: (HADOOP-2549) hdfs does not honor dfs.du.reserved setting

2008-01-08 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557068#action_12557068 ] Raghu Angadi commented on HADOOP-2549: -- "reserved" space is incremented by default bl

[jira] Commented: (HADOOP-2510) Map-Reduce 2.0

2008-01-08 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557066#action_12557066 ] Doug Cutting commented on HADOOP-2510: -- The stated goals of this design are to improv

[jira] Created: (HADOOP-2555) Refactor the HTable#get and HTable#getRow methods to avoid repetition of retry-on-failure logic

2008-01-08 Thread Peter Dolan (JIRA)
Refactor the HTable#get and HTable#getRow methods to avoid repetition of retry-on-failure logic --- Key: HADOOP-2555 URL: https://issues.apache.org/jira/browse/HADOOP-2555

[jira] Commented: (HADOOP-2549) hdfs does not honor dfs.du.reserved setting

2008-01-08 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557063#action_12557063 ] Hairong Kuang commented on HADOOP-2549: --- The cause of block size being 0 is that blo

[jira] Commented: (HADOOP-2144) Data node process consumes 180% cpu

2008-01-08 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557062#action_12557062 ] dhruba borthakur commented on HADOOP-2144: -- I ran randomWriter on a 500 node clus

[jira] Updated: (HADOOP-2554) Add a HTable get method that retrieves all versions of a particular column and row between two timestamps

2008-01-08 Thread Peter Dolan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Dolan updated HADOOP-2554: Description: The use case: * A weblog application for which rows are user ids and posts are store

[jira] Created: (HADOOP-2554) Add a HTable get method that retrieves all versions of a particular column and row between two timestamps

2008-01-08 Thread Peter Dolan (JIRA)
Add a HTable get method that retrieves all versions of a particular column and row between two timestamps - Key: HADOOP-2554 URL: https://issues.apache.org/jir

[jira] Commented: (HADOOP-1824) want InputFormat for zip files

2008-01-08 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557061#action_12557061 ] Doug Cutting commented on HADOOP-1824: -- > 2. Override the getSplits() method to read

[jira] Commented: (HADOOP-1873) User permissions for Map/Reduce

2008-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557058#action_12557058 ] Hadoop QA commented on HADOOP-1873: --- -1 overall. Here are the results of testing the la

[jira] Updated: (HADOOP-2552) enable hdfs permission checking by default

2008-01-08 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HADOOP-2552: - Attachment: HADOOP-2552.patch > enable hdfs permission checking by default > ---

[jira] Updated: (HADOOP-2552) enable hdfs permission checking by default

2008-01-08 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HADOOP-2552: - Assignee: Doug Cutting Status: Patch Available (was: Open) > enable hdfs permission check

[jira] Assigned: (HADOOP-2094) DFS should not use round robin policy in determing on which volume (file system partition) to allocate for the next block

2008-01-08 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi reassigned HADOOP-2094: -- Assignee: dhruba borthakur > DFS should not use round robin policy in determing on which volum

[jira] Assigned: (HADOOP-2014) Job Tracker should not clobber the data locality of tasks

2008-01-08 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi reassigned HADOOP-2014: -- Assignee: Devaraj Das > Job Tracker should not clobber the data locality of tasks > --

[jira] Assigned: (HADOOP-2144) Data node process consumes 180% cpu

2008-01-08 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi reassigned HADOOP-2144: -- Assignee: dhruba borthakur > Data node process consumes 180% cpu > --

[jira] Commented: (HADOOP-2546) PHP class for Rest Interface

2008-01-08 Thread Michael Bieniosek (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557052#action_12557052 ] Michael Bieniosek commented on HADOOP-2546: --- Hi Billy, It might be easier for y

[jira] Updated: (HADOOP-2553) [hbase] Don't make Long objects calculating hbase type hash codes

2008-01-08 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HADOOP-2553: -- Attachment: white.patch Address issues raised by Tom. > [hbase] Don't make Long objects calculating hbase typ

[jira] Created: (HADOOP-2553) [hbase] Don't make Long objects calculating hbase type hash codes

2008-01-08 Thread stack (JIRA)
[hbase] Don't make Long objects calculating hbase type hash codes - Key: HADOOP-2553 URL: https://issues.apache.org/jira/browse/HADOOP-2553 Project: Hadoop Issue Type: Improveme

[jira] Updated: (HADOOP-2553) [hbase] Don't make Long objects calculating hbase type hash codes

2008-01-08 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HADOOP-2553: -- Status: Patch Available (was: Open) Passes tests locally. Giving to Hudson. > [hbase] Don't make Long objec

[jira] Updated: (HADOOP-2131) Speculative execution should be allowed for reducers only

2008-01-08 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HADOOP-2131: -- Status: Patch Available (was: Open) > Speculative execution should be allowed for reducers on

[jira] Updated: (HADOOP-2131) Speculative execution should be allowed for reducers only

2008-01-08 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HADOOP-2131: -- Attachment: patch-2131.txt Attaching an updated patch( with a couple of minor javadoc fixes) o

[jira] Updated: (HADOOP-2131) Speculative execution should be allowed for reducers only

2008-01-08 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HADOOP-2131: -- Status: Open (was: Patch Available) Need to update this patch to reflect recent changes to tr

[jira] Commented: (HADOOP-2552) enable hdfs permission checking by default

2008-01-08 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557034#action_12557034 ] Raghu Angadi commented on HADOOP-2552: -- +1. Better to iron out issues earlier than la

[jira] Updated: (HADOOP-2443) [hbase] Keep lazy cache of regions in client rather than an 'authoritative' list

2008-01-08 Thread Bryan Duxbury (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Duxbury updated HADOOP-2443: -- Attachment: 2443-v3.patch Not quite done yet - a few tests don't pass, and there is no caching

[jira] Created: (HADOOP-2552) enable hdfs permission checking by default

2008-01-08 Thread Doug Cutting (JIRA)
enable hdfs permission checking by default -- Key: HADOOP-2552 URL: https://issues.apache.org/jira/browse/HADOOP-2552 Project: Hadoop Issue Type: Improvement Components: dfs Repor

[jira] Commented: (HADOOP-2551) hadoop-env.sh needs finer granularity

2008-01-08 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557028#action_12557028 ] Allen Wittenauer commented on HADOOP-2551: -- On a first pass, that sounds like a v

[jira] Resolved: (HADOOP-622) Users should be able to change the environment in which there maps/reduces run.

2008-01-08 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved HADOOP-622. -- Resolution: Duplicate Fixed as a part of HADOOP-1660. > Users should be able to change the env

[jira] Updated: (HADOOP-1660) add support for native library toDistributedCache

2008-01-08 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HADOOP-1660: -- Resolution: Fixed Status: Resolved (was: Patch Available) I just committed this. > a

[jira] Updated: (HADOOP-2285) TextInputFormat is slow compared to reading files.

2008-01-08 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-2285: -- Status: Patch Available (was: Open) > TextInputFormat is slow compared to reading files. > --

[jira] Updated: (HADOOP-2285) TextInputFormat is slow compared to reading files.

2008-01-08 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-2285: -- Status: Open (was: Patch Available) > TextInputFormat is slow compared to reading files. > --

[jira] Updated: (HADOOP-2285) TextInputFormat is slow compared to reading files.

2008-01-08 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-2285: -- Attachment: fast-line3.patch Use LineReader.DEFAULT_BUFFER_SIZE for conf-less LineRecordReader

[jira] Resolved: (HADOOP-2420) Use exit code to detect normal errors while excuting 'ls' in Local FS

2008-01-08 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi resolved HADOOP-2420. -- Resolution: Fixed > Use exit code to detect normal errors while excuting 'ls' in Local FS > --

[jira] Updated: (HADOOP-2512) error stream handling in Shell executor

2008-01-08 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated HADOOP-2512: - Resolution: Fixed Status: Resolved (was: Patch Available) I just committed this. > err

[jira] Commented: (HADOOP-2547) remove use of 'magic number' in build.xml

2008-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557015#action_12557015 ] Hadoop QA commented on HADOOP-2547: --- -1 overall. Here are the results of testing the la

[jira] Commented: (HADOOP-2446) TestHDFSServerPorts fails.

2008-01-08 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557009#action_12557009 ] Konstantin Shvachko commented on HADOOP-2446: - +1 on Nigel's patch Yes this th

[jira] Updated: (HADOOP-1873) User permissions for Map/Reduce

2008-01-08 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HADOOP-1873: -- Fix Version/s: 0.16.0 Affects Version/s: 0.15.1 Status: Patch Available

[jira] Commented: (HADOOP-2532) Add to MapFile a getClosest that returns key that comes just-before if key not present (Currently does just-after only).

2008-01-08 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557008#action_12557008 ] Doug Cutting commented on HADOOP-2532: -- +1 This looks fine to me. > Add to MapFile a

[jira] Commented: (HADOOP-2206) Design/implement a general log-aggregation framework for Hadoop

2008-01-08 Thread Jeff Hammerbacher (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12556992#action_12556992 ] Jeff Hammerbacher commented on HADOOP-2206: --- we're getting the code in shape and

[jira] Commented: (HADOOP-2206) Design/implement a general log-aggregation framework for Hadoop

2008-01-08 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12556991#action_12556991 ] Doug Cutting commented on HADOOP-2206: -- > I got Arun a copy of Scribe a few months ag

[jira] Commented: (HADOOP-1873) User permissions for Map/Reduce

2008-01-08 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12556989#action_12556989 ] Doug Cutting commented on HADOOP-1873: -- +1 this looks good to me. Thanks for your pa

Re: [hbase] table HRegionServer affinity

2008-01-08 Thread Andrew Purtell
stack wrote: > You might be interested in the PNUTs description here: > http://wiki.apache.org/lucene-hadoop/Hbase/PNUTS. In > particular see section where it talks of how it does its > global distribution. > > St.Ack Thanks. Some interesting tidbits there, maybe. We are also looking at, as an

[jira] Commented: (HADOOP-2551) hadoop-env.sh needs finer granularity

2008-01-08 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12556986#action_12556986 ] Doug Cutting commented on HADOOP-2551: -- I don't think we need HADOOP_GLOBAL_OPTS, we

[jira] Commented: (HADOOP-2334) [hbase] VOTE: should row keys be less restrictive than hadoop.io.Text?

2008-01-08 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12556984#action_12556984 ] stack commented on HADOOP-2334: --- Chatting with Dave Simpson, to protect against different cl

[jira] Commented: (HADOOP-2531) HDFS FileStatus.getPermission() should return 777 when dfs.permissions=false

2008-01-08 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12556983#action_12556983 ] Doug Cutting commented on HADOOP-2531: -- Okay, I found it: the default permissions on

Re: [hbase] table HRegionServer affinity

2008-01-08 Thread stack
You might be interested in the PNUTs description here: http://wiki.apache.org/lucene-hadoop/Hbase/PNUTS. In particular see section where it talks of how it does its global distribution. St.Ack

[jira] Commented: (HADOOP-2531) HDFS FileStatus.getPermission() should return 777 when dfs.permissions=false

2008-01-08 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12556981#action_12556981 ] Doug Cutting commented on HADOOP-2531: -- The use case of dfs.permissions=false was bet

[jira] Commented: (HADOOP-2206) Design/implement a general log-aggregation framework for Hadoop

2008-01-08 Thread Jeff Hammerbacher (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12556980#action_12556980 ] Jeff Hammerbacher commented on HADOOP-2206: --- I got Arun a copy of Scribe a few m

RE: [hbase] table HRegionServer affinity

2008-01-08 Thread Andrew Purtell
Thank you all for your considered responses. I would like to make a few comments and clarifications (inline, below). Jim Kellerman wrote: > > Andrew Purtell wrote: > > First: How invasive to the HBase master/region model is > > the concept of specifying constraints on data mobility? > > It would

[jira] Commented: (HADOOP-2551) hadoop-env.sh needs finer granularity

2008-01-08 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12556977#action_12556977 ] Allen Wittenauer commented on HADOOP-2551: -- In particular, I was thinking that it

[jira] Created: (HADOOP-2551) hadoop-env.sh needs finer granularity

2008-01-08 Thread Allen Wittenauer (JIRA)
hadoop-env.sh needs finer granularity - Key: HADOOP-2551 URL: https://issues.apache.org/jira/browse/HADOOP-2551 Project: Hadoop Issue Type: Improvement Reporter: Allen Wittenauer Pr

[jira] Commented: (HADOOP-2528) check permissions for job inputs and outputs

2008-01-08 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12556976#action_12556976 ] Doug Cutting commented on HADOOP-2528: -- Raghu and Hairong yesterday raised a few rele

[jira] Updated: (HADOOP-1873) User permissions for Map/Reduce

2008-01-08 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HADOOP-1873: -- Attachment: mapred7.patch This sounds good to me. I guess this is how "mkdir -m" is implemente

[jira] Updated: (HADOOP-2472) [Hbase Shell] Range selection using filter

2008-01-08 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HADOOP-2472: -- Resolution: Fixed Status: Resolved (was: Patch Available) Committed (Failure was in TTMR). Resolving

Re: [VOTE] Release Hadoop 0.15.2 (candidate 0)

2008-01-08 Thread Doug Cutting
Nigel Daley wrote: I've created a candidate build for Hadoop 0.15.2. http://people.apache.org/~nigel/hadoop-0.15.2-candidate-0/ Should we release this? +1 Looks good to me! Doug

[jira] Commented: (HADOOP-1873) User permissions for Map/Reduce

2008-01-08 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12556969#action_12556969 ] Doug Cutting commented on HADOOP-1873: -- Another option: In the FileSystem.create and

[jira] Updated: (HADOOP-2450) [hbase] Show version (and svn revision) in hbase web ui

2008-01-08 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HADOOP-2450: -- Resolution: Fixed Status: Resolved (was: Patch Available) Committed (Failures were in TTMR and TS2, t

[jira] Commented: (HADOOP-2116) Job.local.dir to be exposed to tasks

2008-01-08 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12556966#action_12556966 ] Milind Bhandarkar commented on HADOOP-2116: --- There are several advantages to hav

  1   2   >