[jira] Commented: (HADOOP-4472) Should we move out the creation of setup/cleanup tasks from JobInProgress.initTasks()?

2008-10-22 Thread Hemanth Yamijala (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12642076#action_12642076 ] Hemanth Yamijala commented on HADOOP-4472: -- As an update, I had a discussion with

[jira] Updated: (HADOOP-4500) multifilesplit is using job default filesystem incorrectly

2008-10-22 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-4500: - Fix Version/s: 0.19.1 This looks like an issue that could merit being in 0.19.1? > mult

[jira] Commented: (HADOOP-4472) Should we move out the creation of setup/cleanup tasks from JobInProgress.initTasks()?

2008-10-22 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12642062#action_12642062 ] Amar Kamat commented on HADOOP-4472: +1 > Should we move out the creation of setup/cl

[jira] Updated: (HADOOP-4187) Create a MapReduce-specific ReflectionUtils that handles JobConf and JobConfigurable

2008-10-22 Thread Sharad Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sharad Agarwal updated HADOOP-4187: --- Fix Version/s: 0.20.0 Status: Patch Available (was: Open) > Create a MapReduce-s

[jira] Updated: (HADOOP-4187) Create a MapReduce-specific ReflectionUtils that handles JobConf and JobConfigurable

2008-10-22 Thread Sharad Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sharad Agarwal updated HADOOP-4187: --- Attachment: 4187_v2.patch Incorporated Tom's comments. Using Configuration#getClassByName in

[jira] Commented: (HADOOP-4348) Adding service-level authorization to Hadoop

2008-10-22 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12642048#action_12642048 ] Doug Cutting commented on HADOOP-4348: -- Sanjay> The best way to represent that servic

[jira] Updated: (HADOOP-4466) SequenceFileOutputFormat is coupled to WritableComparable and Writable

2008-10-22 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HADOOP-4466: -- Resolution: Fixed Fix Version/s: 0.19.0 Assignee: Chris K Wensel Release N

[jira] Updated: (HADOOP-3445) Implementing core scheduler functionality in Resource Manager (V1) for Hadoop

2008-10-22 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-3445: -- Component/s: (was: mapred) contrib/capacity-sched > Implementing core sch

[jira] Updated: (HADOOP-4467) SerializationFactory should use current context ClassLoader

2008-10-22 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HADOOP-4467: -- Resolution: Fixed Fix Version/s: 0.18.2 Assignee: Chris K Wensel Sta

[jira] Commented: (HADOOP-4490) Map and Reduce tasks should run as the user who submitted the job

2008-10-22 Thread Hemanth Yamijala (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12642043#action_12642043 ] Hemanth Yamijala commented on HADOOP-4490: -- I think HADOOP-4451 is either related

[jira] Commented: (HADOOP-4490) Map and Reduce tasks should run as the user who submitted the job

2008-10-22 Thread Vinod K V (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12642042#action_12642042 ] Vinod K V commented on HADOOP-4490: --- Duplicate of HADOOP-4451. > Map and Reduce tasks s

Is there a way to know the input filename at Hadoop Streaming?

2008-10-22 Thread Steve Gao
I am using Hadoop Streaming. The input are multiple files. Is there a way to get the current filename in mapper? For example: $HADOOP_HOME/bin/hadoop \ jar $HADOOP_HOME/hadoop-streaming.jar \ -input file1 \ -input file2 \ -output myOutputDir \ -mapper mapper \ -reducer reducer

[jira] Commented: (HADOOP-4494) libhdfs does not call FileSystem.append when O_APPEND passed to hdfsOpenFile

2008-10-22 Thread Pete Wyckoff (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12642035#action_12642035 ] Pete Wyckoff commented on HADOOP-4494: -- idea - we deprecate not having the O_CREAT fl

[jira] Updated: (HADOOP-4501) CLI not supporting multiline queries from an input file

2008-10-22 Thread Jeremy Huylebroeck (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Huylebroeck updated HADOOP-4501: --- Attachment: patch-trunk.txt uploaded a patch for CliDriver for hadoop trunk > CLI n

[jira] Commented: (HADOOP-4348) Adding service-level authorization to Hadoop

2008-10-22 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12642024#action_12642024 ] Sanjay Radia commented on HADOOP-4348: -- Strictly, rpc does not imply any notion of a

[jira] Issue Comment Edited: (HADOOP-4501) CLI not supporting multiline queries from an input file

2008-10-22 Thread Jeremy Huylebroeck (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12642023#action_12642023 ] mimizone edited comment on HADOOP-4501 at 10/22/08 5:46 PM:

[jira] Updated: (HADOOP-4501) CLI not supporting multiline queries from an input file

2008-10-22 Thread Jeremy Huylebroeck (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Huylebroeck updated HADOOP-4501: --- Comment: was deleted > CLI not supporting multiline queries from an input file > ---

[jira] Updated: (HADOOP-4501) CLI not supporting multiline queries from an input file

2008-10-22 Thread Jeremy Huylebroeck (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Huylebroeck updated HADOOP-4501: --- Attachment: patch-0.17.txt patch against 0.17 available at http://mirror.facebook.co

[jira] Updated: (HADOOP-4501) CLI not supporting multiline queries from an input file

2008-10-22 Thread Jeremy Huylebroeck (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Huylebroeck updated HADOOP-4501: --- Fix Version/s: (was: 0.19.1) (was: 0.19.0)

[jira] Updated: (HADOOP-4494) libhdfs does not call FileSystem.append when O_APPEND passed to hdfsOpenFile

2008-10-22 Thread Pete Wyckoff (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pete Wyckoff updated HADOOP-4494: - Status: Open (was: Patch Available) > libhdfs does not call FileSystem.append when O_APPEND pas

[jira] Commented: (HADOOP-4494) libhdfs does not call FileSystem.append when O_APPEND passed to hdfsOpenFile

2008-10-22 Thread Pete Wyckoff (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12642021#action_12642021 ] Pete Wyckoff commented on HADOOP-4494: -- bq. I just noticed that the test uses O_CREAT

[jira] Created: (HADOOP-4501) CLI not supporting multiline queries from an input file

2008-10-22 Thread Jeremy Huylebroeck (JIRA)
CLI not supporting multiline queries from an input file --- Key: HADOOP-4501 URL: https://issues.apache.org/jira/browse/HADOOP-4501 Project: Hadoop Core Issue Type: Improvement Co

[jira] Updated: (HADOOP-4500) multifilesplit is using job default filesystem incorrectly

2008-10-22 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma updated HADOOP-4500: -- Status: Patch Available (was: Open) > multifilesplit is using job default filesystem

[jira] Updated: (HADOOP-4500) multifilesplit is using job default filesystem incorrectly

2008-10-22 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma updated HADOOP-4500: -- Attachment: 4500.patch > multifilesplit is using job default filesystem incorrectly >

[jira] Commented: (HADOOP-4348) Adding service-level authorization to Hadoop

2008-10-22 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12642016#action_12642016 ] Doug Cutting commented on HADOOP-4348: -- > The problem is that the service authorizati

[jira] Created: (HADOOP-4500) multifilesplit is using job default filesystem incorrectly

2008-10-22 Thread Joydeep Sen Sarma (JIRA)
multifilesplit is using job default filesystem incorrectly -- Key: HADOOP-4500 URL: https://issues.apache.org/jira/browse/HADOOP-4500 Project: Hadoop Core Issue Type: Bug Comp

[jira] Updated: (HADOOP-4498) JobHistory does not escape literal jobName when used in a regex pattern

2008-10-22 Thread Chris K Wensel (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris K Wensel updated HADOOP-4498: --- Release Note: Stuffs jobName between \E and \Q so it is treated as a literal and will not in

[jira] Created: (HADOOP-4499) DFSClient should invoke checksumOk one once.

2008-10-22 Thread Raghu Angadi (JIRA)
DFSClient should invoke checksumOk one once. Key: HADOOP-4499 URL: https://issues.apache.org/jira/browse/HADOOP-4499 Project: Hadoop Core Issue Type: Bug Affects Versions: 0.18.0 R

[jira] Updated: (HADOOP-4498) JobHistory does not escape literal jobName when used in a regex pattern

2008-10-22 Thread Chris K Wensel (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris K Wensel updated HADOOP-4498: --- Attachment: hadoop-4498.patch Stuffs jobName between \Q and \E so it is treated as a literal

[jira] Updated: (HADOOP-4498) JobHistory does not escape literal jobName when used in a regex pattern

2008-10-22 Thread Chris K Wensel (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris K Wensel updated HADOOP-4498: --- Summary: JobHistory does not escape literal jobName when used in a regex pattern (was: JobH

[jira] Updated: (HADOOP-4498) JobHistory does not escape regex chars in jobName

2008-10-22 Thread Chris K Wensel (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris K Wensel updated HADOOP-4498: --- Component/s: mapred changed component affected > JobHistory does not escape regex chars in

[jira] Commented: (HADOOP-3914) checksumOk implementation in DFSClient can break applications

2008-10-22 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12641999#action_12641999 ] Raghu Angadi commented on HADOOP-3914: -- I should add that because of the debug log, I

[jira] Commented: (HADOOP-3914) checksumOk implementation in DFSClient can break applications

2008-10-22 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12641996#action_12641996 ] Raghu Angadi commented on HADOOP-3914: -- hmm.. I can see why this happens? Should we r

[jira] Commented: (HADOOP-4348) Adding service-level authorization to Hadoop

2008-10-22 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12641994#action_12641994 ] Sanjay Radia commented on HADOOP-4348: -- Doug do you mean the authorization will be ch

[jira] Commented: (HADOOP-4453) Improve ssl handling for distcp

2008-10-22 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12641990#action_12641990 ] Chris Douglas commented on HADOOP-4453: --- bq. SSL properties are system properties th

[jira] Commented: (HADOOP-4368) Superuser privileges required to do "df"

2008-10-22 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12641989#action_12641989 ] Doug Cutting commented on HADOOP-4368: -- Pete, no one disagrees with your thesis, that

[jira] Updated: (HADOOP-3708) Provide accounting functionality for Hadoop resource manager

2008-10-22 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-3708: -- Attachment: history-scripts.patch I've attached a patch with the scripts I built at Facebook.

[jira] Commented: (HADOOP-4494) libhdfs does not call FileSystem.append when O_APPEND passed to hdfsOpenFile

2008-10-22 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12641987#action_12641987 ] Sanjay Radia commented on HADOOP-4494: -- Minor doc suggestion: In the documentation i

[jira] Created: (HADOOP-4498) JobHistory does not escape regex chars in jobName

2008-10-22 Thread Chris K Wensel (JIRA)
JobHistory does not escape regex chars in jobName - Key: HADOOP-4498 URL: https://issues.apache.org/jira/browse/HADOOP-4498 Project: Hadoop Core Issue Type: Bug Affects Versions: 0.19.0

[jira] Created: (HADOOP-4497) [Hive] bad error reporting

2008-10-22 Thread Namit Jain (JIRA)
[Hive] bad error reporting -- Key: HADOOP-4497 URL: https://issues.apache.org/jira/browse/HADOOP-4497 Project: Hadoop Core Issue Type: Bug Components: contrib/hive Reporter: Namit Jain

[jira] Commented: (HADOOP-4348) Adding service-level authorization to Hadoop

2008-10-22 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12641984#action_12641984 ] Doug Cutting commented on HADOOP-4348: -- Looking at the implementation I'm reminded of

[jira] Created: (HADOOP-4496) selecting fields from a complex object column in transform clause is throwing a Parse Error.

2008-10-22 Thread Prasad Chakka (JIRA)
selecting fields from a complex object column in transform clause is throwing a Parse Error. Key: HADOOP-4496 URL: https://issues.apache.org/jira/browse/HADOOP-4496

[jira] Commented: (HADOOP-4368) Superuser privileges required to do "df"

2008-10-22 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12641977#action_12641977 ] Konstantin Shvachko commented on HADOOP-4368: - shv> opening getStats for all u

[jira] Commented: (HADOOP-4453) Improve ssl handling for distcp

2008-10-22 Thread Kan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12641972#action_12641972 ] Kan Zhang commented on HADOOP-4453: --- SSL properties are system properties that affect al

[jira] Commented: (HADOOP-4494) libhdfs does not call FileSystem.append when O_APPEND passed to hdfsOpenFile

2008-10-22 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12641971#action_12641971 ] dhruba borthakur commented on HADOOP-4494: -- +1. Looks good. > libhdfs does not c

[jira] Commented: (HADOOP-4368) Superuser privileges required to do "df"

2008-10-22 Thread Pete Wyckoff (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12641970#action_12641970 ] Pete Wyckoff commented on HADOOP-4368: -- bq. In general DFSAdmin commands should requi

[jira] Updated: (HADOOP-4495) fuse-dfs fix writeTest and add writeAppendtest

2008-10-22 Thread Pete Wyckoff (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pete Wyckoff updated HADOOP-4495: - Attachment: HADOOP-4495.txt > fuse-dfs fix writeTest and add writeAppendtest > -

[jira] Created: (HADOOP-4495) fuse-dfs fix writeTest and add writeAppendtest

2008-10-22 Thread Pete Wyckoff (JIRA)
fuse-dfs fix writeTest and add writeAppendtest -- Key: HADOOP-4495 URL: https://issues.apache.org/jira/browse/HADOOP-4495 Project: Hadoop Core Issue Type: Test Components: contrib/fuse-df

[jira] Updated: (HADOOP-4495) fuse-dfs fix writeTest and add writeAppendtest

2008-10-22 Thread Pete Wyckoff (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pete Wyckoff updated HADOOP-4495: - Status: Patch Available (was: Open) > fuse-dfs fix writeTest and add writeAppendtest >

[jira] Updated: (HADOOP-4489) Blocks have been scheduled to delete by NameNode but are not deleted on the DataNode

2008-10-22 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HADOOP-4489: -- Description: NameNode sometimes scheduled a replica to be deleted as shown in the NameNode lo

[jira] Resolved: (HADOOP-1701) Provide a security framework design

2008-10-22 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved HADOOP-1701. Resolution: Later Seems that this won't be done in the near future. Closi

[jira] Updated: (HADOOP-4494) libhdfs does not call FileSystem.append when O_APPEND passed to hdfsOpenFile

2008-10-22 Thread Pete Wyckoff (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pete Wyckoff updated HADOOP-4494: - Attachment: HADOOP-4494.txt > libhdfs does not call FileSystem.append when O_APPEND passed to hd

[jira] Updated: (HADOOP-4494) libhdfs does not call FileSystem.append when O_APPEND passed to hdfsOpenFile

2008-10-22 Thread Pete Wyckoff (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pete Wyckoff updated HADOOP-4494: - Affects Version/s: 0.20.0 0.19.1 Status: Patch Available (

[jira] Commented: (HADOOP-4453) Improve ssl handling for distcp

2008-10-22 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12641960#action_12641960 ] Tsz Wo (Nicholas), SZE commented on HADOOP-4453: setupSsl(...) should not

[jira] Created: (HADOOP-4494) libhdfs does not call FileSystem.append when O_APPEND passed to hdfsOpenFile

2008-10-22 Thread Pete Wyckoff (JIRA)
libhdfs does not call FileSystem.append when O_APPEND passed to hdfsOpenFile Key: HADOOP-4494 URL: https://issues.apache.org/jira/browse/HADOOP-4494 Project: Hadoop Core

[jira] Updated: (HADOOP-4491) Per-job local data on the TaskTracker node should have right access-control

2008-10-22 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HADOOP-4491: -- Component/s: security mapred > Per-job local data on the TaskTracker node sho

[jira] Updated: (HADOOP-4493) Localized files from DistributedCache should have right access-control

2008-10-22 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HADOOP-4493: -- Component/s: security mapred > Localized files from DistributedCache should h

[jira] Updated: (HADOOP-4492) Job-specific data on HDFS (job.xml, input splits etc.) should have right access-control

2008-10-22 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HADOOP-4492: -- Component/s: security mapred > Job-specific data on HDFS (job.xml, input spli

[jira] Created: (HADOOP-4493) Localized files from DistributedCache should have right access-control

2008-10-22 Thread Arun C Murthy (JIRA)
Localized files from DistributedCache should have right access-control -- Key: HADOOP-4493 URL: https://issues.apache.org/jira/browse/HADOOP-4493 Project: Hadoop Core Issue

[jira] Created: (HADOOP-4492) Job-specific data on HDFS (job.xml, input splits etc.) should have right access-control

2008-10-22 Thread Arun C Murthy (JIRA)
Job-specific data on HDFS (job.xml, input splits etc.) should have right access-control --- Key: HADOOP-4492 URL: https://issues.apache.org/jira/browse/HADOOP-4492 Pr

[jira] Created: (HADOOP-4491) Per-job local data on the TaskTracker node should have right access-control

2008-10-22 Thread Arun C Murthy (JIRA)
Per-job local data on the TaskTracker node should have right access-control --- Key: HADOOP-4491 URL: https://issues.apache.org/jira/browse/HADOOP-4491 Project: Hadoop Core

[jira] Commented: (HADOOP-4276) The mapred.*ID classes are inefficient for hashCode and serialization

2008-10-22 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12641956#action_12641956 ] Chris Douglas commented on HADOOP-4276: --- This looks good. Just a few suggestions/nit

[jira] Updated: (HADOOP-4487) Security features for Hadoop

2008-10-22 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HADOOP-4487: -- Component/s: security Issue Type: New Feature (was: Wish) > Security features for Hadoop

[jira] Created: (HADOOP-4490) Map and Reduce tasks should run as the user who submitted the job

2008-10-22 Thread Arun C Murthy (JIRA)
Map and Reduce tasks should run as the user who submitted the job - Key: HADOOP-4490 URL: https://issues.apache.org/jira/browse/HADOOP-4490 Project: Hadoop Core Issue Type: Sub-

[jira] Updated: (HADOOP-4490) Map and Reduce tasks should run as the user who submitted the job

2008-10-22 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HADOOP-4490: -- Component/s: security mapred > Map and Reduce tasks should run as the user wh

[jira] Commented: (HADOOP-4488) [Hive]: Add ability to compute statistics on hive tables

2008-10-22 Thread Prasad Chakka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12641947#action_12641947 ] Prasad Chakka commented on HADOOP-4488: --- some comments and questions 1- For each pa

[jira] Commented: (HADOOP-4488) [Hive]: Add ability to compute statistics on hive tables

2008-10-22 Thread Ashish Thusoo (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12641939#action_12641939 ] Ashish Thusoo commented on HADOOP-4488: --- Type of statistics: The following types of

core-user bounces?

2008-10-22 Thread Alex Loddengaard
Anyone else getting bounces on core-user? I'm fairly new to the list; is this common? Alex

[jira] Created: (HADOOP-4489) Blocks have been scheduled to delete by NameNode but are not deleted on the DataNode

2008-10-22 Thread Hairong Kuang (JIRA)
Blocks have been scheduled to delete by NameNode but are not deleted on the DataNode Key: HADOOP-4489 URL: https://issues.apache.org/jira/browse/HADOOP-4489 Project:

[jira] Updated: (HADOOP-4348) Adding service-level authorization to Hadoop

2008-10-22 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HADOOP-4348: -- Attachment: HADOOP-4348_0_20081022.patch Preliminary patch for review while I continue testing

[jira] Created: (HADOOP-4488) [Hive]: Add ability to compute statistics on hive tables

2008-10-22 Thread Ashish Thusoo (JIRA)
[Hive]: Add ability to compute statistics on hive tables Key: HADOOP-4488 URL: https://issues.apache.org/jira/browse/HADOOP-4488 Project: Hadoop Core Issue Type: New Feature

Re: Hadoop 1.0 Compatibility Discussion.

2008-10-22 Thread Sanjay Radia
On Oct 21, 2008, at 5:23 PM, Konstantin Shvachko wrote: Sanjay Radia wrote: >> o Can't remove deprecated classes or methods until 2.0 Dhruba Borthakur wrote: > 1. APIs that are deprecated in x.y release can be removed in (x+1). 0 release. Current rule is that apis deprecated in M

[jira] Created: (HADOOP-4487) Security features for Hadoop

2008-10-22 Thread Kan Zhang (JIRA)
Security features for Hadoop Key: HADOOP-4487 URL: https://issues.apache.org/jira/browse/HADOOP-4487 Project: Hadoop Core Issue Type: Wish Reporter: Kan Zhang Assignee: Kan Zhang This is

[jira] Created: (HADOOP-4486) Documention for using external profilers on Map-Reduce applications

2008-10-22 Thread Arun C Murthy (JIRA)
Documention for using external profilers on Map-Reduce applications --- Key: HADOOP-4486 URL: https://issues.apache.org/jira/browse/HADOOP-4486 Project: Hadoop Core Issue Type:

[jira] Updated: (HADOOP-4483) getBlockArray in DatanodeDescriptor does not honor passed in maxblocks value

2008-10-22 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-4483: - Attachment: HADOOP-4483-v3.patch Removed more empty lines from earlier patch. > getBloc

[jira] Updated: (HADOOP-4483) getBlockArray in DatanodeDescriptor does not honor passed in maxblocks value

2008-10-22 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-4483: - Attachment: HADOOP-4483-v3.patch Thanks Ahad for the patch. Changed patch to delete empt

[jira] Issue Comment Edited: (HADOOP-4483) getBlockArray in DatanodeDescriptor does not honor passed in maxblocks value

2008-10-22 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12641915#action_12641915 ] hairong edited comment on HADOOP-4483 at 10/22/08 10:56 AM:

[jira] Commented: (HADOOP-4483) getBlockArray in DatanodeDescriptor does not honor passed in maxblocks value

2008-10-22 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12641920#action_12641920 ] Hairong Kuang commented on HADOOP-4483: --- >If there is anything we could do for bette

[jira] Commented: (HADOOP-4483) getBlockArray in DatanodeDescriptor does not honor passed in maxblocks value

2008-10-22 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12641915#action_12641915 ] Hairong Kuang commented on HADOOP-4483: --- When I looked at the code related to block

[jira] Commented: (HADOOP-4483) getBlockArray in DatanodeDescriptor does not honor passed in maxblocks value

2008-10-22 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12641916#action_12641916 ] Tsz Wo (Nicholas), SZE commented on HADOOP-4483: +1 HADOOP-4483-v2.patch l

[jira] Updated: (HADOOP-4466) SequenceFileOutputFormat is coupled to WritableComparable and Writable

2008-10-22 Thread Chris K Wensel (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris K Wensel updated HADOOP-4466: --- Priority: Blocker (was: Major) > SequenceFileOutputFormat is coupled to WritableComparable

[jira] Updated: (HADOOP-4467) SerializationFactory should use current context ClassLoader

2008-10-22 Thread Chris K Wensel (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris K Wensel updated HADOOP-4467: --- Priority: Blocker (was: Major) > SerializationFactory should use current context ClassLoade

Re: [VOTE] Release Hadoop 0.19.0 (candidate 0)

2008-10-22 Thread Chris K Wensel
I see my mistake. (letting Tom go to bed before I could get the tests to finish, heh) They can go in to 0.19.1, of course. Until then the Serialization stuff is rendered useless, but it seems I'm practically the only one using it anyway.. thanks for the reply. ckw On Oct 22, 2008, at 10:

[jira] Commented: (HADOOP-4480) data node process should not die if one dir goes bad

2008-10-22 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12641914#action_12641914 ] dhruba borthakur commented on HADOOP-4480: -- I think getting solution to this prob

Re: [VOTE] Release Hadoop 0.19.0 (candidate 0)

2008-10-22 Thread Nigel Daley
Chris, you filed them but didn't mark them blockers for 0.19.0. Seems like these can these go into 0.19.1. Agreed? Nige On Oct 22, 2008, at 8:19 AM, Chris K Wensel wrote: -1 Unable to load custom Serialization implementations. Patch available https://issues.apache.org/jira/browse/HADOOP-446

Re: Hadoop 1.0 Compatibility Discussion.

2008-10-22 Thread Sanjay Radia
On Oct 20, 2008, at 11:44 PM, Dhruba Borthakur wrote: 3. HDFS disk format can change from 1.x to 1.y release and is transparent to user-application. A cluster when rolling back to 1.x from 1,y will revert back to the old disk format. Dhruba don't you want disk format compatibility to be for

[jira] Commented: (HADOOP-4187) Create a MapReduce-specific ReflectionUtils that handles JobConf and JobConfigurable

2008-10-22 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12641887#action_12641887 ] Tom White commented on HADOOP-4187: --- I think we should use Configuration#getClassByName

Re: [VOTE] Release Hadoop 0.19.0 (candidate 0)

2008-10-22 Thread Chris K Wensel
-1 Unable to load custom Serialization implementations. Patch available https://issues.apache.org/jira/browse/HADOOP-4467 Unable to use non-WritableComprable keys and non-Writable values when writing to SequenceFiles. Patch available. https://issues.apache.org/jira/browse/HADOOP-4466 Both th

[jira] Commented: (HADOOP-4480) data node process should not die if one dir goes bad

2008-10-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12641869#action_12641869 ] Allen Wittenauer commented on HADOOP-4480: -- Yes, we're seeing this to be a proble

Build failed in Hudson: Hadoop-trunk #639

2008-10-22 Thread Apache Hudson Server
See http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/639/changes Changes: [rangadi] HADOOP-4387. TestHDFSFileSystemContract fails on windows nightly builds. [hairong] HADOOP-3914. DFSClient sends Checksum Ok only once for a block. Contributed by Chritian Kunz and Hairong Kuang. [cutting

[jira] Updated: (HADOOP-4485) ant compile-native shorthand

2008-10-22 Thread Enis Soztutar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar updated HADOOP-4485: -- Attachment: ant.compile.native_v1.patch Patch introduces {code} ant compile-native {code} >

[jira] Created: (HADOOP-4485) ant compile-native shorthand

2008-10-22 Thread Enis Soztutar (JIRA)
ant compile-native shorthand Key: HADOOP-4485 URL: https://issues.apache.org/jira/browse/HADOOP-4485 Project: Hadoop Core Issue Type: Improvement Components: build Affects Versions: 0.20.0

[jira] Commented: (HADOOP-4472) Should we move out the creation of setup/cleanup tasks from JobInProgress.initTasks()?

2008-10-22 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12641801#action_12641801 ] Devaraj Das commented on HADOOP-4472: - +1. As we discussed offline, i think it makes s

[jira] Commented: (HADOOP-4305) repeatedly blacklisted tasktrackers should get declared dead

2008-10-22 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12641794#action_12641794 ] Devaraj Das commented on HADOOP-4305: - I think Dhruba's suggestion makes sense. +1 for

[jira] Commented: (HADOOP-4187) Create a MapReduce-specific ReflectionUtils that handles JobConf and JobConfigurable

2008-10-22 Thread Sharad Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12641793#action_12641793 ] Sharad Agarwal commented on HADOOP-4187: The current patch includes a test for thi

[jira] Commented: (HADOOP-4305) repeatedly blacklisted tasktrackers should get declared dead

2008-10-22 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12641786#action_12641786 ] Amareshwari Sriramadasu commented on HADOOP-4305: - bq. Can we count this o

[jira] Updated: (HADOOP-4187) Create a MapReduce-specific ReflectionUtils that handles JobConf and JobConfigurable

2008-10-22 Thread Sharad Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sharad Agarwal updated HADOOP-4187: --- Attachment: 4187_v1.patch patch for runtime class lookup. > Create a MapReduce-specific Ref

[jira] Commented: (HADOOP-4472) Should we move out the creation of setup/cleanup tasks from JobInProgress.initTasks()?

2008-10-22 Thread Hemanth Yamijala (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12641761#action_12641761 ] Hemanth Yamijala commented on HADOOP-4472: -- If we choose to make the schedulers u

[jira] Commented: (HADOOP-4467) SerializationFactory should use current context ClassLoader

2008-10-22 Thread Chris K Wensel (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12641732#action_12641732 ] Chris K Wensel commented on HADOOP-4467: via ant test-patch... seems to be down o

[jira] Commented: (HADOOP-4466) SequenceFileOutputFormat is coupled to WritableComparable and Writable

2008-10-22 Thread Chris K Wensel (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12641731#action_12641731 ] Chris K Wensel commented on HADOOP-4466: via ant test-patch [exec] +1 overal

  1   2   >