[jira] Commented: (HADOOP-3808) [HOD] Include job tracker RPC in notes attribute after job submission

[ https://issues.apache.org/jira/browse/HADOOP-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615893#action_12615893 ] Hemanth Yamijala commented on HADOOP-3808: -- The attached patch makes the followin

[jira] Updated: (HADOOP-3808) [HOD] Include job tracker RPC in notes attribute after job submission

[ https://issues.apache.org/jira/browse/HADOOP-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hemanth Yamijala updated HADOOP-3808: - Attachment: HADOOP-3808.patch Patch that includes the RPC port in the notes attribute >

[jira] Commented: (HADOOP-1230) Replace parameters with context objects in Mapper, Reducer, Partitioner, InputFormat, and OutputFormat classes

[ https://issues.apache.org/jira/browse/HADOOP-1230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615888#action_12615888 ] Alejandro Abdelnur commented on HADOOP-1230: *On 'Interfaces vs Abstract class

[jira] Commented: (HADOOP-3585) Hardware Failure Monitoring in large clusters running Hadoop/HDFS

[ https://issues.apache.org/jira/browse/HADOOP-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615886#action_12615886 ] dhruba borthakur commented on HADOOP-3585: -- It would be nice if we could do the f

[jira] Assigned: (HADOOP-3813) RPC queue overload of JobTracker

[ https://issues.apache.org/jira/browse/HADOOP-3813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das reassigned HADOOP-3813: --- Assignee: Amareshwari Sriramadasu Assigning to Amareshwari for investigation > RPC queue ov

[jira] Resolved: (HADOOP-3815) [Build] Have an ant build property to exclude sources and docs while building a hadoop tar-ball.

[ https://issues.apache.org/jira/browse/HADOOP-3815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nigel Daley resolved HADOOP-3815. - Resolution: Invalid Fix Version/s: (was: 0.19.0) There already is such a target. It'

[jira] Created: (HADOOP-3815) [Build] Have an ant build property to exclude sources and docs while building a hadoop tar-ball.

[Build] Have an ant build property to exclude sources and docs while building a hadoop tar-ball. Key: HADOOP-3815 URL: https://issues.apache.org/jira/browse/HADOOP-38

[jira] Commented: (HADOOP-3601) Hive as a contrib project

[ https://issues.apache.org/jira/browse/HADOOP-3601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615879#action_12615879 ] Ian Holsman commented on HADOOP-3601: - guys.. whatever is the easiest way to get this

[jira] Updated: (HADOOP-3150) Move task file promotion into the task

[ https://issues.apache.org/jira/browse/HADOOP-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated HADOOP-3150: Status: Open (was: Patch Available) > Move task file promotion into the t

[jira] Updated: (HADOOP-3150) Move task file promotion into the task

[ https://issues.apache.org/jira/browse/HADOOP-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated HADOOP-3150: Status: Patch Available (was: Open) Submitting for hudson > Move task fi

[jira] Updated: (HADOOP-3814) [HOD] Remove dfs.client.buffer.dir generation, as this is removed in Hadoop 0.19.

[ https://issues.apache.org/jira/browse/HADOOP-3814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hemanth Yamijala updated HADOOP-3814: - Priority: Blocker (was: Major) > [HOD] Remove dfs.client.buffer.dir generation, as this

[jira] Commented: (HADOOP-3756) dfs.client.buffer.dir isn't used in hdfs, but it's still in conf/hadoop-default.xml

[ https://issues.apache.org/jira/browse/HADOOP-3756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615873#action_12615873 ] Hemanth Yamijala commented on HADOOP-3756: -- Raghu, I filed HADOOP-3814 for addres

[jira] Created: (HADOOP-3814) [HOD] Remove dfs.client.buffer.dir generation, as this is removed in Hadoop 0.19.

[HOD] Remove dfs.client.buffer.dir generation, as this is removed in Hadoop 0.19. - Key: HADOOP-3814 URL: https://issues.apache.org/jira/browse/HADOOP-3814 Project: Hadoo

[jira] Commented: (HADOOP-3801) Change the job state observer classes to interfaces

[ https://issues.apache.org/jira/browse/HADOOP-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615870#action_12615870 ] Vivek Ratan commented on HADOOP-3801: - I agree with your comments in general, and it m

[jira] Commented: (HADOOP-3813) RPC queue overload of JobTracker

[ https://issues.apache.org/jira/browse/HADOOP-3813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615865#action_12615865 ] Christian Kunz commented on HADOOP-3813: Arun, this was first time with a large jo

[jira] Updated: (HADOOP-3776) NPE in NameNode with unknown blocks

[ https://issues.apache.org/jira/browse/HADOOP-3776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated HADOOP-3776: - Attachment: HADOOP-3776.patch The patch essentially reverts the hunk "@@ -2780,17 +2751,8 @@" fr

[jira] Updated: (HADOOP-3661) Normalize fuse-dfs handling of moving things to trash wrt the way hadoop dfs does it (only when non posix trash flag is enabled in compile)

[ https://issues.apache.org/jira/browse/HADOOP-3661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pete Wyckoff updated HADOOP-3661: - Attachment: patch2.txt re-attaching the same one since hudson had some problem and I want it to

[jira] Updated: (HADOOP-3661) Normalize fuse-dfs handling of moving things to trash wrt the way hadoop dfs does it (only when non posix trash flag is enabled in compile)

[ https://issues.apache.org/jira/browse/HADOOP-3661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pete Wyckoff updated HADOOP-3661: - Status: Patch Available (was: Open) hudson failed on unrelated problems so I am re-submitting t

[jira] Updated: (HADOOP-3661) Normalize fuse-dfs handling of moving things to trash wrt the way hadoop dfs does it (only when non posix trash flag is enabled in compile)

[ https://issues.apache.org/jira/browse/HADOOP-3661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pete Wyckoff updated HADOOP-3661: - Status: Open (was: Patch Available) > Normalize fuse-dfs handling of moving things to trash wrt

[jira] Commented: (HADOOP-3661) Normalize fuse-dfs handling of moving things to trash wrt the way hadoop dfs does it (only when non posix trash flag is enabled in compile)

[ https://issues.apache.org/jira/browse/HADOOP-3661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615839#action_12615839 ] Hadoop QA commented on HADOOP-3661: --- -1 overall. Here are the results of testing the la

[jira] Assigned: (HADOOP-3776) NPE in NameNode with unknown blocks

[ https://issues.apache.org/jira/browse/HADOOP-3776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi reassigned HADOOP-3776: Assignee: Raghu Angadi > NPE in NameNode with unknown blocks > ---

[jira] Commented: (HADOOP-3601) Hive as a contrib project

[ https://issues.apache.org/jira/browse/HADOOP-3601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615834#action_12615834 ] Sameer Paranjpye commented on HADOOP-3601: -- Doug, Yes, a sandbox is still a Hado

[jira] Commented: (HADOOP-3813) RPC queue overload of JobTracker

[ https://issues.apache.org/jira/browse/HADOOP-3813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615833#action_12615833 ] Arun C Murthy commented on HADOOP-3813: --- Christian, is this the first time you notic

[jira] Commented: (HADOOP-3169) LeaseChecker daemon should not be started in DFSClient constructor

[ https://issues.apache.org/jira/browse/HADOOP-3169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615830#action_12615830 ] Hairong Kuang commented on HADOOP-3169: --- I feel that we do not need two locks, start

[jira] Updated: (HADOOP-3810) NameNode seems unstable on a cluster with little space left

[ https://issues.apache.org/jira/browse/HADOOP-3810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated HADOOP-3810: - Description: NameNode seems not very responsive and unstable when the cluster has very little s

[jira] Created: (HADOOP-3813) RPC queue overload of JobTracker

RPC queue overload of JobTracker Key: HADOOP-3813 URL: https://issues.apache.org/jira/browse/HADOOP-3813 Project: Hadoop Core Issue Type: Bug Components: mapred Affects Versions: 0.17.1

[jira] Commented: (HADOOP-2302) Streaming should provide an option for numerical sort of keys

[ https://issues.apache.org/jira/browse/HADOOP-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615819#action_12615819 ] Hadoop QA commented on HADOOP-2302: --- -1 overall. Here are the results of testing the la

[jira] Created: (HADOOP-3812) Job completion delayed

Job completion delayed -- Key: HADOOP-3812 URL: https://issues.apache.org/jira/browse/HADOOP-3812 Project: Hadoop Core Issue Type: Bug Components: mapred Affects Versions: 0.17.1 Reporter: Christ

[jira] Created: (HADOOP-3811) can't package zip file with hadoop streaming -file argument

can't package zip file with hadoop streaming -file argument --- Key: HADOOP-3811 URL: https://issues.apache.org/jira/browse/HADOOP-3811 Project: Hadoop Core Issue Type: Bug Co

[jira] Updated: (HADOOP-3778) seek(long) in DFSInputStream should catch socket exception for retry later

[ https://issues.apache.org/jira/browse/HADOOP-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated HADOOP-3778: - Resolution: Fixed Release Note: DFSInputStream.seek() retries in case of errors just like

[jira] Commented: (HADOOP-3778) seek(long) in DFSInputStream should catch socket exception for retry later

[ https://issues.apache.org/jira/browse/HADOOP-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615787#action_12615787 ] Hadoop QA commented on HADOOP-3778: --- -1 overall. Here are the results of testing the la

[jira] Commented: (HADOOP-3601) Hive as a contrib project

[ https://issues.apache.org/jira/browse/HADOOP-3601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615784#action_12615784 ] Doug Cutting commented on HADOOP-3601: -- Sameer, I still don't understand what the dif

[jira] Updated: (HADOOP-3810) NameNode seems unstable on a cluster with little space left

[ https://issues.apache.org/jira/browse/HADOOP-3810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated HADOOP-3810: - Description: NameNode seems not very responsive and unstable when the cluster has very little s

[jira] Created: (HADOOP-3810) NameNode seems unstable on a cluster with little space left

NameNode seems unstable on a cluster with little space left --- Key: HADOOP-3810 URL: https://issues.apache.org/jira/browse/HADOOP-3810 Project: Hadoop Core Issue Type: Bug Co

[jira] Updated: (HADOOP-3661) Normalize fuse-dfs handling of moving things to trash wrt the way hadoop dfs does it (only when non posix trash flag is enabled in compile)

[ https://issues.apache.org/jira/browse/HADOOP-3661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pete Wyckoff updated HADOOP-3661: - Status: Patch Available (was: Open) > Normalize fuse-dfs handling of moving things to trash wrt

[jira] Updated: (HADOOP-3661) Normalize fuse-dfs handling of moving things to trash wrt the way hadoop dfs does it (only when non posix trash flag is enabled in compile)

[ https://issues.apache.org/jira/browse/HADOOP-3661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pete Wyckoff updated HADOOP-3661: - Status: Open (was: Patch Available) > Normalize fuse-dfs handling of moving things to trash wrt

[jira] Commented: (HADOOP-1700) Append to files in HDFS

[ https://issues.apache.org/jira/browse/HADOOP-1700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615780#action_12615780 ] dhruba borthakur commented on HADOOP-1700: -- Ok, i will author a test plan. Will p

[jira] Commented: (HADOOP-1700) Append to files in HDFS

[ https://issues.apache.org/jira/browse/HADOOP-1700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615776#action_12615776 ] Sameer Paranjpye commented on HADOOP-1700: -- +1 Dhruba, if you can author a test

[jira] Commented: (HADOOP-3601) Hive as a contrib project

[ https://issues.apache.org/jira/browse/HADOOP-3601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615772#action_12615772 ] Sameer Paranjpye commented on HADOOP-3601: -- > What's the bar? Releases need to be

[jira] Commented: (HADOOP-3799) Design a pluggable interface to place replicas of blocks in HDFS

[ https://issues.apache.org/jira/browse/HADOOP-3799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615767#action_12615767 ] Lohit Vijayarenu commented on HADOOP-3799: -- It would be good if this could also b

Basic functionality suggestion

I have a suggestion for basic functionality. Let me know if this should instead be posted somewhere (Jira? Wiki?). I am new to map-reduce and hadoop, so I apologize if this is too newbie / And/or I've overlooked existing functionality (i.e. if there's already a way to do this). In implementin

[jira] Assigned: (HADOOP-3756) dfs.client.buffer.dir isn't used in hdfs, but it's still in conf/hadoop-default.xml

[ https://issues.apache.org/jira/browse/HADOOP-3756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi reassigned HADOOP-3756: Assignee: Hemanth Yamijala (was: Raghu Angadi) On second thoughts, I will wait for Hemant

[jira] Commented: (HADOOP-3601) Hive as a contrib project

[ https://issues.apache.org/jira/browse/HADOOP-3601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615754#action_12615754 ] Doug Cutting commented on HADOOP-3601: -- > Another option would be to create a sandbox

[jira] Commented: (HADOOP-3131) enabling BLOCK compression for map outputs breaks the reduce progress counters

[ https://issues.apache.org/jira/browse/HADOOP-3131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615748#action_12615748 ] Hadoop QA commented on HADOOP-3131: --- -1 overall. Here are the results of testing the la

[jira] Commented: (HADOOP-3466) DataNode fails to deliver blocks, holds thousands of open socket connections

[ https://issues.apache.org/jira/browse/HADOOP-3466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615746#action_12615746 ] Raghu Angadi commented on HADOOP-3466: -- Main difference between 0.15 and 0.17 is that

[jira] Created: (HADOOP-3809) TestCLI fails on trunk point out that moveFromLocal/put output has changed

TestCLI fails on trunk point out that moveFromLocal/put output has changed -- Key: HADOOP-3809 URL: https://issues.apache.org/jira/browse/HADOOP-3809 Project: Hadoop Core

[jira] Updated: (HADOOP-2302) Streaming should provide an option for numerical sort of keys

[ https://issues.apache.org/jira/browse/HADOOP-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HADOOP-2302: Status: Patch Available (was: Open) > Streaming should provide an option for numerical sort of k

[jira] Updated: (HADOOP-2302) Streaming should provide an option for numerical sort of keys

[ https://issues.apache.org/jira/browse/HADOOP-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HADOOP-2302: Attachment: 2302.1.patch A reasonably well tested patch. The following is done: 1) Options support

[jira] Commented: (HADOOP-3601) Hive as a contrib project

[ https://issues.apache.org/jira/browse/HADOOP-3601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615736#action_12615736 ] Sameer Paranjpye commented on HADOOP-3601: -- Another option would be to create a s

[jira] Updated: (HADOOP-3778) seek(long) in DFSInputStream should catch socket exception for retry later

[ https://issues.apache.org/jira/browse/HADOOP-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated HADOOP-3778: - Attachment: HADOOP-3778.patch Minor rearrangement of LN's patch. Hopefully its ok. > seek(long)

[jira] Updated: (HADOOP-3778) seek(long) in DFSInputStream should catch socket exception for retry later

[ https://issues.apache.org/jira/browse/HADOOP-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated HADOOP-3778: - Status: Patch Available (was: Open) > seek(long) in DFSInputStream should catch socket exceptio

[jira] Commented: (HADOOP-3724) Namenode does not start due to exception throw while saving Image

[ https://issues.apache.org/jira/browse/HADOOP-3724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615724#action_12615724 ] Lohit Vijayarenu commented on HADOOP-3724: -- Changes look good. minor changes if i

[jira] Commented: (HADOOP-3601) Hive as a contrib project

[ https://issues.apache.org/jira/browse/HADOOP-3601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615721#action_12615721 ] Doug Cutting commented on HADOOP-3601: -- > Would it be possible to have a separate ema

[jira] Commented: (HADOOP-3131) enabling BLOCK compression for map outputs breaks the reduce progress counters

[ https://issues.apache.org/jira/browse/HADOOP-3131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615720#action_12615720 ] Matei Zaharia commented on HADOOP-3131: --- I'm not sure it's worth fixing that, becaus

[jira] Commented: (HADOOP-3776) NPE in NameNode with unknown blocks

[ https://issues.apache.org/jira/browse/HADOOP-3776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615718#action_12615718 ] Tsz Wo (Nicholas), SZE commented on HADOOP-3776: The patches for 0.18 and

[jira] Commented: (HADOOP-3131) enabling BLOCK compression for map outputs breaks the reduce progress counters

[ https://issues.apache.org/jira/browse/HADOOP-3131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615716#action_12615716 ] Arun C Murthy commented on HADOOP-3131: --- Matei, a minor nit: looking through your pa

[jira] Commented: (HADOOP-3756) dfs.client.buffer.dir isn't used in hdfs, but it's still in conf/hadoop-default.xml

[ https://issues.apache.org/jira/browse/HADOOP-3756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615717#action_12615717 ] Raghu Angadi commented on HADOOP-3756: -- yes, it needs to be removed and no new config

[jira] Updated: (HADOOP-3769) expose static SampleMapper and SampleReducer classes of GenericMRLoadGenerator class for gridmix reuse

[ https://issues.apache.org/jira/browse/HADOOP-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lingyun Yang updated HADOOP-3769: - Attachment: patch-3769.txt Hi Arun: Thanks for your comments. I updated a new patch accordin

[jira] Commented: (HADOOP-3776) NPE in NameNode with unknown blocks

[ https://issues.apache.org/jira/browse/HADOOP-3776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615714#action_12615714 ] Raghu Angadi commented on HADOOP-3776: -- > When block does not exist in NameNode's blo

[jira] Updated: (HADOOP-3624) CreateEditsLog could be improved to create tree directory structure

[ https://issues.apache.org/jira/browse/HADOOP-3624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahadev konar updated HADOOP-3624: -- Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Availa

[jira] Updated: (HADOOP-3776) NPE in NameNode with unknown blocks

[ https://issues.apache.org/jira/browse/HADOOP-3776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated HADOOP-3776: - Description: When a datanode has a block that NameNode does not have, it results in an NPE

[jira] Updated: (HADOOP-3795) NameNode does not save image if different dfs.name.dir have different checkpoint stamps

[ https://issues.apache.org/jira/browse/HADOOP-3795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahadev konar updated HADOOP-3795: -- Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Availa

[jira] Commented: (HADOOP-3601) Hive as a contrib project

[ https://issues.apache.org/jira/browse/HADOOP-3601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615701#action_12615701 ] Joydeep Sen Sarma commented on HADOOP-3601: --- Ideally we would like it to be in c

[jira] Assigned: (HADOOP-3795) NameNode does not save image if different dfs.name.dir have different checkpoint stamps

[ https://issues.apache.org/jira/browse/HADOOP-3795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahadev konar reassigned HADOOP-3795: - Assignee: Lohit Vijayarenu > NameNode does not save image if different dfs.name.dir have

[jira] Updated: (HADOOP-3376) [HOD] HOD should have a way to detect and deal with clusters that violate/exceed resource manager limits

[ https://issues.apache.org/jira/browse/HADOOP-3376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Chansler updated HADOOP-3376: Release Note: Modified HOD client to look for specific messages related to resource limit

[jira] Updated: (HADOOP-3366) Shuffle/Merge improvements

[ https://issues.apache.org/jira/browse/HADOOP-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Chansler updated HADOOP-3366: Release Note: Improved shuffle so that all fetched map-outputs are kept in-memory before b

[jira] Updated: (HADOOP-3336) Direct a subset of namenode RPC events for audit logging

[ https://issues.apache.org/jira/browse/HADOOP-3336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Chansler updated HADOOP-3336: Release Note: Added a log4j appender that emits events from FSNamesystem for audit logging

[jira] Updated: (HADOOP-3339) DFS Write pipeline does not detect defective datanode correctly if it times out.

[ https://issues.apache.org/jira/browse/HADOOP-3339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Chansler updated HADOOP-3339: Release Note: Improved failure handling of last Data Node in write pipeline. was: Some

[jira] Updated: (HADOOP-3329) DatanodeDescriptor objects stored in FSImage may be out dated.

[ https://issues.apache.org/jira/browse/HADOOP-3329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Chansler updated HADOOP-3329: Release Note: Changed format of file system image to not store locations of last block. (

[jira] Updated: (HADOOP-3326) ReduceTask should not sleep for 200 ms while waiting for merge to finish

[ https://issues.apache.org/jira/browse/HADOOP-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Chansler updated HADOOP-3326: Release Note: Changed fetchOutputs() so that LocalFSMerger and InMemFSMergeThread threads

[jira] Updated: (HADOOP-3317) add default port for hdfs namenode

[ https://issues.apache.org/jira/browse/HADOOP-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Chansler updated HADOOP-3317: Release Note: Changed the default port for "hdfs:" URIs to be 8020, so that one may simpl

[jira] Updated: (HADOOP-3265) Remove deprecated API getFileCacheHints

[ https://issues.apache.org/jira/browse/HADOOP-3265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Chansler updated HADOOP-3265: Release Note: Removed deprecated API getFileCacheHints (was: Removing deprecated API getF

[jira] Updated: (HADOOP-3250) Extend FileSystem API to allow appending to files

[ https://issues.apache.org/jira/browse/HADOOP-3250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Chansler updated HADOOP-3250: Release Note: (was: Added an optional operation, append, to the FileSystem API and an im

[jira] Updated: (HADOOP-3226) Run combiner when merging spills from map output

[ https://issues.apache.org/jira/browse/HADOOP-3226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Chansler updated HADOOP-3226: Release Note: Changed policy for running combiner. The combiner may be run multiple times

[jira] Updated: (HADOOP-2585) Automatic namespace recovery from the secondary image.

[ https://issues.apache.org/jira/browse/HADOOP-2585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Chansler updated HADOOP-2585: Release Note: Improved management of replicas of the name space image. If all replicas on

[jira] Commented: (HADOOP-3759) Provide ability to run memory intensive jobs without affecting other running tasks on the nodes

[ https://issues.apache.org/jira/browse/HADOOP-3759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615687#action_12615687 ] Hemanth Yamijala commented on HADOOP-3759: -- Some more details on implementation:

[jira] Updated: (HADOOP-3131) enabling BLOCK compression for map outputs breaks the reduce progress counters

[ https://issues.apache.org/jira/browse/HADOOP-3131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-3131: -- Status: Open (was: Patch Available) > enabling BLOCK compression for map outputs breaks the r

[jira] Updated: (HADOOP-3131) enabling BLOCK compression for map outputs breaks the reduce progress counters

[ https://issues.apache.org/jira/browse/HADOOP-3131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-3131: -- Status: Patch Available (was: Open) > enabling BLOCK compression for map outputs breaks the r

[jira] Updated: (HADOOP-2019) DistributedFileCache should support .tgz files in addition to jars and zip files

[ https://issues.apache.org/jira/browse/HADOOP-2019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Chansler updated HADOOP-2019: Release Note: Added support for .tar, .tgz and .tar.gz files in DistributedCache. File siz

[jira] Updated: (HADOOP-3131) enabling BLOCK compression for map outputs breaks the reduce progress counters

[ https://issues.apache.org/jira/browse/HADOOP-3131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-3131: -- Attachment: HADOOP-3131-v5.patch Fixes compile error. > enabling BLOCK compression for map ou

[jira] Updated: (HADOOP-1979) fsck on namenode without datanodes takes too much time

[ https://issues.apache.org/jira/browse/HADOOP-1979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Chansler updated HADOOP-1979: Release Note: Improved performance of {{fsck}} by better management of the data stream on

[jira] Commented: (HADOOP-3581) Prevent memory intensive user tasks from taking down nodes

[ https://issues.apache.org/jira/browse/HADOOP-3581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615679#action_12615679 ] Hemanth Yamijala commented on HADOOP-3581: -- Some more details on the configuratio

[jira] Commented: (HADOOP-3601) Hive as a contrib project

[ https://issues.apache.org/jira/browse/HADOOP-3601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615673#action_12615673 ] Doug Cutting commented on HADOOP-3601: -- > Owen: In particular, I don't think we shoul

[jira] Commented: (HADOOP-3801) Change the job state observer classes to interfaces

[ https://issues.apache.org/jira/browse/HADOOP-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615670#action_12615670 ] Doug Cutting commented on HADOOP-3801: -- > [...] additional/deletion/modification of a

[jira] Created: (HADOOP-3808) [HOD] Include job tracker RPC in notes attribute after job submission

[HOD] Include job tracker RPC in notes attribute after job submission - Key: HADOOP-3808 URL: https://issues.apache.org/jira/browse/HADOOP-3808 Project: Hadoop Core Issue Ty

[jira] Commented: (HADOOP-3702) add support for chaining Maps in a single Map and after a Reduce [M*/RM*]

[ https://issues.apache.org/jira/browse/HADOOP-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615633#action_12615633 ] Alejandro Abdelnur commented on HADOOP-3702: Thanks for the feedback. *On "ea

[jira] Updated: (HADOOP-153) skip records that throw exceptions

[ https://issues.apache.org/jira/browse/HADOOP-153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sharad Agarwal updated HADOOP-153: -- Attachment: 153_2.patch Attaching the patch. It adds the support for streaming and pipes. Also

[jira] Updated: (HADOOP-3150) Move task file promotion into the task

[ https://issues.apache.org/jira/browse/HADOOP-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated HADOOP-3150: Attachment: patch-3150.txt Here is a patch adding OutputCommitter and File

Build failed in Hudson: Hadoop-trunk #553

See http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/553/changes Changes: [cdouglas] HADOOP-3592. Improve exception handling in IOUtils. Contributed by Bill de hOra. [cdouglas] HADOOP-3806. Remove debug statement to stdout from QuickSort. -- [...tr

[jira] Commented: (HADOOP-3654) Log4J logging of stack trace may deadlock JRockit in TestFileSystem

[ https://issues.apache.org/jira/browse/HADOOP-3654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615572#action_12615572 ] Steve Loughran commented on HADOOP-3654: -a switch to turn numbers off would work

[jira] Updated: (HADOOP-3592) org.apache.hadoop.fs.FileUtil.copy() will leak input streams if the destination can't be opened

[ https://issues.apache.org/jira/browse/HADOOP-3592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-3592: -- Resolution: Fixed Fix Version/s: 0.19.0 Assignee: Bill de hOra Hadoop Flag

[jira] Commented: (HADOOP-3592) org.apache.hadoop.fs.FileUtil.copy() will leak input streams if the destination can't be opened

[ https://issues.apache.org/jira/browse/HADOOP-3592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615562#action_12615562 ] Chris Douglas commented on HADOOP-3592: --- Sorry, I'd missed that Bill had uploaded tw

[jira] Created: (HADOOP-3807) task attempt failing to report status just after the intialization

task attempt failing to report status just after the intialization -- Key: HADOOP-3807 URL: https://issues.apache.org/jira/browse/HADOOP-3807 Project: Hadoop Core Issue Type: Bu