Support for pluggable Trash policies
Key: HDFS-2128
URL: https://issues.apache.org/jira/browse/HDFS-2128
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: dhruba borthakur
Ass
ability to support storing extended attributes per file
---
Key: HDFS-2006
URL: https://issues.apache.org/jira/browse/HDFS-2006
Project: Hadoop HDFS
Issue Type: Improvement
Compon
[
https://issues.apache.org/jira/browse/HDFS-1392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur resolved HDFS-1392.
Resolution: Duplicate
duplicate of HDFS-1541
> Improve namenode scalability by prioritizing
Ability for HDFS client to write replicas in parallel
-
Key: HDFS-1783
URL: https://issues.apache.org/jira/browse/HDFS-1783
Project: Hadoop HDFS
Issue Type: Improvement
Components
Convert DFSInputStream synchronized sections to a ReadWrite lock
Key: HDFS-1605
URL: https://issues.apache.org/jira/browse/HDFS-1605
Project: Hadoop HDFS
Issue Type: Improvemen
Allow a datanode to copy a block to a datanode on a foreign HDFS cluster.
-
Key: HDFS-1593
URL: https://issues.apache.org/jira/browse/HDFS-1593
Project: Hadoop HDFS
Issu
Metrics from DFSClient
--
Key: HDFS-1581
URL: https://issues.apache.org/jira/browse/HDFS-1581
Project: Hadoop HDFS
Issue Type: Improvement
Components: hdfs client
Reporter: dhruba borthakur
We woul
DFSClient should retry reading from all datanodes in round robin fashion
Key: HDFS-1567
URL: https://issues.apache.org/jira/browse/HDFS-1567
Project: Hadoop HDFS
Issue
[
https://issues.apache.org/jira/browse/HDFS-1563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur resolved HDFS-1563.
Resolution: Won't Fix
I vote that we keep the semantics of the create(overwrite==true) the s
Make Datanode handle errors to namenode.register call more elegantly
Key: HDFS-1540
URL: https://issues.apache.org/jira/browse/HDFS-1540
Project: Hadoop HDFS
Issue Type: Bu
prevent data loss when a cluster suffers a power loss
-
Key: HDFS-1539
URL: https://issues.apache.org/jira/browse/HDFS-1539
Project: Hadoop HDFS
Issue Type: Improvement
Components
[
https://issues.apache.org/jira/browse/HDFS-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur resolved HDFS-1520.
Resolution: Fixed
Hadoop Flags: [Reviewed]
I just committed this. Thanks Hairong!
> H
[
https://issues.apache.org/jira/browse/HDFS-1162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur resolved HDFS-1162.
Resolution: Won't Fix
This has been fixed via various changes to the fsimage/edits file that
Resync discarded directories in fs.name.dir during saveNamespace command
Key: HDFS-1509
URL: https://issues.apache.org/jira/browse/HDFS-1509
Project: Hadoop HDFS
Issue
Ability to do savenamespace without being in safemode
-
Key: HDFS-1508
URL: https://issues.apache.org/jira/browse/HDFS-1508
Project: Hadoop HDFS
Issue Type: Improvement
Reporter
The logic that makes namenode exit safemode should be pluggable
---
Key: HDFS-1501
URL: https://issues.apache.org/jira/browse/HDFS-1501
Project: Hadoop HDFS
Issue Type: Improvement
accessTime updates should not occur in safeMode
---
Key: HDFS-1463
URL: https://issues.apache.org/jira/browse/HDFS-1463
Project: Hadoop HDFS
Issue Type: Bug
Components: name-node
Expose getCorruptFiles APi via the FileSystem API
-
Key: HDFS-1438
URL: https://issues.apache.org/jira/browse/HDFS-1438
Project: Hadoop HDFS
Issue Type: Improvement
Components: hdfs c
HDFS across data centers: HighTide
--
Key: HDFS-1432
URL: https://issues.apache.org/jira/browse/HDFS-1432
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: dhruba borthakur
Assigne
[
https://issues.apache.org/jira/browse/HDFS-1147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur resolved HDFS-1147.
Resolution: Duplicate
> Reduce NN startup time by reducing the processing time of block repo
[
https://issues.apache.org/jira/browse/HDFS-1393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur resolved HDFS-1393.
Resolution: Duplicate
duplicate of HDFS-1143
> When a directory with huge number of files i
When a directory with huge number of files is deleted, the NN becomes
unresponsive
--
Key: HDFS-1393
URL: https://issues.apache.org/jira/browse/HDFS-1393
Project: Hadoop
Improve namenode scalability by prioritizing datanode heartbeats over block
reports
---
Key: HDFS-1392
URL: https://issues.apache.org/jira/browse/HDFS-1392
Project: Hadoo
Exiting safemode takes a long time when there are lots of blocks in the HDFS
Key: HDFS-1391
URL: https://issues.apache.org/jira/browse/HDFS-1391
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-1384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur resolved HDFS-1384.
Resolution: Duplicate
This bug has been fixed in trunk because the client sends the excluded
reduce namenode startup time by optimising checkBlockInfo while loading
fsimage
-
Key: HDFS-1366
URL: https://issues.apache.org/jira/browse/HDFS-1366
Project: Hadoop HD
Improve namenode restart times by short-circuiting the first block reports from
datanodes
-
Key: HDFS-1295
URL: https://issues.apache.org/jira/browse/HDFS-1295
Pr
ability to send replication traffic on a separate port to the Datanode
--
Key: HDFS-1274
URL: https://issues.apache.org/jira/browse/HDFS-1274
Project: Hadoop HDFS
Issue Type
[
https://issues.apache.org/jira/browse/HDFS-81?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur resolved HDFS-81.
--
Resolution: Won't Fix
This problem occurs only in old releases and is not present in trunk.
> Imp
[
https://issues.apache.org/jira/browse/HDFS-1254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur resolved HDFS-1254.
Hadoop Flags: [Reviewed]
Resolution: Fixed
I just committed this.
> 0.20: mark dfs.su
0.20: mark dfs.supprt.append to be true by default for the 0.20-append branch
-
Key: HDFS-1254
URL: https://issues.apache.org/jira/browse/HDFS-1254
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-1211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur resolved HDFS-1211.
Resolution: Fixed
I just committed this. Thanks Todd!
> 0.20 append: Block receiver should
[
https://issues.apache.org/jira/browse/HDFS-1210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur resolved HDFS-1210.
Fix Version/s: 0.20-append
Resolution: Fixed
I just committed this. Thanks Todd.
> D
[
https://issues.apache.org/jira/browse/HDFS-1204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur resolved HDFS-1204.
Resolution: Fixed
> 0.20: Lease expiration should recover single files, not entire lease hol
[
https://issues.apache.org/jira/browse/HDFS-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur resolved HDFS-1207.
Fix Version/s: 0.20-append
Resolution: Fixed
I just committed this. Thanks Todd!
> 0
[
https://issues.apache.org/jira/browse/HDFS-1141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur resolved HDFS-1141.
Resolution: Fixed
Pulled into hadoop-0.20-append
> completeFile does not check lease owners
[
https://issues.apache.org/jira/browse/HDFS-142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur resolved HDFS-142.
---
Resolution: Fixed
I have committed this. Thanks Sam, Nicolas and Todd.
> In 0.20, move blocks
[
https://issues.apache.org/jira/browse/HDFS-1216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur resolved HDFS-1216.
Resolution: Fixed
I just committed this. Thanks Todd!
> Update to JUnit 4 in branch 20 appe
[
https://issues.apache.org/jira/browse/HDFS-1054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur resolved HDFS-1054.
Fix Version/s: 0.21.0
(was: 0.20-append)
Resolution: Fixed
I c
The namenode could remember the last good location of a missing block
-
Key: HDFS-1200
URL: https://issues.apache.org/jira/browse/HDFS-1200
Project: Hadoop HDFS
Issue Type:
[
https://issues.apache.org/jira/browse/HDFS-200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur resolved HDFS-200.
---
Resolution: Fixed
I committed this into 0.20-append branch.
> In HDFS, sync() not yet guarante
[
https://issues.apache.org/jira/browse/HDFS-200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur reopened HDFS-200:
---
This has to be pulled into the branch-0.20-append branch.
> In HDFS, sync() not yet guarantees dat
Implement a file change log
---
Key: HDFS-1179
URL: https://issues.apache.org/jira/browse/HDFS-1179
Project: Hadoop HDFS
Issue Type: Improvement
Components: name-node
Reporter: dhruba borthakur
Reduce the time required for a checkpoint
-
Key: HDFS-1162
URL: https://issues.apache.org/jira/browse/HDFS-1162
Project: Hadoop HDFS
Issue Type: Improvement
Components: name-node
Reduce NN startup time by reducing the processing time of block reports
---
Key: HDFS-1147
URL: https://issues.apache.org/jira/browse/HDFS-1147
Project: Hadoop HDFS
Issue Ty
When NameNode is shutdown it tries to exit safemode
---
Key: HDFS-1145
URL: https://issues.apache.org/jira/browse/HDFS-1145
Project: Hadoop HDFS
Issue Type: Bug
Components: name-node
Allow HDFS DataNodes and NameNode to have different build versions
--
Key: HDFS-1129
URL: https://issues.apache.org/jira/browse/HDFS-1129
Project: Hadoop HDFS
Issue Type: Improv
ability to create a file whose newly allocated blocks are automatically
persisted immediately
-
Key: HDFS-1108
URL: https://issues.apache.org/jira/browse/HDFS-1108
[
https://issues.apache.org/jira/browse/HDFS-983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur resolved HDFS-983.
---
Resolution: Duplicate
I have not seen this problem after we imported the patch from HADOOP-6522
[
https://issues.apache.org/jira/browse/HDFS-980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur resolved HDFS-980.
---
Resolution: Duplicate
Duplicate of HDFS-1093
> Convert FSNamesystem lock to ReadWriteLock
> --
Intelligent block placement policy to decrease probability of block loss
Key: HDFS-1094
URL: https://issues.apache.org/jira/browse/HDFS-1094
Project: Hadoop HDFS
Issue
Improve namenode scalability by splitting the FSNamesystem synchronized section
in a read/write lock
Key: HDFS-1093
URL: https://issues.apache.org/jira/browse/HDF
savenamespace should write the fsimage to all configured fs.name.dir in parallel
Key: HDFS-1071
URL: https://issues.apache.org/jira/browse/HDFS-1071
Project: Hadoop HDFS
Enhance datanode to read data and checksum file in parallel
---
Key: HDFS-1034
URL: https://issues.apache.org/jira/browse/HDFS-1034
Project: Hadoop HDFS
Issue Type: Improvement
Enhance the webUi to list a few of the corrupted files in HDFS
--
Key: HDFS-1031
URL: https://issues.apache.org/jira/browse/HDFS-1031
Project: Hadoop HDFS
Issue Type: Improvement
SecondaryNamenode fails to checkpoint because namenode fails with
CancelledKeyException
---
Key: HDFS-1024
URL: https://issues.apache.org/jira/browse/HDFS-1024
Projec
[
https://issues.apache.org/jira/browse/HDFS-87?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur resolved HDFS-87.
--
Resolution: Not A Problem
> NameNode startup fails if edit log terminates prematurely
> --
saveNamespace can corrupt edits log
---
Key: HDFS-988
URL: https://issues.apache.org/jira/browse/HDFS-988
Project: Hadoop HDFS
Issue Type: Bug
Components: name-node
Reporter: dhruba borth
NameNode transaction log corruption with bad filename
-
Key: HDFS-983
URL: https://issues.apache.org/jira/browse/HDFS-983
Project: Hadoop HDFS
Issue Type: Bug
Components: name-nod
Record every new block allocation of a file into the transaction log.
-
Key: HDFS-978
URL: https://issues.apache.org/jira/browse/HDFS-978
Project: Hadoop HDFS
Issue Type: Im
Hot Standby for NameNode
Key: HDFS-976
URL: https://issues.apache.org/jira/browse/HDFS-976
Project: Hadoop HDFS
Issue Type: New Feature
Components: name-node
Reporter: dhruba borthakur
NameNode recovers lease even in safemode
Key: HDFS-966
URL: https://issues.apache.org/jira/browse/HDFS-966
Project: Hadoop HDFS
Issue Type: Bug
Components: name-node
Reporter: dh
The namenode should redirect a hftp request to read a file to the datanode that
has the maximum number of local replicas
Key: HDFS-947
URL: ht
Allow hflush/sync to occur in parallel with new writes to the file
--
Key: HDFS-895
URL: https://issues.apache.org/jira/browse/HDFS-895
Project: Hadoop HDFS
Issue Type: Improvem
namenode can save images in parallel to all directories in fs.name.dir
--
Key: HDFS-855
URL: https://issues.apache.org/jira/browse/HDFS-855
Project: Hadoop HDFS
Issue Type:
Datanode should scan devices in parallel to generate block report
-
Key: HDFS-854
URL: https://issues.apache.org/jira/browse/HDFS-854
Project: Hadoop HDFS
Issue Type: Improvemen
The HDFS webUI should show a metric that summarizes whether the cluster is
balanced regarding disk space usage
--
Key: HDFS-853
URL: https://issues.apache.
error while checkpointing edits log gets ignored
Key: HDFS-841
URL: https://issues.apache.org/jira/browse/HDFS-841
Project: Hadoop HDFS
Issue Type: Bug
Components: name-node
The NameNode should forward block reports to BackupNode
---
Key: HDFS-839
URL: https://issues.apache.org/jira/browse/HDFS-839
Project: Hadoop HDFS
Issue Type: New Feature
Componen
Allow a mechanism for an application to detect that datanode(s) have died in
the write pipeline
Key: HDFS-826
URL: https://issues.apache.org/jira/browse/HDFS-826
[
https://issues.apache.org/jira/browse/HDFS-769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur resolved HDFS-769.
---
Resolution: Duplicate
duplicate of HDFS-756
> test-c++-libhdfs constantly fails
>
DataBlockScanner reporting of bad blocks is slightly misleading
---
Key: HDFS-763
URL: https://issues.apache.org/jira/browse/HDFS-763
Project: Hadoop HDFS
Issue Type: Bug
[
https://issues.apache.org/jira/browse/HDFS-503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur resolved HDFS-503.
---
Resolution: Fixed
I will fix the unit-test failure via HDFS-757. The unit tests failed when Mav
Unit tests failure for RAID
---
Key: HDFS-757
URL: https://issues.apache.org/jira/browse/HDFS-757
Project: Hadoop HDFS
Issue Type: Bug
Components: contrib/raid
Reporter: dhruba borthakur
libhdfs unit tests do not run
--
Key: HDFS-756
URL: https://issues.apache.org/jira/browse/HDFS-756
Project: Hadoop HDFS
Issue Type: Bug
Components: contrib/libhdfs
Reporter: dhruba borthakur
TestCrcCorruption succeeds but is not testing anything of value
---
Key: HDFS-751
URL: https://issues.apache.org/jira/browse/HDFS-751
Project: Hadoop HDFS
Issue Type: Bug
Affect
file size is fluctuating although file is closed
Key: HDFS-743
URL: https://issues.apache.org/jira/browse/HDFS-743
Project: Hadoop HDFS
Issue Type: Bug
Components: name-node
fsck option to list only corrupted files
Key: HDFS-729
URL: https://issues.apache.org/jira/browse/HDFS-729
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: dhruba borthakur
RaidNode should red in configuration from hdfs-site.xml
---
Key: HDFS-695
URL: https://issues.apache.org/jira/browse/HDFS-695
Project: Hadoop HDFS
Issue Type: Bug
Components: cont
Use HAR filesystem to merge parity files
-
Key: HDFS-684
URL: https://issues.apache.org/jira/browse/HDFS-684
Project: Hadoop HDFS
Issue Type: Improvement
Components: contrib/raid
Heartbeats times from Datanodes increase when there are plenty of blocks to
delete
--
Key: HDFS-611
URL: https://issues.apache.org/jira/browse/HDFS-611
Project: Hadoop HD
Support for pluggable erasure coding policy for HDFS
Key: HDFS-600
URL: https://issues.apache.org/jira/browse/HDFS-600
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: dh
Improve Namenode robustness by prioritizing datanode heartbeats over client
requests
Key: HDFS-599
URL: https://issues.apache.org/jira/browse/HDFS-599
Project: Hadoo
DFSClient read performance can be improved by stagerring connection setup to
datanode(s)
Key: HDFS-575
URL: https://issues.apache.org/jira/browse/HDFS-575
Projec
Allow applications to know that a read failed beucase block is missing
--
Key: HDFS-532
URL: https://issues.apache.org/jira/browse/HDFS-532
Project: Hadoop HDFS
Issue Type:
Implement erasure coding as a layer on HDFS
---
Key: HDFS-503
URL: https://issues.apache.org/jira/browse/HDFS-503
Project: Hadoop HDFS
Issue Type: New Feature
Reporter: dhruba borthakur
HDFS should expose a fileid to uniquely identify a file
---
Key: HDFS-487
URL: https://issues.apache.org/jira/browse/HDFS-487
Project: Hadoop HDFS
Issue Type: New Feature
Report
[
https://issues.apache.org/jira/browse/HDFS-454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur resolved HDFS-454.
---
Resolution: Fixed
Fix Version/s: 0.21.0
Thanks to Owen for fixing this.
> HDFS workflow
88 matches
Mail list logo