[jira] [Created] (HDFS-6766) optimize ack notify mechanism to avoid thundering herd issue

Liang Xie created HDFS-6766: --- Summary: optimize ack notify mechanism to avoid thundering herd issue Key: HDFS-6766 URL: https://issues.apache.org/jira/browse/HDFS-6766 Project: Hadoop HDFS Issue

Build failed in Jenkins: Hadoop-Hdfs-trunk #1819

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1819/changes Changes: [arp] HADOOP-8069. Enable TCP_NODELAY by default for IPC. (Contributed by Todd Lipcon) [wang] HADOOP-10876. The constructor of Path should not take an empty URL as a parameter. Contributed by Zhihai Xu. [szetszwo]

Hadoop-Hdfs-trunk - Build # 1819 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1819/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 17665 lines...] [INFO] Executing tasks main:

[jira] [Created] (HDFS-6767) Cannot remove directory within encryption zone to Trash

Stephen Chu created HDFS-6767: - Summary: Cannot remove directory within encryption zone to Trash Key: HDFS-6767 URL: https://issues.apache.org/jira/browse/HDFS-6767 Project: Hadoop HDFS Issue

hdfs Jenkins build fails due to findbugs not finishing

Hi, You may have noticed the following in recent hdfs Jenkins builds: [INFO] [ERROR] Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.7:run (site) on project hadoop-hdfs: An Ant BuildException has

[jira] [Created] (HDFS-6768) TestBlockRecovery should use ephemeral ports

Arpit Agarwal created HDFS-6768: --- Summary: TestBlockRecovery should use ephemeral ports Key: HDFS-6768 URL: https://issues.apache.org/jira/browse/HDFS-6768 Project: Hadoop HDFS Issue Type: Bug

[jira] [Resolved] (HDFS-557) documentation for dfsadmin, datanode, etc is using bin/hadoop instead of bin/hdfs

[ https://issues.apache.org/jira/browse/HDFS-557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-557. --- Resolution: Duplicate documentation for dfsadmin, datanode, etc is using bin/hadoop instead

[jira] [Created] (HDFS-6769) TestRefreshCallQueue should use ephemeral ports

Arpit Agarwal created HDFS-6769: --- Summary: TestRefreshCallQueue should use ephemeral ports Key: HDFS-6769 URL: https://issues.apache.org/jira/browse/HDFS-6769 Project: Hadoop HDFS Issue Type:

[jira] [Resolved] (HDFS-6769) TestRefreshCallQueue and TestGenericRefresh should use ephemeral ports

[ https://issues.apache.org/jira/browse/HDFS-6769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6769. - Resolution: Duplicate TestRefreshCallQueue and TestGenericRefresh should use ephemeral ports

[jira] [Resolved] (HDFS-721) ERROR Block blk_XXX_1030 already exists in state RBW and thus cannot be created

[ https://issues.apache.org/jira/browse/HDFS-721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-721. --- Resolution: Duplicate This appears to be fixed by HDFS-6123. ERROR Block blk_XXX_1030

[jira] [Resolved] (HDFS-739) Go to parent directory link broken running on windows

[ https://issues.apache.org/jira/browse/HDFS-739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-739. --- Resolution: Fixed Likely stale. Go to parent directory link broken running on windows

[jira] [Created] (HDFS-6770) stop-dfs.sh/start-dfs.sh breaks if native lib not installed

Allen Wittenauer created HDFS-6770: -- Summary: stop-dfs.sh/start-dfs.sh breaks if native lib not installed Key: HDFS-6770 URL: https://issues.apache.org/jira/browse/HDFS-6770 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-6770) stop-dfs.sh/start-dfs.sh breaks if native lib not installed

[ https://issues.apache.org/jira/browse/HDFS-6770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-6770. Resolution: Duplicate stop-dfs.sh/start-dfs.sh breaks if native lib not installed

[jira] [Resolved] (HDFS-788) Datanode behaves badly when one disk is very low on space

[ https://issues.apache.org/jira/browse/HDFS-788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-788. --- Resolution: Fixed This has likely been fixed. Datanode behaves badly when one disk is very

[jira] [Resolved] (HDFS-6509) Create a special /.reserved/raw directory for raw access to encrypted data

[ https://issues.apache.org/jira/browse/HDFS-6509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-6509. --- Resolution: Fixed Fix Version/s: fs-encryption (HADOOP-10150 and HDFS-6134) Thanks again

[jira] [Resolved] (HDFS-835) TestDefaultNameNodePort.testGetAddressFromConf fails with an unsupported formate error

[ https://issues.apache.org/jira/browse/HDFS-835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-835. --- Resolution: Fixed TestDefaultNameNodePort.testGetAddressFromConf fails with an unsupported

[jira] [Created] (HDFS-6771) Require specification of an encryption key when creating an encryption zone

Andrew Wang created HDFS-6771: - Summary: Require specification of an encryption key when creating an encryption zone Key: HDFS-6771 URL: https://issues.apache.org/jira/browse/HDFS-6771 Project: Hadoop

[jira] [Resolved] (HDFS-842) Serialize NN edits log as avro records

[ https://issues.apache.org/jira/browse/HDFS-842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-842. --- Resolution: Fixed Serialize NN edits log as avro records

[jira] [Resolved] (HDFS-843) Add HTTP POST/PUT/DELETE support for web servers in datanodes

[ https://issues.apache.org/jira/browse/HDFS-843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-843. --- Resolution: Duplicate Add HTTP POST/PUT/DELETE support for web servers in datanodes

[jira] [Resolved] (HDFS-862) Potential NN deadlock in processDistributedUpgradeCommand

[ https://issues.apache.org/jira/browse/HDFS-862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-862. --- Resolution: Won't Fix Potential NN deadlock in processDistributedUpgradeCommand

[jira] [Resolved] (HDFS-864) Potential deadlock rolling edit logs

[ https://issues.apache.org/jira/browse/HDFS-864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-864. --- Resolution: Fixed Potential deadlock rolling edit logs

[jira] [Resolved] (HDFS-866) libhdfs with gdb got SEGV

[ https://issues.apache.org/jira/browse/HDFS-866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-866. --- Resolution: Cannot Reproduce libhdfs with gdb got SEGV -

[jira] [Created] (HDFS-6772) Get DNs out of blockContentsStale==true state faster when NN restarts

Ming Ma created HDFS-6772: - Summary: Get DNs out of blockContentsStale==true state faster when NN restarts Key: HDFS-6772 URL: https://issues.apache.org/jira/browse/HDFS-6772 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-871) Balancer can hang in PendingBlockMove

[ https://issues.apache.org/jira/browse/HDFS-871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-871. --- Resolution: Fixed likely stale. Balancer can hang in PendingBlockMove

[jira] [Created] (HDFS-6773) MiniDFSCluster can run dramatically faster

Daryn Sharp created HDFS-6773: - Summary: MiniDFSCluster can run dramatically faster Key: HDFS-6773 URL: https://issues.apache.org/jira/browse/HDFS-6773 Project: Hadoop HDFS Issue Type:

[jira] [Resolved] (HDFS-886) TestHDFSTrash fails on Windows

[ https://issues.apache.org/jira/browse/HDFS-886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-886. --- Resolution: Fixed TestHDFSTrash fails on Windows --

[jira] [Resolved] (HDFS-887) TestHDFSServerPorts fails on Windows

[ https://issues.apache.org/jira/browse/HDFS-887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-887. --- Resolution: Fixed TestHDFSServerPorts fails on Windows

[jira] [Resolved] (HDFS-888) TestModTime fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-888. --- Resolution: Fixed TestModTime fails intermittently

[jira] [Created] (HDFS-6774) Remove volumes from DataStorage

Lei (Eddy) Xu created HDFS-6774: --- Summary: Remove volumes from DataStorage Key: HDFS-6774 URL: https://issues.apache.org/jira/browse/HDFS-6774 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-6775) Users may see TrashPolicy if hdfs dfs -rm is run

Allen Wittenauer created HDFS-6775: -- Summary: Users may see TrashPolicy if hdfs dfs -rm is run Key: HDFS-6775 URL: https://issues.apache.org/jira/browse/HDFS-6775 Project: Hadoop HDFS Issue

[jira] [Resolved] (HDFS-901) Fedora jdk install creates circular symlinks, causes test-c++-libhdfs not to build

[ https://issues.apache.org/jira/browse/HDFS-901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-901. --- Resolution: Won't Fix Fedora jdk install creates circular symlinks, causes test-c++-libhdfs

[jira] [Resolved] (HDFS-910) Update http://hadoop.apache.org/hdfs/credits.html with current list of committers

[ https://issues.apache.org/jira/browse/HDFS-910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-910. --- Resolution: Fixed Update http://hadoop.apache.org/hdfs/credits.html with current list of

[jira] [Resolved] (HDFS-924) Support reading and writing sequencefile in libhdfs

[ https://issues.apache.org/jira/browse/HDFS-924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-924. --- Resolution: Won't Fix Support reading and writing sequencefile in libhdfs

[jira] [Resolved] (HDFS-945) Make NameNode resilient to DoS attacks (malicious or otherwise)

[ https://issues.apache.org/jira/browse/HDFS-945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-945. --- Resolution: Duplicate I'm going to dupe this to HADOOP-9194. Make NameNode resilient to DoS

[jira] [Created] (HDFS-6776) distcp from insecure cluster to secure cluster doesn't work

Yongjun Zhang created HDFS-6776: --- Summary: distcp from insecure cluster to secure cluster doesn't work Key: HDFS-6776 URL: https://issues.apache.org/jira/browse/HDFS-6776 Project: Hadoop HDFS

[jira] [Created] (HDFS-6778) The Extended Attributes Java doc should simply refer to the Extended Attributes doc

Charles Lamb created HDFS-6778: -- Summary: The Extended Attributes Java doc should simply refer to the Extended Attributes doc Key: HDFS-6778 URL: https://issues.apache.org/jira/browse/HDFS-6778 Project:

[jira] [Created] (HDFS-6777) Supporting consistent edit log reads when in-progress edit log segments are included

James Thomas created HDFS-6777: -- Summary: Supporting consistent edit log reads when in-progress edit log segments are included Key: HDFS-6777 URL: https://issues.apache.org/jira/browse/HDFS-6777

[jira] [Resolved] (HDFS-6771) Require specification of an encryption key when creating an encryption zone

[ https://issues.apache.org/jira/browse/HDFS-6771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-6771. --- Resolution: Fixed Fix Version/s: fs-encryption (HADOOP-10150 and HDFS-6134) Committed, thanks

[jira] [Created] (HDFS-6779) hdfs version subcommand is missing

Allen Wittenauer created HDFS-6779: -- Summary: hdfs version subcommand is missing Key: HDFS-6779 URL: https://issues.apache.org/jira/browse/HDFS-6779 Project: Hadoop HDFS Issue Type:

Build failed in Jenkins: Hadoop-Hdfs-trunk #1820

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1820/changes Changes: [kasha] YARN-2328. FairScheduler: Verify update and continuous scheduling threads are stopped when the scheduler is stopped. (kasha) -- [...truncated 17475 lines...] [javadoc]

Hadoop-Hdfs-trunk - Build # 1820 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1820/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 17668 lines...] [INFO] ---

Re: Branching 2.5

Devs, I created branch-2.5.0 and was trying to cut an RC, but ran into issues with creating one. If anyone knows what is going on, please help me out. I ll continue looking into it otherwise. https://builds.apache.org/job/HADOOP2_Release_Artifacts_Builder/24/console is the build that failed. It

[jira] [Resolved] (HDFS-6730) Create a .RAW extended attribute namespace

[ https://issues.apache.org/jira/browse/HDFS-6730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb resolved HDFS-6730. Resolution: Fixed Fix Version/s: fs-encryption (HADOOP-10150 and HDFS-6134) Create a .RAW