[jira] [Created] (HDFS-4660) Duplicated checksum on DN in a recovered pipeline

PengZhang created HDFS-4660: --- Summary: Duplicated checksum on DN in a recovered pipeline Key: HDFS-4660 URL: https://issues.apache.org/jira/browse/HDFS-4660 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-4660) Duplicated checksum on DN in a recovered pipeline

[ https://issues.apache.org/jira/browse/HDFS-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] PengZhang updated HDFS-4660: Attachment: HDFS-4660.patch patch for trunk Duplicated checksum on DN in a recovered

[jira] [Updated] (HDFS-4660) Duplicated checksum on DN in a recovered pipeline

[ https://issues.apache.org/jira/browse/HDFS-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] PengZhang updated HDFS-4660: Affects Version/s: 3.0.0 Status: Patch Available (was: Open) Duplicated checksum on DN

[jira] [Commented] (HDFS-4659) Support setting execution bit for regular files

[ https://issues.apache.org/jira/browse/HDFS-4659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13619590#comment-13619590 ] Hadoop QA commented on HDFS-4659: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4658) Standby NN will log that it has received a block report after becoming active

[ https://issues.apache.org/jira/browse/HDFS-4658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13619596#comment-13619596 ] Hadoop QA commented on HDFS-4658: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4660) Duplicated checksum on DN in a recovered pipeline

[ https://issues.apache.org/jira/browse/HDFS-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13619631#comment-13619631 ] Hadoop QA commented on HDFS-4660: - {color:red}-1 overall{color}. Here are the results of

Max DataXceiver Exceeded Logs in DataNode log files

Hi All, We are currently running Hadoop 0.20.X version of hadoop cluster in our environment. We have been recently observing slow down of datanodes and DFSClient times out. Looking at the logs in the data nodes we noticed that there were quite a bit of Max DataXceiver exceeded exception

[jira] [Commented] (HDFS-4655) DNA_FINALIZE is logged as being an unknown command by the DN when received from the standby NN

[ https://issues.apache.org/jira/browse/HDFS-4655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13619689#comment-13619689 ] Hudson commented on HDFS-4655: -- Integrated in Hadoop-Yarn-trunk #173 (See

[jira] [Commented] (HDFS-4656) DN heartbeat loop can be briefly tight

[ https://issues.apache.org/jira/browse/HDFS-4656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13619691#comment-13619691 ] Hudson commented on HDFS-4656: -- Integrated in Hadoop-Yarn-trunk #173 (See

[jira] [Commented] (HDFS-4655) DNA_FINALIZE is logged as being an unknown command by the DN when received from the standby NN

[ https://issues.apache.org/jira/browse/HDFS-4655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13619760#comment-13619760 ] Hudson commented on HDFS-4655: -- Integrated in Hadoop-Hdfs-trunk #1362 (See

[jira] [Commented] (HDFS-4656) DN heartbeat loop can be briefly tight

[ https://issues.apache.org/jira/browse/HDFS-4656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13619762#comment-13619762 ] Hudson commented on HDFS-4656: -- Integrated in Hadoop-Hdfs-trunk #1362 (See

[jira] [Commented] (HDFS-4611) Snapshot: Update FSImage for INodeReference

[ https://issues.apache.org/jira/browse/HDFS-4611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13619785#comment-13619785 ] Hudson commented on HDFS-4611: -- Integrated in Hadoop-Hdfs-Snapshots-Branch-build #147 (See

[jira] [Commented] (HDFS-4655) DNA_FINALIZE is logged as being an unknown command by the DN when received from the standby NN

[ https://issues.apache.org/jira/browse/HDFS-4655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13619816#comment-13619816 ] Hudson commented on HDFS-4655: -- Integrated in Hadoop-Mapreduce-trunk #1389 (See

[jira] [Commented] (HDFS-4656) DN heartbeat loop can be briefly tight

[ https://issues.apache.org/jira/browse/HDFS-4656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13619818#comment-13619818 ] Hudson commented on HDFS-4656: -- Integrated in Hadoop-Mapreduce-trunk #1389 (See

[jira] [Commented] (HDFS-4548) Webhdfs doesn't renegotiate SPNEGO token

[ https://issues.apache.org/jira/browse/HDFS-4548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13619889#comment-13619889 ] Kihwal Lee commented on HDFS-4548: -- +1 The fix seems simple and straightforward.

[jira] [Commented] (HDFS-4649) Webhdfs cannot list large directories

[ https://issues.apache.org/jira/browse/HDFS-4649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13619904#comment-13619904 ] Kihwal Lee commented on HDFS-4649: -- The test failure was not caused by this patch and will

[jira] [Commented] (HDFS-4658) Standby NN will log that it has received a block report after becoming active

[ https://issues.apache.org/jira/browse/HDFS-4658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13619990#comment-13619990 ] Daryn Sharp commented on HDFS-4658: --- +1 Ideally, it would be nice to log the actual state

[jira] [Commented] (HDFS-4659) Support setting execution bit for regular files

[ https://issues.apache.org/jira/browse/HDFS-4659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13619996#comment-13619996 ] Daryn Sharp commented on HDFS-4659: --- Looking at the failed tests appears to confirm a

[jira] [Commented] (HDFS-4538) allow use of legacy blockreader

[ https://issues.apache.org/jira/browse/HDFS-4538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13620027#comment-13620027 ] Colin Patrick McCabe commented on HDFS-4538:

[jira] [Commented] (HDFS-4548) Webhdfs doesn't renegotiate SPNEGO token

[ https://issues.apache.org/jira/browse/HDFS-4548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13620029#comment-13620029 ] Alejandro Abdelnur commented on HDFS-4548: -- Looking a bit more I think

[jira] [Created] (HDFS-4661) code style fixes suggested by Nicholas

Colin Patrick McCabe created HDFS-4661: -- Summary: code style fixes suggested by Nicholas Key: HDFS-4661 URL: https://issues.apache.org/jira/browse/HDFS-4661 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-4658) Standby NN will log that it has received a block report after becoming active

[ https://issues.apache.org/jira/browse/HDFS-4658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13620043#comment-13620043 ] Aaron T. Myers commented on HDFS-4658: -- Thanks for the review, Daryn. There's no easy

[jira] [Updated] (HDFS-4658) Standby NN will log that it has received a block report after becoming active

[ https://issues.apache.org/jira/browse/HDFS-4658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4658: - Resolution: Fixed Fix Version/s: 2.0.5-beta Target Version/s: 2.0.5-beta (was:

[jira] [Updated] (HDFS-4661) code style fixes suggested by Nicholas

[ https://issues.apache.org/jira/browse/HDFS-4661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4661: --- Attachment: HDFS-4661.001.patch here's a patch. I've tested it with

[jira] [Commented] (HDFS-4658) Standby NN will log that it has received a block report after becoming active

[ https://issues.apache.org/jira/browse/HDFS-4658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13620075#comment-13620075 ] Hudson commented on HDFS-4658: -- Integrated in Hadoop-trunk-Commit #3548 (See

[jira] [Commented] (HDFS-4548) Webhdfs doesn't renegotiate SPNEGO token

[ https://issues.apache.org/jira/browse/HDFS-4548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13620085#comment-13620085 ] Kihwal Lee commented on HDFS-4548: -- bq. The UGI should, in using keytab, set

[jira] [Updated] (HDFS-4413) Secondary namenode won't start if HDFS isn't the default file system

[ https://issues.apache.org/jira/browse/HDFS-4413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-4413: Component/s: namenode Target Version/s: 1-win, 1.2.1 Affects Version/s: 1.2.1

[jira] [Commented] (HDFS-4413) Secondary namenode won't start if HDFS isn't the default file system

[ https://issues.apache.org/jira/browse/HDFS-4413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13620110#comment-13620110 ] Chris Nauroth commented on HDFS-4413: - Also, thank you Mostafa!

[jira] [Commented] (HDFS-4548) Webhdfs doesn't renegotiate SPNEGO token

[ https://issues.apache.org/jira/browse/HDFS-4548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13620115#comment-13620115 ] Alejandro Abdelnur commented on HDFS-4548: -- agree, we can do that in a different

[jira] [Commented] (HDFS-4649) Webhdfs cannot list large directories

[ https://issues.apache.org/jira/browse/HDFS-4649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13620151#comment-13620151 ] Kihwal Lee commented on HDFS-4649: -- I've committed this to branch-0.23, branch-2 and

[jira] [Updated] (HDFS-4649) Webhdfs cannot list large directories

[ https://issues.apache.org/jira/browse/HDFS-4649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-4649: - Resolution: Fixed Fix Version/s: 2.0.4-alpha 0.23.7 3.0.0

[jira] [Commented] (HDFS-4649) Webhdfs cannot list large directories

[ https://issues.apache.org/jira/browse/HDFS-4649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13620160#comment-13620160 ] Hudson commented on HDFS-4649: -- Integrated in Hadoop-trunk-Commit #3550 (See

[jira] [Commented] (HDFS-4548) Webhdfs doesn't renegotiate SPNEGO token

[ https://issues.apache.org/jira/browse/HDFS-4548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13620161#comment-13620161 ] Daryn Sharp commented on HDFS-4548: --- That's not how it works, so I believe hadoop-auth

[jira] [Resolved] (HDFS-3771) Namenode can't restart due to corrupt edit logs, timing issue with shutdown and edit log rolling

[ https://issues.apache.org/jira/browse/HDFS-3771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-3771. -- Resolution: Won't Fix I'm resolving this as WONTFIX. It is not an issue in 2.0 and there is a

[jira] [Commented] (HDFS-4538) allow use of legacy blockreader

[ https://issues.apache.org/jira/browse/HDFS-4538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13620184#comment-13620184 ] Suresh Srinivas commented on HDFS-4538: --- I have not had time to read the patch in

[jira] [Commented] (HDFS-4538) allow use of legacy blockreader

[ https://issues.apache.org/jira/browse/HDFS-4538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13620225#comment-13620225 ] Colin Patrick McCabe commented on HDFS-4538: On March 5, you commented that you

[jira] [Commented] (HDFS-4548) Webhdfs doesn't renegotiate SPNEGO token

[ https://issues.apache.org/jira/browse/HDFS-4548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13620240#comment-13620240 ] Alejandro Abdelnur commented on HDFS-4548: -- If you have the following

[jira] [Commented] (HDFS-4538) allow use of legacy blockreader

[ https://issues.apache.org/jira/browse/HDFS-4538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13620252#comment-13620252 ] Suresh Srinivas commented on HDFS-4538: --- bq. On March 5, you commented that you would

[jira] [Commented] (HDFS-4538) allow use of legacy blockreader

[ https://issues.apache.org/jira/browse/HDFS-4538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13620270#comment-13620270 ] Suresh Srinivas commented on HDFS-4538: --- bq. I'm sad to hear that you still have not

[jira] [Updated] (HDFS-4659) Support setting execution bit for regular files

[ https://issues.apache.org/jira/browse/HDFS-4659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-4659: - Attachment: HDFS-4659.patch Support setting execution bit for regular files

[jira] [Commented] (HDFS-347) DFS read performance suboptimal when client co-located on nodes with data

[ https://issues.apache.org/jira/browse/HDFS-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13620277#comment-13620277 ] Suresh Srinivas commented on HDFS-347: -- bq. Colin,

[jira] [Commented] (HDFS-4659) Support setting execution bit for regular files

[ https://issues.apache.org/jira/browse/HDFS-4659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13620278#comment-13620278 ] Brandon Li commented on HDFS-4659: -- @Daryn, thanks for the hints. Here the change is not

[jira] [Updated] (HDFS-4538) allow use of legacy blockreader

[ https://issues.apache.org/jira/browse/HDFS-4538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4538: --- Hadoop Flags: Incompatible change,Reviewed (was: Reviewed) marking as incompatible

[jira] [Updated] (HDFS-4538) allow use of legacy blockreader

[ https://issues.apache.org/jira/browse/HDFS-4538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-4538: -- Release Note: Short circuit read mechanism enabled in HDFS-2246 will stop working with this

[jira] [Commented] (HDFS-347) DFS read performance suboptimal when client co-located on nodes with data

[ https://issues.apache.org/jira/browse/HDFS-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13620335#comment-13620335 ] Colin Patrick McCabe commented on HDFS-347: ---

[jira] [Created] (HDFS-4662) Unit test failure: TestFcHdfsSymlink

Brandon Li created HDFS-4662: Summary: Unit test failure: TestFcHdfsSymlink Key: HDFS-4662 URL: https://issues.apache.org/jira/browse/HDFS-4662 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-4662) Unit test failure: TestFcHdfsSymlink

[ https://issues.apache.org/jira/browse/HDFS-4662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13620343#comment-13620343 ] Brandon Li commented on HDFS-4662: -- Stack trace: {noformat} T E S T S

[jira] [Commented] (HDFS-4659) Support setting execution bit for regular files

[ https://issues.apache.org/jira/browse/HDFS-4659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13620350#comment-13620350 ] Daryn Sharp commented on HDFS-4659: --- I understand. However, the CLI tests appear to be

[jira] [Commented] (HDFS-4548) Webhdfs doesn't renegotiate SPNEGO token

[ https://issues.apache.org/jira/browse/HDFS-4548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13620383#comment-13620383 ] Daryn Sharp commented on HDFS-4548: --- bq. then the JDK does the renewal for you. that is

[jira] [Commented] (HDFS-4659) Support setting execution bit for regular files

[ https://issues.apache.org/jira/browse/HDFS-4659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13620386#comment-13620386 ] Hadoop QA commented on HDFS-4659: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-496) Use PureJavaCrc32 in HDFS

[ https://issues.apache.org/jira/browse/HDFS-496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-496: Fix Version/s: 1-win Merged this to branch-1-win. Use

[jira] [Updated] (HDFS-4659) Support setting execution bit for regular files

[ https://issues.apache.org/jira/browse/HDFS-4659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-4659: - Attachment: HDFS-4659.patch Support setting execution bit for regular files

[jira] [Commented] (HDFS-4659) Support setting execution bit for regular files

[ https://issues.apache.org/jira/browse/HDFS-4659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13620426#comment-13620426 ] Brandon Li commented on HDFS-4659: -- Previously TestHDFSCLI failed because it didn't expect

[jira] [Updated] (HDFS-4659) Support setting execution bit for regular files

[ https://issues.apache.org/jira/browse/HDFS-4659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-4659: - Hadoop Flags: Incompatible change Support setting execution bit for regular files

[jira] [Commented] (HDFS-4339) Persist inode id in fsimage and editlog

[ https://issues.apache.org/jira/browse/HDFS-4339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13620495#comment-13620495 ] Fengdong Yu commented on HDFS-4339: --- Pass all unit tests is not enough. It's better to

[jira] [Commented] (HDFS-4339) Persist inode id in fsimage and editlog

[ https://issues.apache.org/jira/browse/HDFS-4339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13620515#comment-13620515 ] Suresh Srinivas commented on HDFS-4339: --- bq. Pass all unit tests is not enough. It's

[jira] [Commented] (HDFS-4659) Support setting execution bit for regular files

[ https://issues.apache.org/jira/browse/HDFS-4659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13620525#comment-13620525 ] Hadoop QA commented on HDFS-4659: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-3068) RemoteBlockReader2 fails when using SocksSocketFactory

[ https://issues.apache.org/jira/browse/HDFS-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13620613#comment-13620613 ] Uma Maheswara Rao G commented on HDFS-3068: --- @Tom, How about fall back to old

[jira] [Commented] (HDFS-347) DFS read performance suboptimal when client co-located on nodes with data

[ https://issues.apache.org/jira/browse/HDFS-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13620632#comment-13620632 ] Tsz Wo (Nicholas), SZE commented on HDFS-347: - The patch

[jira] [Updated] (HDFS-4660) Duplicated checksum on DN in a recovered pipeline

[ https://issues.apache.org/jira/browse/HDFS-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] PengZhang updated HDFS-4660: Description: pipeline DN1 DN2 DN3 stop DN2 pipeline added node DN4 located at 2nd position DN1 DN4 DN3