[jira] [Commented] (HDFS-6450) Support non-positional hedged reads in HDFS

2015-03-05 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14349867#comment-14349867 ] Liang Xie commented on HDFS-6450: - Thanks [~zhz] for the comments, i am not active in this

[jira] [Resolved] (HDFS-7802) Reach xceiver limit once the watcherThread die

2015-02-16 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie resolved HDFS-7802. - Resolution: Duplicate sorry, close this jira, seems it should be in HADOOP catalogy not HDFS... > Reach xc

[jira] [Created] (HDFS-7802) Reach xceiver limit once the watcherThread die

2015-02-16 Thread Liang Xie (JIRA)
Liang Xie created HDFS-7802: --- Summary: Reach xceiver limit once the watcherThread die Key: HDFS-7802 URL: https://issues.apache.org/jira/browse/HDFS-7802 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-7763) fix zkfc hung issue due to not catching exception in a corner case

2015-02-11 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-7763: Attachment: HDFS-7763-002.txt How about v2, Colin? > fix zkfc hung issue due to not catching exception in a

[jira] [Commented] (HDFS-7763) fix zkfc hung issue due to not catching exception in a corner case

2015-02-10 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14315692#comment-14315692 ] Liang Xie commented on HDFS-7763: - The findbugs warning is not related with current fix: "I

[jira] [Updated] (HDFS-7763) fix zkfc hung issue due to not catching exception in a corner case

2015-02-10 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-7763: Attachment: HDFS-7763-001.txt > fix zkfc hung issue due to not catching exception in a corner case >

[jira] [Updated] (HDFS-7763) fix zkfc hung issue due to not catching exception in a corner case

2015-02-10 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-7763: Attachment: (was: HDFS-7763.txt) > fix zkfc hung issue due to not catching exception in a corner case > -

[jira] [Updated] (HDFS-7763) fix zkfc hung issue due to not catching exception in a corner case

2015-02-09 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-7763: Attachment: jstack.4936 HDFS-7763.txt > fix zkfc hung issue due to not catching exception in

[jira] [Updated] (HDFS-7763) fix zkfc hung issue due to not catching exception in a corner case

2015-02-09 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-7763: Status: Patch Available (was: Open) > fix zkfc hung issue due to not catching exception in a corner case > -

[jira] [Created] (HDFS-7763) fix zkfc hung issue due to not catching exception in a corner case

2015-02-09 Thread Liang Xie (JIRA)
Liang Xie created HDFS-7763: --- Summary: fix zkfc hung issue due to not catching exception in a corner case Key: HDFS-7763 URL: https://issues.apache.org/jira/browse/HDFS-7763 Project: Hadoop HDFS I

[jira] [Commented] (HDFS-7523) Setting a socket receive buffer size in DFSClient

2015-01-04 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14263788#comment-14263788 ] Liang Xie commented on HDFS-7523: - Hi [~saint@gmail.com], yes, let's just hold on right

[jira] [Commented] (HDFS-7523) Setting a socket receive buffer size in DFSClient

2014-12-30 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14260901#comment-14260901 ] Liang Xie commented on HDFS-7523: - let me report number once get change, and i think we als

[jira] [Assigned] (HDFS-7561) TestFetchImage should write fetched-image-dir under target.

2014-12-22 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie reassigned HDFS-7561: --- Assignee: Liang Xie > TestFetchImage should write fetched-image-dir under target. > --

[jira] [Updated] (HDFS-7561) TestFetchImage should write fetched-image-dir under target.

2014-12-22 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-7561: Attachment: HDFS-7561-002.txt > TestFetchImage should write fetched-image-dir under target. > ---

[jira] [Updated] (HDFS-7561) TestFetchImage should write fetched-image-dir under target.

2014-12-21 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-7561: Status: Patch Available (was: Open) > TestFetchImage should write fetched-image-dir under target. >

[jira] [Updated] (HDFS-7561) TestFetchImage should write fetched-image-dir under target.

2014-12-21 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-7561: Attachment: HDFS-7561-001.txt yes, the property should be "test.build.dir" instead of "build.test.dir":) How

[jira] [Updated] (HDFS-7553) fix the TestDFSUpgradeWithHA due to BindException

2014-12-19 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-7553: Status: Patch Available (was: Open) > fix the TestDFSUpgradeWithHA due to BindException > --

[jira] [Updated] (HDFS-7553) fix the TestDFSUpgradeWithHA due to BindException

2014-12-19 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-7553: Attachment: HDFS-7553-001.txt After this change, we can ensure HttpServer2.Builder call setFindPort(true), so

[jira] [Created] (HDFS-7553) fix the TestDFSUpgradeWithHA due to BindException

2014-12-19 Thread Liang Xie (JIRA)
Liang Xie created HDFS-7553: --- Summary: fix the TestDFSUpgradeWithHA due to BindException Key: HDFS-7553 URL: https://issues.apache.org/jira/browse/HDFS-7553 Project: Hadoop HDFS Issue Type: Test

[jira] [Commented] (HDFS-7443) Datanode upgrade to BLOCKID_BASED_LAYOUT fails if duplicate block files are present in the same volume

2014-12-18 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14253104#comment-14253104 ] Liang Xie commented on HDFS-7443: - HDFS-6931 introduced a resolveDuplicateReplicas to handl

[jira] [Updated] (HDFS-7552) change FsVolumeList toString() to fix TestDataNodeVolumeFailureToleration

2014-12-18 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-7552: Status: Patch Available (was: Open) [~eddyxu] [~cmccabe] [~wheat9] mind taking a look at it? thanks > chang

[jira] [Updated] (HDFS-7552) change FsVolumeList toString() to fix TestDataNodeVolumeFailureToleration

2014-12-18 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-7552: Attachment: HDFS-7552-001.txt > change FsVolumeList toString() to fix TestDataNodeVolumeFailureToleration >

[jira] [Created] (HDFS-7552) change FsVolumeList toString() to fix TestDataNodeVolumeFailureToleration

2014-12-18 Thread Liang Xie (JIRA)
Liang Xie created HDFS-7552: --- Summary: change FsVolumeList toString() to fix TestDataNodeVolumeFailureToleration Key: HDFS-7552 URL: https://issues.apache.org/jira/browse/HDFS-7552 Project: Hadoop HDFS

[jira] [Commented] (HDFS-7523) Setting a socket receive buffer size in DFSClient

2014-12-18 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14252877#comment-14252877 ] Liang Xie commented on HDFS-7523: - oops, missing say: TestDFSClientRetries was still not tr

[jira] [Updated] (HDFS-7551) Fix the new findbugs warning from TransferFsImage

2014-12-18 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-7551: Attachment: HDFS-7551-002.txt manually edit the patch, hopefully it's ok now:) > Fix the new findbugs warnin

[jira] [Commented] (HDFS-7551) Fix the new findbugs warning from TransferFsImage

2014-12-18 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14252872#comment-14252872 ] Liang Xie commented on HDFS-7551: - Oops, seems i used another project's style, will fix it

[jira] [Commented] (HDFS-7523) Setting a socket receive buffer size in DFSClient

2014-12-18 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14252865#comment-14252865 ] Liang Xie commented on HDFS-7523: - for the findbugs warning and failed case, it's not relat

[jira] [Commented] (HDFS-7373) Clean up temporary files after fsimage transfer failures

2014-12-18 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14252821#comment-14252821 ] Liang Xie commented on HDFS-7373: - [~kihwal], if i am not wrong, there really is a new find

[jira] [Updated] (HDFS-7551) Fix the new findbugs warning from TransferFsImage

2014-12-18 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-7551: Status: Patch Available (was: Open) > Fix the new findbugs warning from TransferFsImage > --

[jira] [Updated] (HDFS-7551) Fix the new findbugs warning from TransferFsImage

2014-12-18 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-7551: Attachment: HDFS-7551-001.txt I just noticed it while working at HDFS-7523 > Fix the new findbugs warning fr

[jira] [Created] (HDFS-7551) Fix the new findbugs warning from TransferFsImage

2014-12-18 Thread Liang Xie (JIRA)
Liang Xie created HDFS-7551: --- Summary: Fix the new findbugs warning from TransferFsImage Key: HDFS-7551 URL: https://issues.apache.org/jira/browse/HDFS-7551 Project: Hadoop HDFS Issue Type: Improve

[jira] [Updated] (HDFS-7523) Setting a socket receive buffer size in DFSClient

2014-12-15 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-7523: Attachment: HDFS-7523-001.txt Attached a small patch. similiar with the writing stuff in DFSOutputStream: {co

[jira] [Updated] (HDFS-7523) Setting a socket receive buffer size in DFSClient

2014-12-15 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-7523: Status: Patch Available (was: Open) > Setting a socket receive buffer size in DFSClient > --

[jira] [Created] (HDFS-7523) Setting a socket receive buffer size in DFSClient

2014-12-15 Thread Liang Xie (JIRA)
Liang Xie created HDFS-7523: --- Summary: Setting a socket receive buffer size in DFSClient Key: HDFS-7523 URL: https://issues.apache.org/jira/browse/HDFS-7523 Project: Hadoop HDFS Issue Type: Improve

[jira] [Updated] (HDFS-6827) Both NameNodes could be in STANDBY State due to HealthMonitor not aware of the target's status changing sometimes

2014-08-12 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6827: Summary: Both NameNodes could be in STANDBY State due to HealthMonitor not aware of the target's status chan

[jira] [Updated] (HDFS-6800) Determine how Datanode layout changes should interact with rolling upgrade

2014-08-01 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6800: Summary: Determine how Datanode layout changes should interact with rolling upgrade (was: Detemine how Data

[jira] [Commented] (HDFS-289) HDFS should blacklist datanodes that are not performing well

2014-07-30 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14079048#comment-14079048 ] Liang Xie commented on HDFS-289: We just hit a HBase write performance degradation several d

[jira] [Commented] (HDFS-6766) optimize ack notify mechanism to avoid thundering herd issue

2014-07-29 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078791#comment-14078791 ] Liang Xie commented on HDFS-6766: - bq. should be the condition timeout configurable Per my

[jira] [Commented] (HDFS-6766) optimize ack notify mechanism to avoid thundering herd issue

2014-07-29 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078790#comment-14078790 ] Liang Xie commented on HDFS-6766: - The failed TestBalancer was not related with current pat

[jira] [Updated] (HDFS-6766) optimize ack notify mechanism to avoid thundering herd issue

2014-07-29 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6766: Status: Patch Available (was: Open) > optimize ack notify mechanism to avoid thundering herd issue > --

[jira] [Updated] (HDFS-6766) optimize ack notify mechanism to avoid thundering herd issue

2014-07-29 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6766: Attachment: HDFS-6766.txt > optimize ack notify mechanism to avoid thundering herd issue > -

[jira] [Created] (HDFS-6766) optimize ack notify mechanism to avoid thundering herd issue

2014-07-29 Thread Liang Xie (JIRA)
Liang Xie created HDFS-6766: --- Summary: optimize ack notify mechanism to avoid thundering herd issue Key: HDFS-6766 URL: https://issues.apache.org/jira/browse/HDFS-6766 Project: Hadoop HDFS Issue T

[jira] [Commented] (HDFS-6735) A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStream

2014-07-23 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14071655#comment-14071655 ] Liang Xie commented on HDFS-6735: - The failed TestPipelinesFailover & TestNamenodeCapacityR

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-07-23 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14071475#comment-14071475 ] Liang Xie commented on HDFS-6698: - TestPipelinesFailover probably is due to ulimit setting,

[jira] [Updated] (HDFS-6735) A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStream

2014-07-23 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6735: Attachment: HDFS-6735-v2.txt > A minor optimization to avoid pread() be blocked by read() inside the same >

[jira] [Commented] (HDFS-6735) A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStream

2014-07-23 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14071440#comment-14071440 ] Liang Xie commented on HDFS-6735: - bq. I'd think you'd want a comment at least in LocatedBl

[jira] [Commented] (HDFS-6735) A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStream

2014-07-22 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14071409#comment-14071409 ] Liang Xie commented on HDFS-6735: - bq. We'd not check in the test since it does not assert

[jira] [Updated] (HDFS-6735) A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStream

2014-07-22 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6735: Description: In current DFSInputStream impl, there're a couple of coarser-grained locks in read/pread path,

[jira] [Commented] (HDFS-6735) A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStream

2014-07-22 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14071335#comment-14071335 ] Liang Xie commented on HDFS-6735: - This patch includes HDFS-6698 already. With the source c

[jira] [Updated] (HDFS-6735) A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStream

2014-07-22 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6735: Attachment: HDFS-6735.txt > A minor optimization to avoid pread() be blocked by read() inside the same > DF

[jira] [Updated] (HDFS-6735) A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStream

2014-07-22 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6735: Status: Patch Available (was: Open) > A minor optimization to avoid pread() be blocked by read() inside the

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-07-22 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14071316#comment-14071316 ] Liang Xie commented on HDFS-6698: - Any thoughts, [~stack]? > try to optimize DFSInputStrea

[jira] [Updated] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-07-22 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6698: Issue Type: Sub-task (was: Improvement) Parent: HDFS-6735 > try to optimize DFSInputStream.getFileL

[jira] [Created] (HDFS-6735) A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStream

2014-07-22 Thread Liang Xie (JIRA)
Liang Xie created HDFS-6735: --- Summary: A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStream Key: HDFS-6735 URL: https://issues.apache.org/jira/browse/HDFS-6735 Project:

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-07-21 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14068467#comment-14068467 ] Liang Xie commented on HDFS-6698: - Those three failure cases are not related with current p

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-07-21 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14068361#comment-14068361 ] Liang Xie commented on HDFS-6698: - In normal situation, The HFiles which all of HBase (p)re

[jira] [Updated] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-07-21 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6698: Attachment: HDFS-6698.txt > try to optimize DFSInputStream.getFileLength() > ---

[jira] [Updated] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-07-21 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6698: Status: Patch Available (was: Open) > try to optimize DFSInputStream.getFileLength() >

[jira] [Commented] (HDFS-6450) Support non-positional hedged reads in HDFS

2014-07-18 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066126#comment-14066126 ] Liang Xie commented on HDFS-6450: - bq. How is testHedgedReadBasic exercising the new functi

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-07-17 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14065990#comment-14065990 ] Liang Xie commented on HDFS-6698: - bq. Makes sense Liang Xie You see this as prob in prod?

[jira] [Commented] (HDFS-6450) Support non-positional hedged reads in HDFS

2014-07-16 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064564#comment-14064564 ] Liang Xie commented on HDFS-6450: - bq. I think in the short term, applications will have t

[jira] [Created] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-07-16 Thread Liang Xie (JIRA)
Liang Xie created HDFS-6698: --- Summary: try to optimize DFSInputStream.getFileLength() Key: HDFS-6698 URL: https://issues.apache.org/jira/browse/HDFS-6698 Project: Hadoop HDFS Issue Type: Improvemen

[jira] [Commented] (HDFS-6695) Investigate using Java 7's nonblocking file I/O in BlockReaderLocal to implement read timeouts

2014-07-16 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064550#comment-14064550 ] Liang Xie commented on HDFS-6695: - I did not look through AsynchronousfileChannel impl, but

[jira] [Commented] (HDFS-6450) Support non-positional hedged reads in HDFS

2014-07-14 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14061760#comment-14061760 ] Liang Xie commented on HDFS-6450: - After a deep looking, it's kind of hard to reuse/maintai

[jira] [Updated] (HDFS-6656) flakey TestProcessCorruptBlocks#testByAddingAnExtraDataNode

2014-07-10 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6656: Attachment: PreCommit-HDFS-Build #7320 test - testByAddingAnExtraDataNode [Jenkins].html > flakey TestProce

[jira] [Created] (HDFS-6656) flakey TestProcessCorruptBlocks#testByAddingAnExtraDataNode

2014-07-10 Thread Liang Xie (JIRA)
Liang Xie created HDFS-6656: --- Summary: flakey TestProcessCorruptBlocks#testByAddingAnExtraDataNode Key: HDFS-6656 URL: https://issues.apache.org/jira/browse/HDFS-6656 Project: Hadoop HDFS Issue Ty

[jira] [Updated] (HDFS-6450) Support non-positional hedged reads in HDFS

2014-07-09 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6450: Attachment: HDFS-6450-like-pread.txt > Support non-positional hedged reads in HDFS > ---

[jira] [Updated] (HDFS-6450) Support non-positional hedged reads in HDFS

2014-07-09 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6450: Attachment: (was: HDFS-6450-like-pread.txt) > Support non-positional hedged reads in HDFS >

[jira] [Updated] (HDFS-6631) TestPread#testHedgedReadLoopTooManyTimes fails intermittently.

2014-07-09 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6631: Attachment: HDFS-6631.txt emm, why QA complain couldn't compile, i verified again it works. let me remove

[jira] [Updated] (HDFS-6631) TestPread#testHedgedReadLoopTooManyTimes fails intermittently.

2014-07-09 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6631: Attachment: (was: HDFS-6631.txt) > TestPread#testHedgedReadLoopTooManyTimes fails intermittently. >

[jira] [Assigned] (HDFS-6631) TestPread#testHedgedReadLoopTooManyTimes fails intermittently.

2014-07-09 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie reassigned HDFS-6631: --- Assignee: Liang Xie > TestPread#testHedgedReadLoopTooManyTimes fails intermittently. > ---

[jira] [Commented] (HDFS-6631) TestPread#testHedgedReadLoopTooManyTimes fails intermittently.

2014-07-09 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056019#comment-14056019 ] Liang Xie commented on HDFS-6631: - I just uploaded a tentitive patch, [~cnauroth], could yo

[jira] [Updated] (HDFS-6631) TestPread#testHedgedReadLoopTooManyTimes fails intermittently.

2014-07-09 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6631: Status: Patch Available (was: Open) > TestPread#testHedgedReadLoopTooManyTimes fails intermittently. >

[jira] [Updated] (HDFS-6631) TestPread#testHedgedReadLoopTooManyTimes fails intermittently.

2014-07-09 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6631: Attachment: HDFS-6631.txt > TestPread#testHedgedReadLoopTooManyTimes fails intermittently. > ---

[jira] [Commented] (HDFS-6631) TestPread#testHedgedReadLoopTooManyTimes fails intermittently.

2014-07-09 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056006#comment-14056006 ] Liang Xie commented on HDFS-6631: - I see, compared with my dev box logfile, found inside at

[jira] [Commented] (HDFS-6614) shorten TestPread run time with a smaller retry timeout setting

2014-07-08 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14054814#comment-14054814 ] Liang Xie commented on HDFS-6614: - Filed HDFS-6638, since this tuning tips could optimize o

[jira] [Commented] (HDFS-6638) shorten test run time with a smaller retry timeout setting

2014-07-08 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14054813#comment-14054813 ] Liang Xie commented on HDFS-6638: - with attached patch, we could reduce more than 2.5 minut

[jira] [Updated] (HDFS-6638) shorten test run time with a smaller retry timeout setting

2014-07-08 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6638: Status: Patch Available (was: Open) > shorten test run time with a smaller retry timeout setting >

[jira] [Updated] (HDFS-6638) shorten test run time with a smaller retry timeout setting

2014-07-08 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6638: Attachment: HDFS-6638.txt > shorten test run time with a smaller retry timeout setting > ---

[jira] [Created] (HDFS-6638) shorten test run time with a smaller retry timeout setting

2014-07-08 Thread Liang Xie (JIRA)
Liang Xie created HDFS-6638: --- Summary: shorten test run time with a smaller retry timeout setting Key: HDFS-6638 URL: https://issues.apache.org/jira/browse/HDFS-6638 Project: Hadoop HDFS Issue Type

[jira] [Commented] (HDFS-6631) TestPread#testHedgedReadLoopTooManyTimes fails intermittently.

2014-07-08 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14054655#comment-14054655 ] Liang Xie commented on HDFS-6631: - I could not repro on my dev box so far. probably it rel

[jira] [Commented] (HDFS-6614) shorten TestPread run time with a smaller retry timeout setting

2014-07-07 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14054487#comment-14054487 ] Liang Xie commented on HDFS-6614: - [~cnauroth] you are right, i remade an addendum patch, r

[jira] [Updated] (HDFS-6614) shorten TestPread run time with a smaller retry timeout setting

2014-07-07 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6614: Attachment: HDFS-6614-addmium.txt > shorten TestPread run time with a smaller retry timeout setting > --

[jira] [Updated] (HDFS-6614) shorten TestPread run time with a smaller retry timeout setting

2014-07-07 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6614: Attachment: (was: HDFS-6614-addmium.txt) > shorten TestPread run time with a smaller retry timeout setti

[jira] [Updated] (HDFS-6450) Support non-positional hedged reads in HDFS

2014-07-07 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6450: Status: Patch Available (was: Open) > Support non-positional hedged reads in HDFS > ---

[jira] [Updated] (HDFS-6450) Support non-positional hedged reads in HDFS

2014-07-07 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6450: Attachment: HDFS-6450-like-pread.txt Attached is a preliminary patch similar with pread() doing, means creat

[jira] [Commented] (HDFS-6450) Support non-positional hedged reads in HDFS

2014-07-06 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14053324#comment-14053324 ] Liang Xie commented on HDFS-6450: - [~cmccabe] [~saint@gmail.com] I made a prototype alr

[jira] [Commented] (HDFS-6614) shorten TestPread run time with a smaller retry timeout setting

2014-07-04 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14052313#comment-14052313 ] Liang Xie commented on HDFS-6614: - [~cnauroth], i found still had several non-zero waiting

[jira] [Updated] (HDFS-6614) shorten TestPread run time with a smaller retry timeout setting

2014-07-04 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6614: Attachment: HDFS-6614-addmium.txt > shorten TestPread run time with a smaller retry timeout setting > --

[jira] [Updated] (HDFS-6627) getReplicaVisibleLength() should do checkReadAccess insteading of checkWriteAccess

2014-07-03 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6627: Status: Patch Available (was: Open) > getReplicaVisibleLength() should do checkReadAccess insteading of >

[jira] [Updated] (HDFS-6627) getReplicaVisibleLength() should do checkReadAccess insteading of checkWriteAccess

2014-07-03 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6627: Attachment: HDFS-6627.txt > getReplicaVisibleLength() should do checkReadAccess insteading of > checkWriteA

[jira] [Created] (HDFS-6627) getReplicaVisibleLength() should do checkReadAccess insteading of checkWriteAccess

2014-07-03 Thread Liang Xie (JIRA)
Liang Xie created HDFS-6627: --- Summary: getReplicaVisibleLength() should do checkReadAccess insteading of checkWriteAccess Key: HDFS-6627 URL: https://issues.apache.org/jira/browse/HDFS-6627 Project: Hadoop

[jira] [Commented] (HDFS-6614) shorten TestPread run time with a smaller retry timeout setting

2014-07-03 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14051293#comment-14051293 ] Liang Xie commented on HDFS-6614: - bq. I did discover that the new testHedgedReadLoopTooMa

[jira] [Commented] (HDFS-6617) Flake TestDFSZKFailoverController.testManualFailoverWithDFSHAAdmin due to a long edit log sync op

2014-07-03 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14051286#comment-14051286 ] Liang Xie commented on HDFS-6617: - [~cnauroth], the above suggestion should be better defin

[jira] [Updated] (HDFS-6617) Flake TestDFSZKFailoverController.testManualFailoverWithDFSHAAdmin due to a long edit log sync op

2014-07-03 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6617: Attachment: HDFS-6617-v2.txt > Flake TestDFSZKFailoverController.testManualFailoverWithDFSHAAdmin due to a

[jira] [Commented] (HDFS-6624) TestBlockTokenWithDFS#testEnd2End fails sometimes

2014-07-03 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14051183#comment-14051183 ] Liang Xie commented on HDFS-6624: - It should be related with the chooseExcessReplicates beh

[jira] [Updated] (HDFS-6617) Flake TestDFSZKFailoverController.testManualFailoverWithDFSHAAdmin due to a long edit log sync op

2014-07-01 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6617: Description: Just Hit a false alarm testing while working at HDFS-6614, see https://builds.apache.org/job/

[jira] [Updated] (HDFS-6617) Flake TestDFSZKFailoverController.testManualFailoverWithDFSHAAdmin due to a long edit log sync op

2014-07-01 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6617: Status: Patch Available (was: Open) > Flake TestDFSZKFailoverController.testManualFailoverWithDFSHAAdmin du

[jira] [Updated] (HDFS-6617) Flake TestDFSZKFailoverController.testManualFailoverWithDFSHAAdmin due to a long edit log sync op

2014-07-01 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6617: Attachment: HDFS-6617.txt > Flake TestDFSZKFailoverController.testManualFailoverWithDFSHAAdmin due to a > l

[jira] [Created] (HDFS-6617) Flake TestDFSZKFailoverController.testManualFailoverWithDFSHAAdmin due to a long edit log sync op

2014-07-01 Thread Liang Xie (JIRA)
Liang Xie created HDFS-6617: --- Summary: Flake TestDFSZKFailoverController.testManualFailoverWithDFSHAAdmin due to a long edit log sync op Key: HDFS-6617 URL: https://issues.apache.org/jira/browse/HDFS-6617

  1   2   3   4   >