[jira] [Commented] (HDFS-119) logSync() may block NameNode forever.

[ https://issues.apache.org/jira/browse/HDFS-119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13253229#comment-13253229 ] Konstantin Shvachko commented on HDFS-119: -- Committed to branch 1.

[jira] [Commented] (HDFS-2983) Relax the build version check to permit rolling upgrades within a release

[ https://issues.apache.org/jira/browse/HDFS-2983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13252271#comment-13252271 ] Konstantin Shvachko commented on HDFS-2983: --- To clarify my point for the record.

[jira] [Commented] (HDFS-119) logSync() may block NameNode forever.

[ https://issues.apache.org/jira/browse/HDFS-119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13252259#comment-13252259 ] Konstantin Shvachko commented on HDFS-119: -- > (nit: the indent seems not aligned)

[jira] [Commented] (HDFS-2983) Relax the build version check to permit rolling upgrades within a release

[ https://issues.apache.org/jira/browse/HDFS-2983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13251148#comment-13251148 ] Konstantin Shvachko commented on HDFS-2983: --- Yes that summarizes what I was askin

[jira] [Commented] (HDFS-119) logSync() may block NameNode forever.

[ https://issues.apache.org/jira/browse/HDFS-119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13250965#comment-13250965 ] Konstantin Shvachko commented on HDFS-119: -- Tested this with a small partition setu

[jira] [Commented] (HDFS-2983) Relax the build version check to permit rolling upgrades within a release

[ https://issues.apache.org/jira/browse/HDFS-2983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13250943#comment-13250943 ] Konstantin Shvachko commented on HDFS-2983: --- The scenario is not different if you

[jira] [Commented] (HDFS-2983) Relax the build version check to permit rolling upgrades within a release

[ https://issues.apache.org/jira/browse/HDFS-2983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13250364#comment-13250364 ] Konstantin Shvachko commented on HDFS-2983: --- Yes, ctime will prevent DNs from pre

[jira] [Commented] (HDFS-2983) Relax the build version check to permit rolling upgrades within a release

[ https://issues.apache.org/jira/browse/HDFS-2983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13250001#comment-13250001 ] Konstantin Shvachko commented on HDFS-2983: --- I'd like to reiterate on Sanjay's po

[jira] [Commented] (HDFS-119) logSync() may block NameNode forever.

[ https://issues.apache.org/jira/browse/HDFS-119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249107#comment-13249107 ] Konstantin Shvachko commented on HDFS-119: -- This has never been ported to 0.20. And

[jira] [Commented] (HDFS-798) Exclude second Ant JAR from classpath in hdfs builds

[ https://issues.apache.org/jira/browse/HDFS-798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13243922#comment-13243922 ] Konstantin Shvachko commented on HDFS-798: -- I think so, yes. > Exc

[jira] [Commented] (HDFS-798) Exclude second Ant JAR from classpath in hdfs builds

[ https://issues.apache.org/jira/browse/HDFS-798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13243599#comment-13243599 ] Konstantin Shvachko commented on HDFS-798: -- I agree with Steve, building in eclipse

[jira] [Commented] (HDFS-1601) Pipeline ACKs are sent as lots of tiny TCP packets

[ https://issues.apache.org/jira/browse/HDFS-1601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13229543#comment-13229543 ] Konstantin Shvachko commented on HDFS-1601: --- I just committed this to 0.22. Thank

[jira] [Commented] (HDFS-1601) Pipeline ACKs are sent as lots of tiny TCP packets

[ https://issues.apache.org/jira/browse/HDFS-1601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13228652#comment-13228652 ] Konstantin Shvachko commented on HDFS-1601: --- Makes sense to have in 0.22. Patch l

[jira] [Commented] (HDFS-2288) Replicas awaiting recovery should return a full visible length

[ https://issues.apache.org/jira/browse/HDFS-2288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13225956#comment-13225956 ] Konstantin Shvachko commented on HDFS-2288: --- > My understanding of visible length

[jira] [Commented] (HDFS-2991) failure to load edits: ClassCastException

[ https://issues.apache.org/jira/browse/HDFS-2991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13218967#comment-13218967 ] Konstantin Shvachko commented on HDFS-2991: --- Looks good +1 > fai

[jira] [Commented] (HDFS-3028) DFS rollback broken

[ https://issues.apache.org/jira/browse/HDFS-3028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13218791#comment-13218791 ] Konstantin Shvachko commented on HDFS-3028: --- Based on the exception message "Repo

[jira] [Commented] (HDFS-2991) failure to load edits: ClassCastException

[ https://issues.apache.org/jira/browse/HDFS-2991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13215000#comment-13215000 ] Konstantin Shvachko commented on HDFS-2991: --- > The patch actually removes logOpen

[jira] [Commented] (HDFS-2991) failure to load edits: ClassCastException

[ https://issues.apache.org/jira/browse/HDFS-2991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13214961#comment-13214961 ] Konstantin Shvachko commented on HDFS-2991: --- (1) should read the other way around

[jira] [Commented] (HDFS-1623) High Availability Framework for HDFS NN

[ https://issues.apache.org/jira/browse/HDFS-1623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13210132#comment-13210132 ] Konstantin Shvachko commented on HDFS-1623: --- I'd recommend 2 series of DFSIO cons

[jira] [Commented] (HDFS-1623) High Availability Framework for HDFS NN

[ https://issues.apache.org/jira/browse/HDFS-1623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13208269#comment-13208269 ] Konstantin Shvachko commented on HDFS-1623: --- Both test plans look good and compli

[jira] [Commented] (HDFS-1623) High Availability Framework for HDFS NN

[ https://issues.apache.org/jira/browse/HDFS-1623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13204739#comment-13204739 ] Konstantin Shvachko commented on HDFS-1623: --- # What test plan has been executed f

[jira] [Commented] (HDFS-2718) Optimize OP_ADD in edits loading

[ https://issues.apache.org/jira/browse/HDFS-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199535#comment-13199535 ] Konstantin Shvachko commented on HDFS-2718: --- Intended to fix CreateEditLogs in a

[jira] [Commented] (HDFS-2718) Optimize OP_ADD in edits loading

[ https://issues.apache.org/jira/browse/HDFS-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199330#comment-13199330 ] Konstantin Shvachko commented on HDFS-2718: --- Glad to have your attention, Todd. W

[jira] [Commented] (HDFS-2877) If locking of a storage dir fails, it will remove the other NN's lock file on exit

[ https://issues.apache.org/jira/browse/HDFS-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198624#comment-13198624 ] Konstantin Shvachko commented on HDFS-2877: --- As for the unit test. I thought it s

[jira] [Commented] (HDFS-2718) Optimize OP_ADD in edits loading

[ https://issues.apache.org/jira/browse/HDFS-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13197962#comment-13197962 ] Konstantin Shvachko commented on HDFS-2718: --- If there are no more comments I'll c

[jira] [Commented] (HDFS-2718) Optimize OP_ADD in edits loading

[ https://issues.apache.org/jira/browse/HDFS-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13196796#comment-13196796 ] Konstantin Shvachko commented on HDFS-2718: --- Findbugs is the same GetConf. TestFS

[jira] [Commented] (HDFS-2718) Optimize OP_ADD in edits loading

[ https://issues.apache.org/jira/browse/HDFS-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13196647#comment-13196647 ] Konstantin Shvachko commented on HDFS-2718: --- Thanks guys for the reviews. JP> it

[jira] [Commented] (HDFS-2718) Optimize OP_ADD in edits loading

[ https://issues.apache.org/jira/browse/HDFS-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13191789#comment-13191789 ] Konstantin Shvachko commented on HDFS-2718: --- Checked findBugs warning. It is beca

[jira] [Commented] (HDFS-1910) when dfs.name.dir and dfs.name.edits.dir are same fsimage will be saved twice every time

[ https://issues.apache.org/jira/browse/HDFS-1910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13182881#comment-13182881 ] Konstantin Shvachko commented on HDFS-1910: --- I will commit it to 1.1 as you guys

[jira] [Commented] (HDFS-2698) BackupNode is downloading image from NameNode for every checkpoint

[ https://issues.apache.org/jira/browse/HDFS-2698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13176849#comment-13176849 ] Konstantin Shvachko commented on HDFS-2698: --- I ran tests. All passed.

[jira] [Commented] (HDFS-1910) when dfs.name.dir and dfs.name.edits.dir are same fsimage will be saved twice every time

[ https://issues.apache.org/jira/browse/HDFS-1910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13176847#comment-13176847 ] Konstantin Shvachko commented on HDFS-1910: --- Sorry had a bad commit day here. I d

[jira] [Commented] (HDFS-2698) BackupNode is downloading image from NameNode for every checkpoint

[ https://issues.apache.org/jira/browse/HDFS-2698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13175529#comment-13175529 ] Konstantin Shvachko commented on HDFS-2698: --- This is specific for 0.22 as trunk d

[jira] [Commented] (HDFS-2712) setTimes should support only for files and move the atime field down to iNodeFile.

[ https://issues.apache.org/jira/browse/HDFS-2712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13174353#comment-13174353 ] Konstantin Shvachko commented on HDFS-2712: --- IllegalArgumentException is a Runtim

[jira] [Commented] (HDFS-2436) FSNamesystem.setTimes(..) expects the path is a file.

[ https://issues.apache.org/jira/browse/HDFS-2436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13173905#comment-13173905 ] Konstantin Shvachko commented on HDFS-2436: --- And sorry for coming late.

[jira] [Commented] (HDFS-2436) FSNamesystem.setTimes(..) expects the path is a file.

[ https://issues.apache.org/jira/browse/HDFS-2436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13173904#comment-13173904 ] Konstantin Shvachko commented on HDFS-2436: --- Guys, accesTime and modificationTime

[jira] [Commented] (HDFS-2698) BackupNode is downloading image from NameNode for every checkpoint

[ https://issues.apache.org/jira/browse/HDFS-2698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13171390#comment-13171390 ] Konstantin Shvachko commented on HDFS-2698: --- This is because NN calles {{FSImage.

[jira] [Commented] (HDFS-2602) Standby needs to maintain BlockInfo while following edits

[ https://issues.apache.org/jira/browse/HDFS-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13170429#comment-13170429 ] Konstantin Shvachko commented on HDFS-2602: --- The issues are tightly related, and

[jira] [Commented] (HDFS-2602) Standby needs to maintain BlockInfo while following edits

[ https://issues.apache.org/jira/browse/HDFS-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13170086#comment-13170086 ] Konstantin Shvachko commented on HDFS-2602: --- I was observing the same issue. And

[jira] [Commented] (HDFS-1910) when dfs.name.dir and dfs.name.edits.dir are same fsimage will be saved twice every time

[ https://issues.apache.org/jira/browse/HDFS-1910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13159678#comment-13159678 ] Konstantin Shvachko commented on HDFS-1910: --- This is indeed a critical issue, whi

[jira] [Commented] (HDFS-2605) CHANGES.txt has two "Release 0.21.1" sections

[ https://issues.apache.org/jira/browse/HDFS-2605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13159585#comment-13159585 ] Konstantin Shvachko commented on HDFS-2605: --- Some issues could have been placed u

[jira] [Commented] (HDFS-2287) TestParallelRead has a small off-by-one bug

[ https://issues.apache.org/jira/browse/HDFS-2287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13156360#comment-13156360 ] Konstantin Shvachko commented on HDFS-2287: --- Todd, you fixed the first assert in

[jira] [Commented] (HDFS-2498) TestParallelRead times out consistently on Jenkins

[ https://issues.apache.org/jira/browse/HDFS-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13156353#comment-13156353 ] Konstantin Shvachko commented on HDFS-2498: --- This is Apache Jenkins. Here is how

[jira] [Commented] (HDFS-2498) TestParallelRead times out consistently on Jenkins

[ https://issues.apache.org/jira/browse/HDFS-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13156343#comment-13156343 ] Konstantin Shvachko commented on HDFS-2498: --- You are right, Todd. I'll incorporat

[jira] [Commented] (HDFS-2498) TestParallelRead times out consistently on Jenkins

[ https://issues.apache.org/jira/browse/HDFS-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13156308#comment-13156308 ] Konstantin Shvachko commented on HDFS-2498: --- See the following assert in the logs

[jira] [Commented] (HDFS-2514) Link resolution bug for intermediate symlinks with relative targets

[ https://issues.apache.org/jira/browse/HDFS-2514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13153967#comment-13153967 ] Konstantin Shvachko commented on HDFS-2514: --- I think the approach to return absol

[jira] [Commented] (HDFS-2573) TestFiDataXceiverServer is failing, not testing OOME

[ https://issues.apache.org/jira/browse/HDFS-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13153885#comment-13153885 ] Konstantin Shvachko commented on HDFS-2573: --- Agreed. +1 for the patch.

[jira] [Commented] (HDFS-2573) TestFiDataXceiverServer is failing, not testing OOME

[ https://issues.apache.org/jira/browse/HDFS-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13153877#comment-13153877 ] Konstantin Shvachko commented on HDFS-2573: --- I was thinking along these lines, bu

[jira] [Commented] (HDFS-2573) TestFiDataXceiverServer is failing, not testing OOME

[ https://issues.apache.org/jira/browse/HDFS-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13153860#comment-13153860 ] Konstantin Shvachko commented on HDFS-2573: --- The test was introduced in HDFS-2451

[jira] [Commented] (HDFS-2513) Bump jetty to 6.1.26

[ https://issues.apache.org/jira/browse/HDFS-2513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13150946#comment-13150946 ] Konstantin Shvachko commented on HDFS-2513: --- +1 > Bump jetty to

[jira] [Commented] (HDFS-2002) Incorrect computation of needed blocks in getTurnOffTip()

[ https://issues.apache.org/jira/browse/HDFS-2002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13141015#comment-13141015 ] Konstantin Shvachko commented on HDFS-2002: --- +1 test failures are not related to

[jira] [Commented] (HDFS-2285) BackupNode should reject requests trying to modify namespace

[ https://issues.apache.org/jira/browse/HDFS-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13139736#comment-13139736 ] Konstantin Shvachko commented on HDFS-2285: --- > we can not file any separate jiras

[jira] [Commented] (HDFS-2477) Optimize computing the diff between a block report and the namenode state.

[ https://issues.apache.org/jira/browse/HDFS-2477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13139431#comment-13139431 ] Konstantin Shvachko commented on HDFS-2477: --- Looks very good. +1

[jira] [Commented] (HDFS-1108) Log newly allocated blocks

[ https://issues.apache.org/jira/browse/HDFS-1108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13138791#comment-13138791 ] Konstantin Shvachko commented on HDFS-1108: --- I remove my veto. Thanks for address

[jira] [Commented] (HDFS-2452) OutOfMemoryError in DataXceiverServer takes down the DataNode

[ https://issues.apache.org/jira/browse/HDFS-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13136364#comment-13136364 ] Konstantin Shvachko commented on HDFS-2452: --- Sorry guys, everything is ok. I was

[jira] [Commented] (HDFS-2452) OutOfMemoryError in DataXceiverServer takes down the DataNode

[ https://issues.apache.org/jira/browse/HDFS-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13135712#comment-13135712 ] Konstantin Shvachko commented on HDFS-2452: --- As Jakob noted to me the patch that

[jira] [Commented] (HDFS-2285) BackupNode should reject requests trying to modify namespace

[ https://issues.apache.org/jira/browse/HDFS-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13135409#comment-13135409 ] Konstantin Shvachko commented on HDFS-2285: --- Uma any progress on this? We should

[jira] [Commented] (HDFS-1900) Use the block size key defined by common

[ https://issues.apache.org/jira/browse/HDFS-1900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13135301#comment-13135301 ] Konstantin Shvachko commented on HDFS-1900: --- I think "dfs.block.size" introduced

[jira] [Commented] (HDFS-2477) Optimize computing the diff between a block report and the namenode state.

[ https://issues.apache.org/jira/browse/HDFS-2477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134814#comment-13134814 ] Konstantin Shvachko commented on HDFS-2477: --- Tomasz, as I understand your intenti

[jira] [Commented] (HDFS-2452) OutOfMemoryError in DataXceiverServer takes down the DataNode

[ https://issues.apache.org/jira/browse/HDFS-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13133731#comment-13133731 ] Konstantin Shvachko commented on HDFS-2452: --- I just committed this to trun and br

[jira] [Commented] (HDFS-2012) Recurring failure of TestBalancer due to incorrect treatment of nodes whose utilization equals avgUtilization.

[ https://issues.apache.org/jira/browse/HDFS-2012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13133150#comment-13133150 ] Konstantin Shvachko commented on HDFS-2012: --- Yes, we missed it. Open another jira

[jira] [Commented] (HDFS-2452) OutOfMemoryError in DataXceiverServer takes down the DataNode

[ https://issues.apache.org/jira/browse/HDFS-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13132949#comment-13132949 ] Konstantin Shvachko commented on HDFS-2452: --- Let's commit the fix and file anothe

[jira] [Commented] (HDFS-2452) OutOfMemoryError in DataXceiverServer takes down the DataNode

[ https://issues.apache.org/jira/browse/HDFS-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13132836#comment-13132836 ] Konstantin Shvachko commented on HDFS-2452: --- We should make a patch for trunk too

[jira] [Commented] (HDFS-2484) checkLease should throw FileNotFoundException when file does not exist

[ https://issues.apache.org/jira/browse/HDFS-2484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13132498#comment-13132498 ] Konstantin Shvachko commented on HDFS-2484: --- The exception is like this: {code} 2

[jira] [Commented] (HDFS-2452) OutOfMemoryError in DataXceiverServer takes down the DataNode

[ https://issues.apache.org/jira/browse/HDFS-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13132290#comment-13132290 ] Konstantin Shvachko commented on HDFS-2452: --- I ran the test several times. It is

[jira] [Commented] (HDFS-2451) TestNodeCount.testNodeCount failes with NPE

[ https://issues.apache.org/jira/browse/HDFS-2451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13131034#comment-13131034 ] Konstantin Shvachko commented on HDFS-2451: --- Sorry for the late comment. I wrote

[jira] [Commented] (HDFS-2452) OutOfMemoryError in DataXceiverServer takes down the DataNode

[ https://issues.apache.org/jira/browse/HDFS-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13131027#comment-13131027 ] Konstantin Shvachko commented on HDFS-2452: --- Are the 2 paths above mutually exclu

[jira] [Commented] (HDFS-2451) TestNodeCount.testNodeCount failes with NPE

[ https://issues.apache.org/jira/browse/HDFS-2451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13131028#comment-13131028 ] Konstantin Shvachko commented on HDFS-2451: --- Looks like a race condition going on

[jira] [Commented] (HDFS-2452) OutOfMemoryError in DataXceiverServer takes down the DataNode

[ https://issues.apache.org/jira/browse/HDFS-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13131024#comment-13131024 ] Konstantin Shvachko commented on HDFS-2452: --- > Here i will use the CounDownLatch(

[jira] [Commented] (HDFS-2452) OutOfMemoryError in DataXceiverServer takes down the DataNode

[ https://issues.apache.org/jira/browse/HDFS-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13129876#comment-13129876 ] Konstantin Shvachko commented on HDFS-2452: --- Sleeping an arbitrary # of seconds i

[jira] [Commented] (HDFS-2452) OutOfMemoryError in DataXceiverServer takes down the DataNode

[ https://issues.apache.org/jira/browse/HDFS-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13129439#comment-13129439 ] Konstantin Shvachko commented on HDFS-2452: --- Can you mock datanode.getXceiverCoun

[jira] [Commented] (HDFS-2286) DataXceiverServer logs AsynchronousCloseException at shutdown

[ https://issues.apache.org/jira/browse/HDFS-2286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13129173#comment-13129173 ] Konstantin Shvachko commented on HDFS-2286: --- Committed to 0.22 branch.

[jira] [Commented] (HDFS-2452) OutOfMemoryError in DataXceiverServer takes down the DataNode

[ https://issues.apache.org/jira/browse/HDFS-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13129130#comment-13129130 ] Konstantin Shvachko commented on HDFS-2452: --- - Uma, yes let's split it into 2 pat

[jira] [Commented] (HDFS-2452) OutOfMemoryError in DataXceiverServer takes down the DataNode

[ https://issues.apache.org/jira/browse/HDFS-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13129070#comment-13129070 ] Konstantin Shvachko commented on HDFS-2452: --- Let's fix one thing at a time. # Asy

[jira] [Commented] (HDFS-2452) OutOfMemoryError in DataXceiverServer takes down the DataNode

[ https://issues.apache.org/jira/browse/HDFS-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13128572#comment-13128572 ] Konstantin Shvachko commented on HDFS-2452: --- I believe the same error exists in t

[jira] [Commented] (HDFS-2452) OutOfMemoryError in DataXceiverServer takes down the DataNode

[ https://issues.apache.org/jira/browse/HDFS-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13128568#comment-13128568 ] Konstantin Shvachko commented on HDFS-2452: --- I carried out a high-load test on a

[jira] [Commented] (HDFS-2012) Recurring failure of TestBalancer on branch-0.22

[ https://issues.apache.org/jira/browse/HDFS-2012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13126884#comment-13126884 ] Konstantin Shvachko commented on HDFS-2012: --- +1 for the patches. Are the test fai

[jira] [Commented] (HDFS-2012) Recurring failure of TestBalancer on branch-0.22

[ https://issues.apache.org/jira/browse/HDFS-2012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13126408#comment-13126408 ] Konstantin Shvachko commented on HDFS-2012: --- The patch looks good. Could you plea

[jira] [Commented] (HDFS-2422) The NN should tolerate the same number of low-resource volumes as failed volumes

[ https://issues.apache.org/jira/browse/HDFS-2422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13124792#comment-13124792 ] Konstantin Shvachko commented on HDFS-2422: --- Sounds like soft NFS mounts should b

[jira] [Commented] (HDFS-2422) The NN should tolerate the same number of low-resource volumes as failed volumes

[ https://issues.apache.org/jira/browse/HDFS-2422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13124752#comment-13124752 ] Konstantin Shvachko commented on HDFS-2422: --- M.C. as far as I know this is exactl

[jira] [Commented] (HDFS-1762) Allow TestHDFSCLI to be run against a cluster

[ https://issues.apache.org/jira/browse/HDFS-1762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13124724#comment-13124724 ] Konstantin Shvachko commented on HDFS-1762: --- +1 > Allow TestHDFS

[jira] [Commented] (HDFS-1762) Allow TestHDFSCLI to be run against a cluster

[ https://issues.apache.org/jira/browse/HDFS-1762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13124307#comment-13124307 ] Konstantin Shvachko commented on HDFS-1762: --- The issues I mentioned before are in

[jira] [Commented] (HDFS-1762) Allow TestHDFSCLI to be run against a cluster

[ https://issues.apache.org/jira/browse/HDFS-1762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13124308#comment-13124308 ] Konstantin Shvachko commented on HDFS-1762: --- (like du: ) > Allow

[jira] [Commented] (HDFS-1762) Allow TestHDFSCLI to be run against a cluster

[ https://issues.apache.org/jira/browse/HDFS-1762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13123796#comment-13123796 ] Konstantin Shvachko commented on HDFS-1762: --- The patch looks good. One thing I wo

[jira] [Commented] (HDFS-2398) SlivePartitioner generates negtive partitions

[ https://issues.apache.org/jira/browse/HDFS-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13119743#comment-13119743 ] Konstantin Shvachko commented on HDFS-2398: --- Yes you are right. Keep forgetting t

[jira] [Commented] (HDFS-2398) SlivePartitioner generates negtive partitions

[ https://issues.apache.org/jira/browse/HDFS-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13119609#comment-13119609 ] Konstantin Shvachko commented on HDFS-2398: --- This is because String.hash() can be

[jira] [Commented] (HDFS-2012) Recurring failure of TestBalancer on branch-0.22

[ https://issues.apache.org/jira/browse/HDFS-2012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13117829#comment-13117829 ] Konstantin Shvachko commented on HDFS-2012: --- In Balancer.initNodes(.) there is lo

[jira] [Commented] (HDFS-2383) TestDfsOverAvroRpc is failing on 0.22

[ https://issues.apache.org/jira/browse/HDFS-2383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13116835#comment-13116835 ] Konstantin Shvachko commented on HDFS-2383: --- I agree. But looking at the changes

[jira] [Commented] (HDFS-2383) TestDfsOverAvroRpc is failing on 0.22

[ https://issues.apache.org/jira/browse/HDFS-2383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13116789#comment-13116789 ] Konstantin Shvachko commented on HDFS-2383: --- Here is the stack trace: {code} Test

[jira] [Commented] (HDFS-2346) TestHost2NodesMap & TestReplicasMap will fail depending upon execution order of test methods

[ https://issues.apache.org/jira/browse/HDFS-2346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13116752#comment-13116752 ] Konstantin Shvachko commented on HDFS-2346: --- I committed this to 0.22. It applied

[jira] [Commented] (HDFS-2346) TestHost2NodesMap & TestReplicasMap tests are failing in 0.23 branch & Trunk

[ https://issues.apache.org/jira/browse/HDFS-2346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13116287#comment-13116287 ] Konstantin Shvachko commented on HDFS-2346: --- Aaron do you mind committing this in

[jira] [Commented] (HDFS-2346) TestHost2NodesMap & TestReplicasMap tests are failing in 0.23 branch & Trunk

[ https://issues.apache.org/jira/browse/HDFS-2346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13114984#comment-13114984 ] Konstantin Shvachko commented on HDFS-2346: --- +1 I looked at 0.22 ant trunk patche