[jira] [Commented] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16696227#comment-16696227 ] Ted Yu commented on HBASE-21387: Looks like catching FileNotFoundException is not enough to pass the new

[jira] [Updated] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21387: --- Attachment: 21387-suggest.txt > Race condition surrounding in progress snapshot handling in snapshot ca

[jira] [Commented] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-20 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693142#comment-16693142 ] Ted Yu commented on HBASE-21387: I was aware of the above JIRA. Thanks for the unit test, Zheng

[jira] [Commented] (HBASE-21478) Make table sorted when displaying rsgroup info in shell and master web UI

2018-11-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16690975#comment-16690975 ] Ted Yu commented on HBASE-21478: bq. what about adding another private member as a copy of tables

[jira] [Updated] (HBASE-21141) Enable MOB in backup / restore test involving incremental backup

2018-11-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21141: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status: Resolved

[jira] [Commented] (HBASE-21482) TestHRegion fails due to 'Too many open files'

2018-11-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689903#comment-16689903 ] Ted Yu commented on HBASE-21482: Toward the end of hbase-server/target/surefire-reports

[jira] [Commented] (HBASE-21141) Enable MOB in backup / restore test involving incremental backup

2018-11-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689834#comment-16689834 ] Ted Yu commented on HBASE-21141: You can shrink the following into one line comment: {code

[jira] [Commented] (HBASE-21141) Enable MOB in backup / restore test involving incremental backup

2018-11-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689825#comment-16689825 ] Ted Yu commented on HBASE-21141: w.r.t. the long method body, can you reduce method length to <=

[jira] [Commented] (HBASE-21246) Introduce WALIdentity interface

2018-11-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689816#comment-16689816 ] Ted Yu commented on HBASE-21246: Patch v43 is mostly formatting change on top of v41. > Introd

[jira] [Updated] (HBASE-21246) Introduce WALIdentity interface

2018-11-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21246: --- Attachment: 21246.43.txt > Introduce WALIdentity interf

[jira] [Commented] (HBASE-21141) Enable MOB in backup / restore test involving incremental backup

2018-11-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689701#comment-16689701 ] Ted Yu commented on HBASE-21141: We're close. {code} + // #3 - incremental backup for multiple

[jira] [Commented] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689656#comment-16689656 ] Ted Yu commented on HBASE-21387: Haven't got around to adding new unit test (without introducing extra

[jira] [Commented] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-15 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16688926#comment-16688926 ] Ted Yu commented on HBASE-21387: Looking at Zheng's suggestion for new unit test, bq. another thread

[jira] [Commented] (HBASE-21141) Enable MOB in backup / restore test involving incremental backup

2018-11-15 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16688648#comment-16688648 ] Ted Yu commented on HBASE-21141: {code} +mobHcd.setMobThreshold(0L); {code} Please increase

[jira] [Commented] (HBASE-21482) TestHRegion fails due to 'Too many open files'

2018-11-15 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16688550#comment-16688550 ] Ted Yu commented on HBASE-21482: Didn't reproduce the test failure in branch-2. Apache Maven 3.5.4

[jira] [Updated] (HBASE-21482) TestHRegion fails due to 'Too many open files'

2018-11-15 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21482: --- Attachment: org.apache.hadoop.hbase.regionserver.TestHRegion.txt > TestHRegion fails due to 'Too many o

[jira] [Updated] (HBASE-21482) TestHRegion fails due to 'Too many open files'

2018-11-15 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21482: --- Attachment: org.apache.hadoop.hbase.regionserver.TestHRegion-output.txt > TestHRegion fails due to '

[jira] [Created] (HBASE-21482) TestHRegion fails due to 'Too many open files'

2018-11-15 Thread Ted Yu (JIRA)
Ted Yu created HBASE-21482: -- Summary: TestHRegion fails due to 'Too many open files' Key: HBASE-21482 URL: https://issues.apache.org/jira/browse/HBASE-21482 Project: HBase Issue Type: Bug

[jira] [Created] (HBASE-21482) TestHRegion fails due to 'Too many open files'

2018-11-15 Thread Ted Yu (JIRA)
Ted Yu created HBASE-21482: -- Summary: TestHRegion fails due to 'Too many open files' Key: HBASE-21482 URL: https://issues.apache.org/jira/browse/HBASE-21482 Project: HBase Issue Type: Bug

[jira] [Commented] (HBASE-21246) Introduce WALIdentity interface

2018-11-15 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16688506#comment-16688506 ] Ted Yu commented on HBASE-21246: Patch v41 fixes TestDLSAsyncFSWAL . TestDLSAsyncFSWAL#countWAL

[jira] [Updated] (HBASE-21246) Introduce WALIdentity interface

2018-11-15 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21246: --- Attachment: 21246.41.txt > Introduce WALIdentity interf

[jira] [Commented] (HBASE-21479) TestHRegionReplayEvents#testSkippingEditsWithSmallerSeqIdAfterRegionOpenEvent fails with IndexOutOfBoundsException

2018-11-15 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16688285#comment-16688285 ] Ted Yu commented on HBASE-21479: The single test used to pass. e.g

[jira] [Updated] (HBASE-21460) correct Document Configurable Bucket Sizes in bucketCache

2018-11-15 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21460: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status: Resolved

[jira] [Commented] (HBASE-21479) TestHRegionReplayEvents#testSkippingEditsWithSmallerSeqIdAfterRegionOpenEvent fails with IndexOutOfBoundsException

2018-11-15 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16688224#comment-16688224 ] Ted Yu commented on HBASE-21479: {code} Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe

[jira] [Commented] (HBASE-21479) TestHRegionReplayEvents#testSkippingEditsWithSmallerSeqIdAfterRegionOpenEvent fails with IndexOutOfBoundsException

2018-11-14 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16687158#comment-16687158 ] Ted Yu commented on HBASE-21479: Progressively stepping back

[jira] [Commented] (HBASE-21457) BackupUtils#getWALFilesOlderThan refers to wrong FileSystem

2018-11-14 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16687051#comment-16687051 ] Ted Yu commented on HBASE-21457: See my comment above: HBASE-21466 cleared the way. > BackupUt

[jira] [Created] (HBASE-21479) TestHRegionReplayEvents#testSkippingEditsWithSmallerSeqIdAfterRegionOpenEvent fails with IndexOutOfBoundsException

2018-11-14 Thread Ted Yu (JIRA)
Ted Yu created HBASE-21479: -- Summary: TestHRegionReplayEvents#testSkippingEditsWithSmallerSeqIdAfterRegionOpenEvent fails with IndexOutOfBoundsException Key: HBASE-21479 URL: https://issues.apache.org/jira/browse/HBASE

[jira] [Updated] (HBASE-21479) TestHRegionReplayEvents#testSkippingEditsWithSmallerSeqIdAfterRegionOpenEvent fails with IndexOutOfBoundsException

2018-11-14 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21479: --- Attachment: testHRegionReplayEvents-output.txt > TestHRegionReplayEve

[jira] [Created] (HBASE-21479) TestHRegionReplayEvents#testSkippingEditsWithSmallerSeqIdAfterRegionOpenEvent fails with IndexOutOfBoundsException

2018-11-14 Thread Ted Yu (JIRA)
Ted Yu created HBASE-21479: -- Summary: TestHRegionReplayEvents#testSkippingEditsWithSmallerSeqIdAfterRegionOpenEvent fails with IndexOutOfBoundsException Key: HBASE-21479 URL: https://issues.apache.org/jira/browse/HBASE

[jira] [Commented] (HBASE-21460) correct Document Configurable Bucket Sizes in bucketCache

2018-11-14 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686827#comment-16686827 ] Ted Yu commented on HBASE-21460: bq. (instead of `hbase.bucketcache.bucket.size`) I don't see the above

[jira] [Commented] (HBASE-21478) Make table sorted when displaying rsgroup info in shell and master web UI

2018-11-14 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686798#comment-16686798 ] Ted Yu commented on HBASE-21478: RSGroupInfo#getTables() references a SortedSet . Do you plan to create

[jira] [Commented] (HBASE-21246) Introduce WALIdentity interface

2018-11-14 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686778#comment-16686778 ] Ted Yu commented on HBASE-21246: There are fewer test failures with patch v39. Need to handle failure

[jira] [Updated] (HBASE-21246) Introduce WALIdentity interface

2018-11-14 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21246: --- Attachment: 21246.39.txt > Introduce WALIdentity interf

[jira] [Commented] (HBASE-21246) Introduce WALIdentity interface

2018-11-13 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685515#comment-16685515 ] Ted Yu commented on HBASE-21246: Patch v37 fixes infinite call in RegionGroupingProvider

[jira] [Updated] (HBASE-21246) Introduce WALIdentity interface

2018-11-13 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21246: --- Attachment: 21246.37.txt > Introduce WALIdentity interf

[jira] [Comment Edited] (HBASE-21457) BackupUtils#getWALFilesOlderThan refers to wrong FileSystem

2018-11-13 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685384#comment-16685384 ] Ted Yu edited comment on HBASE-21457 at 11/13/18 3:50 PM: -- Thanks

[jira] [Updated] (HBASE-21457) BackupUtils#getWALFilesOlderThan refers to wrong FileSystem

2018-11-13 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21457: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status: Resolved

Re: [ANNOUNCE] New HBase committer Jingyun Tian

2018-11-13 Thread Ted Yu
Congratulations, Jingyun! Original message From: Srinivas Reddy Date: 11/13/18 12:46 AM (GMT-08:00) To: dev@hbase.apache.org Cc: Hbase-User Subject: Re: [ANNOUNCE] New HBase committer Jingyun Tian Congratulations Jingyun-Srinivas- Typed on tiny keys. pls ignore

Re: [ANNOUNCE] New HBase committer Jingyun Tian

2018-11-13 Thread Ted Yu
Congratulations, Jingyun! Original message From: Srinivas Reddy Date: 11/13/18 12:46 AM (GMT-08:00) To: d...@hbase.apache.org Cc: Hbase-User Subject: Re: [ANNOUNCE] New HBase committer Jingyun Tian Congratulations Jingyun-Srinivas- Typed on tiny keys. pls ignore

[jira] [Comment Edited] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16684625#comment-16684625 ] Ted Yu edited comment on HBASE-21387 at 11/13/18 2:18 AM: -- The two minor

[jira] [Commented] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16684625#comment-16684625 ] Ted Yu commented on HBASE-21387: The only remaining comment was about a new test, right ? Not sure when

[jira] [Updated] (HBASE-21457) BackupUtils#getWALFilesOlderThan refers to wrong FileSystem

2018-11-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21457: --- Attachment: 21457.v4.txt > BackupUtils#getWALFilesOlderThan refers to wrong FileSys

[jira] [Updated] (HBASE-21466) WALProcedureStore uses wrong FileSystem if wal.dir is not under rootdir

2018-11-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21466: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.2.0 3.0.0

[jira] [Commented] (HBASE-21466) WALProcedureStore uses wrong FileSystem if wal.dir is not under rootdir

2018-11-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16684378#comment-16684378 ] Ted Yu commented on HBASE-21466: Without the leading slash (ahead of 'tmp'), test would fail with: {code

[jira] [Updated] (HBASE-21466) WALProcedureStore uses wrong FileSystem if wal.dir is not under rootdir

2018-11-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21466: --- Attachment: 21466.v3.txt > WALProcedureStore uses wrong FileSystem if wal.dir is not under root

[jira] [Commented] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16684373#comment-16684373 ] Ted Yu commented on HBASE-21387: TestBlockEvictionFromClient failure was unrelated to patch. > R

[jira] [Commented] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16684197#comment-16684197 ] Ted Yu commented on HBASE-21387: TestSnapshotFileCache failed due to NPE, as pointed out by findbugs

[jira] [Updated] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21387: --- Attachment: 21387.v12.txt > Race condition surrounding in progress snapshot handling in snapshot ca

[jira] [Updated] (HBASE-21466) WALProcedureStore uses wrong FileSystem if wal.dir is not under rootdir

2018-11-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21466: --- Attachment: 21466.v3.txt > WALProcedureStore uses wrong FileSystem if wal.dir is not under root

[jira] [Commented] (HBASE-21466) WALProcedureStore uses wrong FileSystem if wal.dir is not under rootdir

2018-11-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16684169#comment-16684169 ] Ted Yu commented on HBASE-21466: Patch v3 addresses review comments above. > WALProcedureStore u

[jira] [Updated] (HBASE-21466) WALProcedureStore uses wrong FileSystem if wal.dir is not under rootdir

2018-11-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21466: --- Attachment: 21466.v2.txt > WALProcedureStore uses wrong FileSystem if wal.dir is not under root

[jira] [Updated] (HBASE-21466) WALProcedureStore uses wrong FileSystem if wal.dir is not under rootdir

2018-11-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21466: --- Attachment: (was: 21466.v1.txt) > WALProcedureStore uses wrong FileSystem if wal.dir is not un

[jira] [Commented] (HBASE-21457) BackupUtils#getWALFilesOlderThan refers to wrong FileSystem

2018-11-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16683916#comment-16683916 ] Ted Yu commented on HBASE-21457: HBASE-21466 needs to be committed first. Without HBASE-21466, master

[jira] [Updated] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21387: --- Attachment: 21387.v11.txt > Race condition surrounding in progress snapshot handling in snapshot ca

[jira] [Comment Edited] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16683206#comment-16683206 ] Ted Yu edited comment on HBASE-21387 at 11/12/18 5:22 AM: -- https

[jira] [Commented] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16683206#comment-16683206 ] Ted Yu commented on HBASE-21387: https://reviews.apache.org/r/69316/ Adding a test may take some time

[jira] [Updated] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21387: --- Attachment: 21387.v10.txt > Race condition surrounding in progress snapshot handling in snapshot ca

[jira] [Updated] (HBASE-21466) WALProcedureStore uses wrong FileSystem if wal.dir is not under rootdir

2018-11-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21466: --- Summary: WALProcedureStore uses wrong FileSystem if wal.dir is not under rootdir (was: WALProcedureStore

[jira] [Commented] (HBASE-21466) WALProcedureStore uses wrong FileSystem if wal.dir is not under rootdir

2018-11-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682946#comment-16682946 ] Ted Yu commented on HBASE-21466: Here is snippet from test output without fix: {code} 2018-11-11 09:12

[jira] [Created] (HBASE-21466) WALProcedureStore uses wrong FileSystem if wal.dir is on different FileSystem as rootdir

2018-11-11 Thread Ted Yu (JIRA)
Ted Yu created HBASE-21466: -- Summary: WALProcedureStore uses wrong FileSystem if wal.dir is on different FileSystem as rootdir Key: HBASE-21466 URL: https://issues.apache.org/jira/browse/HBASE-21466 Project

[jira] [Updated] (HBASE-21466) WALProcedureStore uses wrong FileSystem if wal.dir is not under rootdir

2018-11-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21466: --- Description: In WALProcedureStore ctor , the fs field is initialized this way: {code} this.fs

[jira] [Updated] (HBASE-21466) WALProcedureStore uses wrong FileSystem if wal.dir is on different FileSystem as rootdir

2018-11-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21466: --- Attachment: 21466.v1.txt > WALProcedureStore uses wrong FileSystem if wal.dir is on different FileSys

[jira] [Updated] (HBASE-21466) WALProcedureStore uses wrong FileSystem if wal.dir is on different FileSystem as rootdir

2018-11-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21466: --- Status: Patch Available (was: Open) > WALProcedureStore uses wrong FileSystem if wal.dir is on differ

[jira] [Created] (HBASE-21466) WALProcedureStore uses wrong FileSystem if wal.dir is on different FileSystem as rootdir

2018-11-11 Thread Ted Yu (JIRA)
Ted Yu created HBASE-21466: -- Summary: WALProcedureStore uses wrong FileSystem if wal.dir is on different FileSystem as rootdir Key: HBASE-21466 URL: https://issues.apache.org/jira/browse/HBASE-21466 Project

[jira] [Commented] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-10 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682644#comment-16682644 ] Ted Yu commented on HBASE-21387: One more note about why I choose 21387.v9.txt as the version for review

[jira] [Commented] (HBASE-21246) Introduce WALIdentity interface

2018-11-10 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682638#comment-16682638 ] Ted Yu commented on HBASE-21246: Currently there are about 69 failing test classes. Working through

[jira] [Updated] (HBASE-13468) hbase.zookeeper.quorum supports ipv6 address

2018-11-10 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-13468: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status: Resolved

[jira] [Updated] (HBASE-21341) DeadServer shouldn't import unshaded Preconditions

2018-11-09 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21341: --- Fix Version/s: 3.0.0 > DeadServer shouldn't import unshaded Preconditi

[jira] [Commented] (HBASE-21246) Introduce WALIdentity interface

2018-11-09 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681979#comment-16681979 ] Ted Yu commented on HBASE-21246: Patch v34 is based on current master. Running test suite locally

[jira] [Updated] (HBASE-21246) Introduce WALIdentity interface

2018-11-09 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21246: --- Attachment: 21246.34.txt > Introduce WALIdentity interf

[jira] [Commented] (HBASE-21457) BackupUtils#getWALFilesOlderThan refers to wrong FileSystem

2018-11-09 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681855#comment-16681855 ] Ted Yu commented on HBASE-21457: The master startup delay probably is related to procedure store WAL

[jira] [Commented] (HBASE-21457) BackupUtils#getWALFilesOlderThan refers to wrong FileSystem

2018-11-09 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681852#comment-16681852 ] Ted Yu commented on HBASE-21457: The failed tests are already marked large test. Looking for where

[jira] [Commented] (HBASE-21457) BackupUtils#getWALFilesOlderThan refers to wrong FileSystem

2018-11-09 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681788#comment-16681788 ] Ted Yu commented on HBASE-21457: Shall we leave the test change to another JIRA ? > BackupUt

Re: [VOTE] Apache Bahir 2.2.2 (RC1)

2018-11-08 Thread Ted Yu
+1 Ran unit test suite which passed. On Thu, Nov 8, 2018 at 1:34 PM Luciano Resende wrote: > Dear community member, > > Please vote to approve the release of Apache Bahir 2.2.2 (RC1) based on > Apache Spark 2.2.2. > > Tag: v2.2.2-rc1 (821a8c67c21f4f4ab4a7caa8e2f85a2c396683d4) > >

[jira] [Commented] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680721#comment-16680721 ] Ted Yu commented on HBASE-21387: [~openinx][~Apache9][~elserj] : Gentle ping. > Race condit

[jira] [Updated] (HBASE-21457) BackupUtils#getWALFilesOlderThan refers to wrong FileSystem

2018-11-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21457: --- Attachment: 21457.v3.txt > BackupUtils#getWALFilesOlderThan refers to wrong FileSys

[jira] [Commented] (HBASE-21246) Introduce WALIdentity interface

2018-11-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680549#comment-16680549 ] Ted Yu commented on HBASE-21246: Looking at compilation errors for patch v22: 321 lines

[jira] [Commented] (HBASE-21457) BackupUtils#getWALFilesOlderThan refers to wrong FileSystem

2018-11-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680531#comment-16680531 ] Ted Yu commented on HBASE-21457: The test passed during local run. Tests run: 1, Failures: 0, Errors: 0

[jira] [Commented] (HBASE-21457) BackupUtils#getWALFilesOlderThan refers to wrong FileSystem

2018-11-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680500#comment-16680500 ] Ted Yu commented on HBASE-21457: I tried to retrieve output for the failed test but it looks like

[jira] [Commented] (HBASE-21457) BackupUtils#getWALFilesOlderThan refers to wrong FileSystem

2018-11-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680435#comment-16680435 ] Ted Yu commented on HBASE-21457: I did a search in hbase-backup module where we retrieve FileSystem

[jira] [Updated] (HBASE-21457) BackupUtils#getWALFilesOlderThan refers to wrong FileSystem

2018-11-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21457: --- Attachment: 21457.v3.txt > BackupUtils#getWALFilesOlderThan refers to wrong FileSys

[jira] [Created] (HADOOP-15910) Javadoc for LdapAuthenticationHandler#ENABLE_START_TLS is wrong

2018-11-08 Thread Ted Yu (JIRA)
Ted Yu created HADOOP-15910: --- Summary: Javadoc for LdapAuthenticationHandler#ENABLE_START_TLS is wrong Key: HADOOP-15910 URL: https://issues.apache.org/jira/browse/HADOOP-15910 Project: Hadoop Common

[jira] [Updated] (HBASE-21457) BackupUtils#getWALFilesOlderThan refers to wrong FileSystem

2018-11-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21457: --- Attachment: (was: 21457.v3.txt) > BackupUtils#getWALFilesOlderThan refers to wrong FileSys

[jira] [Updated] (HBASE-21457) BackupUtils#getWALFilesOlderThan refers to wrong FileSystem

2018-11-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21457: --- Attachment: 21457.v3.txt > BackupUtils#getWALFilesOlderThan refers to wrong FileSys

[jira] [Commented] (HBASE-21457) BackupUtils#getWALFilesOlderThan refers to wrong FileSystem

2018-11-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680380#comment-16680380 ] Ted Yu commented on HBASE-21457: Patch v3 modifies TestBackupBase to use second hdfs cluster for WAL dir

[jira] [Updated] (HBASE-21439) StochasticLoadBalancer RegionLoads aren’t being used in RegionLoad cost functions

2018-11-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21439: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status: Resolved

[jira] [Updated] (HBASE-21246) Introduce WALIdentity interface

2018-11-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21246: --- Attachment: 21246.26.txt > Introduce WALIdentity interf

[jira] [Updated] (HBASE-21457) BackupUtils#getWALFilesOlderThan refers to wrong FileSystem

2018-11-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21457: --- Attachment: 21457.v2.txt > BackupUtils#getWALFilesOlderThan refers to wrong FileSys

[jira] [Created] (HADOOP-15910) Javadoc for LdapAuthenticationHandler#ENABLE_START_TLS is wrong

2018-11-08 Thread Ted Yu (JIRA)
Ted Yu created HADOOP-15910: --- Summary: Javadoc for LdapAuthenticationHandler#ENABLE_START_TLS is wrong Key: HADOOP-15910 URL: https://issues.apache.org/jira/browse/HADOOP-15910 Project: Hadoop Common

[jira] [Updated] (HBASE-21457) BackupUtils#getWALFilesOlderThan refers to wrong FileSystem

2018-11-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21457: --- Status: Patch Available (was: Open) > BackupUtils#getWALFilesOlderThan refers to wrong FileSys

[jira] [Assigned] (HBASE-21457) BackupUtils#getWALFilesOlderThan refers to wrong FileSystem

2018-11-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu reassigned HBASE-21457: -- Assignee: Ted Yu > BackupUtils#getWALFilesOlderThan refers to wrong FileSys

[jira] [Created] (HBASE-21457) BackupUtils#getWALFilesOlderThan refers to wrong FileSystem

2018-11-08 Thread Ted Yu (JIRA)
Ted Yu created HBASE-21457: -- Summary: BackupUtils#getWALFilesOlderThan refers to wrong FileSystem Key: HBASE-21457 URL: https://issues.apache.org/jira/browse/HBASE-21457 Project: HBase Issue Type

[jira] [Created] (HBASE-21457) BackupUtils#getWALFilesOlderThan refers to wrong FileSystem

2018-11-08 Thread Ted Yu (JIRA)
Ted Yu created HBASE-21457: -- Summary: BackupUtils#getWALFilesOlderThan refers to wrong FileSystem Key: HBASE-21457 URL: https://issues.apache.org/jira/browse/HBASE-21457 Project: HBase Issue Type

[jira] [Updated] (HBASE-21457) BackupUtils#getWALFilesOlderThan refers to wrong FileSystem

2018-11-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21457: --- Attachment: 21457.v1.txt > BackupUtils#getWALFilesOlderThan refers to wrong FileSys

[jira] [Commented] (HBASE-21457) BackupUtils#getWALFilesOlderThan refers to wrong FileSystem

2018-11-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680048#comment-16680048 ] Ted Yu commented on HBASE-21457: bq. can you replace filesystem parameter fs with walFs in the lines

[jira] [Commented] (HBASE-21439) StochasticLoadBalancer RegionLoads aren’t being used in RegionLoad cost functions

2018-11-07 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16678766#comment-16678766 ] Ted Yu commented on HBASE-21439: StochasticLoadBalancer tests passed. lgtm, pending QA

[jira] [Commented] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-07 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16678531#comment-16678531 ] Ted Yu commented on HBASE-21387: Here is a brief summary of the approaches I tried, with most recent

[jira] [Updated] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-07 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21387: --- Description: During recent report from customer where ExportSnapshot failed: {code} 2018-10-09 18:54:32,559

[jira] [Commented] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-07 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16678473#comment-16678473 ] Ted Yu commented on HBASE-21387: [~openinx][~Apache9][~elserj] : Please take a look at 21387.v9.txt

[jira] [Updated] (HBASE-21246) Introduce WALIdentity interface

2018-11-06 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-21246: --- Attachment: 21246.25.txt > Introduce WALIdentity interf

<    1   2   3   4   5   6   7   8   9   10   >