[jira] [Updated] (HBASE-12686) Failures in split before PONR not clearing the daughter regions from regions in transition during rollback
[ https://issues.apache.org/jira/browse/HBASE-12686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vandana Ayyalasomayajula updated HBASE-12686: - Attachment: HBASE-12686-branch-1.patch Patch for branch-1 > Failures in split before PONR not clearing the daughter regions from regions > in transition during rollback > -- > > Key: HBASE-12686 > URL: https://issues.apache.org/jira/browse/HBASE-12686 > Project: HBase > Issue Type: Bug > Components: Region Assignment >Affects Versions: 0.98.9 >Reporter: Rajeshbabu Chintaguntla >Assignee: Vandana Ayyalasomayajula >Priority: Blocker > Fix For: 1.0.0, 2.0.0, 0.98.9 > > Attachments: HBASE-12686-branch-1.patch > > > If there are any split failures then the both daughter regions left in > SPLITTING_NEW transition even after rollback, which will block balancing to > happen forever until unless master is restarted. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12686) Failures in split before PONR not clearing the daughter regions from regions in transition during rollback
[ https://issues.apache.org/jira/browse/HBASE-12686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246402#comment-14246402 ] Rajeshbabu Chintaguntla commented on HBASE-12686: - I have written one test to reproduce the issue that is passing in trunk version. Failing in 0.98 and branch-1. It will not be a problem for 2.0.0. > Failures in split before PONR not clearing the daughter regions from regions > in transition during rollback > -- > > Key: HBASE-12686 > URL: https://issues.apache.org/jira/browse/HBASE-12686 > Project: HBase > Issue Type: Bug > Components: Region Assignment >Affects Versions: 0.98.9 >Reporter: Rajeshbabu Chintaguntla >Assignee: Vandana Ayyalasomayajula >Priority: Blocker > Fix For: 1.0.0, 2.0.0, 0.98.9 > > > If there are any split failures then the both daughter regions left in > SPLITTING_NEW transition even after rollback, which will block balancing to > happen forever until unless master is restarted. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12686) Failures in split before PONR not clearing the daughter regions from regions in transition during rollback
[ https://issues.apache.org/jira/browse/HBASE-12686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246396#comment-14246396 ] Vandana Ayyalasomayajula commented on HBASE-12686: -- Is this JIRA a blocker for all 1.0.0, 2.0.0, 0.98.9 ? I will put up a patch for the blocker branch first. > Failures in split before PONR not clearing the daughter regions from regions > in transition during rollback > -- > > Key: HBASE-12686 > URL: https://issues.apache.org/jira/browse/HBASE-12686 > Project: HBase > Issue Type: Bug > Components: Region Assignment >Affects Versions: 0.98.9 >Reporter: Rajeshbabu Chintaguntla >Assignee: Vandana Ayyalasomayajula >Priority: Blocker > Fix For: 1.0.0, 2.0.0, 0.98.9 > > > If there are any split failures then the both daughter regions left in > SPLITTING_NEW transition even after rollback, which will block balancing to > happen forever until unless master is restarted. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12677) Update replication docs to clarify terminology
[ https://issues.apache.org/jira/browse/HBASE-12677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246395#comment-14246395 ] Hudson commented on HBASE-12677: SUCCESS: Integrated in HBase-TRUNK #5920 (See [https://builds.apache.org/job/HBase-TRUNK/5920/]) HBASE-12677 Update replication docs to clarify terminology (mstanleyjones: rev db873f0886ec43e2e5b3bdcb56399b3bceb4dcaa) * src/main/site/resources/images/hbase_replication_diagram.jpg * hbase-server/src/main/javadoc/org/apache/hadoop/hbase/replication/package.html * src/main/docbkx/ops_mgt.xml > Update replication docs to clarify terminology > -- > > Key: HBASE-12677 > URL: https://issues.apache.org/jira/browse/HBASE-12677 > Project: HBase > Issue Type: Bug > Components: documentation >Reporter: Misty Stanley-Jones >Assignee: Misty Stanley-Jones > Fix For: 2.0.0 > > Attachments: HBASE-12677-v1.patch, HBASE-12677.patch > > > Remove use of master-master and cyclical replication and just talk about > topologies -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-10201) Port 'Make flush decisions per column family' to trunk
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246385#comment-14246385 ] stack commented on HBASE-10201: --- I'm +1 on this going into master branch. I am +1 on this going into branch-1 but with it disabled by default as an experimental feature; users would have to enable the FlushLargeStoresPolicy explicitly (You ok w/ that [~enis])? Any chance of more +1s? [~jeffreyz]? Any other reviews out there? This is an old issue, nicely addressed, that can make a nice dent in our i/o profile when more than one column family but it would be good to get more eyes on it given its messing with sequenceids. Thanks. > Port 'Make flush decisions per column family' to trunk > -- > > Key: HBASE-10201 > URL: https://issues.apache.org/jira/browse/HBASE-10201 > Project: HBase > Issue Type: Improvement > Components: wal >Reporter: Ted Yu >Assignee: zhangduo > Fix For: 1.0.0, 2.0.0 > > Attachments: 3149-trunk-v1.txt, HBASE-10201-0.98.patch, > HBASE-10201-0.98_1.patch, HBASE-10201-0.98_2.patch, HBASE-10201-0.99.patch, > HBASE-10201.patch, HBASE-10201_1.patch, HBASE-10201_10.patch, > HBASE-10201_11.patch, HBASE-10201_12.patch, HBASE-10201_13.patch, > HBASE-10201_13.patch, HBASE-10201_14.patch, HBASE-10201_15.patch, > HBASE-10201_16.patch, HBASE-10201_17.patch, HBASE-10201_18.patch, > HBASE-10201_19.patch, HBASE-10201_2.patch, HBASE-10201_3.patch, > HBASE-10201_4.patch, HBASE-10201_5.patch, HBASE-10201_6.patch, > HBASE-10201_7.patch, HBASE-10201_8.patch, HBASE-10201_9.patch, > compactions.png, count.png, io.png, memstore.png > > > Currently the flush decision is made using the aggregate size of all column > families. When large and small column families co-exist, this causes many > small flushes of the smaller CF. We need to make per-CF flush decisions. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12690) list_quotas command is failing with not able to load Java class
[ https://issues.apache.org/jira/browse/HBASE-12690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Singhi updated HBASE-12690: -- Attachment: HBASE-12690.patch > list_quotas command is failing with not able to load Java class > --- > > Key: HBASE-12690 > URL: https://issues.apache.org/jira/browse/HBASE-12690 > Project: HBase > Issue Type: Bug > Components: shell >Affects Versions: 2.0.0, 0.99.2 >Reporter: Ashish Singhi >Assignee: Ashish Singhi > Fix For: 1.0.0, 2.0.0 > > Attachments: HBASE-12690.patch > > > {noformat} > hbase(main):004:0> list_quotas > OWNERQUOTAS > ERROR: cannot load Java class org.apache.hadoop.hbase.client.ConnectionFactor > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12690) list_quotas command is failing with not able to load Java class
[ https://issues.apache.org/jira/browse/HBASE-12690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Singhi updated HBASE-12690: -- Status: Patch Available (was: Open) > list_quotas command is failing with not able to load Java class > --- > > Key: HBASE-12690 > URL: https://issues.apache.org/jira/browse/HBASE-12690 > Project: HBase > Issue Type: Bug > Components: shell >Affects Versions: 0.99.2, 2.0.0 >Reporter: Ashish Singhi >Assignee: Ashish Singhi > Fix For: 1.0.0, 2.0.0 > > Attachments: HBASE-12690.patch > > > {noformat} > hbase(main):004:0> list_quotas > OWNERQUOTAS > ERROR: cannot load Java class org.apache.hadoop.hbase.client.ConnectionFactor > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12332) [mob] use filelink instad of retry when resolving an hfilelink.
[ https://issues.apache.org/jira/browse/HBASE-12332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246357#comment-14246357 ] Jiajia Li commented on HBASE-12332: --- hi, [~j...@cloudera.com], the case you mentioned is added in https://issues.apache.org/jira/browse/HBASE-12673, can you look at it? Thanks~ > [mob] use filelink instad of retry when resolving an hfilelink. > --- > > Key: HBASE-12332 > URL: https://issues.apache.org/jira/browse/HBASE-12332 > Project: HBase > Issue Type: Sub-task > Components: mob >Affects Versions: hbase-11339 >Reporter: Jonathan Hsieh > Fix For: hbase-11339 > > Attachments: HBASE-12332-V1.diff > > > in the snapshot code, hmobstore was modified to traverse an hfile link to a > mob. Ideally this should use the transparent filelink code to read the data. > Also there will likely be some issues with the mob file cache with these > links. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-12690) list_quotas command is failing with not able to load Java class
Ashish Singhi created HBASE-12690: - Summary: list_quotas command is failing with not able to load Java class Key: HBASE-12690 URL: https://issues.apache.org/jira/browse/HBASE-12690 Project: HBase Issue Type: Bug Components: shell Affects Versions: 0.99.2, 2.0.0 Reporter: Ashish Singhi Assignee: Ashish Singhi Fix For: 1.0.0, 2.0.0 {noformat} hbase(main):004:0> list_quotas OWNERQUOTAS ERROR: cannot load Java class org.apache.hadoop.hbase.client.ConnectionFactor {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12689) Move version on from 0.99.2 to HBASE-1.0.0-SNAPSHOT
[ https://issues.apache.org/jira/browse/HBASE-12689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246349#comment-14246349 ] Hudson commented on HBASE-12689: SUCCESS: Integrated in HBase-1.0 #582 (See [https://builds.apache.org/job/HBase-1.0/582/]) HBASE-12689 Move version on from 0.99.2 to HBASE-1.0.0-SNAPSHOT (stack: rev f0afcd2cc2f7951e6750dae00af93f33a7a1a52f) * hbase-thrift/pom.xml * hbase-assembly/pom.xml * hbase-checkstyle/pom.xml * hbase-rest/pom.xml * hbase-common/pom.xml * hbase-prefix-tree/pom.xml * hbase-protocol/pom.xml * hbase-client/pom.xml * hbase-testing-util/pom.xml * hbase-shell/pom.xml * hbase-hadoop-compat/pom.xml * hbase-it/pom.xml * hbase-annotations/pom.xml * hbase-hadoop2-compat/pom.xml * hbase-server/pom.xml * hbase-examples/pom.xml * pom.xml > Move version on from 0.99.2 to HBASE-1.0.0-SNAPSHOT > --- > > Key: HBASE-12689 > URL: https://issues.apache.org/jira/browse/HBASE-12689 > Project: HBase > Issue Type: Task >Reporter: stack >Assignee: stack > Fix For: 1.0.0 > > > Correct me if I have it wrong [~enis]. I believe this is what you want (I'm > doing it because I want to publish 1.0.0-SNAPSHOTS for a contributor -- see > HBASE-12668) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12422) Use ConnectionFactory in HTable constructors
[ https://issues.apache.org/jira/browse/HBASE-12422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246348#comment-14246348 ] Hudson commented on HBASE-12422: SUCCESS: Integrated in HBase-1.0 #582 (See [https://builds.apache.org/job/HBase-1.0/582/]) HBASE-12422 Use ConnectionFactory in HTable constructors Fix method signature in test (stack: rev b1c95d50cf2f2de260595e7c076565e492ff9330) * hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestSecureLoadIncrementalHFilesSplitRecovery.java * hbase-client/src/main/java/org/apache/hadoop/hbase/client/coprocessor/SecureBulkLoadClient.java * hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/LoadIncrementalHFiles.java * hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFilesSplitRecovery.java * hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestHBaseFsck.java * hbase-server/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java * hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java > Use ConnectionFactory in HTable constructors > > > Key: HBASE-12422 > URL: https://issues.apache.org/jira/browse/HBASE-12422 > Project: HBase > Issue Type: Bug > Components: Client >Reporter: Solomon Duskis >Assignee: stack >Priority: Minor > Fix For: 1.0.0, 2.0.0 > > Attachments: 12422v2.txt, 12422v3.txt, 12422v4.txt, 12422v5.txt, > HBASE-12422.patch, HBASE-12422.patch, HBASE-12422.patch, HBASE-12422.patch, > HBASE-12422.patch > > > Use ConnectionFactory in HTable instead of ConnectionManager. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12673) Add a UT to read mob file when the mob hfile moving from the mob dir to the archive dir
[ https://issues.apache.org/jira/browse/HBASE-12673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246344#comment-14246344 ] Jiajia Li commented on HBASE-12673: --- hi, [~j...@cloudera.com], can you review this patch? > Add a UT to read mob file when the mob hfile moving from the mob dir to the > archive dir > --- > > Key: HBASE-12673 > URL: https://issues.apache.org/jira/browse/HBASE-12673 > Project: HBase > Issue Type: Sub-task > Components: regionserver, Scanners >Affects Versions: hbase-11339 >Reporter: Jiajia Li >Assignee: Jiajia Li > Fix For: hbase-11339 > > Attachments: HBASE-12673.patch > > > add a unit test to scan the cloned table when deleting the original table, > and the steps as following: > 1) create a table with mobs, > 2) snapshot it, > 3) clone it as a a different table > 4) have a read workload on the snapshot > 5) delete the original table -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12677) Update replication docs to clarify terminology
[ https://issues.apache.org/jira/browse/HBASE-12677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misty Stanley-Jones updated HBASE-12677: Resolution: Fixed Fix Version/s: 2.0.0 Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks for checking locally, [~saint@gmail.com] > Update replication docs to clarify terminology > -- > > Key: HBASE-12677 > URL: https://issues.apache.org/jira/browse/HBASE-12677 > Project: HBase > Issue Type: Bug > Components: documentation >Reporter: Misty Stanley-Jones >Assignee: Misty Stanley-Jones > Fix For: 2.0.0 > > Attachments: HBASE-12677-v1.patch, HBASE-12677.patch > > > Remove use of master-master and cyclical replication and just talk about > topologies -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12636) Avoid too many write operations on zookeeper in replication
[ https://issues.apache.org/jira/browse/HBASE-12636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246330#comment-14246330 ] stack commented on HBASE-12636: --- bq. if the frequency is too high, just check a little less often and let more data accumulate. That'd keep current 'style'. > Avoid too many write operations on zookeeper in replication > --- > > Key: HBASE-12636 > URL: https://issues.apache.org/jira/browse/HBASE-12636 > Project: HBase > Issue Type: Improvement >Affects Versions: 0.94.11 >Reporter: Liu Shaohui >Assignee: Liu Shaohui > Labels: replication > Fix For: 1.0.0 > > Attachments: HBASE-12635-v2.diff, HBASE-12636-v1.diff > > > In our production cluster, we found there are about over 1k write operations > per second on zookeeper from hbase replication. The reason is that the > replication source will write the log position to zookeeper for every edit > shipping. If the current replicating WAL is just the WAL that regionserver is > writing to, each skipping will be very small but the frequency is very high, > which causes many write operations on zookeeper. > A simple solution is that writing log position to zookeeper when position > diff or skipped edit number is larger than a threshold, not every edit > shipping. > Suggestions are welcomed, thx~ -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12422) Use ConnectionFactory in HTable constructors
[ https://issues.apache.org/jira/browse/HBASE-12422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246329#comment-14246329 ] Hudson commented on HBASE-12422: SUCCESS: Integrated in HBase-TRUNK #5919 (See [https://builds.apache.org/job/HBase-TRUNK/5919/]) HBASE-12422 Use ConnectionFactory in HTable constructors Fix method signature in test (stack: rev 029768287a62452cf99595b513f08133524fa834) * hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestHBaseFsck.java * hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/LoadIncrementalHFiles.java * hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestSecureLoadIncrementalHFilesSplitRecovery.java * hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFilesSplitRecovery.java * hbase-client/src/main/java/org/apache/hadoop/hbase/client/coprocessor/SecureBulkLoadClient.java * hbase-server/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java * hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java > Use ConnectionFactory in HTable constructors > > > Key: HBASE-12422 > URL: https://issues.apache.org/jira/browse/HBASE-12422 > Project: HBase > Issue Type: Bug > Components: Client >Reporter: Solomon Duskis >Assignee: stack >Priority: Minor > Fix For: 1.0.0, 2.0.0 > > Attachments: 12422v2.txt, 12422v3.txt, 12422v4.txt, 12422v5.txt, > HBASE-12422.patch, HBASE-12422.patch, HBASE-12422.patch, HBASE-12422.patch, > HBASE-12422.patch > > > Use ConnectionFactory in HTable instead of ConnectionManager. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12645) HBaseTestingUtility is using ${$HOME} for rootDir
[ https://issues.apache.org/jira/browse/HBASE-12645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246327#comment-14246327 ] stack commented on HBASE-12645: --- [~varun_saxena] Sorry.. should have explained. I ran the hadoopqa just to see what tests would fail. Thought it might be input for you as you were debugging failures. On current patch, its great. A few questions. With this in place, after the test suite completes, we are not writing to user homedir any more? Also, the new flag is never doc'd. What is it supposed to do? (I'm not clear). Flag is createRootDirIfExists This means, create root dir if it exists? But we don't check existance when we use it. Should we? 178 + public Path getDefaultRootDirPath(boolean createIfExists) throws IOException { 179 +if (false == createIfExists) { 180 + return getDataTestDirOnTestFS(); 181 +} else { 182 + return setupNewDataTestDirOnTestFS(); 183 +} 184 + } nit: Usually the following is written as if(!createIfExists) rather than as if (false == createIfExists) { Would we not want this flag always set? Or some tests need it not set? Thanks [~varun_saxena] > HBaseTestingUtility is using ${$HOME} for rootDir > - > > Key: HBASE-12645 > URL: https://issues.apache.org/jira/browse/HBASE-12645 > Project: HBase > Issue Type: Test > Components: test >Affects Versions: 1.0.0 >Reporter: Nick Dimiduk >Assignee: Varun Saxena >Priority: Critical > Fix For: 1.0.0, 2.0.0 > > Attachments: HBASE-12645.002.patch, HBASE-12645.003.patch, > HBASE-12645.004.patch, HBASE-12645.004.patch, HBASE-12645.005.patch, > HBASE-12645.patch > > > I noticed this while running tests on branch-1 > {noformat} > Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.009 sec <<< > FAILURE! - in > org.apache.hadoop.hbase.regionserver.wal.TestReadOldRootAndMetaEdits > org.apache.hadoop.hbase.regionserver.wal.TestReadOldRootAndMetaEdits Time > elapsed: 0.009 sec <<< ERROR! > java.io.FileNotFoundException: Destination exists and is not a directory: > /homes/hortonnd/hbase > at > org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:423) > at > org.apache.hadoop.fs.ChecksumFileSystem.mkdirs(ChecksumFileSystem.java:588) > at > org.apache.hadoop.hbase.HBaseTestingUtility.createRootDir(HBaseTestingUtility.java:1053) > at > org.apache.hadoop.hbase.regionserver.wal.TestReadOldRootAndMetaEdits.setupBeforeClass(TestReadOldRootAndMetaEdits.java:70) > {noformat} > Either the testing utility has a regression or there's a config regression in > this test. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12683) Compilation with hadoop-2.7.0-SNAPSHOT is broken
[ https://issues.apache.org/jira/browse/HBASE-12683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246323#comment-14246323 ] stack commented on HBASE-12683: --- +1 Good catch. > Compilation with hadoop-2.7.0-SNAPSHOT is broken > > > Key: HBASE-12683 > URL: https://issues.apache.org/jira/browse/HBASE-12683 > Project: HBase > Issue Type: Bug >Reporter: Enis Soztutar >Assignee: Enis Soztutar > Fix For: 1.0.0, 2.0.0, 0.98.10 > > Attachments: hbase-12683_v1.patch > > > HADOOP-11389 changed ReflectionUtils.printThreadInfo() signature, which > breaks compilation. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12684) Add new AsyncRpcClient
[ https://issues.apache.org/jira/browse/HBASE-12684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246321#comment-14246321 ] stack commented on HBASE-12684: --- bq. Besides delivering a new AsyncRpcClient I would also like to ask the question what it would take to replace the current RpcClient? Faster, cleaner, and more maintainable than what we currently have. I'd say if there was a strong signal along any of these dimensions, we'd be up for replacement (as long as no regression on the other vectors). bq. Will RpcClientImpl live on after this issue or should RpcClientImpl be removed with the arrival of AsyncRpcClient? This question affects what work is to be done next. We shoud ask out on the dev list but one scenario would have the master branch switch to new async client wholesale if it could do what the old client did (w/o significant regression and preferably with obvious improvement over what was there previous) but folks would sleep easier if the old client could live on a while and its removal happened down the road after the new client had proven its worth a while. For 1.x, we'll be conservative about a wholesale change (It could happen but preferably, folks could have choice between the old and new with the old the default). On a quick review of your patch, it looks a lot like the old client (smile) except for nice stuff doing callback. At this low level, I would suggest you do whats natural for netty and async'ing and not worry too much about code dup (minimize if you can but I'd imagine the 'flow' and 'shape' of the client at this level will want to differ from what we currently have and your hands will be full just trying to ensure you get to parity) > Add new AsyncRpcClient > -- > > Key: HBASE-12684 > URL: https://issues.apache.org/jira/browse/HBASE-12684 > Project: HBase > Issue Type: Improvement > Components: Client >Reporter: Jurriaan Mous >Assignee: Jurriaan Mous > Attachments: HBASE-12684.patch > > > With the changes in HBASE-12597 it is possible to add new RpcClients. This > issue is about adding a new Async RpcClient which would enable HBase to do > non blocking protobuf service communication. > Besides delivering a new AsyncRpcClient I would also like to ask the question > what it would take to replace the current RpcClient? This would enable to > simplify async code in some next issues. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12686) Failures in split before PONR not clearing the daughter regions from regions in transition during rollback
[ https://issues.apache.org/jira/browse/HBASE-12686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajeshbabu Chintaguntla updated HBASE-12686: Assignee: Vandana Ayyalasomayajula (was: Rajeshbabu Chintaguntla) > Failures in split before PONR not clearing the daughter regions from regions > in transition during rollback > -- > > Key: HBASE-12686 > URL: https://issues.apache.org/jira/browse/HBASE-12686 > Project: HBase > Issue Type: Bug > Components: Region Assignment >Affects Versions: 0.98.9 >Reporter: Rajeshbabu Chintaguntla >Assignee: Vandana Ayyalasomayajula >Priority: Blocker > Fix For: 1.0.0, 2.0.0, 0.98.9 > > > If there are any split failures then the both daughter regions left in > SPLITTING_NEW transition even after rollback, which will block balancing to > happen forever until unless master is restarted. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12668) Adapt PayloadCarryingRpcController so it can also be used in async way
[ https://issues.apache.org/jira/browse/HBASE-12668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246317#comment-14246317 ] stack commented on HBASE-12668: --- Your plan sounds great [~jurmous] You might post a note on dev list on what you are at (and what you have achieved so far) because more than just the lowlifes who hang out here in the JIRA forge are likely interested in what you are at. Regards publishing the snapshot, try again (smile -- sorry about that). > Adapt PayloadCarryingRpcController so it can also be used in async way > -- > > Key: HBASE-12668 > URL: https://issues.apache.org/jira/browse/HBASE-12668 > Project: HBase > Issue Type: Improvement > Components: Client >Reporter: Jurriaan Mous >Assignee: Jurriaan Mous > Fix For: 1.0.0, 2.0.0 > > Attachments: HBASE-12668-V1.patch, HBASE-12668-V1.patch, > HBASE-12668.patch > > > With the changes in HBASE-12597 it is possible to create a new RPC client. > But in all places the BlockingRpcChannel is called with a > PayloadCarryingRpcController. This controller is not usable in Async context > because some methods are not supported at the moment. (See > TimeLimitedRpcController for the methods that throw > UnsupportedOperationException) > This issue is about implementing these methods so > PayloadCarryingRpcController can also be used in an async context and work > the same in a sync context. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12689) Move version on from 0.99.2 to HBASE-1.0.0-SNAPSHOT
[ https://issues.apache.org/jira/browse/HBASE-12689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246316#comment-14246316 ] Enis Soztutar commented on HBASE-12689: --- Thanks Stack. Forgot about that after the 0.99.2 release. > Move version on from 0.99.2 to HBASE-1.0.0-SNAPSHOT > --- > > Key: HBASE-12689 > URL: https://issues.apache.org/jira/browse/HBASE-12689 > Project: HBase > Issue Type: Task >Reporter: stack >Assignee: stack > Fix For: 1.0.0 > > > Correct me if I have it wrong [~enis]. I believe this is what you want (I'm > doing it because I want to publish 1.0.0-SNAPSHOTS for a contributor -- see > HBASE-12668) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12688) Update site with a bootstrap-based UI
[ https://issues.apache.org/jira/browse/HBASE-12688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246315#comment-14246315 ] Enis Soztutar commented on HBASE-12688: --- Looks better. +1. > Update site with a bootstrap-based UI > - > > Key: HBASE-12688 > URL: https://issues.apache.org/jira/browse/HBASE-12688 > Project: HBase > Issue Type: Bug > Components: site >Affects Versions: 2.0.0 >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 2.0.0 > > Attachments: HBASE-12688.00.patch > > > Looks like we can "upgrade" our look pretty cheaply by just swapping to a > different skin. This fluido-skin uses Twitter Bootstrap. It's an older 2.x > version (upstream has moved onto 3.x), but it's a start. There's some > out-of-the-box configuration choices regarding menu bar location. We can also > look into some of our own custom CSS. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HBASE-12689) Move version on from 0.99.2 to HBASE-1.0.0-SNAPSHOT
[ https://issues.apache.org/jira/browse/HBASE-12689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-12689. --- Resolution: Fixed Fix Version/s: 1.0.0 Pushed to branch-1 > Move version on from 0.99.2 to HBASE-1.0.0-SNAPSHOT > --- > > Key: HBASE-12689 > URL: https://issues.apache.org/jira/browse/HBASE-12689 > Project: HBase > Issue Type: Task >Reporter: stack >Assignee: stack > Fix For: 1.0.0 > > > Correct me if I have it wrong [~enis]. I believe this is what you want (I'm > doing it because I want to publish 1.0.0-SNAPSHOTS for a contributor -- see > HBASE-12668) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12677) Update replication docs to clarify terminology
[ https://issues.apache.org/jira/browse/HBASE-12677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246313#comment-14246313 ] stack commented on HBASE-12677: --- I applied this locally. It seems to work for me [~misty] Suggest you just go ahead with the commit and then we sort it out after. If you would someone else blamed for the build breakage (if any), just say and I'll commit. > Update replication docs to clarify terminology > -- > > Key: HBASE-12677 > URL: https://issues.apache.org/jira/browse/HBASE-12677 > Project: HBase > Issue Type: Bug > Components: documentation >Reporter: Misty Stanley-Jones >Assignee: Misty Stanley-Jones > Attachments: HBASE-12677-v1.patch, HBASE-12677.patch > > > Remove use of master-master and cyclical replication and just talk about > topologies -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-12689) Move version on from 0.99.2 to HBASE-1.0.0-SNAPSHOT
stack created HBASE-12689: - Summary: Move version on from 0.99.2 to HBASE-1.0.0-SNAPSHOT Key: HBASE-12689 URL: https://issues.apache.org/jira/browse/HBASE-12689 Project: HBase Issue Type: Task Reporter: stack Assignee: stack Correct me if I have it wrong [~enis]. I believe this is what you want (I'm doing it because I want to publish 1.0.0-SNAPSHOTS for a contributor -- see HBASE-12668) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12687) Book is missing styling
[ https://issues.apache.org/jira/browse/HBASE-12687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246310#comment-14246310 ] stack commented on HBASE-12687: --- I kept looking for a better styling of docbook other than doing it ourselves but this was best I could turn up at time > Book is missing styling > --- > > Key: HBASE-12687 > URL: https://issues.apache.org/jira/browse/HBASE-12687 > Project: HBase > Issue Type: Bug > Components: documentation >Affects Versions: 2.0.0 >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 2.0.0 > > Attachments: HBASE-12687.00.patch > > > The online book is intended to be styled, there's a file freebsd_docbook.css. > It's not being applied; fix that. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12687) Book is missing styling
[ https://issues.apache.org/jira/browse/HBASE-12687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246309#comment-14246309 ] stack commented on HBASE-12687: --- I remember that styling. You know where we dropped it? +1 on patch. > Book is missing styling > --- > > Key: HBASE-12687 > URL: https://issues.apache.org/jira/browse/HBASE-12687 > Project: HBase > Issue Type: Bug > Components: documentation >Affects Versions: 2.0.0 >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 2.0.0 > > Attachments: HBASE-12687.00.patch > > > The online book is intended to be styled, there's a file freebsd_docbook.css. > It's not being applied; fix that. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12688) Update site with a bootstrap-based UI
[ https://issues.apache.org/jira/browse/HBASE-12688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246308#comment-14246308 ] stack commented on HBASE-12688: --- I tried it locally. Its great. +1. Maybe use the file:///Users/stack/checkouts/hbase.git.commit/target/site/images/jumping-orca_rotated_12percent.png instead of the 25percenter because its size is taking up too much of the banner. Also, have you dropped our little search box? Excellent. How were you brave enough to purge the site.vm? No more velocity templating going on? That's a blessing really (but this is probably how you lost the search box). Commit and we can refine after. You know how to build site? If not, say, and I can do it for you post-commit. > Update site with a bootstrap-based UI > - > > Key: HBASE-12688 > URL: https://issues.apache.org/jira/browse/HBASE-12688 > Project: HBase > Issue Type: Bug > Components: site >Affects Versions: 2.0.0 >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 2.0.0 > > Attachments: HBASE-12688.00.patch > > > Looks like we can "upgrade" our look pretty cheaply by just swapping to a > different skin. This fluido-skin uses Twitter Bootstrap. It's an older 2.x > version (upstream has moved onto 3.x), but it's a start. There's some > out-of-the-box configuration choices regarding menu bar location. We can also > look into some of our own custom CSS. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12685) TestSplitLogManager#testLogFilesAreArchived sometimes times out due to race condition
[ https://issues.apache.org/jira/browse/HBASE-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246303#comment-14246303 ] Anoop Sam John commented on HBASE-12685: LGTM > TestSplitLogManager#testLogFilesAreArchived sometimes times out due to race > condition > -- > > Key: HBASE-12685 > URL: https://issues.apache.org/jira/browse/HBASE-12685 > Project: HBase > Issue Type: Test >Reporter: Ted Yu >Assignee: Ted Yu >Priority: Minor > Attachments: 12685-v1.txt > > > From > https://builds.apache.org/job/hbase-0.98/739/testReport/org.apache.hadoop.hbase.master/TestSplitLogManager/testLogFilesAreArchived/ > : > {code} > 2014-12-14 14:40:30,420 INFO [Thread-27] master.SplitLogManager(325): > started splitting 1 logs in > [/home/jenkins/jenkins-slave/workspace/HBase-0.98/hbase-server/target/test-data/c065c13d-bc83-48e7-9178-51a14df531c3/testLogFilesAreArchived/f7ae1e8f-c848-4089-b5b1-20aff73c81dd] > 2014-12-14 14:40:30,422 WARN [Thread-31] master.TestSplitLogManager$5(527): > org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = > NoNode for /hbase/splitWAL/f7ae1e8f-c848-4089-b5b1-20aff73c81dd%2Ffoo%2C1%2C1 > 2014-12-14 14:40:30,423 DEBUG [main-EventThread] master.SplitLogManager(703): > put up splitlog task at znode > /hbase/splitWAL/f7ae1e8f-c848-4089-b5b1-20aff73c81dd%2Ffoo%2C1%2C1 > {code} > The thread which mocks split done called ZKUtil.setData() before > SplitLogManager put up the splitlog task znode. The setting of done to true > should exclude the above scenario. > Otherwise log split task would miss the split done mock, resulting in test > failure: > {code} > 2014-12-14 14:41:18,562 INFO [main-EventThread] master.SplitLogManager(753): > task /hbase/splitWAL/RESCAN04 entered state: DONE dummy-master,1,1 > 2014-12-14 14:41:18,563 DEBUG [main-EventThread] > zookeeper.ZooKeeperWatcher(312): > split-log-manager-testsa62d20ae-9904-4dc6-9e79-b7d98486dd49-0x14a493e58af, > quorum=localhost:50869, baseZNode=/hbase Received ZooKeeper Event, > type=NodeDeleted, state=SyncConnected, path=/hbase/splitWAL/RESCAN04 > 2014-12-14 14:41:18,563 DEBUG [main-EventThread] > master.SplitLogManager$DeleteAsyncCallback(1712): deleted > /hbase/splitWAL/RESCAN04 > 2014-12-14 14:41:18,563 DEBUG [main-EventThread] master.SplitLogManager(935): > deleted task without in memory state /hbase/splitWAL/RESCAN04 > 2014-12-14 14:41:20,562 INFO > [dummy-master,1,1.splitLogManagerTimeoutMonitor] > master.SplitLogManager$TimeoutMonitor(1502): total tasks = 1 unassigned = 1 > tasks={/hbase/splitWAL/f7ae1e8f-c848-4089-b5b1-20aff73c81dd%2Ffoo%2C1%2C1=last_update > = -1 last_version = -1 cur_worker_name = null status = in_progress > incarnation = 0 resubmits = 0 batch = installed = 1 done = 0 error = 0} > 2014-12-14 14:41:25,568 INFO > [dummy-master,1,1.splitLogManagerTimeoutMonitor] > master.SplitLogManager$TimeoutMonitor(1502): total tasks = 1 unassigned = 1 > tasks={/hbase/splitWAL/f7ae1e8f-c848-4089-b5b1-20aff73c81dd%2Ffoo%2C1%2C1=last_update > = -1 last_version = -1 cur_worker_name = null status = in_progress > incarnation = 0 resubmits = 0 batch = installed = 1 done = 0 error = 0} > 2014-12-14 14:41:30,399 WARN [Thread-27] master.SplitLogManager(441): > Interrupted while waiting for log splits to be completed > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12679) Add HBaseInterfaceAudience.TOOLS and move some of the Public classes to LimitedPrivate
[ https://issues.apache.org/jira/browse/HBASE-12679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246297#comment-14246297 ] Hudson commented on HBASE-12679: SUCCESS: Integrated in HBase-1.0 #581 (See [https://builds.apache.org/job/HBase-1.0/581/]) HBASE-12679 Add HBaseInterfaceAudience.TOOLS and move some of the Public classes to LimitedPrivate (enis: rev 4f22143dfac700078492da580bad54fd578062e0) * hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftServer.java * hbase-server/src/test/java/org/apache/hadoop/hbase/util/LoadTestTool.java * hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/Driver.java * hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift2/ThriftServer.java * hbase-client/src/main/java/org/apache/hadoop/hbase/client/Query.java * hbase-rest/src/main/java/org/apache/hadoop/hbase/rest/RESTServer.java * hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFilePrettyPrinter.java * hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/HQuorumPeer.java * hbase-server/src/test/java/org/apache/hadoop/hbase/HFilePerformanceEvaluation.java * hbase-server/src/main/java/org/apache/hadoop/hbase/util/Merge.java * hbase-client/src/main/java/org/apache/hadoop/hbase/YouAreDeadException.java * hbase-server/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java * hbase-client/src/main/java/org/apache/hadoop/hbase/client/ReversedScannerCallable.java * hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HeapMemoryTuner.java * hbase-server/src/test/java/org/apache/hadoop/hbase/ScanPerformanceEvaluation.java * hbase-server/src/main/java/org/apache/hadoop/hbase/util/CompressionTest.java * hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/HLogPrettyPrinter.java * hbase-server/src/test/java/org/apache/hadoop/hbase/PerformanceEvaluation.java * hbase-server/src/main/java/org/apache/hadoop/hbase/mapred/Driver.java * hbase-server/src/main/java/org/apache/hadoop/hbase/util/hbck/OfflineMetaRepair.java * hbase-server/src/main/java/org/apache/hadoop/hbase/util/MapreduceDependencyClasspathTool.java * hbase-server/src/main/java/org/apache/hadoop/hbase/zookeeper/ZKServerTool.java * hbase-common/src/main/java/org/apache/hadoop/hbase/HBaseInterfaceAudience.java * hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTableInterfaceFactory.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java * hbase-server/src/test/java/org/apache/hadoop/hbase/MapFilePerformanceEvaluation.java * hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/CompactionTool.java * hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java * hbase-client/src/main/java/org/apache/hadoop/hbase/master/RegionState.java * hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WALPrettyPrinter.java * hbase-server/src/main/java/org/apache/hadoop/hbase/zookeeper/ZooKeeperMainServer.java > Add HBaseInterfaceAudience.TOOLS and move some of the Public classes to > LimitedPrivate > -- > > Key: HBASE-12679 > URL: https://issues.apache.org/jira/browse/HBASE-12679 > Project: HBase > Issue Type: Sub-task > Components: Client >Reporter: Enis Soztutar >Assignee: Enis Soztutar > Fix For: 1.0.0, 2.0.0 > > Attachments: hbase-12679_v1.patch, hbase-12679_v2.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12422) Use ConnectionFactory in HTable constructors
[ https://issues.apache.org/jira/browse/HBASE-12422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-12422: -- Resolution: Fixed Status: Resolved (was: Patch Available) Pushed to branch-1+ > Use ConnectionFactory in HTable constructors > > > Key: HBASE-12422 > URL: https://issues.apache.org/jira/browse/HBASE-12422 > Project: HBase > Issue Type: Bug > Components: Client >Reporter: Solomon Duskis >Assignee: stack >Priority: Minor > Fix For: 1.0.0, 2.0.0 > > Attachments: 12422v2.txt, 12422v3.txt, 12422v4.txt, 12422v5.txt, > HBASE-12422.patch, HBASE-12422.patch, HBASE-12422.patch, HBASE-12422.patch, > HBASE-12422.patch > > > Use ConnectionFactory in HTable instead of ConnectionManager. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12422) Use ConnectionFactory in HTable constructors
[ https://issues.apache.org/jira/browse/HBASE-12422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246291#comment-14246291 ] stack commented on HBASE-12422: --- Sorry the patch is big but its big because I added timeouts to TestHBaseFsck and to TestLoadIncrementalHFilesSplitRecovery so they wouldn't go zombie on us anymore when an issue. Other changes in TestLoadIncrementalHFilesSplitRecovery are refactorings so we reuse a connection rather than use deprecated HTable constructor; ditto in LoadIncrementalHFiles (this latter and similar change in TestHBaseFsck) fixed the failing tests). The change in HBaseFsck just moves us onto newer Interfaces. Then there is Solomon's original change. > Use ConnectionFactory in HTable constructors > > > Key: HBASE-12422 > URL: https://issues.apache.org/jira/browse/HBASE-12422 > Project: HBase > Issue Type: Bug > Components: Client >Reporter: Solomon Duskis >Assignee: stack >Priority: Minor > Fix For: 1.0.0, 2.0.0 > > Attachments: 12422v2.txt, 12422v3.txt, 12422v4.txt, 12422v5.txt, > HBASE-12422.patch, HBASE-12422.patch, HBASE-12422.patch, HBASE-12422.patch, > HBASE-12422.patch > > > Use ConnectionFactory in HTable instead of ConnectionManager. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12679) Add HBaseInterfaceAudience.TOOLS and move some of the Public classes to LimitedPrivate
[ https://issues.apache.org/jira/browse/HBASE-12679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246282#comment-14246282 ] Hudson commented on HBASE-12679: SUCCESS: Integrated in HBase-TRUNK #5918 (See [https://builds.apache.org/job/HBase-TRUNK/5918/]) HBASE-12679 Add HBaseInterfaceAudience.TOOLS and move some of the Public classes to LimitedPrivate (enis: rev 743d16138e8817164f82026b4ef26fbd02c204bd) * hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java * hbase-server/src/test/java/org/apache/hadoop/hbase/ScanPerformanceEvaluation.java * hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/HQuorumPeer.java * hbase-server/src/main/java/org/apache/hadoop/hbase/zookeeper/ZooKeeperMainServer.java * hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFilePrettyPrinter.java * hbase-server/src/test/java/org/apache/hadoop/hbase/PerformanceEvaluation.java * hbase-client/src/main/java/org/apache/hadoop/hbase/master/RegionState.java * hbase-server/src/main/java/org/apache/hadoop/hbase/util/Merge.java * hbase-server/src/main/java/org/apache/hadoop/hbase/mapred/Driver.java * hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HeapMemoryTuner.java * hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WALPrettyPrinter.java * hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTableInterfaceFactory.java * hbase-server/src/test/java/org/apache/hadoop/hbase/MapFilePerformanceEvaluation.java * hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/Driver.java * hbase-client/src/main/java/org/apache/hadoop/hbase/client/ReversedScannerCallable.java * hbase-rest/src/main/java/org/apache/hadoop/hbase/rest/RESTServer.java * hbase-server/src/main/java/org/apache/hadoop/hbase/util/MapreduceDependencyClasspathTool.java * hbase-server/src/main/java/org/apache/hadoop/hbase/util/hbck/OfflineMetaRepair.java * hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java * hbase-client/src/main/java/org/apache/hadoop/hbase/YouAreDeadException.java * hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift2/ThriftServer.java * hbase-server/src/test/java/org/apache/hadoop/hbase/util/LoadTestTool.java * hbase-server/src/main/java/org/apache/hadoop/hbase/zookeeper/ZKServerTool.java * hbase-server/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java * hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftServer.java * hbase-server/src/test/java/org/apache/hadoop/hbase/HFilePerformanceEvaluation.java * hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/HLogPrettyPrinter.java * hbase-common/src/main/java/org/apache/hadoop/hbase/HBaseInterfaceAudience.java * hbase-server/src/main/java/org/apache/hadoop/hbase/util/CompressionTest.java * hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/CompactionTool.java * hbase-client/src/main/java/org/apache/hadoop/hbase/client/Query.java > Add HBaseInterfaceAudience.TOOLS and move some of the Public classes to > LimitedPrivate > -- > > Key: HBASE-12679 > URL: https://issues.apache.org/jira/browse/HBASE-12679 > Project: HBase > Issue Type: Sub-task > Components: Client >Reporter: Enis Soztutar >Assignee: Enis Soztutar > Fix For: 1.0.0, 2.0.0 > > Attachments: hbase-12679_v1.patch, hbase-12679_v2.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12688) Update site with a bootstrap-based UI
[ https://issues.apache.org/jira/browse/HBASE-12688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246277#comment-14246277 ] Hadoop QA commented on HBASE-12688: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12687154/HBASE-12688.00.patch against master branch at commit 65830b096b6f540b7e49ef590dac1ebe2491c126. ATTACHMENT ID: 12687154 {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:red}-1 tests included{color}. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 checkstyle{color}. The applied patch does not increase the total number of checkstyle errors {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 2.0.3) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 lineLengths{color}. The patch does not introduce lines longer than 100 {color:green}+1 site{color}. The mvn site goal succeeds with this patch. {color:green}+1 core tests{color}. The patch passed unit tests in . Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/12081//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12081//artifact/patchprocess/newPatchFindbugsWarningshbase-rest.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12081//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12081//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12081//artifact/patchprocess/newPatchFindbugsWarningshbase-annotations.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12081//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12081//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12081//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12081//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12081//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12081//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12081//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html Checkstyle Errors: https://builds.apache.org/job/PreCommit-HBASE-Build/12081//artifact/patchprocess/checkstyle-aggregate.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/12081//console This message is automatically generated. > Update site with a bootstrap-based UI > - > > Key: HBASE-12688 > URL: https://issues.apache.org/jira/browse/HBASE-12688 > Project: HBase > Issue Type: Bug > Components: site >Affects Versions: 2.0.0 >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 2.0.0 > > Attachments: HBASE-12688.00.patch > > > Looks like we can "upgrade" our look pretty cheaply by just swapping to a > different skin. This fluido-skin uses Twitter Bootstrap. It's an older 2.x > version (upstream has moved onto 3.x), but it's a start. There's some > out-of-the-box configuration choices regarding menu bar location. We can also > look into some of our own custom CSS. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12685) TestSplitLogManager#testLogFilesAreArchived sometimes times out due to race condition
[ https://issues.apache.org/jira/browse/HBASE-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246239#comment-14246239 ] Andrew Purtell commented on HBASE-12685: +1 > TestSplitLogManager#testLogFilesAreArchived sometimes times out due to race > condition > -- > > Key: HBASE-12685 > URL: https://issues.apache.org/jira/browse/HBASE-12685 > Project: HBase > Issue Type: Test >Reporter: Ted Yu >Assignee: Ted Yu >Priority: Minor > Attachments: 12685-v1.txt > > > From > https://builds.apache.org/job/hbase-0.98/739/testReport/org.apache.hadoop.hbase.master/TestSplitLogManager/testLogFilesAreArchived/ > : > {code} > 2014-12-14 14:40:30,420 INFO [Thread-27] master.SplitLogManager(325): > started splitting 1 logs in > [/home/jenkins/jenkins-slave/workspace/HBase-0.98/hbase-server/target/test-data/c065c13d-bc83-48e7-9178-51a14df531c3/testLogFilesAreArchived/f7ae1e8f-c848-4089-b5b1-20aff73c81dd] > 2014-12-14 14:40:30,422 WARN [Thread-31] master.TestSplitLogManager$5(527): > org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = > NoNode for /hbase/splitWAL/f7ae1e8f-c848-4089-b5b1-20aff73c81dd%2Ffoo%2C1%2C1 > 2014-12-14 14:40:30,423 DEBUG [main-EventThread] master.SplitLogManager(703): > put up splitlog task at znode > /hbase/splitWAL/f7ae1e8f-c848-4089-b5b1-20aff73c81dd%2Ffoo%2C1%2C1 > {code} > The thread which mocks split done called ZKUtil.setData() before > SplitLogManager put up the splitlog task znode. The setting of done to true > should exclude the above scenario. > Otherwise log split task would miss the split done mock, resulting in test > failure: > {code} > 2014-12-14 14:41:18,562 INFO [main-EventThread] master.SplitLogManager(753): > task /hbase/splitWAL/RESCAN04 entered state: DONE dummy-master,1,1 > 2014-12-14 14:41:18,563 DEBUG [main-EventThread] > zookeeper.ZooKeeperWatcher(312): > split-log-manager-testsa62d20ae-9904-4dc6-9e79-b7d98486dd49-0x14a493e58af, > quorum=localhost:50869, baseZNode=/hbase Received ZooKeeper Event, > type=NodeDeleted, state=SyncConnected, path=/hbase/splitWAL/RESCAN04 > 2014-12-14 14:41:18,563 DEBUG [main-EventThread] > master.SplitLogManager$DeleteAsyncCallback(1712): deleted > /hbase/splitWAL/RESCAN04 > 2014-12-14 14:41:18,563 DEBUG [main-EventThread] master.SplitLogManager(935): > deleted task without in memory state /hbase/splitWAL/RESCAN04 > 2014-12-14 14:41:20,562 INFO > [dummy-master,1,1.splitLogManagerTimeoutMonitor] > master.SplitLogManager$TimeoutMonitor(1502): total tasks = 1 unassigned = 1 > tasks={/hbase/splitWAL/f7ae1e8f-c848-4089-b5b1-20aff73c81dd%2Ffoo%2C1%2C1=last_update > = -1 last_version = -1 cur_worker_name = null status = in_progress > incarnation = 0 resubmits = 0 batch = installed = 1 done = 0 error = 0} > 2014-12-14 14:41:25,568 INFO > [dummy-master,1,1.splitLogManagerTimeoutMonitor] > master.SplitLogManager$TimeoutMonitor(1502): total tasks = 1 unassigned = 1 > tasks={/hbase/splitWAL/f7ae1e8f-c848-4089-b5b1-20aff73c81dd%2Ffoo%2C1%2C1=last_update > = -1 last_version = -1 cur_worker_name = null status = in_progress > incarnation = 0 resubmits = 0 batch = installed = 1 done = 0 error = 0} > 2014-12-14 14:41:30,399 WARN [Thread-27] master.SplitLogManager(441): > Interrupted while waiting for log splits to be completed > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12686) Failures in split before PONR not clearing the daughter regions from regions in transition during rollback
[ https://issues.apache.org/jira/browse/HBASE-12686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell updated HBASE-12686: --- Fix Version/s: (was: 0.98.10) 0.98.9 > Failures in split before PONR not clearing the daughter regions from regions > in transition during rollback > -- > > Key: HBASE-12686 > URL: https://issues.apache.org/jira/browse/HBASE-12686 > Project: HBase > Issue Type: Bug > Components: Region Assignment >Affects Versions: 0.98.9 >Reporter: Rajeshbabu Chintaguntla >Assignee: Rajeshbabu Chintaguntla >Priority: Blocker > Fix For: 1.0.0, 2.0.0, 0.98.9 > > > If there are any split failures then the both daughter regions left in > SPLITTING_NEW transition even after rollback, which will block balancing to > happen forever until unless master is restarted. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12686) Failures in split before PONR not clearing the daughter regions from regions in transition during rollback
[ https://issues.apache.org/jira/browse/HBASE-12686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell updated HBASE-12686: --- Fix Version/s: 2.0.0 > Failures in split before PONR not clearing the daughter regions from regions > in transition during rollback > -- > > Key: HBASE-12686 > URL: https://issues.apache.org/jira/browse/HBASE-12686 > Project: HBase > Issue Type: Bug > Components: Region Assignment >Affects Versions: 0.98.9 >Reporter: Rajeshbabu Chintaguntla >Assignee: Rajeshbabu Chintaguntla >Priority: Blocker > Fix For: 1.0.0, 2.0.0, 0.98.10 > > > If there are any split failures then the both daughter regions left in > SPLITTING_NEW transition even after rollback, which will block balancing to > happen forever until unless master is restarted. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12686) Failures in split before PONR not clearing the daughter regions from regions in transition during rollback
[ https://issues.apache.org/jira/browse/HBASE-12686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell updated HBASE-12686: --- Priority: Blocker (was: Major) Fix Version/s: 1.0.0 > Failures in split before PONR not clearing the daughter regions from regions > in transition during rollback > -- > > Key: HBASE-12686 > URL: https://issues.apache.org/jira/browse/HBASE-12686 > Project: HBase > Issue Type: Bug > Components: Region Assignment >Affects Versions: 0.98.9 >Reporter: Rajeshbabu Chintaguntla >Assignee: Rajeshbabu Chintaguntla >Priority: Blocker > Fix For: 1.0.0, 0.98.10 > > > If there are any split failures then the both daughter regions left in > SPLITTING_NEW transition even after rollback, which will block balancing to > happen forever until unless master is restarted. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12687) Book is missing styling
[ https://issues.apache.org/jira/browse/HBASE-12687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246232#comment-14246232 ] Hadoop QA commented on HBASE-12687: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12687153/HBASE-12687.00.patch against master branch at commit 65830b096b6f540b7e49ef590dac1ebe2491c126. ATTACHMENT ID: 12687153 {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+0 tests included{color}. The patch appears to be a documentation patch that doesn't require tests. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 checkstyle{color}. The applied patch does not increase the total number of checkstyle errors {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 2.0.3) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 lineLengths{color}. The patch does not introduce lines longer than 100 {color:green}+1 site{color}. The mvn site goal succeeds with this patch. {color:red}-1 core tests{color}. The patch failed these unit tests: {color:red}-1 core zombie tests{color}. There are 1 zombie test(s): at org.apache.hadoop.hbase.http.TestHttpServerLifecycle.testStartedServerIsAlive(TestHttpServerLifecycle.java:71) Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/12080//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12080//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12080//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12080//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12080//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12080//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12080//artifact/patchprocess/newPatchFindbugsWarningshbase-rest.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12080//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12080//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12080//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12080//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12080//artifact/patchprocess/newPatchFindbugsWarningshbase-annotations.html Checkstyle Errors: https://builds.apache.org/job/PreCommit-HBASE-Build/12080//artifact/patchprocess/checkstyle-aggregate.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/12080//console This message is automatically generated. > Book is missing styling > --- > > Key: HBASE-12687 > URL: https://issues.apache.org/jira/browse/HBASE-12687 > Project: HBase > Issue Type: Bug > Components: documentation >Affects Versions: 2.0.0 >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 2.0.0 > > Attachments: HBASE-12687.00.patch > > > The online book is intended to be styled, there's a file freebsd_docbook.css. > It's not being applied; fix that. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12679) Add HBaseInterfaceAudience.TOOLS and move some of the Public classes to LimitedPrivate
[ https://issues.apache.org/jira/browse/HBASE-12679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar updated HBASE-12679: -- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Pushed to 1.0+. Thanks for review Stack. > Add HBaseInterfaceAudience.TOOLS and move some of the Public classes to > LimitedPrivate > -- > > Key: HBASE-12679 > URL: https://issues.apache.org/jira/browse/HBASE-12679 > Project: HBase > Issue Type: Sub-task > Components: Client >Reporter: Enis Soztutar >Assignee: Enis Soztutar > Fix For: 1.0.0, 2.0.0 > > Attachments: hbase-12679_v1.patch, hbase-12679_v2.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12651) Backport HBASE-12559 'Provide LoadBalancer with online configuration capability' to branch-1
[ https://issues.apache.org/jira/browse/HBASE-12651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246227#comment-14246227 ] Enis Soztutar commented on HBASE-12651: --- Sorry I was not part of the original review. This seems fine for 1.0, but I am concerned about the hbase-site2.xml and the unit test. hbase-site2.xml will diverge from hbase-site.xml very quickly since devs will not know about this file, and will not change it then they add a new conf option. Then, when this test overwrites the file, concurrently running tests will be affected. I think the unit test should be changed so that it dynamically re-writes the file with the added config option rather than committing the hbase-site2.xml file. > Backport HBASE-12559 'Provide LoadBalancer with online configuration > capability' to branch-1 > > > Key: HBASE-12651 > URL: https://issues.apache.org/jira/browse/HBASE-12651 > Project: HBase > Issue Type: Improvement >Reporter: Ted Yu >Assignee: Ted Yu > Fix For: 1.0.0 > > Attachments: 12651-1.0.txt > > > HBASE-12559 added support for online configuration update of load balancer. > This JIRA backports this to branch-1 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12688) Update site with a bootstrap-based UI
[ https://issues.apache.org/jira/browse/HBASE-12688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Dimiduk updated HBASE-12688: - Status: Patch Available (was: Open) > Update site with a bootstrap-based UI > - > > Key: HBASE-12688 > URL: https://issues.apache.org/jira/browse/HBASE-12688 > Project: HBase > Issue Type: Bug > Components: site >Affects Versions: 2.0.0 >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 2.0.0 > > Attachments: HBASE-12688.00.patch > > > Looks like we can "upgrade" our look pretty cheaply by just swapping to a > different skin. This fluido-skin uses Twitter Bootstrap. It's an older 2.x > version (upstream has moved onto 3.x), but it's a start. There's some > out-of-the-box configuration choices regarding menu bar location. We can also > look into some of our own custom CSS. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12688) Update site with a bootstrap-based UI
[ https://issues.apache.org/jira/browse/HBASE-12688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Dimiduk updated HBASE-12688: - Attachment: HBASE-12688.00.patch > Update site with a bootstrap-based UI > - > > Key: HBASE-12688 > URL: https://issues.apache.org/jira/browse/HBASE-12688 > Project: HBase > Issue Type: Bug > Components: site >Affects Versions: 2.0.0 >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 2.0.0 > > Attachments: HBASE-12688.00.patch > > > Looks like we can "upgrade" our look pretty cheaply by just swapping to a > different skin. This fluido-skin uses Twitter Bootstrap. It's an older 2.x > version (upstream has moved onto 3.x), but it's a start. There's some > out-of-the-box configuration choices regarding menu bar location. We can also > look into some of our own custom CSS. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-12688) Update site with a bootstrap-based UI
Nick Dimiduk created HBASE-12688: Summary: Update site with a bootstrap-based UI Key: HBASE-12688 URL: https://issues.apache.org/jira/browse/HBASE-12688 Project: HBase Issue Type: Bug Components: site Affects Versions: 2.0.0 Reporter: Nick Dimiduk Assignee: Nick Dimiduk Fix For: 2.0.0 Looks like we can "upgrade" our look pretty cheaply by just swapping to a different skin. This fluido-skin uses Twitter Bootstrap. It's an older 2.x version (upstream has moved onto 3.x), but it's a start. There's some out-of-the-box configuration choices regarding menu bar location. We can also look into some of our own custom CSS. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12687) Book is missing styling
[ https://issues.apache.org/jira/browse/HBASE-12687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Dimiduk updated HBASE-12687: - Status: Patch Available (was: Open) > Book is missing styling > --- > > Key: HBASE-12687 > URL: https://issues.apache.org/jira/browse/HBASE-12687 > Project: HBase > Issue Type: Bug > Components: documentation >Affects Versions: 2.0.0 >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 2.0.0 > > Attachments: HBASE-12687.00.patch > > > The online book is intended to be styled, there's a file freebsd_docbook.css. > It's not being applied; fix that. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12687) Book is missing styling
[ https://issues.apache.org/jira/browse/HBASE-12687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Dimiduk updated HBASE-12687: - Attachment: HBASE-12687.00.patch > Book is missing styling > --- > > Key: HBASE-12687 > URL: https://issues.apache.org/jira/browse/HBASE-12687 > Project: HBase > Issue Type: Bug > Components: documentation >Affects Versions: 2.0.0 >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk > Fix For: 2.0.0 > > Attachments: HBASE-12687.00.patch > > > The online book is intended to be styled, there's a file freebsd_docbook.css. > It's not being applied; fix that. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12686) Failures in split before PONR not clearing the daughter regions from regions in transition during rollback
[ https://issues.apache.org/jira/browse/HBASE-12686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajeshbabu Chintaguntla updated HBASE-12686: Summary: Failures in split before PONR not clearing the daughter regions from regions in transition during rollback (was: Failures in split left the daughter regions in transition forever even after rollback) > Failures in split before PONR not clearing the daughter regions from regions > in transition during rollback > -- > > Key: HBASE-12686 > URL: https://issues.apache.org/jira/browse/HBASE-12686 > Project: HBase > Issue Type: Bug > Components: Region Assignment >Affects Versions: 0.98.9 >Reporter: Rajeshbabu Chintaguntla >Assignee: Rajeshbabu Chintaguntla > Fix For: 0.98.10 > > > If there are any split failures then the both daughter regions left in > SPLITTING_NEW transition even after rollback, which will block balancing to > happen forever until unless master is restarted. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12686) Failures in split left the daughter regions in transition forever even after rollback
[ https://issues.apache.org/jira/browse/HBASE-12686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajeshbabu Chintaguntla updated HBASE-12686: Description: If there are any split failures then the both daughter regions left in SPLITTING_NEW transition even after rollback, which will block balancing to happen forever until unless master is restarted. (was: If there are any split failures then the both daughter regions left in transition even after rollback, which will block balancing to happen forever until unless master is restarted.) > Failures in split left the daughter regions in transition forever even after > rollback > - > > Key: HBASE-12686 > URL: https://issues.apache.org/jira/browse/HBASE-12686 > Project: HBase > Issue Type: Bug > Components: Region Assignment >Affects Versions: 0.98.9 >Reporter: Rajeshbabu Chintaguntla >Assignee: Rajeshbabu Chintaguntla > Fix For: 0.98.10 > > > If there are any split failures then the both daughter regions left in > SPLITTING_NEW transition even after rollback, which will block balancing to > happen forever until unless master is restarted. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Assigned] (HBASE-12686) Failures in split left the daughter regions in transition forever even after rollback
[ https://issues.apache.org/jira/browse/HBASE-12686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajeshbabu Chintaguntla reassigned HBASE-12686: --- Assignee: Rajeshbabu Chintaguntla (was: rajeshbabu) > Failures in split left the daughter regions in transition forever even after > rollback > - > > Key: HBASE-12686 > URL: https://issues.apache.org/jira/browse/HBASE-12686 > Project: HBase > Issue Type: Bug > Components: Region Assignment >Affects Versions: 0.98.9 >Reporter: Rajeshbabu Chintaguntla >Assignee: Rajeshbabu Chintaguntla > Fix For: 0.98.10 > > > If there are any split failures then the both daughter regions left in > transition even after rollback, which will block balancing to happen forever > until unless master is restarted. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-12687) Book is missing styling
Nick Dimiduk created HBASE-12687: Summary: Book is missing styling Key: HBASE-12687 URL: https://issues.apache.org/jira/browse/HBASE-12687 Project: HBase Issue Type: Bug Components: documentation Affects Versions: 2.0.0 Reporter: Nick Dimiduk Assignee: Nick Dimiduk Fix For: 2.0.0 The online book is intended to be styled, there's a file freebsd_docbook.css. It's not being applied; fix that. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Assigned] (HBASE-12686) Failures in split left the daughter regions in transition forever even after rollback
[ https://issues.apache.org/jira/browse/HBASE-12686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] rajeshbabu reassigned HBASE-12686: -- Assignee: rajeshbabu > Failures in split left the daughter regions in transition forever even after > rollback > - > > Key: HBASE-12686 > URL: https://issues.apache.org/jira/browse/HBASE-12686 > Project: HBase > Issue Type: Bug > Components: Region Assignment >Affects Versions: 0.98.9 >Reporter: Rajeshbabu Chintaguntla >Assignee: rajeshbabu > Fix For: 0.98.10 > > > If there are any split failures then the both daughter regions left in > transition even after rollback, which will block balancing to happen forever > until unless master is restarted. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-12686) Failures in split left the daughter regions in transition forever even after rollback
Rajeshbabu Chintaguntla created HBASE-12686: --- Summary: Failures in split left the daughter regions in transition forever even after rollback Key: HBASE-12686 URL: https://issues.apache.org/jira/browse/HBASE-12686 Project: HBase Issue Type: Bug Components: Region Assignment Affects Versions: 0.98.9 Reporter: Rajeshbabu Chintaguntla Fix For: 0.98.10 If there are any split failures then the both daughter regions left in transition even after rollback, which will block balancing to happen forever until unless master is restarted. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12677) Update replication docs to clarify terminology
[ https://issues.apache.org/jira/browse/HBASE-12677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246191#comment-14246191 ] Hadoop QA commented on HBASE-12677: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12687150/HBASE-12677-v1.patch against master branch at commit 65830b096b6f540b7e49ef590dac1ebe2491c126. ATTACHMENT ID: 12687150 {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+0 tests included{color}. The patch appears to be a documentation patch that doesn't require tests. {color:red}-1 patch{color}. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/12079//console This message is automatically generated. > Update replication docs to clarify terminology > -- > > Key: HBASE-12677 > URL: https://issues.apache.org/jira/browse/HBASE-12677 > Project: HBase > Issue Type: Bug > Components: documentation >Reporter: Misty Stanley-Jones >Assignee: Misty Stanley-Jones > Attachments: HBASE-12677-v1.patch, HBASE-12677.patch > > > Remove use of master-master and cyclical replication and just talk about > topologies -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12677) Update replication docs to clarify terminology
[ https://issues.apache.org/jira/browse/HBASE-12677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misty Stanley-Jones updated HBASE-12677: Attachment: HBASE-12677-v1.patch > Update replication docs to clarify terminology > -- > > Key: HBASE-12677 > URL: https://issues.apache.org/jira/browse/HBASE-12677 > Project: HBase > Issue Type: Bug > Components: documentation >Reporter: Misty Stanley-Jones >Assignee: Misty Stanley-Jones > Attachments: HBASE-12677-v1.patch, HBASE-12677.patch > > > Remove use of master-master and cyclical replication and just talk about > topologies -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12465) HBase master start fails due to incorrect file creations
[ https://issues.apache.org/jira/browse/HBASE-12465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246118#comment-14246118 ] Alicia Ying Shu commented on HBASE-12465: - [~saint@gmail.com] [~jeffreyz] If an exception out of createInitialFileSystemLayout is not fatal, can we catch the exception and make sure the tmp directory exist and continue? > HBase master start fails due to incorrect file creations > > > Key: HBASE-12465 > URL: https://issues.apache.org/jira/browse/HBASE-12465 > Project: HBase > Issue Type: Bug > Components: master >Affects Versions: 0.96.0 > Environment: Ubuntu >Reporter: Biju Nair >Assignee: Alicia Ying Shu > Labels: hbase, hbase-bulkload > > - Start of HBase master fails due to the following error found in the log. > 2014-11-11 20:25:58,860 WARN org.apache.hadoop.hbase.backup.HFileArchiver: > Failed to archive class > org.apache.hadoop.hbase.backup.HFileArchiver$FileablePa > th,file:hdfs:///hbase/.tmp/data/default/tbl/00820520f5cb7839395e83f40c8d97c2/e/52bf9eee7a27460c8d9e2a26fa43c918_SeqId_282271246_ > on try #1 > org.apache.hadoop.security.AccessControlException: Permission denied: > user=hbase,access=WRITE,inode="/hbase/.tmp/data/default/tbl/00820520f5cb7839395e83f40c8d97c2/e/52bf9eee7a27460c8d9e2a26fa43c918_SeqId_282271246_":devuser:supergroup:-rwxr-xr-x > - All the files that hbase master was complaining about are created under an > users user-id instead on "hbase" user resulting in incorrect access > permission for the master to act on. > - Looks like this was due to bulk load done using LoadIncrementalHFiles > program. > - HBASE-12052 is another scenario similar to this one. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12685) TestSplitLogManager#testLogFilesAreArchived sometimes times out due to race condition
[ https://issues.apache.org/jira/browse/HBASE-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246095#comment-14246095 ] Hadoop QA commented on HBASE-12685: --- {color:green}+1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12687128/12685-v1.txt against master branch at commit 65830b096b6f540b7e49ef590dac1ebe2491c126. ATTACHMENT ID: 12687128 {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 3 new or modified tests. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 checkstyle{color}. The applied patch does not increase the total number of checkstyle errors {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 2.0.3) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 lineLengths{color}. The patch does not introduce lines longer than 100 {color:green}+1 site{color}. The mvn site goal succeeds with this patch. {color:green}+1 core tests{color}. The patch passed unit tests in . Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/12078//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12078//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12078//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12078//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12078//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12078//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12078//artifact/patchprocess/newPatchFindbugsWarningshbase-rest.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12078//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12078//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12078//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12078//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12078//artifact/patchprocess/newPatchFindbugsWarningshbase-annotations.html Checkstyle Errors: https://builds.apache.org/job/PreCommit-HBASE-Build/12078//artifact/patchprocess/checkstyle-aggregate.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/12078//console This message is automatically generated. > TestSplitLogManager#testLogFilesAreArchived sometimes times out due to race > condition > -- > > Key: HBASE-12685 > URL: https://issues.apache.org/jira/browse/HBASE-12685 > Project: HBase > Issue Type: Test >Reporter: Ted Yu >Assignee: Ted Yu >Priority: Minor > Attachments: 12685-v1.txt > > > From > https://builds.apache.org/job/hbase-0.98/739/testReport/org.apache.hadoop.hbase.master/TestSplitLogManager/testLogFilesAreArchived/ > : > {code} > 2014-12-14 14:40:30,420 INFO [Thread-27] master.SplitLogManager(325): > started splitting 1 logs in > [/home/jenkins/jenkins-slave/workspace/HBase-0.98/hbase-server/target/test-data/c065c13d-bc83-48e7-9178-51a14df531c3/testLogFilesAreArchived/f7ae1e8f-c848-4089-b5b1-20aff73c81dd] > 2014-12-14 14:40:30,422 WARN [Thread-31] master.TestSplitLogManager$5(527): > org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = > NoNode for /hbase/splitWAL/f7ae1e8f-c848-4089-b5b1-20aff73c81dd%2Ffoo%2C1%2C1 > 2014-12-14 14:40:30,423 DEBUG [main-EventThread] master.SplitLogManager(703): > put up splitlog task at znode > /hbase/splitWAL/f7ae1e8f-c848-4089-b5b1-20aff73c81dd%2Ffoo%2C1%2C1 > {code} > The thread which mocks split done called ZKUtil.setData() before > SplitLogManage
[jira] [Updated] (HBASE-12685) TestSplitLogManager#testLogFilesAreArchived sometimes times out due to race condition
[ https://issues.apache.org/jira/browse/HBASE-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-12685: --- Status: Patch Available (was: Open) > TestSplitLogManager#testLogFilesAreArchived sometimes times out due to race > condition > -- > > Key: HBASE-12685 > URL: https://issues.apache.org/jira/browse/HBASE-12685 > Project: HBase > Issue Type: Test >Reporter: Ted Yu >Assignee: Ted Yu >Priority: Minor > Attachments: 12685-v1.txt > > > From > https://builds.apache.org/job/hbase-0.98/739/testReport/org.apache.hadoop.hbase.master/TestSplitLogManager/testLogFilesAreArchived/ > : > {code} > 2014-12-14 14:40:30,420 INFO [Thread-27] master.SplitLogManager(325): > started splitting 1 logs in > [/home/jenkins/jenkins-slave/workspace/HBase-0.98/hbase-server/target/test-data/c065c13d-bc83-48e7-9178-51a14df531c3/testLogFilesAreArchived/f7ae1e8f-c848-4089-b5b1-20aff73c81dd] > 2014-12-14 14:40:30,422 WARN [Thread-31] master.TestSplitLogManager$5(527): > org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = > NoNode for /hbase/splitWAL/f7ae1e8f-c848-4089-b5b1-20aff73c81dd%2Ffoo%2C1%2C1 > 2014-12-14 14:40:30,423 DEBUG [main-EventThread] master.SplitLogManager(703): > put up splitlog task at znode > /hbase/splitWAL/f7ae1e8f-c848-4089-b5b1-20aff73c81dd%2Ffoo%2C1%2C1 > {code} > The thread which mocks split done called ZKUtil.setData() before > SplitLogManager put up the splitlog task znode. The setting of done to true > should exclude the above scenario. > Otherwise log split task would miss the split done mock, resulting in test > failure: > {code} > 2014-12-14 14:41:18,562 INFO [main-EventThread] master.SplitLogManager(753): > task /hbase/splitWAL/RESCAN04 entered state: DONE dummy-master,1,1 > 2014-12-14 14:41:18,563 DEBUG [main-EventThread] > zookeeper.ZooKeeperWatcher(312): > split-log-manager-testsa62d20ae-9904-4dc6-9e79-b7d98486dd49-0x14a493e58af, > quorum=localhost:50869, baseZNode=/hbase Received ZooKeeper Event, > type=NodeDeleted, state=SyncConnected, path=/hbase/splitWAL/RESCAN04 > 2014-12-14 14:41:18,563 DEBUG [main-EventThread] > master.SplitLogManager$DeleteAsyncCallback(1712): deleted > /hbase/splitWAL/RESCAN04 > 2014-12-14 14:41:18,563 DEBUG [main-EventThread] master.SplitLogManager(935): > deleted task without in memory state /hbase/splitWAL/RESCAN04 > 2014-12-14 14:41:20,562 INFO > [dummy-master,1,1.splitLogManagerTimeoutMonitor] > master.SplitLogManager$TimeoutMonitor(1502): total tasks = 1 unassigned = 1 > tasks={/hbase/splitWAL/f7ae1e8f-c848-4089-b5b1-20aff73c81dd%2Ffoo%2C1%2C1=last_update > = -1 last_version = -1 cur_worker_name = null status = in_progress > incarnation = 0 resubmits = 0 batch = installed = 1 done = 0 error = 0} > 2014-12-14 14:41:25,568 INFO > [dummy-master,1,1.splitLogManagerTimeoutMonitor] > master.SplitLogManager$TimeoutMonitor(1502): total tasks = 1 unassigned = 1 > tasks={/hbase/splitWAL/f7ae1e8f-c848-4089-b5b1-20aff73c81dd%2Ffoo%2C1%2C1=last_update > = -1 last_version = -1 cur_worker_name = null status = in_progress > incarnation = 0 resubmits = 0 batch = installed = 1 done = 0 error = 0} > 2014-12-14 14:41:30,399 WARN [Thread-27] master.SplitLogManager(441): > Interrupted while waiting for log splits to be completed > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12685) TestSplitLogManager#testLogFilesAreArchived sometimes times out due to race condition
[ https://issues.apache.org/jira/browse/HBASE-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-12685: --- Attachment: 12685-v1.txt With patch, 10 runs of TestSplitLogManager#testLogFilesAreArchived passed. > TestSplitLogManager#testLogFilesAreArchived sometimes times out due to race > condition > -- > > Key: HBASE-12685 > URL: https://issues.apache.org/jira/browse/HBASE-12685 > Project: HBase > Issue Type: Test >Reporter: Ted Yu >Assignee: Ted Yu >Priority: Minor > Attachments: 12685-v1.txt > > > From > https://builds.apache.org/job/hbase-0.98/739/testReport/org.apache.hadoop.hbase.master/TestSplitLogManager/testLogFilesAreArchived/ > : > {code} > 2014-12-14 14:40:30,420 INFO [Thread-27] master.SplitLogManager(325): > started splitting 1 logs in > [/home/jenkins/jenkins-slave/workspace/HBase-0.98/hbase-server/target/test-data/c065c13d-bc83-48e7-9178-51a14df531c3/testLogFilesAreArchived/f7ae1e8f-c848-4089-b5b1-20aff73c81dd] > 2014-12-14 14:40:30,422 WARN [Thread-31] master.TestSplitLogManager$5(527): > org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = > NoNode for /hbase/splitWAL/f7ae1e8f-c848-4089-b5b1-20aff73c81dd%2Ffoo%2C1%2C1 > 2014-12-14 14:40:30,423 DEBUG [main-EventThread] master.SplitLogManager(703): > put up splitlog task at znode > /hbase/splitWAL/f7ae1e8f-c848-4089-b5b1-20aff73c81dd%2Ffoo%2C1%2C1 > {code} > The thread which mocks split done called ZKUtil.setData() before > SplitLogManager put up the splitlog task znode. The setting of done to true > should exclude the above scenario. > Otherwise log split task would miss the split done mock, resulting in test > failure: > {code} > 2014-12-14 14:41:18,562 INFO [main-EventThread] master.SplitLogManager(753): > task /hbase/splitWAL/RESCAN04 entered state: DONE dummy-master,1,1 > 2014-12-14 14:41:18,563 DEBUG [main-EventThread] > zookeeper.ZooKeeperWatcher(312): > split-log-manager-testsa62d20ae-9904-4dc6-9e79-b7d98486dd49-0x14a493e58af, > quorum=localhost:50869, baseZNode=/hbase Received ZooKeeper Event, > type=NodeDeleted, state=SyncConnected, path=/hbase/splitWAL/RESCAN04 > 2014-12-14 14:41:18,563 DEBUG [main-EventThread] > master.SplitLogManager$DeleteAsyncCallback(1712): deleted > /hbase/splitWAL/RESCAN04 > 2014-12-14 14:41:18,563 DEBUG [main-EventThread] master.SplitLogManager(935): > deleted task without in memory state /hbase/splitWAL/RESCAN04 > 2014-12-14 14:41:20,562 INFO > [dummy-master,1,1.splitLogManagerTimeoutMonitor] > master.SplitLogManager$TimeoutMonitor(1502): total tasks = 1 unassigned = 1 > tasks={/hbase/splitWAL/f7ae1e8f-c848-4089-b5b1-20aff73c81dd%2Ffoo%2C1%2C1=last_update > = -1 last_version = -1 cur_worker_name = null status = in_progress > incarnation = 0 resubmits = 0 batch = installed = 1 done = 0 error = 0} > 2014-12-14 14:41:25,568 INFO > [dummy-master,1,1.splitLogManagerTimeoutMonitor] > master.SplitLogManager$TimeoutMonitor(1502): total tasks = 1 unassigned = 1 > tasks={/hbase/splitWAL/f7ae1e8f-c848-4089-b5b1-20aff73c81dd%2Ffoo%2C1%2C1=last_update > = -1 last_version = -1 cur_worker_name = null status = in_progress > incarnation = 0 resubmits = 0 batch = installed = 1 done = 0 error = 0} > 2014-12-14 14:41:30,399 WARN [Thread-27] master.SplitLogManager(441): > Interrupted while waiting for log splits to be completed > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-12685) TestSplitLogManager#testLogFilesAreArchived sometimes times out due to race condition
Ted Yu created HBASE-12685: -- Summary: TestSplitLogManager#testLogFilesAreArchived sometimes times out due to race condition Key: HBASE-12685 URL: https://issues.apache.org/jira/browse/HBASE-12685 Project: HBase Issue Type: Test Reporter: Ted Yu Assignee: Ted Yu Priority: Minor >From >https://builds.apache.org/job/hbase-0.98/739/testReport/org.apache.hadoop.hbase.master/TestSplitLogManager/testLogFilesAreArchived/ > : {code} 2014-12-14 14:40:30,420 INFO [Thread-27] master.SplitLogManager(325): started splitting 1 logs in [/home/jenkins/jenkins-slave/workspace/HBase-0.98/hbase-server/target/test-data/c065c13d-bc83-48e7-9178-51a14df531c3/testLogFilesAreArchived/f7ae1e8f-c848-4089-b5b1-20aff73c81dd] 2014-12-14 14:40:30,422 WARN [Thread-31] master.TestSplitLogManager$5(527): org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /hbase/splitWAL/f7ae1e8f-c848-4089-b5b1-20aff73c81dd%2Ffoo%2C1%2C1 2014-12-14 14:40:30,423 DEBUG [main-EventThread] master.SplitLogManager(703): put up splitlog task at znode /hbase/splitWAL/f7ae1e8f-c848-4089-b5b1-20aff73c81dd%2Ffoo%2C1%2C1 {code} The thread which mocks split done called ZKUtil.setData() before SplitLogManager put up the splitlog task znode. The setting of done to true should exclude the above scenario. Otherwise log split task would miss the split done mock, resulting in test failure: {code} 2014-12-14 14:41:18,562 INFO [main-EventThread] master.SplitLogManager(753): task /hbase/splitWAL/RESCAN04 entered state: DONE dummy-master,1,1 2014-12-14 14:41:18,563 DEBUG [main-EventThread] zookeeper.ZooKeeperWatcher(312): split-log-manager-testsa62d20ae-9904-4dc6-9e79-b7d98486dd49-0x14a493e58af, quorum=localhost:50869, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/splitWAL/RESCAN04 2014-12-14 14:41:18,563 DEBUG [main-EventThread] master.SplitLogManager$DeleteAsyncCallback(1712): deleted /hbase/splitWAL/RESCAN04 2014-12-14 14:41:18,563 DEBUG [main-EventThread] master.SplitLogManager(935): deleted task without in memory state /hbase/splitWAL/RESCAN04 2014-12-14 14:41:20,562 INFO [dummy-master,1,1.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1502): total tasks = 1 unassigned = 1 tasks={/hbase/splitWAL/f7ae1e8f-c848-4089-b5b1-20aff73c81dd%2Ffoo%2C1%2C1=last_update = -1 last_version = -1 cur_worker_name = null status = in_progress incarnation = 0 resubmits = 0 batch = installed = 1 done = 0 error = 0} 2014-12-14 14:41:25,568 INFO [dummy-master,1,1.splitLogManagerTimeoutMonitor] master.SplitLogManager$TimeoutMonitor(1502): total tasks = 1 unassigned = 1 tasks={/hbase/splitWAL/f7ae1e8f-c848-4089-b5b1-20aff73c81dd%2Ffoo%2C1%2C1=last_update = -1 last_version = -1 cur_worker_name = null status = in_progress incarnation = 0 resubmits = 0 batch = installed = 1 done = 0 error = 0} 2014-12-14 14:41:30,399 WARN [Thread-27] master.SplitLogManager(441): Interrupted while waiting for log splits to be completed {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12659) Replace the method calls to grant and revoke in shell scripts with AccessControlClient
[ https://issues.apache.org/jira/browse/HBASE-12659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245975#comment-14245975 ] Hudson commented on HBASE-12659: FAILURE: Integrated in HBase-0.98-on-Hadoop-1.1 #706 (See [https://builds.apache.org/job/HBase-0.98-on-Hadoop-1.1/706/]) HBASE-12659 Replace the method calls to grant and revoke in shell scripts with AccessControlClient (Srikanth Srungarapu) (tedyu: rev 8f521775ea6466d8c133b4f910ace8914fcbe58d) * hbase-server/src/test/java/org/apache/hadoop/hbase/security/access/TestAccessController.java * hbase-shell/src/main/ruby/hbase/security.rb * hbase-server/src/test/java/org/apache/hadoop/hbase/security/access/SecureTestUtil.java * hbase-client/src/main/java/org/apache/hadoop/hbase/security/access/AccessControlClient.java > Replace the method calls to grant and revoke in shell scripts with > AccessControlClient > --- > > Key: HBASE-12659 > URL: https://issues.apache.org/jira/browse/HBASE-12659 > Project: HBase > Issue Type: Improvement > Components: security, shell >Reporter: Srikanth Srungarapu >Assignee: Srikanth Srungarapu >Priority: Minor > Fix For: 1.0.0, 2.0.0, 0.98.10 > > Attachments: 12659-v2.patch, HBASE-12659.patch, HBASE-12659_0.98.patch > > > Currently, the grant and revoke methods of ProtobufUtil methods are being > used in ruby shell scripts. Using AccessControlClient methods instead will > provide cleaner separation and easier maintenance. Thanks to [~mbertozzi] for > making this suggestion. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12659) Replace the method calls to grant and revoke in shell scripts with AccessControlClient
[ https://issues.apache.org/jira/browse/HBASE-12659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245965#comment-14245965 ] Hudson commented on HBASE-12659: FAILURE: Integrated in HBase-0.98 #739 (See [https://builds.apache.org/job/HBase-0.98/739/]) HBASE-12659 Replace the method calls to grant and revoke in shell scripts with AccessControlClient (Srikanth Srungarapu) (tedyu: rev 8f521775ea6466d8c133b4f910ace8914fcbe58d) * hbase-client/src/main/java/org/apache/hadoop/hbase/security/access/AccessControlClient.java * hbase-shell/src/main/ruby/hbase/security.rb * hbase-server/src/test/java/org/apache/hadoop/hbase/security/access/TestAccessController.java * hbase-server/src/test/java/org/apache/hadoop/hbase/security/access/SecureTestUtil.java > Replace the method calls to grant and revoke in shell scripts with > AccessControlClient > --- > > Key: HBASE-12659 > URL: https://issues.apache.org/jira/browse/HBASE-12659 > Project: HBase > Issue Type: Improvement > Components: security, shell >Reporter: Srikanth Srungarapu >Assignee: Srikanth Srungarapu >Priority: Minor > Fix For: 1.0.0, 2.0.0, 0.98.10 > > Attachments: 12659-v2.patch, HBASE-12659.patch, HBASE-12659_0.98.patch > > > Currently, the grant and revoke methods of ProtobufUtil methods are being > used in ruby shell scripts. Using AccessControlClient methods instead will > provide cleaner separation and easier maintenance. Thanks to [~mbertozzi] for > making this suggestion. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12659) Replace the method calls to grant and revoke in shell scripts with AccessControlClient
[ https://issues.apache.org/jira/browse/HBASE-12659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-12659: --- Resolution: Fixed Status: Resolved (was: Patch Available) > Replace the method calls to grant and revoke in shell scripts with > AccessControlClient > --- > > Key: HBASE-12659 > URL: https://issues.apache.org/jira/browse/HBASE-12659 > Project: HBase > Issue Type: Improvement > Components: security, shell >Reporter: Srikanth Srungarapu >Assignee: Srikanth Srungarapu >Priority: Minor > Fix For: 1.0.0, 2.0.0, 0.98.10 > > Attachments: 12659-v2.patch, HBASE-12659.patch, HBASE-12659_0.98.patch > > > Currently, the grant and revoke methods of ProtobufUtil methods are being > used in ruby shell scripts. Using AccessControlClient methods instead will > provide cleaner separation and easier maintenance. Thanks to [~mbertozzi] for > making this suggestion. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12659) Replace the method calls to grant and revoke in shell scripts with AccessControlClient
[ https://issues.apache.org/jira/browse/HBASE-12659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-12659: --- Fix Version/s: 0.98.10 Integrated to 0.98 as well. > Replace the method calls to grant and revoke in shell scripts with > AccessControlClient > --- > > Key: HBASE-12659 > URL: https://issues.apache.org/jira/browse/HBASE-12659 > Project: HBase > Issue Type: Improvement > Components: security, shell >Reporter: Srikanth Srungarapu >Assignee: Srikanth Srungarapu >Priority: Minor > Fix For: 1.0.0, 2.0.0, 0.98.10 > > Attachments: 12659-v2.patch, HBASE-12659.patch, HBASE-12659_0.98.patch > > > Currently, the grant and revoke methods of ProtobufUtil methods are being > used in ruby shell scripts. Using AccessControlClient methods instead will > provide cleaner separation and easier maintenance. Thanks to [~mbertozzi] for > making this suggestion. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Assigned] (HBASE-12684) Add new AsyncRpcClient
[ https://issues.apache.org/jira/browse/HBASE-12684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jurriaan Mous reassigned HBASE-12684: - Assignee: Jurriaan Mous > Add new AsyncRpcClient > -- > > Key: HBASE-12684 > URL: https://issues.apache.org/jira/browse/HBASE-12684 > Project: HBase > Issue Type: Improvement > Components: Client >Reporter: Jurriaan Mous >Assignee: Jurriaan Mous > Attachments: HBASE-12684.patch > > > With the changes in HBASE-12597 it is possible to add new RpcClients. This > issue is about adding a new Async RpcClient which would enable HBase to do > non blocking protobuf service communication. > Besides delivering a new AsyncRpcClient I would also like to ask the question > what it would take to replace the current RpcClient? This would enable to > simplify async code in some next issues. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12668) Adapt PayloadCarryingRpcController so it can also be used in async way
[ https://issues.apache.org/jira/browse/HBASE-12668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245889#comment-14245889 ] Jurriaan Mous commented on HBASE-12668: --- I opened HBASE-12684 for an async RpcClient addition and committed some first code based on the work I already did in my published async client. Btw: the 1.0.0-SNAPSHOT is still of december 9th: http://repository.apache.org/content/groups/snapshots/org/apache/hbase/hbase-client/1.0.0-SNAPSHOT/ > Adapt PayloadCarryingRpcController so it can also be used in async way > -- > > Key: HBASE-12668 > URL: https://issues.apache.org/jira/browse/HBASE-12668 > Project: HBase > Issue Type: Improvement > Components: Client >Reporter: Jurriaan Mous >Assignee: Jurriaan Mous > Fix For: 1.0.0, 2.0.0 > > Attachments: HBASE-12668-V1.patch, HBASE-12668-V1.patch, > HBASE-12668.patch > > > With the changes in HBASE-12597 it is possible to create a new RPC client. > But in all places the BlockingRpcChannel is called with a > PayloadCarryingRpcController. This controller is not usable in Async context > because some methods are not supported at the moment. (See > TimeLimitedRpcController for the methods that throw > UnsupportedOperationException) > This issue is about implementing these methods so > PayloadCarryingRpcController can also be used in an async context and work > the same in a sync context. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12684) Add new AsyncRpcClient
[ https://issues.apache.org/jira/browse/HBASE-12684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jurriaan Mous updated HBASE-12684: -- Attachment: HBASE-12684.patch First suggestion for AsyncRpcClient to jumpstart this issue. - Based on Netty 4. Dependency was already present. - The AsyncRpcClient is set as the default client in this patch. Todo: - AsyncCall could be integrated with Call. Need to check rpcTimeout code. - More duplicated code with RpcClientImpl could be abstracted. - Tests that run with RpcClientImpl would need a AsyncRpcClient version. Question: - Will RpcClientImpl live on after this issue or should RpcClientImpl be removed with the arrival of AsyncRpcClient? This question affects what work is to be done next. > Add new AsyncRpcClient > -- > > Key: HBASE-12684 > URL: https://issues.apache.org/jira/browse/HBASE-12684 > Project: HBase > Issue Type: Improvement > Components: Client >Reporter: Jurriaan Mous > Attachments: HBASE-12684.patch > > > With the changes in HBASE-12597 it is possible to add new RpcClients. This > issue is about adding a new Async RpcClient which would enable HBase to do > non blocking protobuf service communication. > Besides delivering a new AsyncRpcClient I would also like to ask the question > what it would take to replace the current RpcClient? This would enable to > simplify async code in some next issues. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-12684) Add new AsyncRpcClient
Jurriaan Mous created HBASE-12684: - Summary: Add new AsyncRpcClient Key: HBASE-12684 URL: https://issues.apache.org/jira/browse/HBASE-12684 Project: HBase Issue Type: Improvement Components: Client Reporter: Jurriaan Mous With the changes in HBASE-12597 it is possible to add new RpcClients. This issue is about adding a new Async RpcClient which would enable HBase to do non blocking protobuf service communication. Besides delivering a new AsyncRpcClient I would also like to ask the question what it would take to replace the current RpcClient? This would enable to simplify async code in some next issues. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12679) Add HBaseInterfaceAudience.TOOLS and move some of the Public classes to LimitedPrivate
[ https://issues.apache.org/jira/browse/HBASE-12679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245882#comment-14245882 ] Hadoop QA commented on HBASE-12679: --- {color:green}+1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12687109/hbase-12679_v2.patch against master branch at commit 65830b096b6f540b7e49ef590dac1ebe2491c126. ATTACHMENT ID: 12687109 {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 15 new or modified tests. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 checkstyle{color}. The applied patch does not increase the total number of checkstyle errors {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 2.0.3) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 lineLengths{color}. The patch does not introduce lines longer than 100 {color:green}+1 site{color}. The mvn site goal succeeds with this patch. {color:green}+1 core tests{color}. The patch passed unit tests in . Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/12077//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12077//artifact/patchprocess/newPatchFindbugsWarningshbase-rest.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12077//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12077//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12077//artifact/patchprocess/newPatchFindbugsWarningshbase-annotations.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12077//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12077//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12077//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12077//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12077//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12077//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12077//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html Checkstyle Errors: https://builds.apache.org/job/PreCommit-HBASE-Build/12077//artifact/patchprocess/checkstyle-aggregate.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/12077//console This message is automatically generated. > Add HBaseInterfaceAudience.TOOLS and move some of the Public classes to > LimitedPrivate > -- > > Key: HBASE-12679 > URL: https://issues.apache.org/jira/browse/HBASE-12679 > Project: HBase > Issue Type: Sub-task > Components: Client >Reporter: Enis Soztutar >Assignee: Enis Soztutar > Fix For: 1.0.0, 2.0.0 > > Attachments: hbase-12679_v1.patch, hbase-12679_v2.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-12683) Compilation with hadoop-2.7.0-SNAPSHOT is broken
[ https://issues.apache.org/jira/browse/HBASE-12683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245880#comment-14245880 ] Hadoop QA commented on HBASE-12683: --- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12687108/hbase-12683_v1.patch against master branch at commit 65830b096b6f540b7e49ef590dac1ebe2491c126. ATTACHMENT ID: 12687108 {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:red}-1 tests included{color}. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages. {color:green}+1 checkstyle{color}. The applied patch does not increase the total number of checkstyle errors {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 2.0.3) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 lineLengths{color}. The patch does not introduce lines longer than 100 {color:green}+1 site{color}. The mvn site goal succeeds with this patch. {color:green}+1 core tests{color}. The patch passed unit tests in . Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/12076//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12076//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12076//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12076//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12076//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12076//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12076//artifact/patchprocess/newPatchFindbugsWarningshbase-rest.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12076//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12076//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12076//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12076//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/12076//artifact/patchprocess/newPatchFindbugsWarningshbase-annotations.html Checkstyle Errors: https://builds.apache.org/job/PreCommit-HBASE-Build/12076//artifact/patchprocess/checkstyle-aggregate.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/12076//console This message is automatically generated. > Compilation with hadoop-2.7.0-SNAPSHOT is broken > > > Key: HBASE-12683 > URL: https://issues.apache.org/jira/browse/HBASE-12683 > Project: HBase > Issue Type: Bug >Reporter: Enis Soztutar >Assignee: Enis Soztutar > Fix For: 1.0.0, 2.0.0, 0.98.10 > > Attachments: hbase-12683_v1.patch > > > HADOOP-11389 changed ReflectionUtils.printThreadInfo() signature, which > breaks compilation. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12679) Add HBaseInterfaceAudience.TOOLS and move some of the Public classes to LimitedPrivate
[ https://issues.apache.org/jira/browse/HBASE-12679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar updated HBASE-12679: -- Attachment: hbase-12679_v2.patch Rebased to master. Will commit if hadoopqa passes. > Add HBaseInterfaceAudience.TOOLS and move some of the Public classes to > LimitedPrivate > -- > > Key: HBASE-12679 > URL: https://issues.apache.org/jira/browse/HBASE-12679 > Project: HBase > Issue Type: Sub-task > Components: Client >Reporter: Enis Soztutar >Assignee: Enis Soztutar > Fix For: 1.0.0, 2.0.0 > > Attachments: hbase-12679_v1.patch, hbase-12679_v2.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)