[jira] [Commented] (HBASE-16646) Enhance LoadIncrementalHFiles to accept store file paths as input

2016-09-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15497687#comment-15497687 ] Ted Yu commented on HBASE-16646: In the map: bq. Map> map key is family. value is List o

[jira] [Updated] (HBASE-16646) Enhance LoadIncrementalHFiles API to accept store file paths as input

2016-09-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16646: --- Summary: Enhance LoadIncrementalHFiles API to accept store file paths as input (was: Enhance LoadIncremental

[jira] [Updated] (HBASE-16620) Fix backup command-line tool usability issues

2016-09-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16620: --- Attachment: 16620.addendum5 Compilation has been fixed. > Fix backup command-line tool usability issues > --

[jira] [Updated] (HBASE-16646) Enhance LoadIncrementalHFiles API to accept store file paths as input

2016-09-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16646: --- Status: Patch Available (was: Open) > Enhance LoadIncrementalHFiles API to accept store file paths as input

[jira] [Updated] (HBASE-16646) Enhance LoadIncrementalHFiles API to accept store file paths as input

2016-09-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16646: --- Attachment: 16646.v2.txt > Enhance LoadIncrementalHFiles API to accept store file paths as input > --

[jira] [Commented] (HBASE-16646) Enhance LoadIncrementalHFiles API to accept store file paths as input

2016-09-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15498121#comment-15498121 ] Ted Yu commented on HBASE-16646: Patch v2 fixes javadoc and findbugs warnings. > Enhance

[jira] [Commented] (HBASE-16647) hbck should do offline reference repair before online repair

2016-09-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15498159#comment-15498159 ] Ted Yu commented on HBASE-16647: Looks like testLingeringReferenceFile needs to be adjust

[jira] [Commented] (HBASE-16645) Wrong range of Cells is caused by CellFlatMap#tailMap, headMap, and SubMap

2016-09-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15499321#comment-15499321 ] Ted Yu commented on HBASE-16645: {code} +if (index >= 0 & descending & !(tail ^ inclu

[jira] [Commented] (HBASE-16649) Truncate table with splits preserved can cause both data loss and truncated data appeared again

2016-09-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15501182#comment-15501182 ] Ted Yu commented on HBASE-16649: For #2, the region's sequenceid's should be reset in mas

[jira] [Commented] (HBASE-16649) Truncate table with splits preserved can cause both data loss and truncated data appeared again

2016-09-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15501245#comment-15501245 ] Ted Yu commented on HBASE-16649: That would be slower compared to the current implementat

[jira] [Commented] (HBASE-16649) Truncate table with splits preserved can cause both data loss and truncated data appeared again

2016-09-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15502157#comment-15502157 ] Ted Yu commented on HBASE-16649: Shouldn't data structures involving the obsolete region

[jira] [Commented] (HBASE-16649) Truncate table with splits preserved can cause both data loss and truncated data appeared again

2016-09-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15502238#comment-15502238 ] Ted Yu commented on HBASE-16649: When is the obsolete region taken off storeFlushedSequen

[jira] [Commented] (HBASE-16646) Enhance LoadIncrementalHFiles API to accept store file paths as input

2016-09-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15503427#comment-15503427 ] Ted Yu commented on HBASE-16646: For test case, that would be covered by HBASE-14417. Is

[jira] [Created] (HBASE-16655) hbase backup describe with incorrect backup id results in NPE

2016-09-19 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16655: -- Summary: hbase backup describe with incorrect backup id results in NPE Key: HBASE-16655 URL: https://issues.apache.org/jira/browse/HBASE-16655 Project: HBase Issue Type

[jira] [Updated] (HBASE-16655) hbase backup describe with incorrect backup id results in NPE

2016-09-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16655: --- Attachment: 16655.v2.txt > hbase backup describe with incorrect backup id results in NPE > --

[jira] [Commented] (HBASE-16655) hbase backup describe with incorrect backup id results in NPE

2016-09-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15504131#comment-15504131 ] Ted Yu commented on HBASE-16655: Modified test in TestBackupDescribe for the case of inco

[jira] [Updated] (HBASE-16655) hbase backup describe with incorrect backup id results in NPE

2016-09-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16655: --- Attachment: (was: 16655.v2.txt) > hbase backup describe with incorrect backup id results in NPE > ---

[jira] [Updated] (HBASE-16655) hbase backup describe with incorrect backup id results in NPE

2016-09-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16655: --- Attachment: 16655.v2.txt > hbase backup describe with incorrect backup id results in NPE > --

[jira] [Updated] (HBASE-16646) Enhance LoadIncrementalHFiles API to accept store file paths as input

2016-09-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16646: --- Attachment: 16646.v3.txt Patch v3 adds test which exercises the new API. > Enhance LoadIncrementalHFiles API

[jira] [Commented] (HBASE-14123) HBase Backup/Restore Phase 2

2016-09-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15504404#comment-15504404 ] Ted Yu commented on HBASE-14123: [~stack]: Looking forward to your feedback / code review

[jira] [Commented] (HBASE-15448) HBase Backup Phase 3: Restore optimization 2

2016-09-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15504591#comment-15504591 ] Ted Yu commented on HBASE-15448: I tried reducing the number of additional rows and TestI

[jira] [Updated] (HBASE-15448) HBase Backup Phase 3: Restore optimization 2

2016-09-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-15448: --- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Thanks for

[jira] [Commented] (HBASE-16655) hbase backup describe with incorrect backup id results in NPE

2016-09-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15504765#comment-15504765 ] Ted Yu commented on HBASE-16655: Addendum 6 would result in retrieving progress for null

[jira] [Updated] (HBASE-16655) hbase backup describe with incorrect backup id results in NPE

2016-09-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16655: --- Attachment: 16655.v3.txt Patch v3 combines addendum 6 from HBASE-16620 . Vlad: I will give you credit when c

[jira] [Commented] (HBASE-16655) hbase backup describe with incorrect backup id results in NPE

2016-09-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15504819#comment-15504819 ] Ted Yu commented on HBASE-16655: Both TestBackupCommandLineTool and TestBackupDescribe pa

[jira] [Resolved] (HBASE-16655) hbase backup describe with incorrect backup id results in NPE

2016-09-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-16655. Resolution: Fixed Hadoop Flags: Reviewed > hbase backup describe with incorrect backup id results in

[jira] [Commented] (HBASE-16647) hbck should do offline reference repair before online repair

2016-09-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15504836#comment-15504836 ] Ted Yu commented on HBASE-16647: lgtm > hbck should do offline reference repair before o

[jira] [Commented] (HBASE-16655) hbase backup describe with incorrect backup id results in NPE

2016-09-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15505118#comment-15505118 ] Ted Yu commented on HBASE-16655: {code} public static final String PROGRESS_CMD_USAGE =

[jira] [Updated] (HBASE-16655) hbase backup describe with incorrect backup id results in NPE

2016-09-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16655: --- Attachment: 16655.addendum The addendum allows progress command to retrieve on-going backup session. > hbase

[jira] [Commented] (HBASE-16646) Enhance LoadIncrementalHFiles API to accept store file paths as input

2016-09-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15505283#comment-15505283 ] Ted Yu commented on HBASE-16646: Failed tests passed locally with patch: {code} Running

[jira] [Commented] (HBASE-16646) Enhance LoadIncrementalHFiles API to accept store file paths as input

2016-09-20 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15506616#comment-15506616 ] Ted Yu commented on HBASE-16646: The added run method checks config parameter such as SIL

[jira] [Commented] (HBASE-16659) Use CellUtil.createFirstOnRow instead of KeyValueUtil.createFirstOnRow in some places.

2016-09-20 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15506737#comment-15506737 ] Ted Yu commented on HBASE-16659: lgtm, pending QA. > Use CellUtil.createFirstOnRow inste

[jira] [Commented] (HBASE-16658) Optimize UTF8 string/byte conversions

2016-09-20 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15506755#comment-15506755 ] Ted Yu commented on HBASE-16658: lgtm > Optimize UTF8 string/byte conversions >

[jira] [Updated] (HBASE-16646) Enhance LoadIncrementalHFiles API to accept store file paths as input

2016-09-20 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16646: --- Hadoop Flags: Reviewed Fix Version/s: 2.0.0 > Enhance LoadIncrementalHFiles API to accept store file pat

[jira] [Updated] (HBASE-16646) Enhance LoadIncrementalHFiles API to accept store file paths as input

2016-09-20 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16646: --- Attachment: 16646.addendum Turns out I need to maintain the original cleanup logic since prepareHFileQueue()

[jira] [Commented] (HBASE-15921) Add first AsyncTable impl and create TableImpl based on it

2016-09-20 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507390#comment-15507390 ] Ted Yu commented on HBASE-15921: {code} 1237this.stubs.put(key, asyncStub); {

[jira] [Updated] (HBASE-16658) Optimize UTF8 string/byte conversions

2016-09-20 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16658: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.0.0 Status: Resolved (was: P

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-20 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15508425#comment-15508425 ] Ted Yu commented on HBASE-16630: {code} +Set result = new HashSet<>(bucketCount); +

[jira] [Updated] (HBASE-16646) Enhance LoadIncrementalHFiles API to accept store file paths as input

2016-09-20 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16646: --- Resolution: Fixed Status: Resolved (was: Patch Available) Thanks for the reviews. > Enhance LoadInc

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-20 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15508568#comment-15508568 ] Ted Yu commented on HBASE-16630: {code} +// Add buckets with blocks currently in use

[jira] [Updated] (HBASE-16179) Fix compilation errors when building hbase-spark against Spark 2.0

2016-09-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16179: --- Attachment: 16179.v4.txt With patch v4, tests in hbase-spark pass against Spark 2.0 release. Still need to f

[jira] [Commented] (HBASE-16423) Add re-compare option to VerifyReplication to avoid occasional inconsistent rows

2016-09-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15510275#comment-15510275 ] Ted Yu commented on HBASE-16423: {code} 125 sleepToReCompare = conf.getInt(NA

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15510294#comment-15510294 ] Ted Yu commented on HBASE-16630: If you have time, do you mind trying patch v2 on a (test

[jira] [Assigned] (HBASE-14417) Incremental backup and bulk loading

2016-09-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu reassigned HBASE-14417: -- Assignee: Ted Yu (was: Vladimir Rodionov) > Incremental backup and bulk loading > ---

[jira] [Updated] (HBASE-14417) Incremental backup and bulk loading

2016-09-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-14417: --- Attachment: 14417.v1.txt Patch v1 shows basic flow of bulk loaded hfiles support. To be added: cleanup of Bu

[jira] [Commented] (HBASE-16557) UI for backup / restore

2016-09-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15510969#comment-15510969 ] Ted Yu commented on HBASE-16557: Once support for bulk loaded hfiles is added, the UI sho

[jira] [Updated] (HBASE-16672) Add option for bulk load to copy hfile(s) instead of renaming

2016-09-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16672: --- Description: While working on HBASE-14417, I found that taking full backup of table which received bulk load

[jira] [Created] (HBASE-16672) Add option for bulk load to copy hfile(s) instead of renaming

2016-09-21 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16672: -- Summary: Add option for bulk load to copy hfile(s) instead of renaming Key: HBASE-16672 URL: https://issues.apache.org/jira/browse/HBASE-16672 Project: HBase Issue Type

[jira] [Updated] (HBASE-16672) Add option for bulk load to copy hfile(s) instead of renaming

2016-09-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16672: --- Attachment: 16672.v1.txt Draft patch. Still needs to add client side config. > Add option for bulk load to c

[jira] [Updated] (HBASE-16672) Add option for bulk load to copy hfile(s) instead of renaming

2016-09-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16672: --- Attachment: 16672.v2.txt > Add option for bulk load to copy hfile(s) instead of renaming > --

[jira] [Updated] (HBASE-16672) Add option for bulk load to copy hfile(s) instead of renaming

2016-09-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16672: --- Assignee: Ted Yu Status: Patch Available (was: Open) > Add option for bulk load to copy hfile(s) inste

[jira] [Updated] (HBASE-16672) Add option for bulk load to copy hfile(s) instead of renaming

2016-09-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16672: --- Status: Open (was: Patch Available) > Add option for bulk load to copy hfile(s) instead of renaming > --

[jira] [Updated] (HBASE-16672) Add option for bulk load to copy hfile(s) instead of renaming

2016-09-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16672: --- Attachment: 16672.v3.txt > Add option for bulk load to copy hfile(s) instead of renaming > --

[jira] [Updated] (HBASE-16672) Add option for bulk load to copy hfile(s) instead of renaming

2016-09-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16672: --- Status: Patch Available (was: Open) > Add option for bulk load to copy hfile(s) instead of renaming > --

[jira] [Created] (HBASE-16675) Average region size may be incorrect when there is region whose RegionLoad cannot be retrieved

2016-09-21 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16675: -- Summary: Average region size may be incorrect when there is region whose RegionLoad cannot be retrieved Key: HBASE-16675 URL: https://issues.apache.org/jira/browse/HBASE-16675 Pr

[jira] [Updated] (HBASE-16675) Average region size may be incorrect when there is region whose RegionLoad cannot be retrieved

2016-09-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16675: --- Attachment: 16675.v1.txt > Average region size may be incorrect when there is region whose RegionLoad > cann

[jira] [Updated] (HBASE-16675) Average region size may be incorrect when there is region whose RegionLoad cannot be retrieved

2016-09-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16675: --- Status: Patch Available (was: Open) > Average region size may be incorrect when there is region whose Region

[jira] [Updated] (HBASE-16672) Add option for bulk load to copy hfile(s) instead of renaming

2016-09-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16672: --- Attachment: 16672.v4.txt Patch v4 addresses TestHRegionServerBulkLoadWithOldClient. > Add option for bulk lo

[jira] [Updated] (HBASE-16672) Add option for bulk load to copy hfile(s) instead of renaming

2016-09-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16672: --- Description: This is related to HBASE-14417, to support incrementally restoring to multiple destinations, thi

[jira] [Commented] (HBASE-16672) Add option for bulk load to copy hfile(s) instead of renaming

2016-09-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15511681#comment-15511681 ] Ted Yu commented on HBASE-16672: I agree that there is no need to dive into the details o

[jira] [Commented] (HBASE-14417) Incremental backup and bulk loading

2016-09-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15511698#comment-15511698 ] Ted Yu commented on HBASE-14417: I was adding new test which does one more full table bac

[jira] [Commented] (HBASE-16672) Add option for bulk load to copy hfile(s) instead of renaming

2016-09-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15511718#comment-15511718 ] Ted Yu commented on HBASE-16672: w.r.t. the SecureBulkLoadListener, we have this code: {c

[jira] [Commented] (HBASE-16675) Average region size may be incorrect when there is region whose RegionLoad cannot be retrieved

2016-09-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15511912#comment-15511912 ] Ted Yu commented on HBASE-16675: Test failures were not related to the patch - normalizer

[jira] [Updated] (HBASE-14417) Incremental backup and bulk loading

2016-09-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-14417: --- Attachment: 14417.v2.txt Patch v2 adds second full back up in the test. Not working yet. > Incremental back

[jira] [Updated] (HBASE-16672) Add option for bulk load to copy hfile(s) instead of renaming

2016-09-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16672: --- Attachment: 16672.v5.txt > Add option for bulk load to copy hfile(s) instead of renaming > --

[jira] [Commented] (HBASE-16672) Add option for bulk load to copy hfile(s) instead of renaming

2016-09-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15512213#comment-15512213 ] Ted Yu commented on HBASE-16672: SecureBulkLoadListener has logic for the copy through st

[jira] [Commented] (HBASE-16672) Add option for bulk load to copy hfile(s) instead of renaming

2016-09-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15512359#comment-15512359 ] Ted Yu commented on HBASE-16672: Restoring to another cluster is one scenario. Local res

[jira] [Comment Edited] (HBASE-16672) Add option for bulk load to copy hfile(s) instead of renaming

2016-09-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15512359#comment-15512359 ] Ted Yu edited comment on HBASE-16672 at 9/22/16 6:57 AM: - Restori

[jira] [Updated] (HBASE-16672) Add option for bulk load to copy hfile(s) instead of renaming

2016-09-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16672: --- Attachment: 16672.v6.txt > Add option for bulk load to copy hfile(s) instead of renaming > --

[jira] [Updated] (HBASE-16675) Average region size may be incorrect when there is region whose RegionLoad cannot be retrieved

2016-09-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16675: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 1.4.0 2.0.0

[jira] [Updated] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16630: --- Attachment: 16630-v2-suggest.patch Suggested patch based on v2 which removes Set creation in getLeastFilledB

[jira] [Updated] (HBASE-16683) Address review comments for mega patch of backup / restore feature

2016-09-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16683: --- Summary: Address review comments for mega patch of backup / restore feature (was: Address review comments fo

[jira] [Created] (HBASE-16683) Address review comments for backup / restore feature

2016-09-22 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16683: -- Summary: Address review comments for backup / restore feature Key: HBASE-16683 URL: https://issues.apache.org/jira/browse/HBASE-16683 Project: HBase Issue Type: Bug

[jira] [Updated] (HBASE-14123) HBase Backup/Restore Phase 2

2016-09-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-14123: --- Attachment: 14123-master.v24.txt Patch v24 sync's up to commit 7dab75096f8549b0d59338a07bffae7e594bd758 > HB

[jira] [Created] (HBASE-16685) Revisit execution of SnapshotCopy in MapReduceBackupCopyService

2016-09-22 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16685: -- Summary: Revisit execution of SnapshotCopy in MapReduceBackupCopyService Key: HBASE-16685 URL: https://issues.apache.org/jira/browse/HBASE-16685 Project: HBase Issue Ty

[jira] [Updated] (HBASE-16683) Address review comments for mega patch of backup / restore feature

2016-09-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16683: --- Attachment: 16683.v1.txt > Address review comments for mega patch of backup / restore feature > -

[jira] [Commented] (HBASE-16683) Address review comments for mega patch of backup / restore feature

2016-09-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514125#comment-15514125 ] Ted Yu commented on HBASE-16683: [~mbertozzi]: Patch v1 is in response to your first roun

[jira] [Commented] (HBASE-16683) Address review comments for mega patch of backup / restore feature

2016-09-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514158#comment-15514158 ] Ted Yu commented on HBASE-16683: Clarification: waiting for more review comments before c

[jira] [Commented] (HBASE-16672) Add option for bulk load to copy hfile(s) instead of renaming

2016-09-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514292#comment-15514292 ] Ted Yu commented on HBASE-16672: Test failures were not related. I ran a few with patch w

[jira] [Updated] (HBASE-16423) Add re-compare option to VerifyReplication to avoid occasional inconsistent rows

2016-09-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16423: --- Status: Patch Available (was: Open) > Add re-compare option to VerifyReplication to avoid occasional inconsi

[jira] [Commented] (HBASE-16423) Add re-compare option to VerifyReplication to avoid occasional inconsistent rows

2016-09-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514335#comment-15514335 ] Ted Yu commented on HBASE-16423: lgtm > Add re-compare option to VerifyReplication to av

[jira] [Commented] (HBASE-16656) BackupID must include backup set name

2016-09-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514386#comment-15514386 ] Ted Yu commented on HBASE-16656: {code} +if(setName == null) { + setName = "back

[jira] [Commented] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514424#comment-15514424 ] Ted Yu commented on HBASE-16630: {code} + Set candidateBuckets = bucketAllocator.get

[jira] [Comment Edited] (HBASE-16683) Address review comments for mega patch of backup / restore feature

2016-09-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514158#comment-15514158 ] Ted Yu edited comment on HBASE-16683 at 9/22/16 9:10 PM: - Checkin

[jira] [Commented] (HBASE-14417) Incremental backup and bulk loading

2016-09-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15514628#comment-15514628 ] Ted Yu commented on HBASE-14417: Currently there is one BulkLoadHandler inside each regio

[jira] [Updated] (HBASE-16630) Fragmentation in long running Bucket Cache

2016-09-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16630: --- Attachment: 16630-v3-suggest.patch Patch with DEBUG log at the end of freeEntireBuckets(). > Fragmentation i

[jira] [Commented] (HBASE-14123) HBase Backup/Restore Phase 2

2016-09-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15515119#comment-15515119 ] Ted Yu commented on HBASE-14123: Ran the following tests with patch v24 locally: {code} R

[jira] [Updated] (HBASE-14123) HBase Backup/Restore Phase 2

2016-09-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-14123: --- Attachment: 14123-master.v25.txt Patch v25 syncs up to commit 9952b134fc26b3e4745b2a93afaddb12565975a7 > HBa

[jira] [Updated] (HBASE-16423) Add re-compare option to VerifyReplication to avoid occasional inconsistent rows

2016-09-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16423: --- Assignee: Jianwei Cui Hadoop Flags: Reviewed Fix Version/s: 1.4.0 2.0.0 Test

[jira] [Commented] (HBASE-16672) Add option for bulk load to copy hfile(s) instead of renaming

2016-09-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15516218#comment-15516218 ] Ted Yu commented on HBASE-16672: The first copy is part of backup artifacts which should

[jira] [Commented] (HBASE-14123) HBase Backup/Restore Phase 2

2016-09-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15516229#comment-15516229 ] Ted Yu commented on HBASE-14123: Test failures were not related to patch. I ran the follo

[jira] [Updated] (HBASE-16423) Add re-compare option to VerifyReplication to avoid occasional inconsistent rows

2016-09-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16423: --- Resolution: Fixed Status: Resolved (was: Patch Available) Thanks for the patch, Jianwei. > Add re-c

[jira] [Commented] (HBASE-16672) Add option for bulk load to copy hfile(s) instead of renaming

2016-09-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15516373#comment-15516373 ] Ted Yu commented on HBASE-16672: This is to cover the case where secure bulk load endpoin

[jira] [Commented] (HBASE-16672) Add option for bulk load to copy hfile(s) instead of renaming

2016-09-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15516396#comment-15516396 ] Ted Yu commented on HBASE-16672: I also target branch-1 where secure bulk load endpoint i

[jira] [Updated] (HBASE-16672) Add option for bulk load to copy hfile(s) instead of renaming

2016-09-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16672: --- Attachment: 16672.v7.txt Patch v7 passes copyFile parameter to store#bulkLoadHFile() bq. Can we add a new me

[jira] [Created] (HBASE-16696) TestBlockEvictionFromClient fails in master branch

2016-09-23 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16696: -- Summary: TestBlockEvictionFromClient fails in master branch Key: HBASE-16696 URL: https://issues.apache.org/jira/browse/HBASE-16696 Project: HBase Issue Type: Bug

[jira] [Updated] (HBASE-16696) TestBlockEvictionFromClient fails in master branch

2016-09-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16696: --- Attachment: build-1639.out build-1638.out > TestBlockEvictionFromClient fails in master branc

[jira] [Commented] (HBASE-16645) Wrong range of Cells is caused by CellFlatMap#tailMap, headMap, and SubMap

2016-09-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15516919#comment-15516919 ] Ted Yu commented on HBASE-16645: [~anastas]: Is the patch good by you ? > Wrong range of

[jira] [Updated] (HBASE-16672) Add option for bulk load to copy hfile(s) instead of renaming

2016-09-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-16672: --- Attachment: 16672.v8.txt > Add option for bulk load to copy hfile(s) instead of renaming > --

[jira] [Commented] (HBASE-16672) Add option for bulk load to copy hfile(s) instead of renaming

2016-09-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15517034#comment-15517034 ] Ted Yu commented on HBASE-16672: The above description is not accurate. The normal bulk

<    3   4   5   6   7   8   9   10   11   12   >