[jira] [Updated] (HBASE-21463) The checkOnlineRegionsReport can accidentally complete a TRSP

2018-11-10 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-21463: -- Attachment: HBASE-21463.patch > The checkOnlineRegionsReport can accidentally complete a TRSP >

[jira] [Updated] (HBASE-21463) The checkOnlineRegionsReport can accidentally complete a TRSP

2018-11-10 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-21463: -- Assignee: Duo Zhang Status: Patch Available (was: Open) > The checkOnlineRegionsReport can

[jira] [Commented] (HBASE-21423) Procedures for meta table/region should be able to execute in separate workers

2018-11-10 Thread Allan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682754#comment-16682754 ] Allan Yang commented on HBASE-21423: Uploaded an addendum to resolve some remaining issues. >

[jira] [Updated] (HBASE-21423) Procedures for meta table/region should be able to execute in separate workers

2018-11-10 Thread Allan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allan Yang updated HBASE-21423: --- Attachment: HBASE-21423.branch-2.0.addendum.patch > Procedures for meta table/region should be able

[jira] [Reopened] (HBASE-21423) Procedures for meta table/region should be able to execute in separate workers

2018-11-10 Thread Allan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allan Yang reopened HBASE-21423: > Procedures for meta table/region should be able to execute in separate > workers >

[jira] [Commented] (HBASE-21401) Sanity check in BaseDecoder#parseCell

2018-11-10 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682732#comment-16682732 ] stack commented on HBASE-21401: --- Sorry. Late to this. I think the extra parse this patch adds the wrong

[jira] [Commented] (HBASE-21410) A helper page that help find all problematic regions and procedures

2018-11-10 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682730#comment-16682730 ] stack commented on HBASE-21410: --- [~tianjingyun] This patch looks really good. Give me a day or so. I want

[jira] [Commented] (HBASE-21445) CopyTable by bulkload will write hfile into yarn's HDFS

2018-11-10 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682724#comment-16682724 ] Zheng Hu commented on HBASE-21445: -- Got it, Thanks [~stack] . > CopyTable by bulkload will write

[jira] [Commented] (HBASE-20952) Re-visit the WAL API

2018-11-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682723#comment-16682723 ] Hudson commented on HBASE-20952: Results for branch HBASE-20952 [build #46 on

[jira] [Commented] (HBASE-21461) Region CoProcessor for splitting large WAL entries in smaller batches, to handle situation when faulty ingestion had created too many mutations for same cell in single

2018-11-10 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682722#comment-16682722 ] stack commented on HBASE-21461: --- Lets do option #2. I can help. Its too early (or too late -- smile) for

[jira] [Commented] (HBASE-21463) The checkOnlineRegionsReport can accidentally complete a TRSP

2018-11-10 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682721#comment-16682721 ] stack commented on HBASE-21463: --- My bad. > The checkOnlineRegionsReport can accidentally complete a TRSP

[jira] [Commented] (HBASE-20604) ProtobufLogReader#readNext can incorrectly loop to the same position in the stream until the the WAL is rolled

2018-11-10 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682718#comment-16682718 ] stack commented on HBASE-20604: --- Understood [~apurtell] New (sub-)issue sounds good. Just noting reviewer

[jira] [Commented] (HBASE-21463) The checkOnlineRegionsReport can accidentally complete a TRSP

2018-11-10 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682678#comment-16682678 ] Duo Zhang commented on HBASE-21463: --- Yes, only a UT(I have a 'UT' in the patch name...). Will provide

[jira] [Commented] (HBASE-20604) ProtobufLogReader#readNext can incorrectly loop to the same position in the stream until the the WAL is rolled

2018-11-10 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682677#comment-16682677 ] Duo Zhang commented on HBASE-20604: --- I'm OK with opening a new issue to address the remaining

[jira] [Commented] (HBASE-21376) Add some verbose log to MasterProcedureScheduler

2018-11-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682658#comment-16682658 ] Hudson commented on HBASE-21376: Results for branch branch-2 [build #1495 on

[jira] [Commented] (HBASE-21387) Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files

2018-11-10 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682644#comment-16682644 ] Ted Yu commented on HBASE-21387: One more note about why I choose 21387.v9.txt as the version for

[jira] [Commented] (HBASE-21246) Introduce WALIdentity interface

2018-11-10 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682638#comment-16682638 ] Ted Yu commented on HBASE-21246: Currently there are about 69 failing test classes. Working through

[jira] [Commented] (HBASE-20604) ProtobufLogReader#readNext can incorrectly loop to the same position in the stream until the the WAL is rolled

2018-11-10 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682571#comment-16682571 ] Andrew Purtell commented on HBASE-20604: I have no strong opinion, could go either way.

[jira] [Commented] (HBASE-21461) Region CoProcessor for splitting large WAL entries in smaller batches, to handle situation when faulty ingestion had created too many mutations for same cell in single

2018-11-10 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682563#comment-16682563 ] Wellington Chevreuil commented on HBASE-21461: -- {quote}It could be here on this JIRA w/

[jira] [Commented] (HBASE-20604) ProtobufLogReader#readNext can incorrectly loop to the same position in the stream until the the WAL is rolled

2018-11-10 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682561#comment-16682561 ] stack commented on HBASE-20604: --- [~esteban] See above. Should we reopen this issue since outstanding

[jira] [Commented] (HBASE-21454) Kill zk spew

2018-11-10 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682559#comment-16682559 ] stack commented on HBASE-21454: --- I would like us to take control of what gets logged and when. For too

[jira] [Commented] (HBASE-21445) CopyTable by bulkload will write hfile into yarn's HDFS

2018-11-10 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682555#comment-16682555 ] stack commented on HBASE-21445: --- +1 on the patch. In future, consider leaving out reformatting changes

[jira] [Commented] (HBASE-21463) The checkOnlineRegionsReport can accidentally complete a TRSP

2018-11-10 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682554#comment-16682554 ] stack commented on HBASE-21463: --- Is there a change in the patch? I see making a method visible for

[jira] [Commented] (HBASE-21440) Assign procedure on the crashed server is not properly interrupted

2018-11-10 Thread Josh Elser (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682544#comment-16682544 ] Josh Elser commented on HBASE-21440: Ah, I think I see what the issue is. The change to

[jira] [Commented] (HBASE-21461) Region CoProcessor for splitting large WAL entries in smaller batches, to handle situation when faulty ingestion had created too many mutations for same cell in single

2018-11-10 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682538#comment-16682538 ] stack commented on HBASE-21461: --- It could be here on this JIRA w/ instructions on how to build. Might be

[jira] [Commented] (HBASE-21440) Assign procedure on the crashed server is not properly interrupted

2018-11-10 Thread Josh Elser (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682532#comment-16682532 ] Josh Elser commented on HBASE-21440: Let me try to put up a v4 :) > Assign procedure on the crashed

[jira] [Comment Edited] (HBASE-21457) BackupUtils#getWALFilesOlderThan refers to wrong FileSystem

2018-11-10 Thread Josh Elser (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682531#comment-16682531 ] Josh Elser edited comment on HBASE-21457 at 11/10/18 6:10 PM: --

[jira] [Commented] (HBASE-21457) BackupUtils#getWALFilesOlderThan refers to wrong FileSystem

2018-11-10 Thread Josh Elser (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682531#comment-16682531 ] Josh Elser commented on HBASE-21457: {quote}Looking for where the timeout should be increased.

[jira] [Commented] (HBASE-21376) Add some verbose log to MasterProcedureScheduler

2018-11-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682510#comment-16682510 ] Hudson commented on HBASE-21376: Results for branch branch-2.0 [build #1073 on

[jira] [Commented] (HBASE-21376) Add some verbose log to MasterProcedureScheduler

2018-11-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682494#comment-16682494 ] Hudson commented on HBASE-21376: Results for branch branch-2.1 [build #594 on

[jira] [Updated] (HBASE-13468) hbase.zookeeper.quorum supports ipv6 address

2018-11-10 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HBASE-13468: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status: Resolved (was:

[jira] [Commented] (HBASE-21463) The checkOnlineRegionsReport can accidentally complete a TRSP

2018-11-10 Thread Guanghao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682410#comment-16682410 ] Guanghao Zhang commented on HBASE-21463: Great UT. Not easy to find this bug and represent this

[jira] [Commented] (HBASE-21463) The checkOnlineRegionsReport can accidentally complete a TRSP

2018-11-10 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682388#comment-16682388 ] Duo Zhang commented on HBASE-21463: --- A UT to represent the problem. [~zghaobac] FYI. If no other

[jira] [Updated] (HBASE-21463) The checkOnlineRegionsReport can accidentally complete a TRSP

2018-11-10 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-21463: -- Attachment: HBASE-21463-UT.patch > The checkOnlineRegionsReport can accidentally complete a TRSP >

[jira] [Commented] (HBASE-21445) CopyTable by bulkload will write hfile into yarn's HDFS

2018-11-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682394#comment-16682394 ] Hudson commented on HBASE-21445: Results for branch master [build #596 on

[jira] [Commented] (HBASE-21437) Bypassed procedure throw IllegalArgumentException when its state is WAITING_TIMEOUT

2018-11-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682393#comment-16682393 ] Hudson commented on HBASE-21437: Results for branch master [build #596 on

[jira] [Commented] (HBASE-21461) Region CoProcessor for splitting large WAL entries in smaller batches, to handle situation when faulty ingestion had created too many mutations for same cell in single

2018-11-10 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682392#comment-16682392 ] Wellington Chevreuil commented on HBASE-21461: -- Thanks for the insights, [~stack]! {quote}I

[jira] [Commented] (HBASE-21445) CopyTable by bulkload will write hfile into yarn's HDFS

2018-11-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682361#comment-16682361 ] Hudson commented on HBASE-21445: Results for branch branch-2.1 [build #593 on

[jira] [Commented] (HBASE-21445) CopyTable by bulkload will write hfile into yarn's HDFS

2018-11-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682356#comment-16682356 ] Hudson commented on HBASE-21445: Results for branch branch-2.0 [build #1072 on

[jira] [Commented] (HBASE-21445) CopyTable by bulkload will write hfile into yarn's HDFS

2018-11-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682351#comment-16682351 ] Hudson commented on HBASE-21445: Results for branch branch-2 [build #1494 on

[jira] [Commented] (HBASE-21445) CopyTable by bulkload will write hfile into yarn's HDFS

2018-11-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682349#comment-16682349 ] Hudson commented on HBASE-21445: Results for branch branch-1.4 [build #543 on

[jira] [Commented] (HBASE-21445) CopyTable by bulkload will write hfile into yarn's HDFS

2018-11-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682320#comment-16682320 ] Hudson commented on HBASE-21445: Results for branch branch-1.3 [build #536 on

[jira] [Commented] (HBASE-21445) CopyTable by bulkload will write hfile into yarn's HDFS

2018-11-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682307#comment-16682307 ] Hudson commented on HBASE-21445: Results for branch branch-1 [build #546 on

[jira] [Updated] (HBASE-21463) The checkOnlineRegionsReport can accidentally complete a TRSP

2018-11-10 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-21463: -- Priority: Critical (was: Major) > The checkOnlineRegionsReport can accidentally complete a TRSP >

[jira] [Commented] (HBASE-21445) CopyTable by bulkload will write hfile into yarn's HDFS

2018-11-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682306#comment-16682306 ] Hudson commented on HBASE-21445: Results for branch branch-1.2 [build #545 on

[jira] [Updated] (HBASE-21376) Add some verbose log to MasterProcedureScheduler

2018-11-10 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-21376: -- Resolution: Fixed Assignee: Duo Zhang (was: Allan Yang) Status: Resolved (was: Patch

[jira] [Commented] (HBASE-21377) Missing procedure stack index when restarting

2018-11-10 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682302#comment-16682302 ] Duo Zhang commented on HBASE-21377: --- Never seen this for a long time. Plan to close this after the

[jira] [Updated] (HBASE-21376) Add some verbose log to MasterProcedureScheduler

2018-11-10 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-21376: -- Fix Version/s: 2.2.0 3.0.0 > Add some verbose log to MasterProcedureScheduler >

[jira] [Updated] (HBASE-21376) Add some verbose log to MasterProcedureScheduler

2018-11-10 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-21376: -- Component/s: proc-v2 logging > Add some verbose log to MasterProcedureScheduler >

[jira] [Commented] (HBASE-21454) Kill zk spew

2018-11-10 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682293#comment-16682293 ] Duo Zhang commented on HBASE-21454: --- I think we should find a way to disable all logs when executing