[jira] [Created] (HBASE-21650) Add DDL operation and some other miscellaneous to thrift2

2018-12-26 Thread Allan Yang (JIRA)
Allan Yang created HBASE-21650:
--

 Summary: Add DDL operation and some other miscellaneous to thrift2
 Key: HBASE-21650
 URL: https://issues.apache.org/jira/browse/HBASE-21650
 Project: HBase
  Issue Type: Sub-task
Reporter: Allan Yang
Assignee: Allan Yang
 Fix For: 3.0.0, 2.2.0






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (HBASE-21649) Complete Thrift2 to supersede Thrift1

2018-12-26 Thread Allan Yang (JIRA)
Allan Yang created HBASE-21649:
--

 Summary: Complete Thrift2 to supersede Thrift1
 Key: HBASE-21649
 URL: https://issues.apache.org/jira/browse/HBASE-21649
 Project: HBase
  Issue Type: Umbrella
Reporter: Allan Yang
Assignee: Allan Yang
 Fix For: 3.0.0, 2.2.0


Thrift1 and Thrift2 coexists in our project for a very long time. Functionality 
is more complete in thrift1 but its interface design is bad for adding new 
features(so we have get(), getVer(),getVerTs,getRowWithColumns() and so many 
other methods for a single get request, this is bad). Thrift2 has a more clean 
interface and structure definition, making our user more easy to use. But, it 
has not been updated for a long time, lacking of DDL method is a major 
weakness. 

I think we should complete Thrift2 and supersede Thrift1, making Thrift2 as the 
standard multi language definition. This is a umbrella issue to make it happen. 
The plan would be:
1. complete the DDL interface of thrift2
2. Making thrift2 server can handle thrift1 requests, user don't have to choose 
which thrift server they need to start
3. deprecate thrift1



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (HBASE-21648) hbase shell "move_servers_rsgroup" and "balance_rsgroup" will be failed when meet a split region.

2018-12-26 Thread xuming (JIRA)
xuming created HBASE-21648:
--

 Summary: hbase shell "move_servers_rsgroup" and "balance_rsgroup" 
will be failed when meet a split region.
 Key: HBASE-21648
 URL: https://issues.apache.org/jira/browse/HBASE-21648
 Project: HBase
  Issue Type: Bug
Reporter: xuming






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (HBASE-21647) Add status track for splitting WAL tasks

2018-12-26 Thread Jingyun Tian (JIRA)
Jingyun Tian created HBASE-21647:


 Summary: Add status track for splitting WAL tasks
 Key: HBASE-21647
 URL: https://issues.apache.org/jira/browse/HBASE-21647
 Project: HBase
  Issue Type: Sub-task
Reporter: Jingyun Tian


add status track to help operator check the status of splitting WAL



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (HBASE-21646) Flakey TestTableSnapshotInputFormat; DisableTable not completing...

2018-12-26 Thread stack (JIRA)
stack created HBASE-21646:
-

 Summary: Flakey TestTableSnapshotInputFormat; DisableTable not 
completing...
 Key: HBASE-21646
 URL: https://issues.apache.org/jira/browse/HBASE-21646
 Project: HBase
  Issue Type: Bug
  Components: test
Affects Versions: 2.0.3
Reporter: stack


Fails about 50% of time in the GCE builds... 
https://builds.apache.org/view/H-L/view/HBase/job/HBase-Find-Flaky-Tests/job/branch-2.0/lastSuccessfulBuild/artifact/dashboard.html

We are disabling table to delete at end of test when multi regions and we don't 
complete... pid=21:

{code}
 2018-12-26 20:52:17,179 DEBUG 
[RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=55246] 
assignment.RegionTransitionProcedure(297): Received report CLOSED seqId=-1, 
pid=27, ppid=21, state=RUNNABLE:REGION_TRANSITION_DISPATCH, locked=true; 
UnassignProcedure  table=testWithMapReduce, 
region=b66d77b9dd3eaed5b4f8c89872bb56ca, 
server=192.168.1.51,55250,1545886322135; rit=CLOSING, 
location=192.168.1.51,55250,1545886322135
 2018-12-26 20:52:17,179 DEBUG 
[RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=55246] 
procedure.MasterProcedureScheduler(339): Add TableQueue(testWithMapReduce, 
xlock=false sharedLock=8 size=1) to run queue because: pid=27, ppid=21, 
state=RUNNABLE:  REGION_TRANSITION_FINISH, locked=true; 
UnassignProcedure table=testWithMapReduce, 
region=b66d77b9dd3eaed5b4f8c89872bb56ca, 
server=192.168.1.51,55250,1545886322135 has lock
 2018-12-26 20:52:17,179 DEBUG 
[RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=55246] 
assignment.RegionTransitionProcedure(297): Received report CLOSED seqId=-1, 
pid=26, ppid=21, state=RUNNABLE:REGION_TRANSITION_DISPATCH, locked=true; 
UnassignProcedure  table=testWithMapReduce, 
region=71231f8d1e9b8d4dc83519a6b2b0602a, 
server=192.168.1.51,55250,1545886322135; rit=CLOSING, 
location=192.168.1.51,55250,1545886322135
 2018-12-26 20:52:17,179 DEBUG [PEWorker-1] 
procedure.MasterProcedureScheduler(349): Remove TableQueue(testWithMapReduce, 
xlock=false sharedLock=8 size=0) from run queue because: queue is empty after 
polling out pid=27, ppid=21, state=RUNNABLE:REGION_TRANSITION_FINISH, 
locked=true; UnassignProcedure table=testWithMapReduce, 
region=b66d77b9dd3eaed5b4f8c89872bb56ca, server=192.168.1.51,55250,1545886322135
 2018-12-26 20:52:17,179 DEBUG [PEWorker-1] 
assignment.RegionTransitionProcedure(394): Finishing pid=27, ppid=21, 
state=RUNNABLE:REGION_TRANSITION_FINISH, locked=true; UnassignProcedure 
table=testWithMapReduce, region=b66d77b9dd3eaed5b4f8c89872bb56ca, 
server=192.168.1.51,  55250,1545886322135; rit=CLOSING, 
location=192.168.1.51,55250,1545886322135
 2018-12-26 20:52:17,179 DEBUG 
[RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=55246] 
procedure.MasterProcedureScheduler(339): Add TableQueue(testWithMapReduce, 
xlock=false sharedLock=8 size=1) to run queue because: pid=26, ppid=21, 
state=RUNNABLE:  REGION_TRANSITION_FINISH, locked=true; 
UnassignProcedure table=testWithMapReduce, 
region=71231f8d1e9b8d4dc83519a6b2b0602a, 
server=192.168.1.51,55250,1545886322135 has lock
 2018-12-26 20:52:17,180 DEBUG [PEWorker-14] 
procedure.MasterProcedureScheduler(349): Remove TableQueue(testWithMapReduce, 
xlock=false sharedLock=8 size=0) from run queue because: queue is empty after 
polling out pid=26, ppid=21, state=RUNNABLE:REGION_TRANSITION_FINISH,
locked=true; UnassignProcedure table=testWithMapReduce, 
region=71231f8d1e9b8d4dc83519a6b2b0602a, server=192.168.1.51,55250,1545886322135
 2018-12-26 20:52:17,180 DEBUG [PEWorker-14] 
assignment.RegionTransitionProcedure(394): Finishing pid=26, ppid=21, 
state=RUNNABLE:REGION_TRANSITION_FINISH, locked=true; UnassignProcedure 
table=testWithMapReduce, region=71231f8d1e9b8d4dc83519a6b2b0602a, 
server=192.168.1.51, 55250,1545886322135; rit=CLOSING, 
location=192.168.1.51,55250,1545886322135
 2018-12-26 20:52:17,405 DEBUG 
[RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=55246] 
master.MasterRpcServices(1152): Checking to see if procedure is done pid=21
 2018-12-26 20:52:17,911 DEBUG 
[RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=55246] 
master.MasterRpcServices(1152): Checking to see if procedure is done pid=21
 2018-12-26 20:52:18,917 DEBUG 
[RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=55246] 
master.MasterRpcServices(1152): Checking to see if procedure is done pid=21
 2018-12-26 20:52:20,922 DEBUG 
[RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=55246] 
master.MasterRpcServices(1152): Checking to see if procedure is done pid=21
 2018-12-26 20:52:24,928 DEBUG 
[RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=55246] 
master.MasterRpcServices(1152): Checking to see if procedure is done pid=21
 2018-12-26 20:52:34,932 DEBUG 
[RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=55246] 

[jira] [Created] (HBASE-21645) Perform sanity check and disallow table creation/modification with region replication < 1

2018-12-26 Thread Nihal Jain (JIRA)
Nihal Jain created HBASE-21645:
--

 Summary: Perform sanity check and disallow table 
creation/modification with region replication < 1
 Key: HBASE-21645
 URL: https://issues.apache.org/jira/browse/HBASE-21645
 Project: HBase
  Issue Type: Improvement
Affects Versions: 2.1.1, 3.0.0, 1.5.0, 2.1.2
Reporter: Nihal Jain
Assignee: Nihal Jain


We should perform sanity check and disallow table creation with region 
replication < 1 or modification of an existing table with new region 
replication value < 1.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (HBASE-21644) Modify table procedure runs infinitely for a table having region replication > 1

2018-12-26 Thread Nihal Jain (JIRA)
Nihal Jain created HBASE-21644:
--

 Summary: Modify table procedure runs infinitely for a table having 
region replication > 1
 Key: HBASE-21644
 URL: https://issues.apache.org/jira/browse/HBASE-21644
 Project: HBase
  Issue Type: Bug
  Components: Admin
Affects Versions: 2.1.1, 3.0.0, 2.1.2
Reporter: Nihal Jain
Assignee: Nihal Jain






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (HBASE-21643) Introduce two new region coprocessor method and deprecated postMutationBeforeWAL

2018-12-26 Thread Guanghao Zhang (JIRA)
Guanghao Zhang created HBASE-21643:
--

 Summary: Introduce two new region coprocessor method and 
deprecated postMutationBeforeWAL
 Key: HBASE-21643
 URL: https://issues.apache.org/jira/browse/HBASE-21643
 Project: HBase
  Issue Type: Improvement
Reporter: Guanghao Zhang
Assignee: Guanghao Zhang


The old method postMutationBeforeWAL is not accurate about what it do. It is 
only called during increment and append. But the name is "Mutation"... And the 
javadoc only said it will be called by increment...

 
{code:java}
* Called after a new cell has been created during an increment operation, but 
before
* it is committed to the WAL or memstore.
{code}
 

 

We use this coprocessor in our use case. And need add some cells to apply to 
WAL. So I introduced two new method postIncrementBeforeWAL and 
postAppendBeforeWAL to instead of this.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)