[kudu-CR] WIP KUDU-2612 p2 (b): add transaction status retrieval

2020-09-23 Thread Alexey Serbin (Code Review)
Hello Kudu Jenkins, Andrew Wong,

I'd like you to reexamine a change. Please visit

http://gerrit.cloudera.org:8080/16495

to look at the new patch set (#2).

Change subject: WIP KUDU-2612 p2 (b): add transaction status retrieval
..

WIP KUDU-2612 p2 (b): add transaction status retrieval

After offline discussions with Andrew, it became clear that TxnManager
should provide an asynchronous interface to commit a transaction, i.e.
something similar to CreateTable()/IsCreateTableDone().  To implement
that, the TxnManager needs to check for the status of the transaction
after initiating the commit phase by issuing corresponding call
to TxnStatusManager (that's implemented as CoordinateTransaction() RPC
to TabletServerAdminService with BEGIN_COMMIT_TXN operation type).

This patch introduces the required server-side piece to retrieve the
information on a transaction status from the TxnStatusManager.  I'm
planning to introduce corresponding bindings via the TxnSystemClient
in a separate changelist.

This is a follow-up to efd8c4f165460b7fa337b8ebd1856b10bc274311.

WIP:
  * I'd like to get some feedback on this approach:
-- Is it OK to have a method to fetch transaction status
   as another operation type for the TxnStatusManager?
-- Is it OK to use PB structures for the status of
   a transaction or we want to wrap that into something else?
-- Anything else?

Change-Id: I45f099d943f2b7955d6d561a1cb883343c7b79a4
---
M src/kudu/tablet/txn_coordinator.h
M src/kudu/transactions/CMakeLists.txt
M src/kudu/transactions/txn_status_manager-test.cc
M src/kudu/transactions/txn_status_manager.cc
M src/kudu/transactions/txn_status_manager.h
M src/kudu/transactions/txn_status_tablet.h
M src/kudu/tserver/CMakeLists.txt
M src/kudu/tserver/tablet_service.cc
M src/kudu/tserver/tserver_admin.proto
9 files changed, 165 insertions(+), 8 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/95/16495/2
--
To view, visit http://gerrit.cloudera.org:8080/16495
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I45f099d943f2b7955d6d561a1cb883343c7b79a4
Gerrit-Change-Number: 16495
Gerrit-PatchSet: 2
Gerrit-Owner: Alexey Serbin 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Kudu Jenkins (120)


[kudu-CR] WIP [security] report error details for Kerberos init failure

2020-09-23 Thread Alexey Serbin (Code Review)
Alexey Serbin has uploaded this change for review. ( 
http://gerrit.cloudera.org:8080/16496


Change subject: WIP [security] report error details for Kerberos init failure
..

WIP [security] report error details for Kerberos init failure

WIP:
  * add functionality to add includedir into the krb5.conf
  * cleanup the code
Change-Id: Ic4eca298b9796b311010f81d04eea8507a9c56c1
---
M src/kudu/security/init.cc
M src/kudu/security/test/mini_kdc-test.cc
M src/kudu/security/test/mini_kdc.cc
3 files changed, 59 insertions(+), 18 deletions(-)



  git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/96/16496/1
--
To view, visit http://gerrit.cloudera.org:8080/16496
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: Ic4eca298b9796b311010f81d04eea8507a9c56c1
Gerrit-Change-Number: 16496
Gerrit-PatchSet: 1
Gerrit-Owner: Alexey Serbin 


[kudu-CR] KUDU-3192: [client] Expose the cluster ID in the client KuduTable

2020-09-23 Thread Grant Henke (Code Review)
Grant Henke has removed a vote on this change.

Change subject: KUDU-3192: [client] Expose the cluster ID in the client 
KuduTable
..


Removed Verified-1 by Kudu Jenkins (120)
--
To view, visit http://gerrit.cloudera.org:8080/16493
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: deleteVote
Gerrit-Change-Id: Ia1f5a451aaa44834534d2387ee1c9aa9cf95dd37
Gerrit-Change-Number: 16493
Gerrit-PatchSet: 2
Gerrit-Owner: Grant Henke 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Hao Hao 
Gerrit-Reviewer: Kudu Jenkins (120)


[kudu-CR] KUDU-3192: [hms] Leverage the cluster ID in HMS sync

2020-09-23 Thread Grant Henke (Code Review)
Grant Henke has removed a vote on this change.

Change subject: KUDU-3192: [hms] Leverage the cluster ID in HMS sync
..


Removed Verified-1 by Kudu Jenkins (120)
--
To view, visit http://gerrit.cloudera.org:8080/16494
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: deleteVote
Gerrit-Change-Id: I865b418a3cc4e11c889cc4757cd940831c43af17
Gerrit-Change-Number: 16494
Gerrit-PatchSet: 1
Gerrit-Owner: Grant Henke 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Hao Hao 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Reviewer: Tidy Bot (241)


[kudu-CR] KUDU-3192: [client] Expose the cluster ID in the client KuduTable

2020-09-23 Thread Grant Henke (Code Review)
Grant Henke has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/16493 )

Change subject: KUDU-3192: [client] Expose the cluster ID in the client 
KuduTable
..


Patch Set 2: Verified+1


--
To view, visit http://gerrit.cloudera.org:8080/16493
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ia1f5a451aaa44834534d2387ee1c9aa9cf95dd37
Gerrit-Change-Number: 16493
Gerrit-PatchSet: 2
Gerrit-Owner: Grant Henke 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Grant Henke 
Gerrit-Reviewer: Hao Hao 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Comment-Date: Wed, 23 Sep 2020 13:15:20 +
Gerrit-HasComments: No


[kudu-CR] KUDU-3192: [hms] Leverage the cluster ID in HMS sync

2020-09-23 Thread Grant Henke (Code Review)
Grant Henke has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/16494 )

Change subject: KUDU-3192: [hms] Leverage the cluster ID in HMS sync
..


Patch Set 1: Verified+1


--
To view, visit http://gerrit.cloudera.org:8080/16494
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I865b418a3cc4e11c889cc4757cd940831c43af17
Gerrit-Change-Number: 16494
Gerrit-PatchSet: 1
Gerrit-Owner: Grant Henke 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Grant Henke 
Gerrit-Reviewer: Hao Hao 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Reviewer: Tidy Bot (241)
Gerrit-Comment-Date: Wed, 23 Sep 2020 13:15:56 +
Gerrit-HasComments: No


[kudu-CR](branch-1.12.x) [kudu-tool-test] fix ClusterNameResolverFileCorrupt with glibc 2.31

2020-09-23 Thread Alexey Serbin (Code Review)
Alexey Serbin has submitted this change and it was merged. ( 
http://gerrit.cloudera.org:8080/16491 )

Change subject: [kudu-tool-test] fix ClusterNameResolverFileCorrupt with glibc 
2.31
..

[kudu-tool-test] fix ClusterNameResolverFileCorrupt with glibc 2.31

This patch updates the expected error message in the
ToolTest.ClusterNameResolverFileCorrupt scenario to make the test
pass on Ubuntu 20.04 LTS (it should fix it on other platforms which
use newer glibc versions).

Without this patch, the scenario failed on Ubuntu 20.04 LTS:

  src/kudu/tools/kudu-tool-test.cc:637: Failure
  Value of: stderr
  Expected: has substring "Network error: Could not connect to the cluster: 
unable to resolve address for bad: Name or service not known"
Actual: "W0919 23:39:50.032436 1041101 flags.cc:405] Enabled unsafe flag: 
--openssl_security_level_override=0\nW0919 23:39:50.032559 1041101 
flags.cc:405] Enabled unsafe flag: --never_fsync=true\nNetwork error: Could not 
connect to the cluster: unable to resolve address for bad: Temporary failure in 
name resolution"

Instead of tailoring the errno-converted message for every platform,
it's easier to rely in the essential part of it that corresponds
to the DNS resolver failure.

In addition, I did a minor cleanup on the code around, removing
calls of the Substitute() function where a fixed string is enough.

Change-Id: I3eb0991cb2d4311051e55e231cb4fe6d065aa632
Reviewed-on: http://gerrit.cloudera.org:8080/16478
Tested-by: Kudu Jenkins
Reviewed-by: Grant Henke 
(cherry picked from commit d8ab44c6864172d4b990adf31f7d84fd33e4ae15)
Reviewed-on: http://gerrit.cloudera.org:8080/16491
---
M src/kudu/tools/kudu-tool-test.cc
1 file changed, 4 insertions(+), 9 deletions(-)

Approvals:
  Kudu Jenkins: Verified
  Grant Henke: Looks good to me, approved

--
To view, visit http://gerrit.cloudera.org:8080/16491
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: branch-1.12.x
Gerrit-MessageType: merged
Gerrit-Change-Id: I3eb0991cb2d4311051e55e231cb4fe6d065aa632
Gerrit-Change-Number: 16491
Gerrit-PatchSet: 2
Gerrit-Owner: Alexey Serbin 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Attila Bukor 
Gerrit-Reviewer: Grant Henke 
Gerrit-Reviewer: Kudu Jenkins (120)


[kudu-CR](branch-1.12.x) [thirdparty] fix LLVM compilation on Ubuntu 20.04

2020-09-23 Thread Alexey Serbin (Code Review)
Alexey Serbin has submitted this change and it was merged. ( 
http://gerrit.cloudera.org:8080/16490 )

Change subject: [thirdparty] fix LLVM compilation on Ubuntu 20.04
..

[thirdparty] fix LLVM compilation on Ubuntu 20.04

This changelist adds a patch from the llvm-toolchain-9-9.0.1 Debian
source package to fix compilation of LLVM 9.0 in Kudu thirdparty
on Ubuntu 20.04 LTS.  See [1], [2] for the original source of the patch.

The patch is already included in the upstream LLVM repo and included
into 10.0.0 and later releases.

[1] https://reviews.llvm.org/rG947f9692440
[2] 
https://github.com/llvm/llvm-project/commit/947f9692440836dcb8d88b74b69dd379d85974ce

Change-Id: Ifba0bf6ba660a536ed54ddce228a38470dd1c650
Reviewed-on: http://gerrit.cloudera.org:8080/16477
Tested-by: Kudu Jenkins
Reviewed-by: Grant Henke 
(cherry picked from commit 2bed4068c53fcc6084e8e8742437846cf417a746)
Reviewed-on: http://gerrit.cloudera.org:8080/16490
---
M thirdparty/download-thirdparty.sh
A thirdparty/patches/llvm-947f9692440836dcb8d88b74b69dd379d85974ce.patch
2 files changed, 84 insertions(+), 2 deletions(-)

Approvals:
  Kudu Jenkins: Verified
  Grant Henke: Looks good to me, approved

--
To view, visit http://gerrit.cloudera.org:8080/16490
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: branch-1.12.x
Gerrit-MessageType: merged
Gerrit-Change-Id: Ifba0bf6ba660a536ed54ddce228a38470dd1c650
Gerrit-Change-Number: 16490
Gerrit-PatchSet: 2
Gerrit-Owner: Alexey Serbin 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Attila Bukor 
Gerrit-Reviewer: Grant Henke 
Gerrit-Reviewer: Kudu Jenkins (120)


[kudu-CR] [master] KUDU-2181 Raft ChangeConfig request to add a master

2020-09-23 Thread Bankim Bhavsar (Code Review)
Hello Tidy Bot, Alexey Serbin, Kudu Jenkins, Andrew Wong,

I'd like you to reexamine a change. Please visit

http://gerrit.cloudera.org:8080/16321

to look at the new patch set (#6).

Change subject: [master] KUDU-2181 Raft ChangeConfig request to add a master
..

[master] KUDU-2181 Raft ChangeConfig request to add a master

This change:
- Adds hidden feature flag "--master_support_change_config" off by
  default.
- RPC changes to add a master that initiates Raft config change and
  responds asynchronously.
- RPC changes to report back member type(VOTER/NON_VOTER) of masters
- Removes the cached master_addresses in catalog manager as it's no
  longer static.
- Updates and adds comments in MasterOptions such that it's used to
  fetch master addresses only during master init time as masters can
  be added/removed dynamically with this change.
- Updates ListMasters() to look at local Raft config instead of
  MasterOptions as the masters can be added/removed dynamically.

If the new master can be caught up from the WAL then the master
gets promoted to VOTER else it remains as NON_VOTER without master
tablet copying support.

Change-Id: I0ac7e6e55220bcb01cad0fa386daaf656258088c
---
M src/kudu/common/wire_protocol.proto
M src/kudu/consensus/raft_consensus.cc
M src/kudu/consensus/raft_consensus.h
M src/kudu/master/CMakeLists.txt
M src/kudu/master/catalog_manager.cc
M src/kudu/master/catalog_manager.h
A src/kudu/master/dynamic_multi_master-test.cc
M src/kudu/master/master.cc
M src/kudu/master/master.h
M src/kudu/master/master.proto
M src/kudu/master/master_options.cc
M src/kudu/master/master_options.h
M src/kudu/master/master_path_handlers.cc
M src/kudu/master/master_service.cc
M src/kudu/master/master_service.h
M src/kudu/master/mini_master.cc
M src/kudu/master/sys_catalog.cc
M src/kudu/mini-cluster/external_mini_cluster.cc
M src/kudu/mini-cluster/external_mini_cluster.h
M src/kudu/tools/tool_action_master.cc
20 files changed, 965 insertions(+), 55 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/21/16321/6
--
To view, visit http://gerrit.cloudera.org:8080/16321
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I0ac7e6e55220bcb01cad0fa386daaf656258088c
Gerrit-Change-Number: 16321
Gerrit-PatchSet: 6
Gerrit-Owner: Bankim Bhavsar 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Bankim Bhavsar 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Reviewer: Tidy Bot (241)


[kudu-CR] [master] KUDU-2181 Raft ChangeConfig request to add a master

2020-09-23 Thread Bankim Bhavsar (Code Review)
Bankim Bhavsar has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/16321 )

Change subject: [master] KUDU-2181 Raft ChangeConfig request to add a master
..


Patch Set 5:

(16 comments)

http://gerrit.cloudera.org:8080/#/c/16321/5/src/kudu/master/catalog_manager.h
File src/kudu/master/catalog_manager.h:

http://gerrit.cloudera.org:8080/#/c/16321/5/src/kudu/master/catalog_manager.h@810
PS5, Line 810: kRemoveMaster
> +1
Remove master is not implemented. Removing the enum.


http://gerrit.cloudera.org:8080/#/c/16321/5/src/kudu/master/catalog_manager.cc
File src/kudu/master/catalog_manager.cc:

http://gerrit.cloudera.org:8080/#/c/16321/5/src/kudu/master/catalog_manager.cc@1419
PS5, Line 1419:
> nit: 4 spaces here
Done


http://gerrit.cloudera.org:8080/#/c/16321/5/src/kudu/master/dynamic_multi_master-test.cc
File src/kudu/master/dynamic_multi_master-test.cc:

http://gerrit.cloudera.org:8080/#/c/16321/5/src/kudu/master/dynamic_multi_master-test.cc@126
PS5, Line 126: resp
> Should we also check resp.error() here? Same elsewhere.
Done


http://gerrit.cloudera.org:8080/#/c/16321/5/src/kudu/master/dynamic_multi_master-test.cc@149
PS5, Line 149: // Start with an existing master daemon.
> nit: maybe, "Start with an existing master daemon's options, but modify the
Done


http://gerrit.cloudera.org:8080/#/c/16321/5/src/kudu/master/dynamic_multi_master-test.cc@186
PS5, Line 186: ASSERT_EVENTUALLY([&] {
> I guess the idea was to protect against fluctuations of master leadership (
Yeah it was to prevent flakiness in tests due to leadership change between 
querying for leader master and issuing leader master RPC.
Added a functor approach instead.


http://gerrit.cloudera.org:8080/#/c/16321/5/src/kudu/master/dynamic_multi_master-test.cc@194
PS5, Line 194: num_masters_
> nit: this number changes throughout the test, so it isn't obvious what its
Changed to orig_num_masters_ and check using orig_num_masters_ as the base.


http://gerrit.cloudera.org:8080/#/c/16321/5/src/kudu/master/dynamic_multi_master-test.cc@198
PS5, Line 198: returning the status.
> nit: could you mention how this might fail, so it's obvious when and why we
Done


http://gerrit.cloudera.org:8080/#/c/16321/5/src/kudu/master/dynamic_multi_master-test.cc@258
PS5, Line 258: ASSERT_EVENTUALLY
> nit: in general, it isn't obvious why we need ASSERT_EVENTUALLYs everywhere
Done


http://gerrit.cloudera.org:8080/#/c/16321/5/src/kudu/master/dynamic_multi_master-test.cc@273
PS5, Line 273: num_masters_
> nit: I'd much rather have this be constant and explicitly use `orig_num_mas
Done


http://gerrit.cloudera.org:8080/#/c/16321/5/src/kudu/master/dynamic_multi_master-test.cc@399
PS5, Line 399:   SleepFor(MonoDelta::FromSeconds(1));
> nit: could we instead look at metrics to wait until WAL GC has happened?
I took a look around but couldn't determine the right metric that would suggest 
sys catalog WAL has been GC'ed or what it's current size is to determine that 
event has happened.

Added TODO and keeping the sleep here for now.


http://gerrit.cloudera.org:8080/#/c/16321/5/src/kudu/master/dynamic_multi_master-test.cc@515
PS5, Line 515:   });
> nit: could we also run VerifyNumMastersAndGetAddresses here too? Same with
Done


http://gerrit.cloudera.org:8080/#/c/16321/5/src/kudu/master/dynamic_multi_master-test.cc@518
PS5, Line 518: a master with missing master address
> Not sure whether I missed it or not, but what about the case of trying to a
Done


http://gerrit.cloudera.org:8080/#/c/16321/5/src/kudu/master/dynamic_multi_master-test.cc@524
PS5, Line 524: master
> nit: drop
Done


http://gerrit.cloudera.org:8080/#/c/16321/5/src/kudu/master/master.h
File src/kudu/master/master.h:

http://gerrit.cloudera.org:8080/#/c/16321/5/src/kudu/master/master.h@92
PS5, Line 92:   MasterOptions* mutable_opts() { return &opts_; }
> Is this needed still?
Good catch.


http://gerrit.cloudera.org:8080/#/c/16321/5/src/kudu/master/master.cc
File src/kudu/master/master.cc:

http://gerrit.cloudera.org:8080/#/c/16321/5/src/kudu/master/master.cc@64
PS5, Line 64: namespace kudu {
: namespace rpc {
: class RpcContext;
: }  // namespace rpc
: }  // namespace kudu
> nit: can you move this down into the other kudu namespace?
Done


http://gerrit.cloudera.org:8080/#/c/16321/5/src/kudu/master/master_service.cc
File src/kudu/master/master_service.cc:

http://gerrit.cloudera.org:8080/#/c/16321/5/src/kudu/master/master_service.cc@267
PS5, Line 267: InitiateMasterChange
> nit: InitiateMasterChangeConfig
Done



--
To view, visit http://gerrit.cloudera.org:8080/16321
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I0ac7e6e55220bcb01cad0fa386daaf656258088c
Gerrit-Change-Number: 16321
Gerrit-PatchSet: 5
Gerrit-Owner: Bankim Bhavsar 
Gerrit-Reviewer: Alexey Serbin

[kudu-CR] KUDU-3192: [client] Expose the cluster ID in the client KuduTable

2020-09-23 Thread Andrew Wong (Code Review)
Andrew Wong has removed a vote on this change.

Change subject: KUDU-3192: [client] Expose the cluster ID in the client 
KuduTable
..


Removed Code-Review+2 by Andrew Wong 
--
To view, visit http://gerrit.cloudera.org:8080/16493
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: deleteVote
Gerrit-Change-Id: Ia1f5a451aaa44834534d2387ee1c9aa9cf95dd37
Gerrit-Change-Number: 16493
Gerrit-PatchSet: 2
Gerrit-Owner: Grant Henke 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Grant Henke 
Gerrit-Reviewer: Hao Hao 
Gerrit-Reviewer: Kudu Jenkins (120)


[kudu-CR] KUDU-3192: [client] Expose the cluster ID in the client KuduTable

2020-09-23 Thread Andrew Wong (Code Review)
Andrew Wong has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/16493 )

Change subject: KUDU-3192: [client] Expose the cluster ID in the client 
KuduTable
..


Patch Set 2: Code-Review+2

(1 comment)

http://gerrit.cloudera.org:8080/#/c/16493/2//COMMIT_MSG
Commit Message:

http://gerrit.cloudera.org:8080/#/c/16493/2//COMMIT_MSG@9
PS2, Line 9: This patch adds a cluster ID field to the KuduTable object in the
I'm surprised this field has to be associated with Kudu tables instead of 
entire Kudu clients, which get initialized with a single cluster via the master 
addresses. I understand that it will be a per table field in the HMS, but I'm 
not convinced that means it should be a public API for tables.



--
To view, visit http://gerrit.cloudera.org:8080/16493
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ia1f5a451aaa44834534d2387ee1c9aa9cf95dd37
Gerrit-Change-Number: 16493
Gerrit-PatchSet: 2
Gerrit-Owner: Grant Henke 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Grant Henke 
Gerrit-Reviewer: Hao Hao 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Comment-Date: Wed, 23 Sep 2020 17:44:13 +
Gerrit-HasComments: Yes


[kudu-CR] KUDU-3192: [client] Expose the cluster ID in the client KuduTable

2020-09-23 Thread Grant Henke (Code Review)
Grant Henke has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/16493 )

Change subject: KUDU-3192: [client] Expose the cluster ID in the client 
KuduTable
..


Patch Set 2:

(1 comment)

http://gerrit.cloudera.org:8080/#/c/16493/2//COMMIT_MSG
Commit Message:

http://gerrit.cloudera.org:8080/#/c/16493/2//COMMIT_MSG@9
PS2, Line 9: This patch adds a cluster ID field to the KuduTable object in the
> I'm surprised this field has to be associated with Kudu tables instead of e
It is convenient to have it on the KuduTable object so that the user can check 
if the table is from the cluster they expect. It could also be useful if there 
are applications that talk to multiple clusters.

I could add cluster ID to the ConnectToMasterResponsePB and store it in the 
client as well when it connects, but I still might consider adding a 
convenience method to the client that returns client.getClusterId using the 
client in the KuduTable object.



--
To view, visit http://gerrit.cloudera.org:8080/16493
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ia1f5a451aaa44834534d2387ee1c9aa9cf95dd37
Gerrit-Change-Number: 16493
Gerrit-PatchSet: 2
Gerrit-Owner: Grant Henke 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Grant Henke 
Gerrit-Reviewer: Hao Hao 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Comment-Date: Wed, 23 Sep 2020 17:57:23 +
Gerrit-HasComments: Yes


[kudu-CR] KUDU-3192: [client] Expose the cluster ID in the client KuduTable

2020-09-23 Thread Andrew Wong (Code Review)
Andrew Wong has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/16493 )

Change subject: KUDU-3192: [client] Expose the cluster ID in the client 
KuduTable
..


Patch Set 2:

(1 comment)

http://gerrit.cloudera.org:8080/#/c/16493/2//COMMIT_MSG
Commit Message:

http://gerrit.cloudera.org:8080/#/c/16493/2//COMMIT_MSG@9
PS2, Line 9: This patch adds a cluster ID field to the KuduTable object in the
> It is convenient to have it on the KuduTable object so that the user can ch
I agree it's convenient to know the cluster ID, but every table will hit the 
same masters and get the same cluster ID. It seems like if we have a KuduTable, 
we should also have a Kudu client, in which case we could get the cluster ID 
directly from the client for such validation. I'd be onboard with the 
ConnectToMaster approach.



--
To view, visit http://gerrit.cloudera.org:8080/16493
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ia1f5a451aaa44834534d2387ee1c9aa9cf95dd37
Gerrit-Change-Number: 16493
Gerrit-PatchSet: 2
Gerrit-Owner: Grant Henke 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Grant Henke 
Gerrit-Reviewer: Hao Hao 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Comment-Date: Wed, 23 Sep 2020 18:13:57 +
Gerrit-HasComments: Yes


[kudu-CR] KUDU-3192: [client] Expose the cluster ID in the client KuduTable

2020-09-23 Thread Andrew Wong (Code Review)
Andrew Wong has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/16493 )

Change subject: KUDU-3192: [client] Expose the cluster ID in the client 
KuduTable
..


Patch Set 2: Code-Review+2


--
To view, visit http://gerrit.cloudera.org:8080/16493
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ia1f5a451aaa44834534d2387ee1c9aa9cf95dd37
Gerrit-Change-Number: 16493
Gerrit-PatchSet: 2
Gerrit-Owner: Grant Henke 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Grant Henke 
Gerrit-Reviewer: Hao Hao 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Comment-Date: Wed, 23 Sep 2020 18:15:36 +
Gerrit-HasComments: No


[kudu-CR] KUDU-3192: [client] Expose the cluster ID in the client KuduTable

2020-09-23 Thread Andrew Wong (Code Review)
Andrew Wong has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/16493 )

Change subject: KUDU-3192: [client] Expose the cluster ID in the client 
KuduTable
..


Patch Set 2:

Mobile gerrit makes it too easy to +2 things :)


--
To view, visit http://gerrit.cloudera.org:8080/16493
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ia1f5a451aaa44834534d2387ee1c9aa9cf95dd37
Gerrit-Change-Number: 16493
Gerrit-PatchSet: 2
Gerrit-Owner: Grant Henke 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Grant Henke 
Gerrit-Reviewer: Hao Hao 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Comment-Date: Wed, 23 Sep 2020 18:16:04 +
Gerrit-HasComments: No


[kudu-CR] KUDU-3192: [client] Expose the cluster ID in the client KuduTable

2020-09-23 Thread Andrew Wong (Code Review)
Andrew Wong has removed a vote on this change.

Change subject: KUDU-3192: [client] Expose the cluster ID in the client 
KuduTable
..


Removed Code-Review+2 by Andrew Wong 
--
To view, visit http://gerrit.cloudera.org:8080/16493
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: deleteVote
Gerrit-Change-Id: Ia1f5a451aaa44834534d2387ee1c9aa9cf95dd37
Gerrit-Change-Number: 16493
Gerrit-PatchSet: 2
Gerrit-Owner: Grant Henke 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Grant Henke 
Gerrit-Reviewer: Hao Hao 
Gerrit-Reviewer: Kudu Jenkins (120)


[kudu-CR] KUDU-3192: [hms] Leverage the cluster ID in HMS sync

2020-09-23 Thread Andrew Wong (Code Review)
Andrew Wong has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/16494 )

Change subject: KUDU-3192: [hms] Leverage the cluster ID in HMS sync
..


Patch Set 1:

(3 comments)

http://gerrit.cloudera.org:8080/#/c/16494/1//COMMIT_MSG
Commit Message:

http://gerrit.cloudera.org:8080/#/c/16494/1//COMMIT_MSG@9
PS1, Line 9: This patch propagates the cluster ID to the HMS entries for
Could you also add tests where we create some real-looking metadata with no or 
different cluster IDs and ensure we ignore or account for it as appropriate?


http://gerrit.cloudera.org:8080/#/c/16494/1/src/kudu/master/hms_notification_log_listener.cc
File src/kudu/master/hms_notification_log_listener.cc:

http://gerrit.cloudera.org:8080/#/c/16494/1/src/kudu/master/hms_notification_log_listener.cc@363
PS1, Line 363: before_table.tableName, cluster_id);
Should dereference cluster_id


http://gerrit.cloudera.org:8080/#/c/16494/1/src/kudu/master/hms_notification_log_listener.cc@437
PS1, Line 437:   // If there is not a cluster ID, for maximum compatibility we 
should assume this is an older
Uncomment this? Also maybe encapsulate in some FilterDifferentClusterId() 
method?



--
To view, visit http://gerrit.cloudera.org:8080/16494
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I865b418a3cc4e11c889cc4757cd940831c43af17
Gerrit-Change-Number: 16494
Gerrit-PatchSet: 1
Gerrit-Owner: Grant Henke 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Grant Henke 
Gerrit-Reviewer: Hao Hao 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Reviewer: Tidy Bot (241)
Gerrit-Comment-Date: Wed, 23 Sep 2020 18:35:49 +
Gerrit-HasComments: Yes


[kudu-CR] WIP KUDU-2612 p2 (b): add transaction status retrieval

2020-09-23 Thread Andrew Wong (Code Review)
Andrew Wong has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/16495 )

Change subject: WIP KUDU-2612 p2 (b): add transaction status retrieval
..


Patch Set 2:

(4 comments)

http://gerrit.cloudera.org:8080/#/c/16495/2//COMMIT_MSG
Commit Message:

http://gerrit.cloudera.org:8080/#/c/16495/2//COMMIT_MSG@26
PS2, Line 26: -- Is it OK to have a method to fetch transaction status
I was on the fence about exposing as a CoordinatorOp because it seems like 
there is a difference in concerns -- all other ops may mutate the transaction 
state, while this new op doesn't. That said, beyond that I can't articulate a 
good reason why not reuse what we have. I'm fine keeping it as is.


http://gerrit.cloudera.org:8080/#/c/16495/2//COMMIT_MSG@28
PS2, Line 28: -- Is it OK to use PB structures for the status of
I think it's fine to expose these as pb given it is internal API.


http://gerrit.cloudera.org:8080/#/c/16495/2/src/kudu/transactions/txn_status_manager-test.cc
File src/kudu/transactions/txn_status_manager-test.cc:

http://gerrit.cloudera.org:8080/#/c/16495/2/src/kudu/transactions/txn_status_manager-test.cc@445
PS2, Line 445:   // Supplying not-yet-used transaction idenfier.
Nit: ID or identifier, same below


http://gerrit.cloudera.org:8080/#/c/16495/2/src/kudu/tserver/tserver_admin.proto
File src/kudu/tserver/tserver_admin.proto:

http://gerrit.cloudera.org:8080/#/c/16495/2/src/kudu/tserver/tserver_admin.proto@55
PS2, Line 55:   // TODO(aserbin): does it make sense to populate this with the 
current status
Good thought. I can imagine this being useful in the future for debugging cases 
where we have returned an error



--
To view, visit http://gerrit.cloudera.org:8080/16495
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I45f099d943f2b7955d6d561a1cb883343c7b79a4
Gerrit-Change-Number: 16495
Gerrit-PatchSet: 2
Gerrit-Owner: Alexey Serbin 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Comment-Date: Wed, 23 Sep 2020 19:09:24 +
Gerrit-HasComments: Yes


[kudu-CR] WIP KUDU-2612 p2 (b): add transaction status retrieval

2020-09-23 Thread Alexey Serbin (Code Review)
Alexey Serbin has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/16495 )

Change subject: WIP KUDU-2612 p2 (b): add transaction status retrieval
..


Patch Set 2:

(1 comment)

Thank you for the quick review.

Just exploring an extra option: maybe, there should be a separate RPC  to 
retrieve a status of a transaction?

http://gerrit.cloudera.org:8080/#/c/16495/2//COMMIT_MSG
Commit Message:

http://gerrit.cloudera.org:8080/#/c/16495/2//COMMIT_MSG@26
PS2, Line 26: -- Is it OK to have a method to fetch transaction status
> I was on the fence about exposing as a CoordinatorOp because it seems like
As a better option, do you think a separate RPC in the TabletServerAdminService 
interface would be more appropriate?

Something like
  GetTransactionStatus()

?



--
To view, visit http://gerrit.cloudera.org:8080/16495
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I45f099d943f2b7955d6d561a1cb883343c7b79a4
Gerrit-Change-Number: 16495
Gerrit-PatchSet: 2
Gerrit-Owner: Alexey Serbin 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Comment-Date: Wed, 23 Sep 2020 19:38:11 +
Gerrit-HasComments: Yes


[kudu-CR] [master] KUDU-2181 Raft ChangeConfig request to add a master

2020-09-23 Thread Andrew Wong (Code Review)
Andrew Wong has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/16321 )

Change subject: [master] KUDU-2181 Raft ChangeConfig request to add a master
..


Patch Set 6:

(5 comments)

http://gerrit.cloudera.org:8080/#/c/16321/5/src/kudu/master/dynamic_multi_master-test.cc
File src/kudu/master/dynamic_multi_master-test.cc:

http://gerrit.cloudera.org:8080/#/c/16321/5/src/kudu/master/dynamic_multi_master-test.cc@258
PS5, Line 258:   *req.mutabl
> Done
Thanks! Much clearer this time around


http://gerrit.cloudera.org:8080/#/c/16321/6/src/kudu/master/dynamic_multi_master-test.cc
File src/kudu/master/dynamic_multi_master-test.cc:

http://gerrit.cloudera.org:8080/#/c/16321/6/src/kudu/master/dynamic_multi_master-test.cc@162
PS6, Line 162:   }
Nit: Would it make sense to define a deadline instead and keep retrying until 
then?


http://gerrit.cloudera.org:8080/#/c/16321/6/src/kudu/master/dynamic_multi_master-test.cc@266
PS6, Line 266: return RunLeaderMasterRPC(add_master).AndThen([&] {
Nit: AndThen is useful when we need to do something extra with the result of 
the first error we see (eg check for specific errors). If we're just returning 
the error, it's simpler to just use RETURN_NOT_OK() and return.


http://gerrit.cloudera.org:8080/#/c/16321/6/src/kudu/master/dynamic_multi_master-test.cc@399
PS6, Line 399: }
The log_gc_duration histogram metric has a TotalCount() method that might be 
useful.

I use it here: 
https://gerrit.cloudera.org/c/16492/3/src/kudu/integration-tests/txn_participant-itest.cc


http://gerrit.cloudera.org:8080/#/c/16321/5/src/kudu/master/master.cc
File src/kudu/master/master.cc:

http://gerrit.cloudera.org:8080/#/c/16321/5/src/kudu/master/master.cc@424
PS5, Line 424: auto
> nit: could be a const ref
Missed this?



--
To view, visit http://gerrit.cloudera.org:8080/16321
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I0ac7e6e55220bcb01cad0fa386daaf656258088c
Gerrit-Change-Number: 16321
Gerrit-PatchSet: 6
Gerrit-Owner: Bankim Bhavsar 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Bankim Bhavsar 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Reviewer: Tidy Bot (241)
Gerrit-Comment-Date: Wed, 23 Sep 2020 19:46:56 +
Gerrit-HasComments: Yes


[kudu-CR] WIP KUDU-2612 p2 (b): add transaction status retrieval

2020-09-23 Thread Andrew Wong (Code Review)
Andrew Wong has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/16495 )

Change subject: WIP KUDU-2612 p2 (b): add transaction status retrieval
..


Patch Set 2:

(1 comment)

http://gerrit.cloudera.org:8080/#/c/16495/2//COMMIT_MSG
Commit Message:

http://gerrit.cloudera.org:8080/#/c/16495/2//COMMIT_MSG@26
PS2, Line 26: -- Is it OK to have a method to fetch transaction status
> As a better option, do you think a separate RPC in the TabletServerAdminSer
That sounds good to me too.



--
To view, visit http://gerrit.cloudera.org:8080/16495
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I45f099d943f2b7955d6d561a1cb883343c7b79a4
Gerrit-Change-Number: 16495
Gerrit-PatchSet: 2
Gerrit-Owner: Alexey Serbin 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Comment-Date: Wed, 23 Sep 2020 20:39:37 +
Gerrit-HasComments: Yes


[kudu-CR] WIP KUDU-2612 p2 (b): add transaction status retrieval

2020-09-23 Thread Andrew Wong (Code Review)
Andrew Wong has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/16495 )

Change subject: WIP KUDU-2612 p2 (b): add transaction status retrieval
..


Patch Set 2:

(1 comment)

http://gerrit.cloudera.org:8080/#/c/16495/2//COMMIT_MSG
Commit Message:

http://gerrit.cloudera.org:8080/#/c/16495/2//COMMIT_MSG@26
PS2, Line 26: -- Is it OK to have a method to fetch transaction status
> That sounds good to me too.
The main benefit to using CoordinatorOp is that it lets us reuse the existing 
CoordinatorOp code in the system client.



--
To view, visit http://gerrit.cloudera.org:8080/16495
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I45f099d943f2b7955d6d561a1cb883343c7b79a4
Gerrit-Change-Number: 16495
Gerrit-PatchSet: 2
Gerrit-Owner: Alexey Serbin 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Comment-Date: Wed, 23 Sep 2020 20:41:40 +
Gerrit-HasComments: Yes


[kudu-CR] KUDU-3187: Enhance the HMS plugin to check if synchronization is enabled

2020-09-23 Thread Grant Henke (Code Review)
Hello Alexey Serbin, Kudu Jenkins, Andrew Wong, Greg Solovyev, Hao Hao,

I'd like you to reexamine a change. Please visit

http://gerrit.cloudera.org:8080/16388

to look at the new patch set (#8).

Change subject: KUDU-3187: Enhance the HMS plugin to check if synchronization 
is enabled
..

KUDU-3187: Enhance the HMS plugin to check if synchronization is enabled

This patch enhances the HMS plugin to check if synchronization
is enabled on the Kudu cluster backing the table. This can
simplify enabling HMS synchronization because the plugin
jar can be added to the HMS classpath unconditionally.

This also helps support cases where multiple Kudu clusters
use the same HMS and one is synchronized and the other isn’t.

This patch introduces a new environment property,
`KUDU_HMS_SYNC_ENABLED`, to the plugin which allows
for faster tests that do not need to setup a Kudu cluster.
It could also be useful to disable this new functionality as
a workaround if issues are seen.

Additonally, this patch adjusts the mini HMS to add
security properties configuration. This is required now
that the Kudu client runs in the plugin and communicates
with the cluster. See these commits for context:
- https://github.com/apache/kudu/commit/0ee93e31a1febb987c72e7392a69b2584e6f38ed
- https://github.com/apache/kudu/commit/3343144fefaad5a30e95e21297c64c78e308fa1f

I also manually verified the following behavior on a real cluster:
- `KUDU_HMS_SYNC_ENABLED` environment variable
- CREATE/ALTER/DROP on non-sync cluster works
- - With plugin jar used by the HMS
- CREATE/ALTER/DROP on sync cluster fails with clear message
- Authn via Kerberos

Change-Id: Ib3588d72af1bb499202b47fca50a08876e13ea37
---
M java/kudu-hive/build.gradle
M 
java/kudu-hive/src/main/java/org/apache/kudu/hive/metastore/KuduMetastorePlugin.java
M 
java/kudu-hive/src/test/java/org/apache/kudu/hive/metastore/TestKuduMetastorePlugin.java
M src/kudu/hms/hms_catalog-test.cc
M src/kudu/hms/hms_client-test.cc
M src/kudu/hms/mini_hms.cc
M src/kudu/hms/mini_hms.h
7 files changed, 239 insertions(+), 43 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/88/16388/8
--
To view, visit http://gerrit.cloudera.org:8080/16388
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Ib3588d72af1bb499202b47fca50a08876e13ea37
Gerrit-Change-Number: 16388
Gerrit-PatchSet: 8
Gerrit-Owner: Grant Henke 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Grant Henke 
Gerrit-Reviewer: Greg Solovyev 
Gerrit-Reviewer: Hao Hao 
Gerrit-Reviewer: Kudu Jenkins (120)


[kudu-CR] WIP KUDU-2612 p2 (b): add transaction status retrieval

2020-09-23 Thread Alexey Serbin (Code Review)
Alexey Serbin has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/16495 )

Change subject: WIP KUDU-2612 p2 (b): add transaction status retrieval
..


Patch Set 2:

(1 comment)

http://gerrit.cloudera.org:8080/#/c/16495/2//COMMIT_MSG
Commit Message:

http://gerrit.cloudera.org:8080/#/c/16495/2//COMMIT_MSG@26
PS2, Line 26: -- Is it OK to have a method to fetch transaction status
> The main benefit to using CoordinatorOp is that it lets us reuse the existi
Right, that's what I thought to rely upon when adding the client-side bindings 
in TxnSystemClient.  That code needs to be modified a bit, though.

OK, let's then keep this new type for the CoordinatorOp.  I guess we can update 
it further if we find this approach is not so good for some other reasons that 
we cannot see right away.



-- 
To view, visit http://gerrit.cloudera.org:8080/16495
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I45f099d943f2b7955d6d561a1cb883343c7b79a4
Gerrit-Change-Number: 16495
Gerrit-PatchSet: 2
Gerrit-Owner: Alexey Serbin 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Comment-Date: Wed, 23 Sep 2020 20:45:58 +
Gerrit-HasComments: Yes


[kudu-CR] WIP KUDU-2612 p2 (b): add transaction status retrieval

2020-09-23 Thread Andrew Wong (Code Review)
Andrew Wong has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/16495 )

Change subject: WIP KUDU-2612 p2 (b): add transaction status retrieval
..


Patch Set 2:

(1 comment)

http://gerrit.cloudera.org:8080/#/c/16495/2//COMMIT_MSG
Commit Message:

http://gerrit.cloudera.org:8080/#/c/16495/2//COMMIT_MSG@26
PS2, Line 26: -- Is it OK to have a method to fetch transaction status
> Right, that's what I thought to rely upon when adding the client-side bindi
Yep, SGTM.



--
To view, visit http://gerrit.cloudera.org:8080/16495
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I45f099d943f2b7955d6d561a1cb883343c7b79a4
Gerrit-Change-Number: 16495
Gerrit-PatchSet: 2
Gerrit-Owner: Alexey Serbin 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Comment-Date: Wed, 23 Sep 2020 20:51:38 +
Gerrit-HasComments: Yes


[kudu-CR] KUDU-3187: Enhance the HMS plugin to check if synchronization is enabled

2020-09-23 Thread Grant Henke (Code Review)
Grant Henke has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/16388 )

Change subject: KUDU-3187: Enhance the HMS plugin to check if synchronization 
is enabled
..


Patch Set 8: Verified+1


--
To view, visit http://gerrit.cloudera.org:8080/16388
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ib3588d72af1bb499202b47fca50a08876e13ea37
Gerrit-Change-Number: 16388
Gerrit-PatchSet: 8
Gerrit-Owner: Grant Henke 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Grant Henke 
Gerrit-Reviewer: Greg Solovyev 
Gerrit-Reviewer: Hao Hao 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Comment-Date: Wed, 23 Sep 2020 21:36:39 +
Gerrit-HasComments: No


[kudu-CR] KUDU-3187: Enhance the HMS plugin to check if synchronization is enabled

2020-09-23 Thread Grant Henke (Code Review)
Grant Henke has removed a vote on this change.

Change subject: KUDU-3187: Enhance the HMS plugin to check if synchronization 
is enabled
..


Removed Verified-1 by Kudu Jenkins (120)
--
To view, visit http://gerrit.cloudera.org:8080/16388
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: deleteVote
Gerrit-Change-Id: Ib3588d72af1bb499202b47fca50a08876e13ea37
Gerrit-Change-Number: 16388
Gerrit-PatchSet: 8
Gerrit-Owner: Grant Henke 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Grant Henke 
Gerrit-Reviewer: Greg Solovyev 
Gerrit-Reviewer: Hao Hao 
Gerrit-Reviewer: Kudu Jenkins (120)


[kudu-CR] [master] KUDU-2181 Raft ChangeConfig request to add a master

2020-09-23 Thread Bankim Bhavsar (Code Review)
Bankim Bhavsar has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/16321 )

Change subject: [master] KUDU-2181 Raft ChangeConfig request to add a master
..


Patch Set 6:

(19 comments)

http://gerrit.cloudera.org:8080/#/c/16321/6/src/kudu/master/catalog_manager.cc
File src/kudu/master/catalog_manager.cc:

http://gerrit.cloudera.org:8080/#/c/16321/6/src/kudu/master/catalog_manager.cc@1615
PS6, Line 1615:   optional user = rpc ?
> error: no viable conversion from 'optionalhttp://gerrit.cloudera.org:8080/#/c/16321/6/src/kudu/master/catalog_manager.cc@1848
PS6, Line 1848:   req.has_dimension_label() ? 
make_optional(req.dimension_label()) : none;
> error: no matching function for call to 'make_optional' [clang-diagnostic-e
Done


http://gerrit.cloudera.org:8080/#/c/16321/6/src/kudu/master/catalog_manager.cc@2146
PS6, Line 2146:   optional user = rpc ?
> error: no viable conversion from 'optionalhttp://gerrit.cloudera.org:8080/#/c/16321/6/src/kudu/master/catalog_manager.cc@2506
PS6, Line 2506:   
make_optional(step.add_range_partition().dimension_label()) : none;
> error: no matching function for call to 'make_optional' [clang-diagnostic-e
Done


http://gerrit.cloudera.org:8080/#/c/16321/6/src/kudu/master/catalog_manager.cc@2581
PS6, Line 2581:   optional user = rpc ?
> error: no viable conversion from 'optionalhttp://gerrit.cloudera.org:8080/#/c/16321/6/src/kudu/master/catalog_manager.cc@4822
PS6, Line 4822:   make_optional(old_info.pb.dimension_label()) : 
none;
> error: no matching function for call to 'make_optional' [clang-diagnostic-e
Done


http://gerrit.cloudera.org:8080/#/c/16321/6/src/kudu/master/dynamic_multi_master-test.cc
File src/kudu/master/dynamic_multi_master-test.cc:

http://gerrit.cloudera.org:8080/#/c/16321/6/src/kudu/master/dynamic_multi_master-test.cc@162
PS6, Line 162:   }
> Nit: Would it make sense to define a deadline instead and keep retrying unt
Done


http://gerrit.cloudera.org:8080/#/c/16321/6/src/kudu/master/dynamic_multi_master-test.cc@177
PS6, Line 177:   return std::make_pair(std::move(s), std::move(err_code));
> warning: std::move of the variable 'err_code' of the trivially-copyable typ
Done


http://gerrit.cloudera.org:8080/#/c/16321/6/src/kudu/master/dynamic_multi_master-test.cc@263
PS6, Line 263:   return std::make_pair(std::move(s), std::move(err_code));
> warning: std::move of the variable 'err_code' of the trivially-copyable typ
Done


http://gerrit.cloudera.org:8080/#/c/16321/6/src/kudu/master/dynamic_multi_master-test.cc@266
PS6, Line 266: return RunLeaderMasterRPC(add_master).AndThen([&] {
> Nit: AndThen is useful when we need to do something extra with the result o
Done


http://gerrit.cloudera.org:8080/#/c/16321/6/src/kudu/master/dynamic_multi_master-test.cc@399
PS6, Line 399: }
> The log_gc_duration histogram metric has a TotalCount() method that might b
Done. Thanks!


http://gerrit.cloudera.org:8080/#/c/16321/5/src/kudu/master/master.cc
File src/kudu/master/master.cc:

http://gerrit.cloudera.org:8080/#/c/16321/5/src/kudu/master/master.cc@424
PS5, Line 424: auto
> Missed this?
Indeed. Done.


http://gerrit.cloudera.org:8080/#/c/16321/6/src/kudu/master/master_service.cc
File src/kudu/master/master_service.cc:

http://gerrit.cloudera.org:8080/#/c/16321/6/src/kudu/master/master_service.cc@435
PS6, Line 435: make_optional(rpc->remote_user().username()));
> error: no viable conversion from 'optionalhttp://gerrit.cloudera.org:8080/#/c/16321/6/src/kudu/master/master_service.cc@474
PS6, Line 474:   req, resp, make_optional(rpc->remote_user().username()));
> error: no viable conversion from 'optionalhttp://gerrit.cloudera.org:8080/#/c/16321/6/src/kudu/master/master_service.cc@514
PS6, Line 514:   req, resp, make_optional(rpc->remote_user().username()));
> error: no viable conversion from 'optionalhttp://gerrit.cloudera.org:8080/#/c/16321/6/src/kudu/master/master_service.cc@528
PS6, Line 528:   req, resp, make_optional(rpc->remote_user().username()));
> error: no viable conversion from 'optionalhttp://gerrit.cloudera.org:8080/#/c/16321/6/src/kudu/master/master_service.cc@541
PS6, Line 541:   req, resp, make_optional(rpc->remote_user().username()));
> error: no viable conversion from 'optionalhttp://gerrit.cloudera.org:8080/#/c/16321/6/src/kudu/master/master_service.cc@563
PS6, Line 563: req, resp, make_optional(rpc->remote_user().username()));
> error: no viable conversion from 'optionalhttp://gerrit.cloudera.org:8080/#/c/16321/6/src/kudu/master/master_service.cc@581
PS6, Line 581: req, resp, make_optional(rpc->remote_user().username()),
> error: no viable conversion from 'optionalhttp://gerrit.cloudera.org:8080/16321
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I0ac7e6e55220bcb01cad0fa386daaf656258088c

[kudu-CR] [master] KUDU-2181 Raft ChangeConfig request to add a master

2020-09-23 Thread Bankim Bhavsar (Code Review)
Hello Tidy Bot, Alexey Serbin, Kudu Jenkins, Andrew Wong,

I'd like you to reexamine a change. Please visit

http://gerrit.cloudera.org:8080/16321

to look at the new patch set (#7).

Change subject: [master] KUDU-2181 Raft ChangeConfig request to add a master
..

[master] KUDU-2181 Raft ChangeConfig request to add a master

This change:
- Adds hidden feature flag "--master_support_change_config" off by
  default.
- RPC changes to add a master that initiates Raft config change and
  responds asynchronously.
- RPC changes to report back member type(VOTER/NON_VOTER) of masters
- Removes the cached master_addresses in catalog manager as it's no
  longer static.
- Updates and adds comments in MasterOptions such that it's used to
  fetch master addresses only during master init time as masters can
  be added/removed dynamically with this change.
- Updates ListMasters() to look at local Raft config instead of
  MasterOptions as the masters can be added/removed dynamically.

If the new master can be caught up from the WAL then the master
gets promoted to VOTER else it remains as NON_VOTER without master
tablet copying support.

Change-Id: I0ac7e6e55220bcb01cad0fa386daaf656258088c
---
M src/kudu/common/wire_protocol.proto
M src/kudu/consensus/raft_consensus.cc
M src/kudu/consensus/raft_consensus.h
M src/kudu/master/CMakeLists.txt
M src/kudu/master/catalog_manager.cc
M src/kudu/master/catalog_manager.h
A src/kudu/master/dynamic_multi_master-test.cc
M src/kudu/master/master.cc
M src/kudu/master/master.h
M src/kudu/master/master.proto
M src/kudu/master/master_options.cc
M src/kudu/master/master_options.h
M src/kudu/master/master_path_handlers.cc
M src/kudu/master/master_service.cc
M src/kudu/master/master_service.h
M src/kudu/master/mini_master.cc
M src/kudu/master/sys_catalog.cc
M src/kudu/mini-cluster/external_mini_cluster.cc
M src/kudu/mini-cluster/external_mini_cluster.h
M src/kudu/tools/tool_action_master.cc
20 files changed, 987 insertions(+), 56 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/21/16321/7
--
To view, visit http://gerrit.cloudera.org:8080/16321
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I0ac7e6e55220bcb01cad0fa386daaf656258088c
Gerrit-Change-Number: 16321
Gerrit-PatchSet: 7
Gerrit-Owner: Bankim Bhavsar 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Bankim Bhavsar 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Reviewer: Tidy Bot (241)


[kudu-CR] KUDU-2612 p2 (b): add transaction status retrieval

2020-09-23 Thread Alexey Serbin (Code Review)
Hello Kudu Jenkins, Andrew Wong,

I'd like you to reexamine a change. Please visit

http://gerrit.cloudera.org:8080/16495

to look at the new patch set (#3).

Change subject: KUDU-2612 p2 (b): add transaction status retrieval
..

KUDU-2612 p2 (b): add transaction status retrieval

After offline discussions with Andrew, it became clear that TxnManager
should provide an asynchronous interface to commit a transaction, i.e.
something similar to CreateTable()/IsCreateTableDone().  To implement
that, the TxnManager needs to check for the status of the transaction
after initiating the commit phase by issuing corresponding call
to TxnStatusManager (that's implemented as CoordinateTransaction() RPC
to TabletServerAdminService with BEGIN_COMMIT_TXN operation type).

This patch introduces the required server-side piece to retrieve the
information on a transaction status from the TxnStatusManager.  I'm
planning to introduce corresponding bindings via the TxnSystemClient
in a separate changelist.

This is a follow-up to efd8c4f165460b7fa337b8ebd1856b10bc274311.

Change-Id: I45f099d943f2b7955d6d561a1cb883343c7b79a4
---
M src/kudu/tablet/txn_coordinator.h
M src/kudu/transactions/CMakeLists.txt
M src/kudu/transactions/txn_status_manager-test.cc
M src/kudu/transactions/txn_status_manager.cc
M src/kudu/transactions/txn_status_manager.h
M src/kudu/transactions/txn_status_tablet.h
M src/kudu/tserver/CMakeLists.txt
M src/kudu/tserver/tablet_service.cc
M src/kudu/tserver/tserver_admin.proto
9 files changed, 165 insertions(+), 8 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/95/16495/3
--
To view, visit http://gerrit.cloudera.org:8080/16495
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I45f099d943f2b7955d6d561a1cb883343c7b79a4
Gerrit-Change-Number: 16495
Gerrit-PatchSet: 3
Gerrit-Owner: Alexey Serbin 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Kudu Jenkins (120)


[kudu-CR] [master] KUDU-2181 Raft ChangeConfig request to add a master

2020-09-23 Thread Alexey Serbin (Code Review)
Alexey Serbin has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/16321 )

Change subject: [master] KUDU-2181 Raft ChangeConfig request to add a master
..


Patch Set 7: Code-Review+2

(1 comment)

http://gerrit.cloudera.org:8080/#/c/16321/7/src/kudu/master/dynamic_multi_master-test.cc
File src/kudu/master/dynamic_multi_master-test.cc:

http://gerrit.cloudera.org:8080/#/c/16321/7/src/kudu/master/dynamic_multi_master-test.cc@141
PS7, Line 141: IllegalStatus
nit: IllegalState



--
To view, visit http://gerrit.cloudera.org:8080/16321
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I0ac7e6e55220bcb01cad0fa386daaf656258088c
Gerrit-Change-Number: 16321
Gerrit-PatchSet: 7
Gerrit-Owner: Bankim Bhavsar 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Bankim Bhavsar 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Reviewer: Tidy Bot (241)
Gerrit-Comment-Date: Wed, 23 Sep 2020 23:09:25 +
Gerrit-HasComments: Yes


[kudu-CR] KUDU-3192: [hms] Leverage the cluster ID in HMS sync

2020-09-23 Thread Alexey Serbin (Code Review)
Alexey Serbin has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/16494 )

Change subject: KUDU-3192: [hms] Leverage the cluster ID in HMS sync
..


Patch Set 1:

(2 comments)

http://gerrit.cloudera.org:8080/#/c/16494/1/src/kudu/hms/hms_client-test.cc
File src/kudu/hms/hms_client-test.cc:

http://gerrit.cloudera.org:8080/#/c/16494/1/src/kudu/hms/hms_client-test.cc@169
PS1, Line 169:   ASSERT_TRUE(CreateTable(&client, database_name, table_name,
 :   table_id, cluster_id).IsAlreadyPresent());
What if supplying the same table_id, but different cluster_id?  What should be 
the behavior?

I guess it should report Status::AlreadyPresent, and I think it would be great 
to explicitly document the expected behavior in this scenario.


http://gerrit.cloudera.org:8080/#/c/16494/1/src/kudu/hms/hms_client-test.cc@179
PS1, Line 179:   EXPECT_EQ(HmsClient::kManagedTable, my_table.tableType);
I guess GetTable() should return HmsClient::kKuduClusterIdKey property along 
with others once cluster_id is introduced, no?

If so, probably it make sense to make sure such property is present in the 
response?



--
To view, visit http://gerrit.cloudera.org:8080/16494
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I865b418a3cc4e11c889cc4757cd940831c43af17
Gerrit-Change-Number: 16494
Gerrit-PatchSet: 1
Gerrit-Owner: Grant Henke 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Grant Henke 
Gerrit-Reviewer: Hao Hao 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Reviewer: Tidy Bot (241)
Gerrit-Comment-Date: Wed, 23 Sep 2020 23:29:54 +
Gerrit-HasComments: Yes


[kudu-CR] KUDU-2612 p2 (b): add transaction status retrieval

2020-09-23 Thread Alexey Serbin (Code Review)
Alexey Serbin has removed a vote on this change.

Change subject: KUDU-2612 p2 (b): add transaction status retrieval
..


Removed Verified-1 by Kudu Jenkins (120)
--
To view, visit http://gerrit.cloudera.org:8080/16495
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: deleteVote
Gerrit-Change-Id: I45f099d943f2b7955d6d561a1cb883343c7b79a4
Gerrit-Change-Number: 16495
Gerrit-PatchSet: 3
Gerrit-Owner: Alexey Serbin 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Kudu Jenkins (120)


[kudu-CR] KUDU-2612 p2 (b): add transaction status retrieval

2020-09-23 Thread Alexey Serbin (Code Review)
Alexey Serbin has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/16495 )

Change subject: KUDU-2612 p2 (b): add transaction status retrieval
..


Patch Set 3: Verified+1

Unrelated test failure in 
CatalogManagerTskITest.LeadershipChangeOnTskGeneration (ASAN)


--
To view, visit http://gerrit.cloudera.org:8080/16495
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I45f099d943f2b7955d6d561a1cb883343c7b79a4
Gerrit-Change-Number: 16495
Gerrit-PatchSet: 3
Gerrit-Owner: Alexey Serbin 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Comment-Date: Thu, 24 Sep 2020 00:30:27 +
Gerrit-HasComments: No


[kudu-CR] [master] KUDU-2181 Raft ChangeConfig request to add a master

2020-09-23 Thread Bankim Bhavsar (Code Review)
Hello Tidy Bot, Alexey Serbin, Kudu Jenkins, Andrew Wong,

I'd like you to reexamine a change. Please visit

http://gerrit.cloudera.org:8080/16321

to look at the new patch set (#8).

Change subject: [master] KUDU-2181 Raft ChangeConfig request to add a master
..

[master] KUDU-2181 Raft ChangeConfig request to add a master

This change:
- Adds hidden feature flag "--master_support_change_config" off by
  default.
- RPC changes to add a master that initiates Raft config change and
  responds asynchronously.
- RPC changes to report back member type(VOTER/NON_VOTER) of masters
- Removes the cached master_addresses in catalog manager as it's no
  longer static.
- Updates and adds comments in MasterOptions such that it's used to
  fetch master addresses only during master init time as masters can
  be added/removed dynamically with this change.
- Updates ListMasters() to look at local Raft config instead of
  MasterOptions as the masters can be added/removed dynamically.

If the new master can be caught up from the WAL then the master
gets promoted to VOTER else it remains as NON_VOTER without master
tablet copying support.

Change-Id: I0ac7e6e55220bcb01cad0fa386daaf656258088c
---
M src/kudu/common/wire_protocol.proto
M src/kudu/consensus/raft_consensus.cc
M src/kudu/consensus/raft_consensus.h
M src/kudu/master/CMakeLists.txt
M src/kudu/master/catalog_manager.cc
M src/kudu/master/catalog_manager.h
A src/kudu/master/dynamic_multi_master-test.cc
M src/kudu/master/master.cc
M src/kudu/master/master.h
M src/kudu/master/master.proto
M src/kudu/master/master_options.cc
M src/kudu/master/master_options.h
M src/kudu/master/master_path_handlers.cc
M src/kudu/master/master_service.cc
M src/kudu/master/master_service.h
M src/kudu/master/mini_master.cc
M src/kudu/master/sys_catalog.cc
M src/kudu/mini-cluster/external_mini_cluster.cc
M src/kudu/mini-cluster/external_mini_cluster.h
M src/kudu/tools/tool_action_master.cc
20 files changed, 987 insertions(+), 56 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/21/16321/8
--
To view, visit http://gerrit.cloudera.org:8080/16321
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I0ac7e6e55220bcb01cad0fa386daaf656258088c
Gerrit-Change-Number: 16321
Gerrit-PatchSet: 8
Gerrit-Owner: Bankim Bhavsar 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Bankim Bhavsar 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Reviewer: Tidy Bot (241)


[kudu-CR] [master] KUDU-2181 Raft ChangeConfig request to add a master

2020-09-23 Thread Bankim Bhavsar (Code Review)
Bankim Bhavsar has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/16321 )

Change subject: [master] KUDU-2181 Raft ChangeConfig request to add a master
..


Patch Set 8:

(1 comment)

http://gerrit.cloudera.org:8080/#/c/16321/7/src/kudu/master/dynamic_multi_master-test.cc
File src/kudu/master/dynamic_multi_master-test.cc:

http://gerrit.cloudera.org:8080/#/c/16321/7/src/kudu/master/dynamic_multi_master-test.cc@141
PS7, Line 141: IllegalState
> nit: IllegalState
Done



--
To view, visit http://gerrit.cloudera.org:8080/16321
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I0ac7e6e55220bcb01cad0fa386daaf656258088c
Gerrit-Change-Number: 16321
Gerrit-PatchSet: 8
Gerrit-Owner: Bankim Bhavsar 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Bankim Bhavsar 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Reviewer: Tidy Bot (241)
Gerrit-Comment-Date: Thu, 24 Sep 2020 01:01:54 +
Gerrit-HasComments: Yes


[kudu-CR] [master] KUDU-2181 Raft ChangeConfig request to add a master

2020-09-23 Thread Alexey Serbin (Code Review)
Alexey Serbin has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/16321 )

Change subject: [master] KUDU-2181 Raft ChangeConfig request to add a master
..


Patch Set 8: Code-Review+2


--
To view, visit http://gerrit.cloudera.org:8080/16321
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I0ac7e6e55220bcb01cad0fa386daaf656258088c
Gerrit-Change-Number: 16321
Gerrit-PatchSet: 8
Gerrit-Owner: Bankim Bhavsar 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Bankim Bhavsar 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Reviewer: Tidy Bot (241)
Gerrit-Comment-Date: Thu, 24 Sep 2020 01:29:46 +
Gerrit-HasComments: No


[kudu-CR] KUDU-2612 p10: have timestamp assignment account for commit timestamps

2020-09-23 Thread Hao Hao (Code Review)
Hao Hao has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/16470 )

Change subject: KUDU-2612 p10: have timestamp assignment account for commit 
timestamps
..


Patch Set 2:

(8 comments)

http://gerrit.cloudera.org:8080/#/c/16470/2/src/kudu/consensus/time_manager.h
File src/kudu/consensus/time_manager.h:

http://gerrit.cloudera.org:8080/#/c/16470/2/src/kudu/consensus/time_manager.h@71
PS2, Line 71: queue
Can you clarify which queue this is referring to?


http://gerrit.cloudera.org:8080/#/c/16470/2/src/kudu/consensus/time_manager.h@71
PS2, Line 71: i.e.
: // AdvanceSafeTimeWithMessage() hasn't been called on the 
corresponding
: // message)
Wondering when this can happen?


http://gerrit.cloudera.org:8080/#/c/16470/2/src/kudu/consensus/time_manager.h@79
PS2, Line 79: leader lease
Do you plan to address this in future patch?


http://gerrit.cloudera.org:8080/#/c/16470/2/src/kudu/consensus/time_manager.h@94
PS2, Line 94: the MVCC op registered for BEGIN_COMMIT is not
: //   finished when the op is applied
Does this mean even when the op is applied it is not visible to the user inside 
the transaction?


http://gerrit.cloudera.org:8080/#/c/16470/2/src/kudu/consensus/time_manager.h@97
PS2, Line 97: Until the MVCC op is completed below, further snapshot scans at t 
where
: // t > T_bc will block
Will other concurrent transaction be blocked as well waiting for a timestamp be 
assigned?


http://gerrit.cloudera.org:8080/#/c/16470/2/src/kudu/tablet/ops/participant_op.h
File src/kudu/tablet/ops/participant_op.h:

http://gerrit.cloudera.org:8080/#/c/16470/2/src/kudu/tablet/ops/participant_op.h@73
PS2, Line 73: Anchors the given 'op_id' in the WAL, ensuring that subsequent 
bootstraps
:   // of the tablet's WAL will leave the transaction in the 
appropriate state.
The comment needs to be updated?


http://gerrit.cloudera.org:8080/#/c/16470/2/src/kudu/tablet/ops/participant_op.h@89
PS2, Line 89: void SetMvccOp(std::unique_ptr mvcc_op);
:   void ReleaseMvccOpToTxn();
Add a comment for these functions?


http://gerrit.cloudera.org:8080/#/c/16470/2/src/kudu/tablet/txn_participant.h
File src/kudu/tablet/txn_participant.h:

http://gerrit.cloudera.org:8080/#/c/16470/2/src/kudu/tablet/txn_participant.h@227
PS2, Line 227: commit_op_
Add a short description for this?



--
To view, visit http://gerrit.cloudera.org:8080/16470
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I0412fd0cf778d96f3fe6b14624d8d06942f40e72
Gerrit-Change-Number: 16470
Gerrit-PatchSet: 2
Gerrit-Owner: Andrew Wong 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Hao Hao 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Comment-Date: Thu, 24 Sep 2020 04:16:30 +
Gerrit-HasComments: Yes


[kudu-CR] [master] KUDU-2181 Raft ChangeConfig request to add a master

2020-09-23 Thread Bankim Bhavsar (Code Review)
Bankim Bhavsar has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/16321 )

Change subject: [master] KUDU-2181 Raft ChangeConfig request to add a master
..


Patch Set 8: Verified+1

Unrelated ASAN test failure in 
SlowTabletBootstrapTest.TestFallBehindSlowBootstrap


--
To view, visit http://gerrit.cloudera.org:8080/16321
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I0ac7e6e55220bcb01cad0fa386daaf656258088c
Gerrit-Change-Number: 16321
Gerrit-PatchSet: 8
Gerrit-Owner: Bankim Bhavsar 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Bankim Bhavsar 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Reviewer: Tidy Bot (241)
Gerrit-Comment-Date: Thu, 24 Sep 2020 05:31:54 +
Gerrit-HasComments: No


[kudu-CR] [master] KUDU-2181 Raft ChangeConfig request to add a master

2020-09-23 Thread Bankim Bhavsar (Code Review)
Bankim Bhavsar has removed a vote on this change.

Change subject: [master] KUDU-2181 Raft ChangeConfig request to add a master
..


Removed Verified-1 by Kudu Jenkins (120)
--
To view, visit http://gerrit.cloudera.org:8080/16321
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: deleteVote
Gerrit-Change-Id: I0ac7e6e55220bcb01cad0fa386daaf656258088c
Gerrit-Change-Number: 16321
Gerrit-PatchSet: 8
Gerrit-Owner: Bankim Bhavsar 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Bankim Bhavsar 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Reviewer: Tidy Bot (241)


[kudu-CR] KUDU-2612 p6 (c): add GetTransactionStatus() to TxnSystemClient

2020-09-23 Thread Alexey Serbin (Code Review)
Alexey Serbin has uploaded this change for review. ( 
http://gerrit.cloudera.org:8080/16501


Change subject: KUDU-2612 p6 (c): add GetTransactionStatus() to TxnSystemClient
..

KUDU-2612 p6 (c): add GetTransactionStatus() to TxnSystemClient

This patch adds GetTransactionStatus() method into the interface
of the TxnSystemClient class.  Added corresponding test as well.

This is a follow-up to cb1c2efb59373453e734074a02021f14c403257d
and 0f9ff5ff043125be4a1150be0306373619b4ca89

Change-Id: I7fac7158df307d03db6a48087e7c5a16269a3bc6
---
M src/kudu/integration-tests/txn_status_table-itest.cc
M src/kudu/transactions/coordinator_rpc.cc
M src/kudu/transactions/coordinator_rpc.h
M src/kudu/transactions/txn_system_client.cc
M src/kudu/transactions/txn_system_client.h
M src/kudu/tserver/tablet_service.cc
6 files changed, 122 insertions(+), 19 deletions(-)



  git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/01/16501/1
--
To view, visit http://gerrit.cloudera.org:8080/16501
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: I7fac7158df307d03db6a48087e7c5a16269a3bc6
Gerrit-Change-Number: 16501
Gerrit-PatchSet: 1
Gerrit-Owner: Alexey Serbin 


[kudu-CR] KUDU-2612 p6 (c): add GetTransactionStatus() to TxnSystemClient

2020-09-23 Thread Alexey Serbin (Code Review)
Alexey Serbin has removed a vote on this change.

Change subject: KUDU-2612 p6 (c): add GetTransactionStatus() to TxnSystemClient
..


Removed Verified-1 by Kudu Jenkins (120)
--
To view, visit http://gerrit.cloudera.org:8080/16501
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: deleteVote
Gerrit-Change-Id: I7fac7158df307d03db6a48087e7c5a16269a3bc6
Gerrit-Change-Number: 16501
Gerrit-PatchSet: 1
Gerrit-Owner: Alexey Serbin 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Hao Hao 
Gerrit-Reviewer: Kudu Jenkins (120)


[kudu-CR] KUDU-2612 p6 (c): add GetTransactionStatus() to TxnSystemClient

2020-09-23 Thread Alexey Serbin (Code Review)
Alexey Serbin has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/16501 )

Change subject: KUDU-2612 p6 (c): add GetTransactionStatus() to TxnSystemClient
..


Patch Set 1: Code-Review+1

unrelated test failure in 
HmsConfigurations/MasterFailoverTest.TestMasterPermanentFailure/1


--
To view, visit http://gerrit.cloudera.org:8080/16501
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I7fac7158df307d03db6a48087e7c5a16269a3bc6
Gerrit-Change-Number: 16501
Gerrit-PatchSet: 1
Gerrit-Owner: Alexey Serbin 
Gerrit-Reviewer: Alexey Serbin 
Gerrit-Reviewer: Andrew Wong 
Gerrit-Reviewer: Hao Hao 
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Comment-Date: Thu, 24 Sep 2020 06:57:49 +
Gerrit-HasComments: No