[ 
https://issues.apache.org/jira/browse/KUDU-2147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18128035#comment-18128035
 ] 

ASF subversion and git services commented on KUDU-2147:
-------------------------------------------------------

Commit a0409299d44318756156ca8760812b1fdfadf291 in kudu's branch 
refs/heads/master from Abhishek Chennaka
[ https://gitbox.apache.org/repos/asf?p=kudu.git;h=a0409299d ]

KUDU-3816 [consensus] Send the new leader's NO_OP without waiting for a 
heartbeat

A new leader now signals its peers when it appends its NO_OP. This will
ensure the the clean time is initialized and the tablet's replicas
serve the scans independent of --raft_heartbeat_interval_ms.

The regression test for KUDU-2147 has been updated according to the new 
behavior.

AdminCliTest.TestRebuildTables now rebuilds TestTable in add mode with
its actual replication factor of 3. With the default of 1 the master
evicts the extra replicas after the restart which this change makes
happen before the test sees all 3 replicas.

The repro.cc attached at KUDU_3747 doesn't show any latency with this patch
in place.

Change-Id: I1c1c4e448a1bf0142d32ee7e2721d304e444f9d8
Reviewed-on: http://gerrit.cloudera.org:8080/25101
Reviewed-by: Alexey Serbin <[email protected]>
Tested-by: Abhishek Chennaka <[email protected]>


> Unknown leader treated as valid TS UUID by catalog manager
> ----------------------------------------------------------
>
>                 Key: KUDU-2147
>                 URL: https://issues.apache.org/jira/browse/KUDU-2147
>             Project: Kudu
>          Issue Type: Bug
>          Components: consensus, master
>            Reporter: Mike Percy
>            Assignee: Mike Percy
>            Priority: Major
>             Fix For: 1.6.0
>
>
> A bug was observed on a development cluster where an empty string reported as 
> the leader in a TS heartbeat to the master was treated as a valid TS UUID by 
> the TSPicker, resulting in the master attempting to add contact an 
> empty-string member of the cluster to add a new replica and being unable to 
> connect.
> ksck looked like this:
> {code}
> Tablet c4e8c3260dda48efbb7e182b569a7fc6 of table 
> 'impala::tpch_1000_kudu.customer' is under-replicated: configuration has 2 
> replicas vs desired 3
>   09d6bf7a02124145b43f43cb7a667b3d (host1.foo.example.com:7050): RUNNING
>   a662440710624c02bd5612df32cb0235 (host2.foo.example.com:7050): RUNNING
> 2 replicas' active configs differ from the master's.
>   All the peers reported by the master and tablet servers are:
>   A = 09d6bf7a02124145b43f43cb7a667b3d
>   B = a662440710624c02bd5612df32cb0235
> The consensus matrix is:
>  Config source |  Voters  | Current term | Config index | Committed?
> ---------------+----------+--------------+--------------+------------
>  master        | A   B    |              |              | Yes
>  A             | A*  B    | 101          | 5441         | Yes
>  B             | A*  B    | 101          | 5441         | Yes
> Table impala::tpch_1000_kudu.customer has 1 under-replicated tablet(s)
> {code}
> There were accompanying error messages printed in the catalog manager log 
> that looked like this:
> {code}
> I0914 15:03:35.774370 22121 catalog_manager.cc:2988] Scheduling retry of 
> AddServer ChangeConfig RPC for tablet c4e8c3260dda48efbb7e182b569a7fc6 with 
> cas_config_opid_index 5441 with a delay of 24 ms (attempt = 1)
> W0914 15:03:35.774382 22121 catalog_manager.cc:3007] Async tablet task 
> AddServer ChangeConfig RPC for tablet c4e8c3260dda48efbb7e182b569a7fc6 with 
> cas_config_opid_index 5441 failed: Not found: Failed to reset TS proxy: Could 
> not find TS for UUID
> {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to