[
https://issues.apache.org/jira/browse/IMPALA-11129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542732#comment-17542732
]
Wenzhe Zhou commented on IMPALA-11129:
--------------------------------------
In global admission control mode, admission control module is running as a
standalone daemon process (admissiond). It communicate with coordinators
through KRPC.
In current implementation, admissiond is not assigned a Backend-Id so we always
use admissiond's IP address as unique ID for UDS.
If we use backend-Id as the unique ID for UDS address, then we need to assign a
Backend-Id to admissiond.
The question is to how to advertise BackendId of admissiond to coordinators. In
current implementation, admissiond's IP are set as starting flags for
coordinators so that coordinator could setup KRPC connection over TCP.
BackendId is generated in run-time, we cannot set admissiond's Backend-Id as
starting flag for coordinators.
We cannot send admissiond's Backend-Id through cluster-membership since
admissiond does not belong to any executor group.
Coordinator periodically send heart-beat to admissiond through KRPC connection.
We can let admissiond to send its Backend-Id in the response of heart-beat.
When admissiond is started, make it bind and listen on both TCP socket and UDS
socket. Coordinator setup KRPC over TCP first, then switch to KRPC connection
over UDS after getting admissiond's backend-id.
Patch https://gerrit.cloudera.org/#/c/15701/ add support for connecting over
unix domain sockets for Kudu. Kudu's rpc_server could bind to multiple address,
including UDS.
> Support running KRPC over Unix domain socket
> --------------------------------------------
>
> Key: IMPALA-11129
> URL: https://issues.apache.org/jira/browse/IMPALA-11129
> Project: IMPALA
> Issue Type: New Feature
> Components: Backend, Distributed Exec
> Reporter: Wenzhe Zhou
> Assignee: Wenzhe Zhou
> Priority: Major
>
> KRPC was extended to support Unix domain socket in Apache Kudu. The patches
> for this new feature involves code change in kudu/rpc, kudu/security and
> kudu/util. We recently synced up the source code in kudu/rpc, kudu/security
> and kusu/util with Kudu upstream so we can leverage the new functionalities
> provided by Kudu source to support running KRPC over Unix domain socket.
> For the Impala mini-cluster, all Impala daemons are running on the same host.
> We can run KRPC over Unix domain sockets instead of TCP.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org
