GitHub user tison1 opened a pull request:
https://github.com/apache/flink/pull/6339
[FLINK-9859][Runtime] Distinguish TM akka config with JM config
## What is the purpose of the change
Distinguish TM akka config with JM config.
1. increase the number of akka threads on JM, to improve its performance
2. decrease the number of akka threads on TM, to save resource.
## Brief change log
- `AkkaUtils`
- add a method `getTaskExecutorAkkaConfig` to distinguish TM's config
with JM's
- also the config details
- `TaskManagerRunner` && `AkkaRpcServiceUtils` && `AkkaOptions`
- add a method `AkkaRpcServiceUtils#createRpcServiceForTaskExecutor`
- add a config option `AkkaOptions#AKKA_PORT_BIND_TIMEOUT`, which
defines the timeout of binding retry. This is used in
`AkkaRpcServiceUtils#createRpcServiceForTaskExecutor`
- `TaskManagerRunner#createRpcService` now uses
`AkkaRpcServiceUtils#createRpcServiceForTaskExecutor` to create RpcService
- add a test `AkkaRpcServiceUtilsTest` to see createRpcService works
after changes above
## Verifying this change
This change added tests and can be verified as follows:
- Unit test. Locally create rpc service using customized config, to see
whether we could createRpcService properly.
## Does this pull request potentially affect one of the following parts:
- Dependencies (does it add or upgrade a dependency): (no)
- The public API, i.e., is any changed class annotated with
`@Public(Evolving)`: (no)
- The serializers: (no)
- The runtime per-record code paths (performance sensitive): (don't know)
- Anything that affects deployment or recovery: JobManager (and its
components), Checkpointing, Yarn/Mesos, ZooKeeper: (yes)
- The S3 file system connector: (no)
## Documentation
- Does this pull request introduce a new feature? (no, it is internal)
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/tison1/flink akka-improve
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/6339.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #6339
----
commit 019c018dfa994b6ef755823658adf613166659c8
Author: éæ¢ç« <wander4096@...>
Date: 2018-07-16T09:47:29Z
[FLINK-9859][Runtime] Distinguish TM akka config with JM config
... increase the number of akka threads on JM, to improve its performance;
decrease the number of akka threads on TM, to save resource.
----
---
