GitHub user tison1 opened a pull request:

    https://github.com/apache/flink/pull/6339

    [FLINK-9859][Runtime] Distinguish TM akka config with JM config

    ## What is the purpose of the change
    
     Distinguish TM akka config with JM config.
    
     1. increase the number of akka threads on JM, to improve its performance
     2. decrease the number of akka threads on TM, to save resource.
    
    
    ## Brief change log
      - `AkkaUtils`
        - add a method `getTaskExecutorAkkaConfig` to distinguish TM's config 
with JM's
        - also the config details
      - `TaskManagerRunner` && `AkkaRpcServiceUtils` && `AkkaOptions`
        - add a method `AkkaRpcServiceUtils#createRpcServiceForTaskExecutor`
        - add a config option `AkkaOptions#AKKA_PORT_BIND_TIMEOUT`, which 
defines the timeout of binding retry. This is used in 
`AkkaRpcServiceUtils#createRpcServiceForTaskExecutor`
        - `TaskManagerRunner#createRpcService` now uses 
`AkkaRpcServiceUtils#createRpcServiceForTaskExecutor` to create RpcService
      - add a test `AkkaRpcServiceUtilsTest` to see createRpcService works 
after changes above
    
    ## Verifying this change
    
    This change added tests and can be verified as follows:
    
      - Unit test. Locally create rpc service using customized config, to see 
whether we could createRpcService properly.
    
    ## Does this pull request potentially affect one of the following parts:
    
      - Dependencies (does it add or upgrade a dependency): (no)
      - The public API, i.e., is any changed class annotated with 
`@Public(Evolving)`: (no)
      - The serializers: (no)
      - The runtime per-record code paths (performance sensitive): (don't know)
      - Anything that affects deployment or recovery: JobManager (and its 
components), Checkpointing, Yarn/Mesos, ZooKeeper: (yes)
      - The S3 file system connector: (no)
    
    ## Documentation
    
      - Does this pull request introduce a new feature? (no, it is internal)


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/tison1/flink akka-improve

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/flink/pull/6339.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #6339
    
----
commit 019c018dfa994b6ef755823658adf613166659c8
Author: 陈梓立 <wander4096@...>
Date:   2018-07-16T09:47:29Z

    [FLINK-9859][Runtime] Distinguish TM akka config with JM config
    
    ... increase the number of akka threads on JM, to improve its performance; 
decrease the number of akka threads on TM, to save resource.

----


---

Reply via email to