xiangqiao created FLINK-24953:
---------------------------------

             Summary: Optime hive parallelism inference
                 Key: FLINK-24953
                 URL: https://issues.apache.org/jira/browse/FLINK-24953
             Project: Flink
          Issue Type: Improvement
          Components: Connectors / Hive
    Affects Versions: 1.14.0, 1.13.0
            Reporter: xiangqiao


Currently, when I disable hive table source parallelism inference using 
configuration  and set parallelism.default: 100. 
{code:java}
table.exec.hive.infer-source-parallelism: false 
parallelism.default: 100{code}
The result is that the parallelism of hive table source is {*}1{*}, and the 
configuration of the default parallelism is not effective.

I will optimize this problem. In the future, when disable hive table source 
parallelism inference ,the  parallelism of hive table source will be determined 
according to the following order:
 
1. If table.exec.resource.default-parallelism is set, the configured value will 
be used

2. If parallelism.default is set, the configured value is used

3. If the above two configuration items are not set, the default value is 1

 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to