文报 created FLINK-26938:
--------------------------

             Summary: HybridSource recovery from savepoint fails When flink 
parallelism is greater than the number of Kafka partitions
                 Key: FLINK-26938
                 URL: https://issues.apache.org/jira/browse/FLINK-26938
             Project: Flink
          Issue Type: Bug
          Components: API / DataStream
    Affects Versions: 1.14.0
         Environment: Flink 1.14.0
            Reporter: 文报
         Attachments: image-2022-03-31-13-25-28-520.png

First test

Flink job before savePoint
    flink parallelism =16
    kafka partition=3
Flink after savePoint
case 1:
    flink parallelism =16
    kafka partition=3

HybridSource recovery from savepoint fails 
!image-2022-03-31-11-12-56-562.png!


case 2:
    flink parallelism =3
    kafka partition=3
HybridSource recovery from savepoint  successful

case 3:
    flink parallelism =8
    kafka partition=3
HybridSource recovery from savepoint fails  the same NullPointerException: 
Source for index=0 not available

case 4:
    flink parallelism =4
    kafka partition=3
HybridSource recovery from savepoint fails  the same NullPointerException: 
Source for index=0 not available

case 5:
    flink parallelism =1
    kafka partition=3
HybridSource recovery from savepoint  successful

Second test

Flink job before savePoint
    flink parallelism =3
    kafka partition=3
Flink after savePoint
case 1:
    flink parallelism =3
    kafka partition=3
HybridSource recovery from savepoint  successful

case 2:
    flink parallelism =1
    kafka partition=3
HybridSource recovery from savepoint  successful

case 3:
    flink parallelism =4
    kafka partition=3
HybridSource recovery from savepoint fails  the same NullPointerException: 
Source for index=0 not available

Specific code see the attached test code HybridSourceTest

 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to