Jiangjie Qin created FLINK-20108:
------------------------------------

             Summary: SingleThreadFetcherManager may add splits to a shutting 
down SplitFetcher
                 Key: FLINK-20108
                 URL: https://issues.apache.org/jira/browse/FLINK-20108
             Project: Flink
          Issue Type: Bug
          Components: Connectors / Common
    Affects Versions: 1.11.2
            Reporter: Jiangjie Qin


Currently the split fetchers are only removed from the 
{{SplitFetcherManager.fetchers}} when the thread exit. The may cause problem 
because when {{SplitFetcherManager.addSplits()}} is called, it may see a 
shutting down split fetcher and adds splits to it. These splits will then just 
be lost.

The fix is to make {{SplitFetcherManager.fetchers}} field private and introduce 
a protected {{addSplitsToFetcher(Splits, fetcherId)}} method. That method will 
ensure the splits won't be assigned to a shutting down split fetcher instead of 
a new fetcher.

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to