Hang Ruan created FLINK-26126:
---------------------------------

             Summary: Sink V2 will cause error numRecordsOut metric
                 Key: FLINK-26126
                 URL: https://issues.apache.org/jira/browse/FLINK-26126
             Project: Flink
          Issue Type: Bug
          Components: Connectors / Kafka
    Affects Versions: 1.15.0
            Reporter: Hang Ruan


We found that the new sink v2 interface will have a wrong numRecordsOut metric 
for the sink writers. We send a fixed number of records to the source, but the 
numRecordsOut of the sink continues to increase by the time.

The problem lies in the method `emitCommittables` in the class 
`SinkWriterOperator`.  The field `output` in its parent class 
`AbstractStreamOperator` uses the same counter object as the `KafkaWriter`. It 
will cause the numRecordsOut increasing when doing the checkpoint. 

I found this problem when we implement the metric test in the testframe, now I 
disable this metric test in the 
PR([https://github.com/apache/flink/pull/18496).] We could reopen this test 
case after the fix.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to