[
https://issues.apache.org/jira/browse/FLINK-6923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16059867#comment-16059867
]
ASF GitHub Bot commented on FLINK-6923:
---------------------------------------
Github user zhenzhongxu commented on the issue:
https://github.com/apache/flink/pull/4149
Hi @tzulitai, in this particular case, we actually disabled Flink
checkpointing (because we do not want to rely on fixed interval barrier to
trigger sink flush/offset commit). As a workaround, we manually trigger
snapshot and commit upon sink flushing by hooking into source operator's
consumer object. Thus this change. We have also previously discussed this
approach with @StephanEwen
> Kafka connector needs to expose information about in-flight record in
> AbstractFetcher base class
> ------------------------------------------------------------------------------------------------
>
> Key: FLINK-6923
> URL: https://issues.apache.org/jira/browse/FLINK-6923
> Project: Flink
> Issue Type: Improvement
> Components: Kafka Connector
> Reporter: Zhenzhong Xu
> Assignee: Zhenzhong Xu
> Priority: Minor
>
> We have a use case where we have our custom Fetcher implementation that
> extends AbstractFetcher base class. We need to periodically get current in
> flight (in processing) records' partition and offset information.
> This can be easily exposed in AbstractFetcher class.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
