[
https://issues.apache.org/jira/browse/CONNECTORS-1162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699904#comment-14699904
]
Karl Wright commented on CONNECTORS-1162:
-
Right. So when a MCF worker thread is interrupted, it is likely that a wait()
inside Kafka will throw an InterruptedException.
So, you should catch InterruptedException, and throw
ManifoldCFException.INTERRUPTED up the stack. That would seem to be consistent
with what you've told me.
Thanks!
Apache Kafka Output Connector
-
Key: CONNECTORS-1162
URL: https://issues.apache.org/jira/browse/CONNECTORS-1162
Project: ManifoldCF
Issue Type: Wish
Affects Versions: ManifoldCF 1.8.1, ManifoldCF 2.0.1
Reporter: Rafa Haro
Assignee: Karl Wright
Labels: gsoc, gsoc2015
Fix For: ManifoldCF 2.3
Attachments: 1.JPG, 2.JPG, Documentation.zip
Kafka is a distributed, partitioned, replicated commit log service. It
provides the functionality of a messaging system, but with a unique design. A
single Kafka broker can handle hundreds of megabytes of reads and writes per
second from thousands of clients.
Apache Kafka is being used for a number of uses cases. One of them is to use
Kafka as a feeding system for streaming BigData processes, both in Apache
Spark or Hadoop environment. A Kafka output connector could be used for
streaming or dispatching crawled documents or metadata and put them in a
BigData processing pipeline
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
