Gwen Shapira created KAFKA-5000:
-----------------------------------
Summary: Framework should log some progress information regularly
to assist in troubleshooting
Key: KAFKA-5000
URL: https://issues.apache.org/jira/browse/KAFKA-5000
Project: Kafka
Issue Type: Bug
Components: KafkaConnect
Reporter: Gwen Shapira
We get many questions of the type:
"I started a connector, it doesn't seem to make any progress, I don't know what
to do"
I think that periodic "progress reports" on the worker logs may help.
We have the offset commit message: "INFO
WorkerSinkTask{id=cassandra-sink-connector-0} Committing offsets
(org.apache.kafka.connect.runtime.WorkerSinkTask:244)"
But I think we'd also want to know: topic, partition, offsets, how many rows
were read from source/kafka and how many were successfully written.
This will help determine if there is any progress being made and whether some
partitions are "stuck" for some reason.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
