Siying Dong created SPARK-43233: ----------------------------------- Summary: Before batch reading from Kafka, log topic partition, offset range, etc, for debuggin Key: SPARK-43233 URL: https://issues.apache.org/jira/browse/SPARK-43233 Project: Spark Issue Type: Improvement Components: Structured Streaming Affects Versions: 3.4.0 Reporter: Siying Dong
When debugging some slowness issue in structured streaming, it is hard to map a Kafka topic and partition to a Kafka task. Adding some logging in executor might help make it easier. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org