Weiqing Yang created SPARK-24093: ------------------------------------ Summary: Make some fields of KafkaStreamWriter/InternalRowMicroBatchWriter visible to outside of the classes Key: SPARK-24093 URL: https://issues.apache.org/jira/browse/SPARK-24093 Project: Spark Issue Type: Wish Components: Structured Streaming Affects Versions: 2.3.0 Reporter: Weiqing Yang
We are working on Spark Atlas Connector([https://github.com/hortonworks-spark/spark-atlas-connector)|https://github.com/hortonworks-spark/spark-atlas-connector).], and adding supports for Spark Streaming. As SAC needs the information of "writer" and "topic" which streaming data are written into, this jira is created to make relevant fields of KafkaStreamWriter and InternalRowMicroBatchWriter visible to outside of the classes. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org