Unfortunately, exposing Kafka headers is not yet supported in Structured Streaming. The community is more than welcome to add support for it :)
On Tue, Feb 27, 2018 at 2:51 PM, Karthik Jayaraman <aswin8...@gmail.com> wrote: > Hi all, > > I am using Spark 2.2.1 Structured Streaming to read messages from Kafka. I > would like to know how to access the Kafka headers programmatically ? Since > the Kafka message header support is introduced in Kafka 0.11 ( > https://issues.apache.org/jira/browse/KAFKA-4208), is it supported in > Spark. ? If yes, can anyone point me to an example ? > > - Karthik >