Here's one reason I might want to be able to tell whether a given offset is a transactional marker:
https://issues.apache.org/jira/browse/SPARK-24720 Alternatively, is there any efficient way to tell what the offset of the last actual record in a topicpartition is (i.e. like endOffsets) On Thu, Aug 2, 2018 at 3:09 PM, Matthias J. Sax <matth...@confluent.io> wrote: > Messages don't contain any information to what transaction they belong. > > Note, that `transaction markers`, as special messages that only indicate > a commit or abort. There is no `transaction marker` _in_ a message. > > > -Matthias > > On 8/2/18 12:04 PM, ma...@kafkatool.com wrote: >> >> >> This would be useful, for example, showing messages belonging to the >> same transaction. >> >> thanks >> >> marko >> >> ----- Original Message ----- >> From: users@kafka.apache.org >> To:<users@kafka.apache.org> >> Cc: >> Sent:Tue, 31 Jul 2018 14:40:20 -0700 >> Subject:Re: Viewing transactional markers in client >> >> No. Transaction markers are not exposed. >> >> Why would you need them? They are considered implementation details. >> >> -Matthias >> >> On 7/27/18 5:58 AM, ma...@kafkatool.com wrote: >> > Is there any way for a KafkaConsumer to view/get the transactional >> > marker messages? >> > >> > -- >> > Best regards, >> > Marko >> > www.kafkatool.com >> > >> >> >> >