Build Update for apache/druid ------------------------------------- Build: #29849 Status: Fixed
Duration: 8 mins and 44 secs Commit: 118b501 (master) Author: Xavier Léauté Message: Introduce KafkaRecordEntity to support Kafka headers in InputFormats (#10730) Today Kafka message support in streaming indexing tasks is limited to message values, and does not provide a way to expose Kafka headers, timestamps, or keys, which may be of interest to more specialized Druid input formats. For instance, Kafka headers may be used to indicate payload format/encoding or additional metadata, and timestamps are often omitted from values in Kafka streams applications, since they are included in the record. This change proposes to introduce KafkaRecordEntity as InputEntity, which would give input formats full access to the underlying Kafka record, including headers, key, timestamps. It would also open access to low-level information such as topic, partition, offset if needed. KafkaEntity is a subclass of ByteEntity for backwards compatibility with existing input formats, and to avoid introducing unnecessary complexity for Kinesis indexing tasks. View the changeset: https://github.com/apache/druid/compare/2837a9b62fe6ec779bcab837d51ceffadcb83f25...118b50195e5c2989e04e0f5290aa72cae114db39 View the full build log and details: https://travis-ci.com/github/apache/druid/builds/212539528?utm_medium=notification&utm_source=email -- You can unsubscribe from build emails from the apache/druid repository going to https://travis-ci.com/account/preferences/unsubscribe?repository=16806911&utm_medium=notification&utm_source=email. Or unsubscribe from *all* email updating your settings at https://travis-ci.com/account/preferences/unsubscribe?utm_medium=notification&utm_source=email. Or configure specific recipients for build notifications in your .travis.yml file. See https://docs.travis-ci.com/user/notifications.
