B Anil Kumar created DRILL-5977: ----------------------------------- Summary: predicate pushdown support kafkaMsgOffset Key: DRILL-5977 URL: https://issues.apache.org/jira/browse/DRILL-5977 Project: Apache Drill Issue Type: Improvement Reporter: B Anil Kumar
As part of Kafka storage plugin review, below is the suggestion from Paul. {noformat} Does it make sense to provide a way to select a range of messages: a starting point or a count? Perhaps I want to run my query every five minutes, scanning only those messages since the previous scan. Or, I want to limit my take to, say, the next 1000 messages. Could we use a pseudo-column such as "kafkaMsgOffset" for that purpose? Maybe SELECT * FROM <some topic> WHERE kafkaMsgOffset > 12345 {noformat} -- This message was sent by Atlassian JIRA (v6.4.14#64029)