[jira] [Updated] (DRILL-7388) Apache Drill Kafka Storage module fails to return results for partitions containing single offset record
[ https://issues.apache.org/jira/browse/DRILL-7388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Vysotskyi updated DRILL-7388: -- Labels: ready-to-commit (was: ) > Apache Drill Kafka Storage module fails to return results for partitions > containing single offset record > > > Key: DRILL-7388 > URL: https://issues.apache.org/jira/browse/DRILL-7388 > Project: Apache Drill > Issue Type: Bug >Affects Versions: 1.16.0 >Reporter: daniel kelly >Assignee: Arina Ielchiieva >Priority: Major > Labels: ready-to-commit > Fix For: 1.17.0 > > > If a partition only contains one record - e.g. > [topicName=myTopic, partitionId=117, startOffset=0, endOffset=1] > no data is returned. > I fixed this locally with the following code change in contrib/storage-kafka > :- > {code:java} > git diff > src/main/java/org/apache/drill/exec/store/kafka/KafkaRecordReader.java > @@ -109,7 +109,7 @@ public class KafkaRecordReader extends > AbstractRecordReader { > currentMessageCount = 0; > > try { > - while (currentOffset < subScanSpec.getEndOffset() - 1 && > msgItr.hasNext()) { > + while (currentOffset < subScanSpec.getEndOffset() && msgItr.hasNext()) > { > ConsumerRecord consumerRecord = msgItr.next(); > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (DRILL-7388) Apache Drill Kafka Storage module fails to return results for partitions containing single offset record
[ https://issues.apache.org/jira/browse/DRILL-7388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arina Ielchiieva updated DRILL-7388: Reviewer: Vova Vysotskyi > Apache Drill Kafka Storage module fails to return results for partitions > containing single offset record > > > Key: DRILL-7388 > URL: https://issues.apache.org/jira/browse/DRILL-7388 > Project: Apache Drill > Issue Type: Bug >Affects Versions: 1.16.0 >Reporter: daniel kelly >Assignee: Arina Ielchiieva >Priority: Major > Fix For: 1.17.0 > > > If a partition only contains one record - e.g. > [topicName=myTopic, partitionId=117, startOffset=0, endOffset=1] > no data is returned. > I fixed this locally with the following code change in contrib/storage-kafka > :- > {code:java} > git diff > src/main/java/org/apache/drill/exec/store/kafka/KafkaRecordReader.java > @@ -109,7 +109,7 @@ public class KafkaRecordReader extends > AbstractRecordReader { > currentMessageCount = 0; > > try { > - while (currentOffset < subScanSpec.getEndOffset() - 1 && > msgItr.hasNext()) { > + while (currentOffset < subScanSpec.getEndOffset() && msgItr.hasNext()) > { > ConsumerRecord consumerRecord = msgItr.next(); > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (DRILL-7388) Apache Drill Kafka Storage module fails to return results for partitions containing single offset record
[ https://issues.apache.org/jira/browse/DRILL-7388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arina Ielchiieva updated DRILL-7388: Fix Version/s: 1.17.0 > Apache Drill Kafka Storage module fails to return results for partitions > containing single offset record > > > Key: DRILL-7388 > URL: https://issues.apache.org/jira/browse/DRILL-7388 > Project: Apache Drill > Issue Type: Bug >Affects Versions: 1.16.0 >Reporter: daniel kelly >Priority: Major > Fix For: 1.17.0 > > > If a partition only contains one record - e.g. > [topicName=myTopic, partitionId=117, startOffset=0, endOffset=1] > no data is returned. > I fixed this locally with the following code change in contrib/storage-kafka > :- > {code:java} > git diff > src/main/java/org/apache/drill/exec/store/kafka/KafkaRecordReader.java > @@ -109,7 +109,7 @@ public class KafkaRecordReader extends > AbstractRecordReader { > currentMessageCount = 0; > > try { > - while (currentOffset < subScanSpec.getEndOffset() - 1 && > msgItr.hasNext()) { > + while (currentOffset < subScanSpec.getEndOffset() && msgItr.hasNext()) > { > ConsumerRecord consumerRecord = msgItr.next(); > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (DRILL-7388) Apache Drill Kafka Storage module fails to return results for partitions containing single offset record
[ https://issues.apache.org/jira/browse/DRILL-7388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arina Ielchiieva updated DRILL-7388: Affects Version/s: 1.16.0 > Apache Drill Kafka Storage module fails to return results for partitions > containing single offset record > > > Key: DRILL-7388 > URL: https://issues.apache.org/jira/browse/DRILL-7388 > Project: Apache Drill > Issue Type: Bug >Affects Versions: 1.16.0 >Reporter: daniel kelly >Priority: Blocker > > If a partition only contains one record - e.g. > [topicName=myTopic, partitionId=117, startOffset=0, endOffset=1] > no data is returned. > I fixed this locally with the following code change in contrib/storage-kafka > :- > {code:java} > git diff > src/main/java/org/apache/drill/exec/store/kafka/KafkaRecordReader.java > @@ -109,7 +109,7 @@ public class KafkaRecordReader extends > AbstractRecordReader { > currentMessageCount = 0; > > try { > - while (currentOffset < subScanSpec.getEndOffset() - 1 && > msgItr.hasNext()) { > + while (currentOffset < subScanSpec.getEndOffset() && msgItr.hasNext()) > { > ConsumerRecord consumerRecord = msgItr.next(); > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (DRILL-7388) Apache Drill Kafka Storage module fails to return results for partitions containing single offset record
[ https://issues.apache.org/jira/browse/DRILL-7388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arina Ielchiieva updated DRILL-7388: Priority: Major (was: Blocker) > Apache Drill Kafka Storage module fails to return results for partitions > containing single offset record > > > Key: DRILL-7388 > URL: https://issues.apache.org/jira/browse/DRILL-7388 > Project: Apache Drill > Issue Type: Bug >Affects Versions: 1.16.0 >Reporter: daniel kelly >Priority: Major > > If a partition only contains one record - e.g. > [topicName=myTopic, partitionId=117, startOffset=0, endOffset=1] > no data is returned. > I fixed this locally with the following code change in contrib/storage-kafka > :- > {code:java} > git diff > src/main/java/org/apache/drill/exec/store/kafka/KafkaRecordReader.java > @@ -109,7 +109,7 @@ public class KafkaRecordReader extends > AbstractRecordReader { > currentMessageCount = 0; > > try { > - while (currentOffset < subScanSpec.getEndOffset() - 1 && > msgItr.hasNext()) { > + while (currentOffset < subScanSpec.getEndOffset() && msgItr.hasNext()) > { > ConsumerRecord consumerRecord = msgItr.next(); > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (DRILL-7388) Apache Drill Kafka Storage module fails to return results for partitions containing single offset record
[ https://issues.apache.org/jira/browse/DRILL-7388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] daniel kelly updated DRILL-7388: Priority: Blocker (was: Major) > Apache Drill Kafka Storage module fails to return results for partitions > containing single offset record > > > Key: DRILL-7388 > URL: https://issues.apache.org/jira/browse/DRILL-7388 > Project: Apache Drill > Issue Type: Bug >Reporter: daniel kelly >Priority: Blocker > > If a partition only contains one record - e.g. > [topicName=myTopic, partitionId=117, startOffset=0, endOffset=1] > no data is returned. > I fixed this locally with the following code change in contrib/storage-kafka > :- > {code:java} > git diff > src/main/java/org/apache/drill/exec/store/kafka/KafkaRecordReader.java > @@ -109,7 +109,7 @@ public class KafkaRecordReader extends > AbstractRecordReader { > currentMessageCount = 0; > > try { > - while (currentOffset < subScanSpec.getEndOffset() - 1 && > msgItr.hasNext()) { > + while (currentOffset < subScanSpec.getEndOffset() && msgItr.hasNext()) > { > ConsumerRecord consumerRecord = msgItr.next(); > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (DRILL-7388) Apache Drill Kafka Storage module fails to return results for partitions containing single offset record
[ https://issues.apache.org/jira/browse/DRILL-7388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] daniel kelly updated DRILL-7388: Summary: Apache Drill Kafka Storage module fails to return results for partitions containing single offset record (was: Apache Drill fails to return results for partitions containing single offset record) > Apache Drill Kafka Storage module fails to return results for partitions > containing single offset record > > > Key: DRILL-7388 > URL: https://issues.apache.org/jira/browse/DRILL-7388 > Project: Apache Drill > Issue Type: Bug >Reporter: daniel kelly >Priority: Major > > If a partition only contains one record - e.g. > [topicName=myTopic, partitionId=117, startOffset=0, endOffset=1] > no data is returned. > I fixed this locally with the following code change in contrib/storage-kafka > :- > {code:java} > git diff > src/main/java/org/apache/drill/exec/store/kafka/KafkaRecordReader.java > @@ -109,7 +109,7 @@ public class KafkaRecordReader extends > AbstractRecordReader { > currentMessageCount = 0; > > try { > - while (currentOffset < subScanSpec.getEndOffset() - 1 && > msgItr.hasNext()) { > + while (currentOffset < subScanSpec.getEndOffset() && msgItr.hasNext()) > { > ConsumerRecord consumerRecord = msgItr.next(); > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)