[jira] [Commented] (KAFKA-2819) ConsumerConsume throw unexpected exception during clean shutdown

2015-11-12 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/KAFKA-2819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003577#comment-15003577
 ] 

ASF GitHub Bot commented on KAFKA-2819:
---

Github user asfgit closed the pull request at:

https://github.com/apache/kafka/pull/516


> ConsumerConsume throw unexpected exception during clean shutdown
> 
>
> Key: KAFKA-2819
> URL: https://issues.apache.org/jira/browse/KAFKA-2819
> Project: Kafka
>  Issue Type: Bug
>Reporter: Jun Rao
>Assignee: Guozhang Wang
> Fix For: 0.9.0.0
>
>
> Saw the following error during a clean shutdown.
> [2015-11-12 13:12:58,918] INFO [ConsumerFetcherManager-1447333891220] All 
> connections stopped (kafka.consumer.ConsumerFetcherManager)
> [2015-11-12 13:12:58,921] ERROR Error processing message, terminating 
> consumer process:  (kafka.tools.ConsoleConsumer$)
> java.util.NoSuchElementException
>   at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:39)
>   at kafka.consumer.ConsumerIterator.next(ConsumerIterator.scala:46)
>   at kafka.consumer.OldConsumer.receive(BaseConsumer.scala:79)
>   at kafka.tools.ConsoleConsumer$.process(ConsoleConsumer.scala:101)
>   at kafka.tools.ConsoleConsumer$.run(ConsoleConsumer.scala:64)
>   at kafka.tools.ConsoleConsumer$.main(ConsoleConsumer.scala:42)
>   at kafka.tools.ConsoleConsumer.main(ConsoleConsumer.scala)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (KAFKA-2819) ConsumerConsume throw unexpected exception during clean shutdown

2015-11-12 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/KAFKA-2819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002840#comment-15002840
 ] 

ASF GitHub Bot commented on KAFKA-2819:
---

GitHub user guozhangwang opened a pull request:

https://github.com/apache/kafka/pull/516

KAFKA-2819: catch NoSuchElementException in ConsoleConsumer



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/guozhangwang/kafka K2819

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/kafka/pull/516.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #516


commit 2bde950387eee79a0d19c852d827e6cfffd656d3
Author: Guozhang Wang 
Date:   2015-11-12T20:22:27Z

v1




> ConsumerConsume throw unexpected exception during clean shutdown
> 
>
> Key: KAFKA-2819
> URL: https://issues.apache.org/jira/browse/KAFKA-2819
> Project: Kafka
>  Issue Type: Bug
>Reporter: Jun Rao
>Assignee: Guozhang Wang
> Fix For: 0.9.0.0
>
>
> Saw the following error during a clean shutdown.
> [2015-11-12 13:12:58,918] INFO [ConsumerFetcherManager-1447333891220] All 
> connections stopped (kafka.consumer.ConsumerFetcherManager)
> [2015-11-12 13:12:58,921] ERROR Error processing message, terminating 
> consumer process:  (kafka.tools.ConsoleConsumer$)
> java.util.NoSuchElementException
>   at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:39)
>   at kafka.consumer.ConsumerIterator.next(ConsumerIterator.scala:46)
>   at kafka.consumer.OldConsumer.receive(BaseConsumer.scala:79)
>   at kafka.tools.ConsoleConsumer$.process(ConsoleConsumer.scala:101)
>   at kafka.tools.ConsoleConsumer$.run(ConsoleConsumer.scala:64)
>   at kafka.tools.ConsoleConsumer$.main(ConsoleConsumer.scala:42)
>   at kafka.tools.ConsoleConsumer.main(ConsoleConsumer.scala)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (KAFKA-2819) ConsumerConsume throw unexpected exception during clean shutdown

2015-11-12 Thread Jun Rao (JIRA) 

[ 
https://issues.apache.org/jira/browse/KAFKA-2819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002312#comment-15002312
 ] 

Jun Rao commented on KAFKA-2819:


It seems that the following assumption in OldConsumer is incorrect. We should 
first check iter.hasNext since it can return false if the ConsumerConnector is 
shut down.

  override def receive(): BaseConsumerRecord = {
// we do not need to check hasNext for KafkaStream iterator
val messageAndMetadata = iter.next


> ConsumerConsume throw unexpected exception during clean shutdown
> 
>
> Key: KAFKA-2819
> URL: https://issues.apache.org/jira/browse/KAFKA-2819
> Project: Kafka
>  Issue Type: Bug
>Reporter: Jun Rao
> Fix For: 0.9.0.0
>
>
> Saw the following error during a clean shutdown.
> [2015-11-12 13:12:58,918] INFO [ConsumerFetcherManager-1447333891220] All 
> connections stopped (kafka.consumer.ConsumerFetcherManager)
> [2015-11-12 13:12:58,921] ERROR Error processing message, terminating 
> consumer process:  (kafka.tools.ConsoleConsumer$)
> java.util.NoSuchElementException
>   at kafka.utils.IteratorTemplate.next(IteratorTemplate.scala:39)
>   at kafka.consumer.ConsumerIterator.next(ConsumerIterator.scala:46)
>   at kafka.consumer.OldConsumer.receive(BaseConsumer.scala:79)
>   at kafka.tools.ConsoleConsumer$.process(ConsoleConsumer.scala:101)
>   at kafka.tools.ConsoleConsumer$.run(ConsoleConsumer.scala:64)
>   at kafka.tools.ConsoleConsumer$.main(ConsoleConsumer.scala:42)
>   at kafka.tools.ConsoleConsumer.main(ConsoleConsumer.scala)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)