Re: Got ClosedByInterruptException when closing ConsumerConnector

2015-02-09 Thread Guozhang Wang 
Is this exception transient or consistent and blocking the shutdown process?

On Mon, Feb 9, 2015 at 3:07 AM, tao xiao xiaotao...@gmail.com wrote:

 Hi team,

 I got java.nio.channels.ClosedByInterruptException when
 closing ConsumerConnector using kafka 0.8.2

 Here is the exception

 2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
 [test12345_localhost], ZKConsumerConnector shutting down

 2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
 [ConsumerFetcherManager-1423479848796] Stopping leader finder thread

 2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
 [test12345_localhost], Shutting down

 2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
 [test12345_localhost], Shutdown completed

 2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
 [ConsumerFetcherManager-1423479848796] Stopping all fetchers

 2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
 [test12345_localhost], Stopped

 2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
 [ConsumerFetcherThread-test12345_localhost], Shutting down

 2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 - Reconnect due to
 socket error: java.nio.channels.ClosedByInterruptException

 2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
 [ConsumerFetcherThread-test12345_localhost], Stopped

 2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
 [ConsumerFetcherThread-test12345_localhost], Shutdown completed

 2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
 [ConsumerFetcherManager-1423479848796] All connections stopped

 2015-02-09 19:04:19 INFO  org.I0Itec.zkclient.ZkEventThread:82 - Terminate
 ZkClient event thread.

 2015-02-09 19:04:19 INFO  org.apache.zookeeper.ZooKeeper:684 - Session:
 0x14b6dd8fcf80011 closed

 2015-02-09 19:04:19 INFO  org.apache.zookeeper.ClientCnxn$EventThread:512 -
 EventThread shut down

 2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
 [test12345_localhost], ZKConsumerConnector shutdown completed in 86 ms


 --
 Regards,
 Tao




-- 
-- Guozhang

Re: Got ClosedByInterruptException when closing ConsumerConnector

2015-02-09 Thread Guozhang Wang 
This exception should be transient (and that is why we captured it as INFO
level log entries) and can be ignored.

We are currently working on the new consumer APIs, and will improve our
logging pattern to avoid such confusing information.

Guozhang

On Mon, Feb 9, 2015 at 5:33 PM, tao xiao xiaotao...@gmail.com wrote:

 It happens every time I shutdown the connector. It doesn't block the
 shutdown process though

 On Tue, Feb 10, 2015 at 1:09 AM, Guozhang Wang wangg...@gmail.com wrote:

  Is this exception transient or consistent and blocking the shutdown
  process?
 
  On Mon, Feb 9, 2015 at 3:07 AM, tao xiao xiaotao...@gmail.com wrote:
 
   Hi team,
  
   I got java.nio.channels.ClosedByInterruptException when
   closing ConsumerConnector using kafka 0.8.2
  
   Here is the exception
  
   2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
   [test12345_localhost], ZKConsumerConnector shutting down
  
   2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
   [ConsumerFetcherManager-1423479848796] Stopping leader finder thread
  
   2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
   [test12345_localhost], Shutting down
  
   2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
   [test12345_localhost], Shutdown completed
  
   2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
   [ConsumerFetcherManager-1423479848796] Stopping all fetchers
  
   2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
   [test12345_localhost], Stopped
  
   2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
   [ConsumerFetcherThread-test12345_localhost], Shutting down
  
   2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 - Reconnect due
 to
   socket error: java.nio.channels.ClosedByInterruptException
  
   2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
   [ConsumerFetcherThread-test12345_localhost], Stopped
  
   2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
   [ConsumerFetcherThread-test12345_localhost], Shutdown completed
  
   2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
   [ConsumerFetcherManager-1423479848796] All connections stopped
  
   2015-02-09 19:04:19 INFO  org.I0Itec.zkclient.ZkEventThread:82 -
  Terminate
   ZkClient event thread.
  
   2015-02-09 19:04:19 INFO  org.apache.zookeeper.ZooKeeper:684 - Session:
   0x14b6dd8fcf80011 closed
  
   2015-02-09 19:04:19 INFO
  org.apache.zookeeper.ClientCnxn$EventThread:512 -
   EventThread shut down
  
   2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
   [test12345_localhost], ZKConsumerConnector shutdown completed in 86 ms
  
  
   --
   Regards,
   Tao
  
 
 
 
  --
  -- Guozhang
 



 --
 Regards,
 Tao




-- 
-- Guozhang

Re: Got ClosedByInterruptException when closing ConsumerConnector

2015-02-09 Thread tao xiao 
It happens every time I shutdown the connector. It doesn't block the
shutdown process though

On Tue, Feb 10, 2015 at 1:09 AM, Guozhang Wang wangg...@gmail.com wrote:

 Is this exception transient or consistent and blocking the shutdown
 process?

 On Mon, Feb 9, 2015 at 3:07 AM, tao xiao xiaotao...@gmail.com wrote:

  Hi team,
 
  I got java.nio.channels.ClosedByInterruptException when
  closing ConsumerConnector using kafka 0.8.2
 
  Here is the exception
 
  2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
  [test12345_localhost], ZKConsumerConnector shutting down
 
  2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
  [ConsumerFetcherManager-1423479848796] Stopping leader finder thread
 
  2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
  [test12345_localhost], Shutting down
 
  2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
  [test12345_localhost], Shutdown completed
 
  2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
  [ConsumerFetcherManager-1423479848796] Stopping all fetchers
 
  2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
  [test12345_localhost], Stopped
 
  2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
  [ConsumerFetcherThread-test12345_localhost], Shutting down
 
  2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 - Reconnect due to
  socket error: java.nio.channels.ClosedByInterruptException
 
  2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
  [ConsumerFetcherThread-test12345_localhost], Stopped
 
  2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
  [ConsumerFetcherThread-test12345_localhost], Shutdown completed
 
  2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
  [ConsumerFetcherManager-1423479848796] All connections stopped
 
  2015-02-09 19:04:19 INFO  org.I0Itec.zkclient.ZkEventThread:82 -
 Terminate
  ZkClient event thread.
 
  2015-02-09 19:04:19 INFO  org.apache.zookeeper.ZooKeeper:684 - Session:
  0x14b6dd8fcf80011 closed
 
  2015-02-09 19:04:19 INFO
 org.apache.zookeeper.ClientCnxn$EventThread:512 -
  EventThread shut down
 
  2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
  [test12345_localhost], ZKConsumerConnector shutdown completed in 86 ms
 
 
  --
  Regards,
  Tao
 



 --
 -- Guozhang




-- 
Regards,
Tao

Got ClosedByInterruptException when closing ConsumerConnector

2015-02-09 Thread tao xiao 
Hi team,

I got java.nio.channels.ClosedByInterruptException when
closing ConsumerConnector using kafka 0.8.2

Here is the exception

2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
[test12345_localhost], ZKConsumerConnector shutting down

2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
[ConsumerFetcherManager-1423479848796] Stopping leader finder thread

2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
[test12345_localhost], Shutting down

2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
[test12345_localhost], Shutdown completed

2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
[ConsumerFetcherManager-1423479848796] Stopping all fetchers

2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
[test12345_localhost], Stopped

2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
[ConsumerFetcherThread-test12345_localhost], Shutting down

2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 - Reconnect due to
socket error: java.nio.channels.ClosedByInterruptException

2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
[ConsumerFetcherThread-test12345_localhost], Stopped

2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
[ConsumerFetcherThread-test12345_localhost], Shutdown completed

2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
[ConsumerFetcherManager-1423479848796] All connections stopped

2015-02-09 19:04:19 INFO  org.I0Itec.zkclient.ZkEventThread:82 - Terminate
ZkClient event thread.

2015-02-09 19:04:19 INFO  org.apache.zookeeper.ZooKeeper:684 - Session:
0x14b6dd8fcf80011 closed

2015-02-09 19:04:19 INFO  org.apache.zookeeper.ClientCnxn$EventThread:512 -
EventThread shut down

2015-02-09 19:04:19 INFO  kafka.utils.Logging$class:68 -
[test12345_localhost], ZKConsumerConnector shutdown completed in 86 ms


-- 
Regards,
Tao