@Ian, Nina Thanks for the detailed description of your apps. A couple of follow-up questions I have to help us further investigate your issue:
1. About the stack trace pasted before: is it tailing some warning logs like "Could not create task ... Will retry" (i.e. it is part of that warning log) or it is thrown as a exception all they way to the thread's setUncaughtExceptionHandler, in which case your code should have a `Unexpected Exception caught in thread` error log entry and the thread will die. 2. Could you monitor the number of live stream threads during the runtime (originally there should be 8 according to your configs) and see if the count has decreased, meaning some threads have been dead? 3. When you reported that the process "just hang on attempting to rejoin", how long have you observed it hanging before killed the process? 4. Could you try with fewer number of partitions, from 96 to 8 just for the purpose of trouble shooting to see if this issue still exists? Guozhang On Mon, Feb 13, 2017 at 11:38 AM, Guozhang Wang <wangg...@gmail.com> wrote: > Thanks for reporting the JIRA Swen. > > Jason has a patch ready under KAFKA-4761 and I have reviewed it. You could > try it out and see if it has fixed your issue. > > After this is merged in, we will need another RC. > > > Guozhang > > On Mon, Feb 13, 2017 at 9:52 AM, Moczarski, Swen <smoczarski@ebay- > kleinanzeigen.de> wrote: > >> +0 (non-binding) >> >> Thanks for compiling a new release candidate. >> >> I get an NullPointerException when setting batch.size=0 on producer >> config. This worked before with 0.10.1.1. >> See https://issues.apache.org/jira/browse/KAFKA-4761 >> >> Regards, >> Swen >> >> Am 2/10/17, 5:51 PM schrieb "Ewen Cheslack-Postava" <e...@confluent.io>: >> >> Hello Kafka users, developers and client-developers, >> >> This is RC1 for release of Apache Kafka 0.10.2.0. >> >> This is a minor version release of Apache Kafka. It includes 19 new >> KIPs. >> See the release notes and release plan (https://cwiki.apache.org/ >> confluence/display/KAFKA/Release+Plan+0.10.2.0) for more details. A >> few >> feature highlights: SASL-SCRAM support, improved client compatibility >> to >> allow use of clients newer than the broker, session windows and global >> tables in the Kafka Streams API, single message transforms in the >> Kafka >> Connect framework. >> >> Important note: in addition to the artifacts generated using JDK7 for >> Scala >> 2.10 and 2.11, this release also includes experimental artifacts built >> using JDK8 for Scala 2.12. >> >> Important code changes since RC0 (non-docs, non system tests): >> >> * KAFKA-4728; KafkaConsumer#commitSync should copy its input >> * KAFKA-4441; Monitoring incorrect during topic creation and deletion >> * KAFKA-4734; Trim the time index on old segments >> * KAFKA-4725; Stop leaking messages in produce request body when >> requests >> are delayed >> * KAFKA-4716: Fix case when controller cannot be reached >> >> Release notes for the 0.10.2.0 release: >> http://home.apache.org/~ewencp/kafka-0.10.2.0-rc1/RELEASE_NOTES.html >> >> *** Please download, test and vote by Monday, Feb 13, 5pm PT *** >> >> Kafka's KEYS file containing PGP keys we use to sign the release: >> http://kafka.apache.org/KEYS >> >> * Release artifacts to be voted upon (source and binary): >> http://home.apache.org/~ewencp/kafka-0.10.2.0-rc1/ >> >> * Maven artifacts to be voted upon: >> https://repository.apache.org/content/groups/staging/ >> >> * Javadoc: >> http://home.apache.org/~ewencp/kafka-0.10.2.0-rc1/javadoc/ >> >> * Tag to be voted upon (off 0.10.2 branch) is the 0.10.2.0 tag: >> https://git-wip-us.apache.org/repos/asf?p=kafka.git;a=tag;h= >> e825b7994bf8c8c4871d1e0973e287e6d31c7ae4 >> >> >> * Documentation: >> http://kafka.apache.org/0102/documentation.html >> >> * Protocol: >> http://kafka.apache.org/0102/protocol.html >> >> * Successful Jenkins builds for the 0.10.2 branch: >> Unit/integration tests: https://builds.apache.org/job/ >> kafka-0.10.2-jdk7/74/ >> System tests: https://jenkins.confluent.io/j >> ob/system-test-kafka-0.10.2/25/ >> >> /************************************** >> >> Thanks, >> Ewen >> >> >> > > > -- > -- Guozhang > -- -- Guozhang
