Thanks Jun. I updated the list with your suggestions. If anyone feels we are missing a critical patch for 0.8.2.2, please speak up.
Gwen On Mon, Aug 17, 2015 at 5:40 PM, Jun Rao <j...@confluent.io> wrote: > Hi, Grant, > > I took a look at that list. None of those is really critical as you said. > So, I'd suggest that we not include those to minimize the scope of the > release. > > Thanks, > > Jun > > On Mon, Aug 17, 2015 at 5:16 PM, Grant Henke <ghe...@cloudera.com> wrote: > > > Thanks Gwen. > > > > I updated a few small things on the wiki page. > > > > Below is a list of jiras I think could also be marked as included. All of > > these, though not super critical, seem like fairly small and low risk > > changes that help avoid potentially confusing issues or errors for users. > > > > KAFKA-2012 > > KAFKA-972 > > KAFKA-2337 & KAFKA-2393 > > KAFKA-1867 > > KAFKA-2407 > > KAFKA-2234 > > KAFKA-1866 > > KAFKA-2345 & KAFKA-2355 > > > > thoughts? > > > > Thank you, > > Grant > > > > On Mon, Aug 17, 2015 at 4:56 PM, Gwen Shapira <g...@confluent.io> wrote: > > > > > Thanks for creating a list, Grant! > > > > > > I placed it on the wiki with a quick evaluation of the content and > > whether > > > it should be in 0.8.2.2: > > > > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/Proposed+patches+for+0.8.2.2 > > > > > > I'm attempting to only cherrypick fixes that are both important for > large > > > number of users (or very critical to some users) and very safe (mostly > > > judged by the size of the change, but not only) > > > > > > If your favorite bugfix is missing from the list, or is there but > marked > > > "No", please let us know (in this thread) what we are missing and why > it > > is > > > both important and safe. > > > Also, if I accidentally included something you consider unsafe, speak > up! > > > > > > Gwen > > > > > > On Mon, Aug 17, 2015 at 8:17 AM, Grant Henke <ghe...@cloudera.com> > > wrote: > > > > > > > +dev > > > > > > > > Adding dev list back in. Somehow it got dropped. > > > > > > > > > > > > On Mon, Aug 17, 2015 at 10:16 AM, Grant Henke <ghe...@cloudera.com> > > > wrote: > > > > > > > > > Below is a list of candidate bug fix jiras marked fixed for 0.8.3. > I > > > > don't > > > > > suspect all of these will (or should) make it into the release but > > this > > > > > should be a relatively complete list to work from: > > > > > > > > > > - KAFKA-2114 <https://issues.apache.org/jira/browse/KAFKA-2114 > >: > > > > Unable > > > > > to change min.insync.replicas default > > > > > - KAFKA-1702 <https://issues.apache.org/jira/browse/KAFKA-1702 > >: > > > > > Messages silently Lost by producer > > > > > - KAFKA-2012 <https://issues.apache.org/jira/browse/KAFKA-2012 > >: > > > > > Broker should automatically handle corrupt index files > > > > > - KAFKA-2406 <https://issues.apache.org/jira/browse/KAFKA-2406 > >: > > > ISR > > > > > propagation should be throttled to avoid overwhelming > controller. > > > > > - KAFKA-2336 <https://issues.apache.org/jira/browse/KAFKA-2336 > >: > > > > > Changing offsets.topic.num.partitions after the offset topic is > > > > created > > > > > breaks consumer group partition assignment > > > > > - KAFKA-2337 <https://issues.apache.org/jira/browse/KAFKA-2337 > >: > > > > Verify > > > > > that metric names will not collide when creating new topics > > > > > - KAFKA-2393 <https://issues.apache.org/jira/browse/KAFKA-2393 > >: > > > > > Correctly Handle InvalidTopicException in > > > KafkaApis.getTopicMetadata() > > > > > - KAFKA-2189 <https://issues.apache.org/jira/browse/KAFKA-2189 > >: > > > > Snappy > > > > > compression of message batches less efficient in 0.8.2.1 > > > > > - KAFKA-2308 <https://issues.apache.org/jira/browse/KAFKA-2308 > >: > > > New > > > > > producer + Snappy face un-compression errors after broker > restart > > > > > - KAFKA-2042 <https://issues.apache.org/jira/browse/KAFKA-2042 > >: > > > New > > > > > producer metadata update always get all topics. > > > > > - KAFKA-1367 <https://issues.apache.org/jira/browse/KAFKA-1367 > >: > > > > Broker > > > > > topic metadata not kept in sync with ZooKeeper > > > > > - KAFKA-972 <https://issues.apache.org/jira/browse/KAFKA-972>: > > > > MetadataRequest > > > > > returns stale list of brokers > > > > > - KAFKA-1867 <https://issues.apache.org/jira/browse/KAFKA-1867 > >: > > > > liveBroker > > > > > list not updated on a cluster with no topics > > > > > - KAFKA-1650 <https://issues.apache.org/jira/browse/KAFKA-1650 > >: > > > > Mirror > > > > > Maker could lose data on unclean shutdown. > > > > > - KAFKA-2009 <https://issues.apache.org/jira/browse/KAFKA-2009 > >: > > > Fix > > > > > UncheckedOffset.removeOffset synchronization and trace logging > > issue > > > > in > > > > > mirror maker > > > > > - KAFKA-2407 <https://issues.apache.org/jira/browse/KAFKA-2407 > >: > > > Only > > > > > create a log directory when it will be used > > > > > - KAFKA-2327 <https://issues.apache.org/jira/browse/KAFKA-2327 > >: > > > > > broker doesn't start if config defines advertised.host but not > > > > > advertised.port > > > > > - KAFKA-1788: producer record can stay in RecordAccumulator > > forever > > > if > > > > > leader is no available > > > > > - KAFKA-2234 <https://issues.apache.org/jira/browse/KAFKA-2234 > >: > > > > > Partition reassignment of a nonexistent topic prevents future > > > > reassignments > > > > > - KAFKA-2096 <https://issues.apache.org/jira/browse/KAFKA-2096 > >: > > > > > Enable keepalive socket option for broker to prevent socket leak > > > > > - KAFKA-1057 <https://issues.apache.org/jira/browse/KAFKA-1057 > >: > > > Trim > > > > > whitespaces from user specified configs > > > > > - KAFKA-1641 <https://issues.apache.org/jira/browse/KAFKA-1641 > >: > > > Log > > > > > cleaner exits if last cleaned offset is lower than earliest > offset > > > > > - KAFKA-1648 <https://issues.apache.org/jira/browse/KAFKA-1648 > >: > > > > Round > > > > > robin consumer balance throws an NPE when there are no topics > > > > > - KAFKA-1724 <https://issues.apache.org/jira/browse/KAFKA-1724 > >: > > > > > Errors after reboot in single node setup > > > > > - KAFKA-1758 <https://issues.apache.org/jira/browse/KAFKA-1758 > >: > > > > > corrupt recovery file prevents startup > > > > > - KAFKA-1866 <https://issues.apache.org/jira/browse/KAFKA-1866 > >: > > > > > LogStartOffset gauge throws exceptions after log.delete() > > > > > - KAFKA-1883 <https://issues.apache.org/jira/browse/KAFKA-1883 > >: > > > > NullPointerException > > > > > in RequestSendThread > > > > > - KAFKA-1896 <https://issues.apache.org/jira/browse/KAFKA-1896 > >: > > > > > Record size funcition of record in mirror maker hit NPE when the > > > > message > > > > > value is null. > > > > > - KAFKA-2101 <https://issues.apache.org/jira/browse/KAFKA-2101 > >: > > > > > Metric metadata-age is reset on a failed update > > > > > - KAFKA-2112 <https://issues.apache.org/jira/browse/KAFKA-2112 > >: > > > make > > > > > overflowWheel volatile > > > > > - KAFKA-2117 <https://issues.apache.org/jira/browse/KAFKA-2117 > >: > > > > > OffsetManager uses incorrect field for metadata > > > > > - KAFKA-2164 <https://issues.apache.org/jira/browse/KAFKA-2164 > >: > > > > > ReplicaFetcherThread: suspicious log message on reset offset > > > > > - KAFKA-1668 <https://issues.apache.org/jira/browse/KAFKA-1668 > >: > > > > > TopicCommand doesn't warn if --topic argument doesn't match any > > > topics > > > > > - KAFKA-2198 <https://issues.apache.org/jira/browse/KAFKA-2198 > >: > > > > > kafka-topics.sh exits with 0 status on failures > > > > > - KAFKA-2235 <https://issues.apache.org/jira/browse/KAFKA-2235 > >: > > > > > LogCleaner offset map overflow > > > > > - KAFKA-2241 <https://issues.apache.org/jira/browse/KAFKA-2241 > >: > > > > > AbstractFetcherThread.shutdown() should not block on > > > > > ReadableByteChannel.read(buffer) > > > > > - KAFKA-2272 <https://issues.apache.org/jira/browse/KAFKA-2272 > >: > > > > > listeners endpoint parsing fails if the hostname has capital > > letter > > > > > - KAFKA-2345 <https://issues.apache.org/jira/browse/KAFKA-2345 > >: > > > > > Attempt to delete a topic already marked for deletion throws > > > > > ZkNodeExistsException > > > > > - KAFKA-2353 <https://issues.apache.org/jira/browse/KAFKA-2353 > >: > > > > > SocketServer.Processor should catch exception and close the > socket > > > > properly > > > > > in configureNewConnections. > > > > > - KAFKA-1836 <https://issues.apache.org/jira/browse/KAFKA-1836 > >: > > > > > metadata.fetch.timeout.ms set to zero blocks forever > > > > > - KAFKA-2317 <https://issues.apache.org/jira/browse/KAFKA-2317 > >: > > > > De-register > > > > > isrChangeNotificationListener on controller resignation > > > > > > > > > > Note: KAFKA-2120 <https://issues.apache.org/jira/browse/KAFKA-2120 > > > > & > > > > > KAFKA-2421 <https://issues.apache.org/jira/browse/KAFKA-2421> were > > > > > mentioned in previous emails, but are not in the list because they > > are > > > > not > > > > > committed yet. > > > > > > > > > > Hope that helps the effort. > > > > > > > > > > Thanks, > > > > > Grant > > > > > > > > > > On Mon, Aug 17, 2015 at 12:09 AM, Grant Henke <ghe...@cloudera.com > > > > > > wrote: > > > > > > > > > >> +1 to that suggestion. Though I suspect that requires a committer > to > > > do. > > > > >> Making it part of the standard commit process could work too. > > > > >> On Aug 16, 2015 11:01 PM, "Gwen Shapira" <g...@confluent.io> > wrote: > > > > >> > > > > >>> BTW. I think it will be great for Apache Kafka to have a 0.8.2 > > > "release > > > > >>> manager" who's role is to cherrypick low-risk bug-fixes into the > > > 0.8.2 > > > > >>> branch and once enough bug fixes happened (or if sufficiently > > > critical > > > > >>> fixes happened) to roll out a new maintenance release (with > every 3 > > > > month > > > > >>> as a reasonable bugfix release target). > > > > >>> > > > > >>> This will add some predictability regarding how fast we release > > fixes > > > > for > > > > >>> bugs. > > > > >>> > > > > >>> Gwen > > > > >>> > > > > >>> On Sun, Aug 16, 2015 at 8:09 PM, Jeff Holoman < > > jholo...@cloudera.com > > > > > > > > >>> wrote: > > > > >>> > > > > >>> > +1 for the release and also including > > > > >>> > > > > > >>> > https://issues.apache.org/jira/browse/KAFKA-2114 > > > > >>> > > > > > >>> > Thanks > > > > >>> > > > > > >>> > Jeff > > > > >>> > > > > > >>> > On Sun, Aug 16, 2015 at 2:51 PM, Stevo Slavić < > ssla...@gmail.com > > > > > > > >>> wrote: > > > > >>> > > > > > >>> > > +1 (non-binding) for 0.8.2.2 release > > > > >>> > > > > > > >>> > > Would be nice to include in that release new producer > > resiliency > > > > bug > > > > >>> > fixes > > > > >>> > > https://issues.apache.org/jira/browse/KAFKA-1788 and > > > > >>> > > https://issues.apache.org/jira/browse/KAFKA-2120 > > > > >>> > > > > > > >>> > > On Fri, Aug 14, 2015 at 4:03 PM, Gwen Shapira < > > g...@confluent.io > > > > > > > > >>> wrote: > > > > >>> > > > > > > >>> > > > Will be nice to include Kafka-2308 and fix two critical > > snappy > > > > >>> issues > > > > >>> > in > > > > >>> > > > the maintenance release. > > > > >>> > > > > > > > >>> > > > Gwen > > > > >>> > > > On Aug 14, 2015 6:16 AM, "Grant Henke" < > ghe...@cloudera.com> > > > > >>> wrote: > > > > >>> > > > > > > > >>> > > > > Just to clarify. Will KAFKA-2189 be the only patch in the > > > > >>> release? > > > > >>> > > > > > > > > >>> > > > > On Fri, Aug 14, 2015 at 7:35 AM, Manikumar Reddy < > > > > >>> > ku...@nmsworks.co.in > > > > >>> > > > > > > > >>> > > > > wrote: > > > > >>> > > > > > > > > >>> > > > > > +1 for 0.8.2.2 release > > > > >>> > > > > > > > > > >>> > > > > > On Fri, Aug 14, 2015 at 5:49 PM, Ismael Juma < > > > > >>> ism...@juma.me.uk> > > > > >>> > > > wrote: > > > > >>> > > > > > > > > > >>> > > > > > > I think this is a good idea as the change is minimal > on > > > our > > > > >>> side > > > > >>> > > and > > > > >>> > > > it > > > > >>> > > > > > has > > > > >>> > > > > > > been tested in production for some time by the > > reporter. > > > > >>> > > > > > > > > > > >>> > > > > > > Best, > > > > >>> > > > > > > Ismael > > > > >>> > > > > > > > > > > >>> > > > > > > On Fri, Aug 14, 2015 at 1:15 PM, Jun Rao < > > > j...@confluent.io > > > > > > > > > >>> > wrote: > > > > >>> > > > > > > > > > > >>> > > > > > > > Hi, Everyone, > > > > >>> > > > > > > > > > > > >>> > > > > > > > Since the release of Kafka 0.8.2.1, a number of > > people > > > > have > > > > >>> > > > reported > > > > >>> > > > > an > > > > >>> > > > > > > > issue with snappy compression ( > > > > >>> > > > > > > > https://issues.apache.org/jira/browse/KAFKA-2189). > > > > >>> Basically, > > > > >>> > if > > > > >>> > > > > they > > > > >>> > > > > > > use > > > > >>> > > > > > > > snappy in 0.8.2.1, they will experience a 2-3X > space > > > > >>> increase. > > > > >>> > > The > > > > >>> > > > > > issue > > > > >>> > > > > > > > has since been fixed in trunk (just a snappy jar > > > > upgrade). > > > > >>> > Since > > > > >>> > > > > 0.8.3 > > > > >>> > > > > > is > > > > >>> > > > > > > > still a few months away, it may make sense to do an > > > > 0.8.2.2 > > > > >>> > > release > > > > >>> > > > > > just > > > > >>> > > > > > > to > > > > >>> > > > > > > > fix this issue. Any objections? > > > > >>> > > > > > > > > > > > >>> > > > > > > > Thanks, > > > > >>> > > > > > > > > > > > >>> > > > > > > > Jun > > > > >>> > > > > > > > > > > > >>> > > > > > > > > > > >>> > > > > > > > > > >>> > > > > > > > > >>> > > > > > > > > >>> > > > > > > > > >>> > > > > -- > > > > >>> > > > > Grant Henke > > > > >>> > > > > Software Engineer | Cloudera > > > > >>> > > > > gr...@cloudera.com | twitter.com/gchenke | > > > > >>> > linkedin.com/in/granthenke > > > > >>> > > > > > > > > >>> > > > > > > > >>> > > > > > > >>> > > > > > >>> > > > > > >>> > > > > > >>> > -- > > > > >>> > Jeff Holoman > > > > >>> > Systems Engineer > > > > >>> > > > > > >>> > > > > >> > > > > > > > > > > > > > > > -- > > > > > Grant Henke > > > > > Software Engineer | Cloudera > > > > > gr...@cloudera.com | twitter.com/gchenke | > > linkedin.com/in/granthenke > > > > > > > > > > > > > > > > > > > > > -- > > > > Grant Henke > > > > Software Engineer | Cloudera > > > > gr...@cloudera.com | twitter.com/gchenke | > linkedin.com/in/granthenke > > > > > > > > > > > > > > > -- > > Grant Henke > > Software Engineer | Cloudera > > gr...@cloudera.com | twitter.com/gchenke | linkedin.com/in/granthenke > > >
