GitHub user wyzssw opened a pull request:
https://github.com/apache/kafka/pull/206
let kafka support "commit offset after consuming"
Kafka Of Original Version do not support "commit offset after
consuming",when kafka.consumer.ConsumerIterator[K, V].next() return a
MessageAndMetadata,which consumed offset is already being set,and commit thread
maybe commit this offset before "consuming process finished",when jvm restart
or being downï¼this msg will not be consumed next time
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/apache/kafka trunk
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/kafka/pull/206.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #206
----
commit b7439c8081465f8764e88326b3fa7b320f99f130
Author: Sriharsha Chintalapani <[email protected]>
Date: 2015-03-12T20:56:52Z
kafka-1461; Replica fetcher thread does not implement any back-off
behavior; patched by Sriharsha Chintalapani; reviewed by Jun Rao
commit c41c7b40b63ecd668c727a897f29e276a1c5adf7
Author: Jiangjie Qin <[email protected]>
Date: 2015-03-13T22:06:10Z
KAFKA-1997; Refactor MirrorMaker based on KIP-3; reviewed by Joel Koshy and
Guozhang Wang
commit 1caaf6db400df7e37b7f0416bb83ab451018a5c8
Author: Guozhang Wang <[email protected]>
Date: 2015-03-13T22:17:08Z
KAFKA-1863; Add docs for possible thrown exception in Callback; reviewed by
Jiangjie Qin
commit 5bbbb7fddbddc823b0946fda6e82dfba4ab8b5fd
Author: Jiangjie Qin <[email protected]>
Date: 2015-03-17T21:22:01Z
KAFKA-1997; Follow-up to add the shutdown hook before starting the
consumers; reviewed by Guozhang Wang
commit 82789e75199fdc1cae115c5c2eadfd0f1ece4d0d
Author: Jiangjie Qin <[email protected]>
Date: 2015-03-18T21:58:11Z
KAFKA-1997; Hopefully last follow-up fix to get messageHandlerArgs right
commit b2c833aa41cb9a7a6232781b273402042e021607
Author: Guozhang Wang <[email protected]>
Date: 2015-03-19T22:52:54Z
KAFKA-1910; Fix two bugs on MemoryRecords and KafkaConsumer; reviewed by
Onur Karaman
commit c62cff355936eea2a96e3b9678c761334fce8ee2
Author: Guozhang Wang <[email protected]>
Date: 2015-03-19T23:10:23Z
trivial fix on coding style
commit 991195416e0c179d2d2a79891d0214244c287618
Author: Jiangjie Qin <[email protected]>
Date: 2015-03-24T22:48:46Z
KAFKA-2042; Update topic list of the metadata regardless of cluster
information; reviewed by Guozhang Wang
commit 4e0da4965b83b25debdec4d55e075c18be436fa8
Author: Tao Xiao <[email protected]>
Date: 2015-03-25T03:56:22Z
KAFKA-2048; Change lock synchronized to inLock() for partitionMapCond;
reviewed by Guozhang Wang
commit eb2100876b70d1e0d53a88c2513ca3a4ac7a1c1e
Author: Joe Stein <[email protected]>
Date: 2015-03-25T05:57:42Z
KAFKA-1856 Add PreCommit Patch Testing patch by Ashish K Singh reviewed by
Gwen Shapira
commit a74688de46c23dd34ad964372fbed05c1f7f4b3e
Author: Yasuhiro Matsuda <[email protected]>
Date: 2015-03-25T20:08:38Z
kafka-527; Compression support does numerous byte copies; patched by
Yasuhiro Matsuda; reviewed by Guozhang Wang and Jun Rao
commit 5b42b538eb46203f7fd308cb3d3f27dde98840b8
Author: Jiangjie Qin <[email protected]>
Date: 2015-03-25T21:01:19Z
KAFKA-2047; Move the stream creation into concurrent mirror maker threads;
reviewed by Guozhang Wang
commit d2f50fc3886896bc569fea7fb308036008b89f94
Author: Guozhang Wang <[email protected]>
Date: 2015-03-26T22:43:18Z
KAFKA-527; Use in-place decompression enabled inner iterator to replace old
decompress function; reviewed by Joel Koshy and Jun Rao
commit c5df2a8e3acca1e2c905fa6b78e73e09b1dd0cd7
Author: Guozhang Wang <[email protected]>
Date: 2015-03-27T00:16:33Z
KAFKA-1634; Bump up Offset Commit Request to v2 to add global retention and
remove per-partition commit timestamp; reviewed by Joel Koshy and Jun Rao
commit d8fe98efee5a44ae12c1e3484fa20f89b0f30054
Author: Gwen Shapira <[email protected]>
Date: 2015-03-28T15:39:48Z
kafka-2044; Support requests and responses from o.a.k.common in KafkaApis;
patched by Gwen Shapira; reviewed by Jun Rao
commit 66c6f9b1c436187635674f82a9e9940d8f5331f2
Author: Ismael Juma <[email protected]>
Date: 2015-04-01T20:26:45Z
kafka-2039; Update Scala to 2.10.5 and 2.11.6; patched by Ismael Juma;
reviewed by Jun Rao
commit 619d78eb521185f365a002e5f1987b75d3f35192
Author: Yasuhiro Matsuda <[email protected]>
Date: 2015-04-01T23:14:48Z
kafka-2013; benchmark test for the purgatory; patched by Yasuhiro Matsuda;
reviewed by Jun Rao
commit ad722531daafadbcb27b0c0db0b9fcbb68b25b28
Author: Ted Malaska <[email protected]>
Date: 2015-04-03T01:20:54Z
kafka-2016; RollingBounceTest takes long; patched by Ted Malaska; reviewed
by Jun Rao
commit 48f997047228c327f91e8f848142b4607366fc3e
Author: Ted Malaska <[email protected]>
Date: 2015-04-03T18:43:52Z
KAFKA-1961 Prevent deletion of _consumer_offsets topic; reviewed by Neha
Narkhede, Gwen Shapira and Jun Rao
commit 15b93a410a8e988e09dc147c6d5250cbbe328b26
Author: Aditya Auradkar <[email protected]>
Date: 2015-04-04T01:39:27Z
KAFKA-1546; Automate replica lag tuning; reviewed by Joel Koshy, Neha
Narkhede, Jun Rao and Guozhang Wang
commit 6adaffd8ea4bc1f40bd5cf5268c30eb2df1868ab
Author: Ewen Cheslack-Postava <[email protected]>
Date: 2015-04-04T21:26:38Z
KAFKA-1501 Let the OS choose the port in unit tests to avoid collisions.
Patch by Ewen CP, reviewed by Guozhang and me.
commit 70e5c92e213bff7502288c610c252735d6b68c08
Author: Tim Brooks <[email protected]>
Date: 2015-04-04T22:17:09Z
KAFKA-2050 Avoid calling .size() on linked list.
commit a686a67f60beb42eb3d4942508fb15b636e5100d
Author: Yaguo Zhou <[email protected]>
Date: 2015-04-04T22:21:51Z
KAFKA-2002: Mx4JLoader doesn't disable when kafka_mx4jenable=false.
commit 7acfa92c09bbfeb6d28a0771c09d36c9c89fc31f
Author: Rajini Sivaram <[email protected]>
Date: 2015-04-04T22:56:17Z
KAFKA-2024 Log compaction can generate unindexable segments.
commit 9a071017ee80331dc5b776e04ee2ed77f1d751db
Author: Yaguo Zhou <[email protected]>
Date: 2015-04-04T23:05:45Z
KAFKA-1996 Fix scaladoc error.
commit 07598ad8a4e508e738c4af11f16b1649d90d5fdb
Author: paul mackles <[email protected]>
Date: 2015-04-05T02:36:54Z
KAFKA-1005 Shutdown consumer at the end of consumer performance test.
commit 53f31432a0e1da78abf31ad42297790445083072
Author: Gwen Shapira <[email protected]>
Date: 2015-04-06T00:21:37Z
kafka-1809; Refactor brokers to allow listening on multiple ports and IPs;
patched by Gwen Shapira; reviewed by Joel Koshy and Jun Rao
commit 9c23d93553a33c5d85231193614d192a9945796e
Author: Tong Li <[email protected]>
Date: 2015-04-06T04:46:11Z
kafka-1926; Replace kafka.utils.Utils with o.a.k.common.utils.Utils;
patched by Tong Li; reviewed by Jun Rao
commit 75e1cc8bc497e6aaa0dd05454d6c817ed0fb5e23
Author: Grant Henke <[email protected]>
Date: 2015-04-06T20:34:31Z
kafka-2043; CompressionType is passed in each RecordAccumulator append;
patched by Grant Henke; reviewed by Jun Rao
commit 04fce48e1af183d5133be1044d27e0f526e94f2a
Author: Gwen Shapira <[email protected]>
Date: 2015-04-07T01:20:45Z
kafka-2099; BrokerEndPoint file, methods and object names should match;
patched by Gwen Shapira; reviewed by Sriharsha Chintalapani and Jun Rao
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
