kafka git commit: MINOR: Fix deserialization of abortedTransactions and lastStableOffset in FetchResponse

2017-03-25 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk 462767660 -> d348ac92c MINOR: Fix deserialization of abortedTransactions and lastStableOffset in FetchResponse Thanks to Dong Lin for finding the lastStableOffset issue. Author: Ismael Juma Reviewers: Dong Lin

kafka git commit: KAFKA-4631; Request metadata in consumer if topic/partitions unavailable

2017-03-16 Thread jgus
Repository: kafka Updated Branches: refs/heads/0.10.2 928789bf7 -> 94938f373 KAFKA-4631; Request metadata in consumer if topic/partitions unavailable If leader node of one more more partitions in a consumer subscription are temporarily unavailable, request metadata refresh so that partitions

kafka git commit: MINOR: Improve log4j on stream thread and stream process

2017-03-15 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk 962c378cc -> b9f812491 MINOR: Improve log4j on stream thread and stream process Author: Guozhang Wang Reviewers: Matthias J. Sax , Eno Thereska , Damian Guy

kafka git commit: KAFKA-5097; Fix regression in consumer caused by unsafe access to potentially unassigned partitions

2017-04-20 Thread jgus
Repository: kafka Updated Branches: refs/heads/0.10.2 a26731674 -> 2aa615545 KAFKA-5097; Fix regression in consumer caused by unsafe access to potentially unassigned partitions Author: Eno Thereska Reviewers: Ismael Juma , Jiangjie Qin

kafka git commit: KAFKA-5014; NetworkClient.leastLoadedNode should check if channel is ready

2017-04-20 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk 779874fb1 -> 2aa339de1 KAFKA-5014; NetworkClient.leastLoadedNode should check if channel is ready Author: Ismael Juma Reviewers: Jason Gustafson Closes #2813 from

kafka git commit: MINOR: Remove redundant CRC validation for non-compressed records in older message formats

2017-04-21 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk c82118b19 -> 93fbda4c5 MINOR: Remove redundant CRC validation for non-compressed records in older message formats Author: Jason Gustafson Reviewers: Ismael Juma Closes #2881 from

kafka git commit: MINOR: Move `Os` class to utils package and rename it to OperatingSystem

2017-04-22 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk d7b5eadb9 -> 19f266d40 MINOR: Move `Os` class to utils package and rename it to OperatingSystem The `common` package is public and this class is internal. Author: Ismael Juma Reviewers: Jason Gustafson

kafka git commit: MINOR: Introduce NetworkClient.hasInFlightRequests

2017-03-09 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk 294018a57 -> 65650ba4d MINOR: Introduce NetworkClient.hasInFlightRequests It’s a minor optimisation, but simple enough. Author: Ismael Juma Reviewers: Apurva Mehta , Jason Gustafson

kafka git commit: KAFKA-4861; GroupMetadataManager record is rejected if broker configured with LogAppendTime

2017-03-09 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk dbcbd7920 -> 7565dcd8b KAFKA-4861; GroupMetadataManager record is rejected if broker configured with LogAppendTime The record should be created with CreateTime (like in the producer). The conversion to LogAppendTime happens automatically

kafka git commit: KAFKA-4861; GroupMetadataManager record is rejected if broker configured with LogAppendTime

2017-03-09 Thread jgus
Repository: kafka Updated Branches: refs/heads/0.10.2 3445ed0ba -> beb0d5700 KAFKA-4861; GroupMetadataManager record is rejected if broker configured with LogAppendTime The record should be created with CreateTime (like in the producer). The conversion to LogAppendTime happens automatically

kafka git commit: HOTFIX: Fix apache headers in float serde class files

2017-03-13 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk 2a9c18a87 -> d3b8ff024 HOTFIX: Fix apache headers in float serde class files hachikuji Author: Guozhang Wang Reviewers: Jason Gustafson Closes #2679 from guozhangwang/KHotfix-serde-headers

kafka git commit: KAFKA-2507 KAFKA-2959; Remove legacy ControlledShutdown request/response objects

2017-08-03 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk 613971f8d -> 5a516fb28 KAFKA-2507 KAFKA-2959; Remove legacy ControlledShutdown request/response objects This patch replaces the legacy ControlledShutdown objects in `kafka.api` with the alternatives in `org.apache.kafka.common.requests`.

kafka git commit: MINOR: Null out all buffer references in RequestChannel.Request

2017-08-03 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk 6bee1e9e5 -> 13deb84dc MINOR: Null out all buffer references in RequestChannel.Request The previous code kept two references to `Buffer` and only nulled out one of them. As part of this, I removed the `case` modifier from

kafka git commit: KAFKA-5731; Corrected how the sink task worker updates the last committed offsets

2017-08-15 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk 869ef5579 -> 3b1cea60e KAFKA-5731; Corrected how the sink task worker updates the last committed offsets Prior to this change, it was possible for the synchronous consumer commit request to be handled before previously-submitted

kafka git commit: KAFKA-5731; Corrected how the sink task worker updates the last committed offsets (0.11.0)

2017-08-15 Thread jgus
Repository: kafka Updated Branches: refs/heads/0.11.0 a1a118606 -> 22c9a8cb4 KAFKA-5731; Corrected how the sink task worker updates the last committed offsets (0.11.0) Prior to this change, it was possible for the synchronous consumer commit request to be handled before previously-submitted

kafka git commit: HOTFIX: ConsoleConsumer using wrong old consumer config value for auto.offset.reset

2017-08-14 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk c0f7a7705 -> 869ef5579 HOTFIX: ConsoleConsumer using wrong old consumer config value for auto.offset.reset Author: Jason Gustafson Reviewers: Ismael Juma Closes #3665 from

kafka git commit: MINOR: Remove unneeded error handlers in deprecated request objects

2017-08-10 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk 75b0f30c4 -> 017a21c60 MINOR: Remove unneeded error handlers in deprecated request objects These handlers were previously used on the broker to handle uncaught exceptions, but now the broker users the new Java request objects exclusively.

kafka git commit: KAFKA-5600; Fix group loading regression causing stale metadata/offset cache

2017-07-17 Thread jgus
Repository: kafka Updated Branches: refs/heads/0.11.0 973f9d2b2 -> 3a515505e KAFKA-5600; Fix group loading regression causing stale metadata/offset cache the while loop was too big and need to be closed earlier to see the fix, ignore whitespace since most of it is indentation this bug was

kafka git commit: KAFKA-5600; Fix group loading regression causing stale metadata/offset cache

2017-07-17 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk 6d7a81b47 -> e2fe19d22 KAFKA-5600; Fix group loading regression causing stale metadata/offset cache the while loop was too big and need to be closed earlier to see the fix, ignore whitespace since most of it is indentation this bug was

kafka git commit: MINOR: Update docstring for "offsets.retention.minutes" config

2017-07-11 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk 262869535 -> 9c6fc95f9 MINOR: Update docstring for "offsets.retention.minutes" config Author: Manikumar Reddy O Reviewers: Jason Gustafson Closes #2562 from omkreddy/MINOR-DOC Project:

kafka git commit: MINOR: Change log level for group member failure from debug to info

2017-07-14 Thread jgus
Repository: kafka Updated Branches: refs/heads/0.11.0 f0cd6af6d -> 335b9e48e MINOR: Change log level for group member failure from debug to info Author: Guozhang Wang Reviewers: Jason Gustafson Closes #3523 from

kafka git commit: MINOR: Change log level for group member failure from debug to info

2017-07-14 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk 1685e7112 -> 873eeae9f MINOR: Change log level for group member failure from debug to info Author: Guozhang Wang Reviewers: Jason Gustafson Closes #3523 from

[2/2] kafka git commit: MINOR: Enable a number of xlint scalac warnings

2017-07-14 Thread jgus
MINOR: Enable a number of xlint scalac warnings Update the code where possible to fix the warnings. The unused warning introduced in Scala 2.12 is quite handy and provides a reason to compile with Scala 2.12. Author: Ismael Juma Reviewers: Jason Gustafson

[1/2] kafka git commit: MINOR: Enable a number of xlint scalac warnings

2017-07-14 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk e39104547 -> 1685e7112 http://git-wip-us.apache.org/repos/asf/kafka/blob/1685e711/core/src/test/scala/unit/kafka/server/AdvertiseBrokerTest.scala -- diff --git

kafka git commit: KAFKA-5556; Fix IllegalStateException in KafkaConsumer.commitSync due to missing future completion check

2017-07-20 Thread jgus
Repository: kafka Updated Branches: refs/heads/0.11.0 2452201c5 -> 4b968afef KAFKA-5556; Fix IllegalStateException in KafkaConsumer.commitSync due to missing future completion check This PR makes `commitOffsetsSync` method check whether future is completed after client's poll or not.

kafka git commit: KAFKA-5556; Fix IllegalStateException in KafkaConsumer.commitSync due to missing future completion check

2017-07-20 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk fe4a469fc -> e0099e1f5 KAFKA-5556; Fix IllegalStateException in KafkaConsumer.commitSync due to missing future completion check This PR makes `commitOffsetsSync` method check whether future is completed after client's poll or not.

kafka git commit: KAFKA-5534; KafkaConsumer `offsetForTimes` result should include partitions with no offset

2017-07-20 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk cdff011fe -> 5bb53e034 KAFKA-5534; KafkaConsumer `offsetForTimes` result should include partitions with no offset For topics that support timestamp search, if no offset is found for a partition, the partition should still be included in

kafka git commit: KAFKA-5611; AbstractCoordinator should handle wakeup raised from onJoinComplete

2017-07-26 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk 5effe7239 -> 3620035c4 KAFKA-5611; AbstractCoordinator should handle wakeup raised from onJoinComplete Author: Jason Gustafson Reviewers: Ismael Juma Closes #3571 from hachikuji/KAFKA-5611

kafka git commit: KAFKA-5611; AbstractCoordinator should handle wakeup raised from onJoinComplete

2017-07-27 Thread jgus
Repository: kafka Updated Branches: refs/heads/0.11.0 c1f583e67 -> 25bcc2176 KAFKA-5611; AbstractCoordinator should handle wakeup raised from onJoinComplete Author: Jason Gustafson Reviewers: Ismael Juma Closes #3571 from hachikuji/KAFKA-5611

kafka git commit: KAFKA-5634; Do not allow segment deletion beyond high watermark

2017-07-27 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk 9d6020ec5 -> 6bd730264 KAFKA-5634; Do not allow segment deletion beyond high watermark This patch changes the segment deletion behavior to take the high watermark of the partition into account. In particular, segments containing offsets

kafka git commit: KAFKA-5634; Do not allow segment deletion beyond high watermark

2017-07-27 Thread jgus
Repository: kafka Updated Branches: refs/heads/0.11.0 25bcc2176 -> c2b939c62 KAFKA-5634; Do not allow segment deletion beyond high watermark This patch changes the segment deletion behavior to take the high watermark of the partition into account. In particular, segments containing offsets

[1/2] kafka git commit: MINOR: Code Cleanup

2017-07-19 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk 3bfc073f0 -> f87d58b79 http://git-wip-us.apache.org/repos/asf/kafka/blob/f87d58b7/connect/transforms/src/test/java/org/apache/kafka/connect/transforms/TimestampConverterTest.java

[2/2] kafka git commit: MINOR: Code Cleanup

2017-07-19 Thread jgus
MINOR: Code Cleanup Clean up includes: - Switching try-catch-finally blocks to try-with-resources when possible - Removing some seemingly unnecessary `SuppressWarnings` annotations - Resolving some Java warnings - Closing unclosed Closable objects - Removing unused code Author: Vahid Hashemian

kafka git commit: KAFKA-5610; WriteTxnMarker handler should return UNKNOWN_TOPIC_OR_PARTITION if replica is not available

2017-07-20 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk 9b7a6ee2a -> cdff011fe KAFKA-5610; WriteTxnMarker handler should return UNKNOWN_TOPIC_OR_PARTITION if replica is not available Before this patch, we would instead return the non-retriable `UNSUPPORTED_FOR_MESSAGE_FORMAT` causing markers

kafka git commit: KAFKA-5512; Awake the heartbeat thread when timetoNextHeartbeat is equal to 0

2017-07-21 Thread jgus
Repository: kafka Updated Branches: refs/heads/0.11.0 5819a364c -> c63919c27 KAFKA-5512; Awake the heartbeat thread when timetoNextHeartbeat is equal to 0 Author: Stephane Roset Reviewers: Ismael Juma , Jason Gustafson Closes #3442

kafka git commit: KAFKA-5512; Awake the heartbeat thread when timetoNextHeartbeat is equal to 0

2017-07-21 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk 08b775c32 -> 4a7064d1a KAFKA-5512; Awake the heartbeat thread when timetoNextHeartbeat is equal to 0 Author: Stephane Roset Reviewers: Ismael Juma , Jason Gustafson Closes #3442

kafka git commit: KAFKA-5490; Cleaner should retain empty batch if needed to preserve producer last sequence

2017-06-28 Thread jgus
Repository: kafka Updated Branches: refs/heads/0.11.0 ec5b22c8b -> 41fff32a4 KAFKA-5490; Cleaner should retain empty batch if needed to preserve producer last sequence Author: Jason Gustafson Reviewers: Ismael Juma , Guozhang Wang

kafka git commit: KAFKA-5490; Cleaner should retain empty batch if needed to preserve producer last sequence

2017-06-28 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk f05c70b06 -> cb0325d48 KAFKA-5490; Cleaner should retain empty batch if needed to preserve producer last sequence Author: Jason Gustafson Reviewers: Ismael Juma , Guozhang Wang ,

kafka git commit: KAFKA-5020; Update message format in implementation docs

2017-06-30 Thread jgus
Repository: kafka Updated Branches: refs/heads/0.11.0 d46513d2c -> ae170a6a1 KAFKA-5020; Update message format in implementation docs Author: Apurva Mehta Reviewers: Jason Gustafson Closes #3360 from apurvam/KAFKA-5020-message-format-docs-update

kafka git commit: KAFKA-5020; Update message format in implementation docs

2017-06-30 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk 17bdd4831 -> 647182207 KAFKA-5020; Update message format in implementation docs Author: Apurva Mehta Reviewers: Jason Gustafson Closes #3360 from apurvam/KAFKA-5020-message-format-docs-update

kafka git commit: MINOR: Improve TransactionIndex.sanityCheck() message

2017-06-29 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk dc95456f1 -> 27fdd46dc MINOR: Improve TransactionIndex.sanityCheck() message Author: Ismael Juma Reviewers: Jason Gustafson Closes #3446 from ijuma/improve-transaction-index-exception-sanity-check

kafka git commit: MINOR: Improve TransactionIndex.sanityCheck() message

2017-06-29 Thread jgus
Repository: kafka Updated Branches: refs/heads/0.11.0 8f7fd0716 -> ce1ca4ce1 MINOR: Improve TransactionIndex.sanityCheck() message Author: Ismael Juma Reviewers: Jason Gustafson Closes #3446 from ijuma/improve-transaction-index-exception-sanity-check

kafka git commit: KAFKA-5522; ListOffsets should bound timestamp search by LSO in read_committed

2017-06-30 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk 9c2de4920 -> 9238aeaa2 KAFKA-5522; ListOffsets should bound timestamp search by LSO in read_committed Author: Jason Gustafson Reviewers: Ismael Juma , Apurva Mehta , Guozhang

kafka git commit: KAFKA-5522; ListOffsets should bound timestamp search by LSO in read_committed

2017-06-30 Thread jgus
Repository: kafka Updated Branches: refs/heads/0.11.0 ae170a6a1 -> 793ccd85d KAFKA-5522; ListOffsets should bound timestamp search by LSO in read_committed Author: Jason Gustafson Reviewers: Ismael Juma , Apurva Mehta , Guozhang

kafka git commit: MINOR: Enable the TransactionsBounceTest

2017-06-28 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk efb060c57 -> f05c70b06 MINOR: Enable the TransactionsBounceTest I'll let this have multiple runs on the branch builder to see if it fails, and investigate if so. Author: Apurva Mehta Reviewers: Ismael Juma

kafka git commit: KAFKA-5108; Add support for reading PID snapshot files to DumpLogSegments

2017-04-26 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk d06f2cc7a -> 8d8ab2ebc KAFKA-5108; Add support for reading PID snapshot files to DumpLogSegments Author: Jason Gustafson Reviewers: Guozhang Wang Closes #2922 from hachikuji/KAFKA-5108 Project:

[2/2] kafka git commit: KAFKA-4208; Add Record Headers

2017-04-28 Thread jgus
KAFKA-4208; Add Record Headers As per KIP-82 Adding record headers api to ProducerRecord, ConsumerRecord Support to convert from protocol to api added Kafka Producer, Kafka Fetcher (Consumer) Updated MirrorMaker, ConsoleConsumer and scala BaseConsumer Add RecordHeaders and RecordHeader

kafka git commit: KAFKA-4379; Follow-up to avoid sending to changelog while restoring InMemoryLRUCache

2017-04-27 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk 6753af270 -> ee8c5e2dc KAFKA-4379; Follow-up to avoid sending to changelog while restoring InMemoryLRUCache 1. Added a flag to indicate if it is restoring or not in the LRU Store; since we only have a restore callback we have to set it

[3/3] kafka git commit: KAFKA-4818; Exactly once transactional clients

2017-04-27 Thread jgus
KAFKA-4818; Exactly once transactional clients Author: Apurva Mehta Reviewers: Guozhang Wang , Ismael Juma , Jason Gustafson Closes #2840 from apurvam/exactly-once-transactional-clients Project:

[1/3] kafka git commit: KAFKA-4818; Exactly once transactional clients

2017-04-27 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk bb663d04f -> a82f194b2 http://git-wip-us.apache.org/repos/asf/kafka/blob/a82f194b/clients/src/test/java/org/apache/kafka/clients/producer/internals/SenderTest.java -- diff

[2/3] kafka git commit: KAFKA-4818; Exactly once transactional clients

2017-04-27 Thread jgus
http://git-wip-us.apache.org/repos/asf/kafka/blob/a82f194b/clients/src/main/java/org/apache/kafka/clients/producer/internals/TransactionManager.java -- diff --git

kafka git commit: KAFKA-5097; Add testFetchAfterPartitionWithFetchedRecordsIsUnassigned

2017-04-28 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk a931e9954 -> f0152a7fd KAFKA-5097; Add testFetchAfterPartitionWithFetchedRecordsIsUnassigned I verified that the test would trigger an `IllegalStateException` if the `position` call was added back. Author: Ismael Juma

kafka git commit: KAFKA-5630; Consumer should block on corrupt records and keep throwing an exception

2017-08-01 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk da2205578 -> cd4c6c018 KAFKA-5630; Consumer should block on corrupt records and keep throwing an exception This patch handles the case that a CorruptRecordException is thrown from the iterator directly. The fix is a little tricky as

kafka git commit: KAFKA-5630; Consumer should block on corrupt records and keep throwing an exception

2017-08-01 Thread jgus
Repository: kafka Updated Branches: refs/heads/0.11.0 37ada7957 -> 86bfbd0ce KAFKA-5630; Consumer should block on corrupt records and keep throwing an exception This patch handles the case that a CorruptRecordException is thrown from the iterator directly. The fix is a little tricky as

kafka git commit: MINOR: Request log should be enabled by debug level

2017-08-01 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk cd4c6c018 -> 4086db472 MINOR: Request log should be enabled by debug level At some point, we lost the ability to output request logging at debug level (which is a little less verbose than at trace level). Author: Ismael Juma

kafka git commit: MINOR: Request log should be enabled by debug level

2017-08-01 Thread jgus
Repository: kafka Updated Branches: refs/heads/0.11.0 86bfbd0ce -> 7e0ec9c76 MINOR: Request log should be enabled by debug level At some point, we lost the ability to output request logging at debug level (which is a little less verbose than at trace level). Author: Ismael Juma

kafka git commit: KAFKA-5629; ConsoleConsumer should respect auto.offset.reset if specified on the command line

2017-08-09 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk c35c47981 -> 1ad74f5b7 KAFKA-5629; ConsoleConsumer should respect auto.offset.reset if specified on the command line when "auto.offset.reset" property is specified on the command line but overridden by the code during startup. Currently

kafka git commit: KAFKA-5730; Consumer should invoke async commit callback before sync commit returns

2017-08-17 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk efe4f6540 -> 334a30bcf KAFKA-5730; Consumer should invoke async commit callback before sync commit returns Author: Jason Gustafson Reviewers: Randall Hauch , Ewen Cheslack-Postava

kafka git commit: KAFKA-5160; KIP-98 Broker side support for TxnOffsetCommitRequest

2017-05-12 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk da0b5b859 -> 7258a5fdd KAFKA-5160; KIP-98 Broker side support for TxnOffsetCommitRequest This patch adds support for the `TxnOffsetCommitRequest` added in KIP-98. Desired handling for this request is [described

[2/2] kafka git commit: MINOR: Rename InitPidRequest/InitPidResponse to InitProducerIdRequest/InitProducerIdResponse

2017-05-12 Thread jgus
MINOR: Rename InitPidRequest/InitPidResponse to InitProducerIdRequest/InitProducerIdResponse Author: Jason Gustafson Reviewers: Guozhang Wang Closes #2997 from hachikuji/minor-rename-initpid Project: http://git-wip-us.apache.org/repos/asf/kafka/repo

kafka git commit: HOTFIX: Increase kafkatest startup wait time on ConnectDistributed service

2017-05-09 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk c69842336 -> 8ace736f7 HOTFIX: Increase kafkatest startup wait time on ConnectDistributed service Author: Konstantine Karantasis Reviewers: Magesh Nandakumar , Jason Gustafson

kafka git commit: HOTFIX: Increase kafkatest startup wait time on ConnectDistributed service in 0.10.2

2017-05-09 Thread jgus
Repository: kafka Updated Branches: refs/heads/0.10.2 0e8b08477 -> bce189fa4 HOTFIX: Increase kafkatest startup wait time on ConnectDistributed service in 0.10.2 Author: Konstantine Karantasis Reviewers: Jason Gustafson Closes #3007 from

kafka git commit: HOTFIX: AddOffsetsToTxnResponse using incorrect schema in parse

2017-05-15 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk a511a4702 -> 82e84fabf HOTFIX: AddOffsetsToTxnResponse using incorrect schema in parse The parse method was incorrectly referring to `ApiKeys.ADD_PARTITIONS_TO_TXN` Author: Damian Guy Reviewers: Ismael Juma

kafka git commit: MINOR: Eliminate PID terminology from non test code

2017-05-15 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk e40e27b4e -> 3e6669000 MINOR: Eliminate PID terminology from non test code Producer id is used instead. Also refactored TransactionLog schema code to follow our naming convention and to have better structure. Author: Ismael Juma

[2/2] kafka git commit: KAFKA-2273; Sticky partition assignment strategy (KIP-54)

2017-05-17 Thread jgus
KAFKA-2273; Sticky partition assignment strategy (KIP-54) This PR implements a new partition assignment strategy called "sticky", and it's purpose is to balance partitions across consumers in a way that minimizes moving partitions around, or, in other words, preserves existing partition

kafka git commit: KAFKA-5248; Remove unused/unneeded retention time in TxnOffsetCommitRequest

2017-05-15 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk c26545ea5 -> 018679410 KAFKA-5248; Remove unused/unneeded retention time in TxnOffsetCommitRequest Author: Jason Gustafson Reviewers: Guozhang Wang , Apurva Mehta , Ismael Juma

kafka git commit: KAFKA-4714; Flatten and Cast single message transforms (KIP-66)

2017-05-17 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk ebc7f7caa -> 1cea4d8f5 KAFKA-4714; Flatten and Cast single message transforms (KIP-66) Author: Ewen Cheslack-Postava Reviewers: Konstantine Karantasis , Shikhar Bhushan ,

kafka git commit: KAFKA-5129; Add ACL checks for Transactional APIs

2017-05-16 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk a281fe17f -> d66e7af65 KAFKA-5129; Add ACL checks for Transactional APIs Add ACL checks for Transactional APIs Author: Damian Guy Reviewers: Apurva Mehta , Ismael Juma ,

kafka git commit: KAFKA-5252; Fix transient failures LogCleanerTest testCommitMarkerRemoval and testAbortMarkerRemoval

2017-05-15 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk dd9f43140 -> cacbba651 KAFKA-5252; Fix transient failures LogCleanerTest testCommitMarkerRemoval and testAbortMarkerRemoval Author: Jason Gustafson Reviewers: Apurva Mehta , Guozhang Wang

kafka git commit: MINOR: Fix consumer and producer to actually support metrics recording level

2017-05-12 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk 495184916 -> 1c2bbaa50 MINOR: Fix consumer and producer to actually support metrics recording level Also add tests and a few clean-ups. Author: Ismael Juma Reviewers: Eno Thereska , Jason

[2/2] kafka git commit: KAFKA-5196; Make LogCleaner transaction-aware

2017-05-12 Thread jgus
KAFKA-5196; Make LogCleaner transaction-aware Author: Jason Gustafson Reviewers: Jun Rao Closes #3008 from hachikuji/KAFKA-5196 Project: http://git-wip-us.apache.org/repos/asf/kafka/repo Commit:

[1/2] kafka git commit: KAFKA-5196; Make LogCleaner transaction-aware

2017-05-12 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk 1c2bbaa50 -> 7baa58d79 http://git-wip-us.apache.org/repos/asf/kafka/blob/7baa58d7/core/src/test/scala/unit/kafka/log/LogTest.scala -- diff --git

kafka git commit: KAFKA-5422; Handle multiple transitions to ABORTABLE_ERROR correctly

2017-06-09 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk 2af4dd865 -> 8e7839f61 KAFKA-5422; Handle multiple transitions to ABORTABLE_ERROR correctly Author: Apurva Mehta Reviewers: Jason Gustafson Closes #3285 from

kafka git commit: KAFKA-5422; Handle multiple transitions to ABORTABLE_ERROR correctly

2017-06-09 Thread jgus
Repository: kafka Updated Branches: refs/heads/0.11.0 b8b493091 -> 2af69cc6e KAFKA-5422; Handle multiple transitions to ABORTABLE_ERROR correctly Author: Apurva Mehta Reviewers: Jason Gustafson Closes #3285 from

kafka git commit: KAFKA-5415; Remove timestamp check in completeTransitionTo

2017-06-09 Thread jgus
Repository: kafka Updated Branches: refs/heads/0.11.0 2af69cc6e -> 50b20d2d3 KAFKA-5415; Remove timestamp check in completeTransitionTo This assertion is hard to get right because the system time can roll backward on a host due to NTP (as shown in the ticket), and also because a transaction

kafka git commit: KAFKA-5415; Remove timestamp check in completeTransitionTo

2017-06-09 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk 8e7839f61 -> 1e03b7118 KAFKA-5415; Remove timestamp check in completeTransitionTo This assertion is hard to get right because the system time can roll backward on a host due to NTP (as shown in the ticket), and also because a transaction

kafka git commit: KAFKA-5414; Revert KAFKA-5327 which changed ConsoleConsumer offset commit behavior

2017-06-08 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk 88aec3eb6 -> 5d7c8cc81 KAFKA-5414; Revert KAFKA-5327 which changed ConsoleConsumer offset commit behavior This reverts commit d7d1196a0b542adb46d22eeb5b6d12af950b64c9. Author: Jason Gustafson Reviewers: Ismael Juma

kafka git commit: KAFKA-5414; Revert KAFKA-5327 which changed ConsoleConsumer offset commit behavior

2017-06-08 Thread jgus
Repository: kafka Updated Branches: refs/heads/0.11.0 bf4886611 -> 8482e1c73 KAFKA-5414; Revert KAFKA-5327 which changed ConsoleConsumer offset commit behavior This reverts commit d7d1196a0b542adb46d22eeb5b6d12af950b64c9. Author: Jason Gustafson Reviewers: Ismael Juma

kafka git commit: KAFKA-5416; TC should not reset pending state if log append is retried

2017-06-12 Thread jgus
Repository: kafka Updated Branches: refs/heads/0.11.0 26c6a0715 -> f6bcb8472 KAFKA-5416; TC should not reset pending state if log append is retried In `TransationStateManager`, we reset the pending state if an error occurred while appending to log; this is correct except that for the

kafka git commit: MINOR: A few cleanups of usage of Either in TC

2017-06-12 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk d06a0db8b -> 2724053ad MINOR: A few cleanups of usage of Either in TC Author: Jason Gustafson Reviewers: Guozhang Wang , Ismael Juma Closes #3284 from

kafka git commit: KAFKA-5427; Transactional producer should allow FindCoordinator in error state

2017-06-12 Thread jgus
Repository: kafka Updated Branches: refs/heads/0.11.0 ad75a2fa1 -> 0827d2129 KAFKA-5427; Transactional producer should allow FindCoordinator in error state Author: Jason Gustafson Reviewers: Ismael Juma , Apurva Mehta , Guozhang

kafka git commit: MINOR: A few cleanups of usage of Either in TC

2017-06-12 Thread jgus
Repository: kafka Updated Branches: refs/heads/0.11.0 e5109d2d8 -> ad75a2fa1 MINOR: A few cleanups of usage of Either in TC Author: Jason Gustafson Reviewers: Guozhang Wang , Ismael Juma Closes #3284 from

kafka git commit: KAFKA-5437; Always send a sig_kill when cleaning the message copier

2017-06-12 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk 43e935a63 -> 0f3f2f56a KAFKA-5437; Always send a sig_kill when cleaning the message copier When the message copier hangs (like when there is a bug in the client), it ignores the sigterm and doesn't shut down. this leaves the cluster in an

kafka git commit: KAFKA-5437; Always send a sig_kill when cleaning the message copier

2017-06-12 Thread jgus
Repository: kafka Updated Branches: refs/heads/0.11.0 0827d2129 -> 076eefcc6 KAFKA-5437; Always send a sig_kill when cleaning the message copier When the message copier hangs (like when there is a bug in the client), it ignores the sigterm and doesn't shut down. this leaves the cluster in an

kafka git commit: KAFKA-5429; Ignore produce response if batch was previously aborted

2017-06-12 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk 0f3f2f56a -> 6c92fc557 KAFKA-5429; Ignore produce response if batch was previously aborted Author: Jason Gustafson Reviewers: Apurva Mehta , Ismael Juma Closes #3300 from

kafka git commit: KAFKA-5428; Transactional producer should only abort batches in fatal error state

2017-06-12 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk 6c92fc557 -> aea53108a KAFKA-5428; Transactional producer should only abort batches in fatal error state Author: Jason Gustafson Reviewers: Apurva Mehta , Ismael Juma Closes

kafka git commit: KAFKA-5428; Transactional producer should only abort batches in fatal error state

2017-06-12 Thread jgus
Repository: kafka Updated Branches: refs/heads/0.11.0 886a41d62 -> ad74035d5 KAFKA-5428; Transactional producer should only abort batches in fatal error state Author: Jason Gustafson Reviewers: Apurva Mehta , Ismael Juma Closes

kafka git commit: KAFKA-5021; Update delivery semantics documentation for EoS (KIP-98)

2017-06-20 Thread jgus
Repository: kafka Updated Branches: refs/heads/0.11.0 089cd5c84 -> 83edf3f6f KAFKA-5021; Update delivery semantics documentation for EoS (KIP-98) Author: Jason Gustafson Reviewers: Apurva Mehta , Ismael Juma , Guozhang Wang

kafka git commit: KAFKA-5021; Update delivery semantics documentation for EoS (KIP-98)

2017-06-20 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk f28fc1100 -> cb3952a4f KAFKA-5021; Update delivery semantics documentation for EoS (KIP-98) Author: Jason Gustafson Reviewers: Apurva Mehta , Ismael Juma , Guozhang Wang

kafka git commit: MINOR: Add Processing Guarantees to Streams docs

2017-06-20 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk 491774bd5 -> f28fc1100 MINOR: Add Processing Guarantees to Streams docs Author: Guozhang Wang Reviewers: Apurva Mehta , Matthias J. Sax , Jason Gustafson

kafka git commit: MINOR: Add Processing Guarantees to Streams docs

2017-06-20 Thread jgus
Repository: kafka Updated Branches: refs/heads/0.11.0 028b939da -> 089cd5c84 MINOR: Add Processing Guarantees to Streams docs Author: Guozhang Wang Reviewers: Apurva Mehta , Matthias J. Sax , Jason Gustafson

kafka git commit: MINOR: MemoryRecordsBuilder.sizeInBytes should consider initial position

2017-06-20 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk ffa810045 -> 54205697a MINOR: MemoryRecordsBuilder.sizeInBytes should consider initial position Author: Jason Gustafson Reviewers: Ismael Juma Closes #3376 from

kafka git commit: KAFKA-5290; Docs need clarification on meaning of 'committed' to the log

2017-06-20 Thread jgus
Repository: kafka Updated Branches: refs/heads/0.11.0 57181bb77 -> 028b939da KAFKA-5290; Docs need clarification on meaning of 'committed' to the log based on conversations with vahidhashemian rajinisivaram apurvam The docs didn't make clear that what gets committed and what gets not may

kafka git commit: KAFKA-5290; Docs need clarification on meaning of 'committed' to the log

2017-06-20 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk 54205697a -> 491774bd5 KAFKA-5290; Docs need clarification on meaning of 'committed' to the log based on conversations with vahidhashemian rajinisivaram apurvam The docs didn't make clear that what gets committed and what gets not may

kafka git commit: MINOR: Detail message/batch size implications for conversion between old and new formats

2017-06-21 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk f848e2cd6 -> e6e263174 MINOR: Detail message/batch size implications for conversion between old and new formats Author: Jason Gustafson Reviewers: Ismael Juma Closes #3373 from

kafka git commit: MINOR: Detail message/batch size implications for conversion between old and new formats

2017-06-21 Thread jgus
Repository: kafka Updated Branches: refs/heads/0.11.0 f239f1f83 -> 9aef218f0 MINOR: Detail message/batch size implications for conversion between old and new formats Author: Jason Gustafson Reviewers: Ismael Juma Closes #3373 from

kafka git commit: KAFKA-5477; Lower retry backoff for first AddPartitions in transaction

2017-06-21 Thread jgus
Repository: kafka Updated Branches: refs/heads/0.11.0 186e3d5ef -> f239f1f83 KAFKA-5477; Lower retry backoff for first AddPartitions in transaction This patch lowers the retry backoff when receiving a CONCURRENT_TRANSACTIONS error from an AddPartitions request. The default of 100ms would

kafka git commit: KAFKA-5477; Lower retry backoff for first AddPartitions in transaction

2017-06-21 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk 55a90938a -> 254add953 KAFKA-5477; Lower retry backoff for first AddPartitions in transaction This patch lowers the retry backoff when receiving a CONCURRENT_TRANSACTIONS error from an AddPartitions request. The default of 100ms would mean

kafka git commit: MINOR: SaslChannelBuilder should be idempotent

2017-06-23 Thread jgus
Repository: kafka Updated Branches: refs/heads/0.11.0 89e0ae7dc -> 8abac1984 MINOR: SaslChannelBuilder should be idempotent After we call `release`, we should null out the reference so that we neither use it or release it a second time. This should fix the following exception that has been

kafka git commit: MINOR: SaslChannelBuilder should be idempotent

2017-06-23 Thread jgus
Repository: kafka Updated Branches: refs/heads/trunk b49036873 -> d65844b52 MINOR: SaslChannelBuilder should be idempotent After we call `release`, we should null out the reference so that we neither use it or release it a second time. This should fix the following exception that has been

<    1   2   3   4   5   6   7   8   9   10   >