[GitHub] kafka pull request #4319: [WIP] KAFKA-5142: Add Connect support for message ...

2017-12-12 Thread rhauch
GitHub user rhauch opened a pull request: https://github.com/apache/kafka/pull/4319 [WIP] KAFKA-5142: Add Connect support for message headers (KIP-145) *NEW PROPOSAL FOR KIP-145... DO NOT MERGE* Changed the Connect API and runtime to support message headers as described in

[GitHub] kafka pull request #4296: KAFKA-6313: Add SLF4J as direct dependency to Kafk...

2017-12-06 Thread rhauch
GitHub user rhauch opened a pull request: https://github.com/apache/kafka/pull/4296 KAFKA-6313: Add SLF4J as direct dependency to Kafka core Recent changes are now directly using the SLF4J API, so we should have a direct dependency. ### Committer Checklist (excluded from

[GitHub] kafka pull request #4077: KAFKA-5142: Added support for record headers, reus...

2017-10-16 Thread rhauch
GitHub user rhauch opened a pull request: https://github.com/apache/kafka/pull/4077 KAFKA-5142: Added support for record headers, reusing Kafka client's interfaces *This is still a work in progress and should not be merged.* This is a proposed PR that implements mo

[GitHub] kafka pull request #4011: KAFKA-5903: Added Connect metrics to the worker an...

2017-10-03 Thread rhauch
GitHub user rhauch opened a pull request: https://github.com/apache/kafka/pull/4011 KAFKA-5903: Added Connect metrics to the worker and distributed herder Added metrics to the Connect worker and rebalancing metrics to the distributed herder. This is built on top of #3987

[GitHub] kafka pull request #3987: KAFKA-5990: Enable generation of metrics docs for ...

2017-09-28 Thread rhauch
GitHub user rhauch opened a pull request: https://github.com/apache/kafka/pull/3987 KAFKA-5990: Enable generation of metrics docs for Connect A new mechanism was added recently to the Metrics framework to make it easier to generate the documentation. It uses a registry with a

[GitHub] kafka pull request #3985: KAFKA-5987: Maintain order of metric tags in gener...

2017-09-28 Thread rhauch
GitHub user rhauch opened a pull request: https://github.com/apache/kafka/pull/3985 KAFKA-5987: Maintain order of metric tags in generated documentation The `MetricNameTemplate` is changed to used a `LinkedHashSet` to maintain the same order of the tags that are passed in. This tag

[GitHub] kafka pull request #3975: KAFKA-5902 Added sink task metrics

2017-09-27 Thread rhauch
GitHub user rhauch opened a pull request: https://github.com/apache/kafka/pull/3975 KAFKA-5902 Added sink task metrics Added Connect metrics specific to source tasks, and builds upon #3864 and #3911 that have already been merged into `trunk`, and #3959 that has yet to be merged

[GitHub] kafka pull request #3959: KAFKA-5901 Added Connect metrics specific to sourc...

2017-09-25 Thread rhauch
GitHub user rhauch opened a pull request: https://github.com/apache/kafka/pull/3959 KAFKA-5901 Added Connect metrics specific to source tasks Added Connect metrics specific to source tasks. This PR is built on top of #3911, and when that is merged this can be rebased and merged

[GitHub] kafka pull request #3934: KAFKA-5954 Correct Connect REST API system test

2017-09-21 Thread rhauch
GitHub user rhauch opened a pull request: https://github.com/apache/kafka/pull/3934 KAFKA-5954 Correct Connect REST API system test You can merge this pull request into a Git repository by running: $ git pull https://github.com/rhauch/kafka kafka-5954 Alternatively you can

[GitHub] kafka pull request #3911: Kafka 5900

2017-09-19 Thread rhauch
GitHub user rhauch opened a pull request: https://github.com/apache/kafka/pull/3911 Kafka 5900 You can merge this pull request into a Git repository by running: $ git pull https://github.com/rhauch/kafka kafka-5900 Alternatively you can review and apply these changes as the

[GitHub] kafka pull request #3864: KAFKA-5899 Added Connect metrics for connectors

2017-09-14 Thread rhauch
GitHub user rhauch opened a pull request: https://github.com/apache/kafka/pull/3864 KAFKA-5899 Added Connect metrics for connectors Added metrics for each connector using Kafka’s existing `Metrics` framework. Since this is the first of several changes to add several groups of

[GitHub] kafka pull request #3774: MINOR: Increase timeout of Zookeeper service in sy...

2017-08-31 Thread rhauch
GitHub user rhauch opened a pull request: https://github.com/apache/kafka/pull/3774 MINOR: Increase timeout of Zookeeper service in system tests The previous timeout was 10 seconds, but system test failures have occurred when Zookeeper has started after about 11 seconds. Increasing

[GitHub] kafka pull request #3717: KAFKA-5731 Corrected how the sink task worker upda...

2017-08-22 Thread rhauch
Github user rhauch closed the pull request at: https://github.com/apache/kafka/pull/3717 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #3717: KAFKA-5731 Corrected how the sink task worker upda...

2017-08-22 Thread rhauch
GitHub user rhauch opened a pull request: https://github.com/apache/kafka/pull/3717 KAFKA-5731 Corrected how the sink task worker updates the last committed offsets (0.10.2) Prior to this change, it was possible for the synchronous consumer commit request to be handled before

[GitHub] kafka pull request #3672: KAFKA-5731 Corrected how the sink task worker upda...

2017-08-15 Thread rhauch
Github user rhauch closed the pull request at: https://github.com/apache/kafka/pull/3672 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #3672: KAFKA-5731 Corrected how the sink task worker upda...

2017-08-15 Thread rhauch
GitHub user rhauch opened a pull request: https://github.com/apache/kafka/pull/3672 KAFKA-5731 Corrected how the sink task worker updates the last committed offsets (0.11.0) Prior to this change, it was possible for the synchronous consumer commit request to be handled before

[GitHub] kafka pull request #3662: KAFKA-5731 Corrected how the sink task worker upda...

2017-08-13 Thread rhauch
GitHub user rhauch opened a pull request: https://github.com/apache/kafka/pull/3662 KAFKA-5731 Corrected how the sink task worker updates the last committed offsets Prior to this change, it was possible for the synchronous consumer commit request to be handled before previously

[GitHub] kafka pull request #3641: KAFKA-5704 Corrected Connect distributed startup b...

2017-08-07 Thread rhauch
GitHub user rhauch opened a pull request: https://github.com/apache/kafka/pull/3641 KAFKA-5704 Corrected Connect distributed startup behavior to allow older brokers to auto-create topics When a Connect distributed worker starts up talking with broker versions 0.10.1.0 and later

[GitHub] kafka pull request #3563: Added safe deserialization impl

2017-07-21 Thread rhauch
GitHub user rhauch opened a pull request: https://github.com/apache/kafka/pull/3563 Added safe deserialization impl You can merge this pull request into a Git repository by running: $ git pull https://github.com/rhauch/kafka deserialization-validation Alternatively you can

[GitHub] kafka pull request #3379: KAFKA-5472 Eliminated duplicate group names when v...

2017-06-19 Thread rhauch
GitHub user rhauch opened a pull request: https://github.com/apache/kafka/pull/3379 KAFKA-5472 Eliminated duplicate group names when validating connector results Kafka Connect was adding duplicate group names in the response from the REST API's validation of conn

[GitHub] kafka pull request #3344: KAFKA-5450 Increased timeout of Connect system tes...

2017-06-14 Thread rhauch
GitHub user rhauch opened a pull request: https://github.com/apache/kafka/pull/3344 KAFKA-5450 Increased timeout of Connect system test utilities Increased the timeout from 30sec to 60sec. When running the system tests with packaged Kafka, Connect workers can take about 30seconds

[GitHub] kafka pull request #3198: KAFKA-5164 Ensure SetSchemaMetadata updates key or...

2017-06-01 Thread rhauch
GitHub user rhauch opened a pull request: https://github.com/apache/kafka/pull/3198 KAFKA-5164 Ensure SetSchemaMetadata updates key or value when Schema changes When the `SetSchemaMetadata` SMT is used to change the name and/or version of the key or value’s schema, any references

[GitHub] kafka pull request #2984: KAFKA-4667 Connect uses AdminClient to create inte...

2017-05-05 Thread rhauch
GitHub user rhauch opened a pull request: https://github.com/apache/kafka/pull/2984 KAFKA-4667 Connect uses AdminClient to create internal topics when needed The backing store for offsets, status, and configs now attempts to use the new AdminClient to look up the internal topics

[GitHub] kafka pull request #1871: KAFKA-4183 Corrected Kafka Connect's JSON Converte...

2016-09-16 Thread rhauch
GitHub user rhauch opened a pull request: https://github.com/apache/kafka/pull/1871 KAFKA-4183 Corrected Kafka Connect's JSON Converter to properly convert from null to logical values The `JsonConverter` class has `LogicalTypeConverter` implementations for Date, Time, Time

[GitHub] kafka pull request #1867: KAFKA-4183 Corrected Kafka Connect's JSON Converte...

2016-09-16 Thread rhauch
GitHub user rhauch opened a pull request: https://github.com/apache/kafka/pull/1867 KAFKA-4183 Corrected Kafka Connect's JSON Converter to properly convert from null to logical values The `JsonConverter` class has `LogicalTypeConverter` implementations for Date, Time, Time

[GitHub] kafka pull request: KAFKA-2649 Add support for custom partitioning...

2015-10-14 Thread rhauch
GitHub user rhauch opened a pull request: https://github.com/apache/kafka/pull/309 KAFKA-2649 Add support for custom partitioning in topology sinks Added option to use custom partitioning logic within each topology sink. You can merge this pull request into a Git repository by

[GitHub] kafka pull request: KAFKA-2600 Align Kafka Streams' interfaces wit...

2015-10-01 Thread rhauch
GitHub user rhauch opened a pull request: https://github.com/apache/kafka/pull/270 KAFKA-2600 Align Kafka Streams' interfaces with Java 8 functional interfaces A few of Kafka Stream's interfaces and classes are not as well-aligned with Java 8's functional interf

[GitHub] kafka pull request: KAFKA-2597: Add to .gitignore the Eclipse IDE ...

2015-09-28 Thread rhauch
GitHub user rhauch opened a pull request: https://github.com/apache/kafka/pull/259 KAFKA-2597: Add to .gitignore the Eclipse IDE directories The ` .metadata` and `.recommenders` keep IDE workspace state and should not be committed. You can merge this pull request into a Git

[GitHub] kafka pull request: KAFKA-2594 Added InMemoryLRUCacheStore

2015-09-28 Thread rhauch
GitHub user rhauch opened a pull request: https://github.com/apache/kafka/pull/256 KAFKA-2594 Added InMemoryLRUCacheStore Added a new `KeyValueStore` implementation called `InMemoryLRUCacheStore` that keeps a maximum number of entries in-memory, and as the size exceeds the

[GitHub] kafka pull request: KAFKA-2593 Key value stores can use specified ...

2015-09-28 Thread rhauch
GitHub user rhauch opened a pull request: https://github.com/apache/kafka/pull/255 KAFKA-2593 Key value stores can use specified serializers and deserializers Add support for the key value stores to use specified serializers and deserializers (aka, "serdes"). Prior to t