[jira] [Commented] (KAFKA-2472) Fix kafka ssl configs to not throw warnings
[ https://issues.apache.org/jira/browse/KAFKA-2472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14972684#comment-14972684 ] ASF GitHub Bot commented on KAFKA-2472: --- GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/355 KAFKA-2472; Fix capitalisation in SSL classes You can merge this pull request into a Git repository by running: $ git pull https://github.com/ijuma/kafka kafka-2460-fix-capitalisation-in-ssl-classes Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/355.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #355 commit 9bbf8b701f13f0b4ea8df842b46cab29002033be Author: Ismael Juma Date: 2015-10-24T16:24:18Z Fix capitalisation in SSL classes > Fix kafka ssl configs to not throw warnings > --- > > Key: KAFKA-2472 > URL: https://issues.apache.org/jira/browse/KAFKA-2472 > Project: Kafka > Issue Type: Bug >Reporter: Sriharsha Chintalapani >Assignee: Ismael Juma > Fix For: 0.9.0.0 > > > This is a follow-up fix on kafka-1690. > [2015-08-25 18:20:48,236] WARN The configuration ssl.truststore.password = > striker was supplied but isn't a known config. > (org.apache.kafka.clients.producer.ProducerConfig) > [2015-08-25 18:20:48,236] WARN The configuration security.protocol = SSL was > supplied but isn't a known config. > (org.apache.kafka.clients.producer.ProducerConfig) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2472) Fix kafka ssl configs to not throw warnings
[ https://issues.apache.org/jira/browse/KAFKA-2472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965373#comment-14965373 ] Ismael Juma commented on KAFKA-2472: [~jkreps], good point regarding Partitioner and other public classes. That's a problem for the approach I suggested. Without default methods, it seems like we can't change `Configurable`. We could introduce a new interface and use it in new classes and classes that are not public, but it's not great to have two interfaces for the same thing. An alternative is to pass to a special Map implementation to `configure` that records usage. It still means that we can't use the nicer `Config` API, but that is no worse than what we have today. > Fix kafka ssl configs to not throw warnings > --- > > Key: KAFKA-2472 > URL: https://issues.apache.org/jira/browse/KAFKA-2472 > Project: Kafka > Issue Type: Bug >Reporter: Sriharsha Chintalapani >Assignee: Ismael Juma > Fix For: 0.9.0.0 > > > This is a follow-up fix on kafka-1690. > [2015-08-25 18:20:48,236] WARN The configuration ssl.truststore.password = > striker was supplied but isn't a known config. > (org.apache.kafka.clients.producer.ProducerConfig) > [2015-08-25 18:20:48,236] WARN The configuration security.protocol = SSL was > supplied but isn't a known config. > (org.apache.kafka.clients.producer.ProducerConfig) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2472) Fix kafka ssl configs to not throw warnings
[ https://issues.apache.org/jira/browse/KAFKA-2472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965348#comment-14965348 ] Jay Kreps commented on KAFKA-2472: -- [~gwenshap] This should work with plugins too. The config helper code records which configs are requested, so even a config specific to a plugin like a serializer should still get requested by the serializer. [~ijuma] The only thing to be careful of is that if we are changing the Configurable interface that that doesn't result in changing any public interfaces people have implemented such as Partitioner. > Fix kafka ssl configs to not throw warnings > --- > > Key: KAFKA-2472 > URL: https://issues.apache.org/jira/browse/KAFKA-2472 > Project: Kafka > Issue Type: Bug >Reporter: Sriharsha Chintalapani >Assignee: Ismael Juma > Fix For: 0.9.0.0 > > > This is a follow-up fix on kafka-1690. > [2015-08-25 18:20:48,236] WARN The configuration ssl.truststore.password = > striker was supplied but isn't a known config. > (org.apache.kafka.clients.producer.ProducerConfig) > [2015-08-25 18:20:48,236] WARN The configuration security.protocol = SSL was > supplied but isn't a known config. > (org.apache.kafka.clients.producer.ProducerConfig) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2472) Fix kafka ssl configs to not throw warnings
[ https://issues.apache.org/jira/browse/KAFKA-2472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965052#comment-14965052 ] Ismael Juma commented on KAFKA-2472: I did a quick spike: * Introduced a `Config` interface with the `get*` methods * Changed `Configurable.configure` to take the `Config` interface * Introduced `SimpleConfig` that just wraps a `Map` for tests and code that doesn't use a `ConfigDef` * Adapted all the code so that it compiles * Ran the tests It looks promising. There were some test failures, I investigated one and it was due to a genuine bug in trunk (there is no `define` for KafkaConfig.SSLEndpointIdentificationAlgorithmProp in the broker). Thoughts? > Fix kafka ssl configs to not throw warnings > --- > > Key: KAFKA-2472 > URL: https://issues.apache.org/jira/browse/KAFKA-2472 > Project: Kafka > Issue Type: Bug >Reporter: Sriharsha Chintalapani >Assignee: Ismael Juma > Fix For: 0.9.0.0 > > > This is a follow-up fix on kafka-1690. > [2015-08-25 18:20:48,236] WARN The configuration ssl.truststore.password = > striker was supplied but isn't a known config. > (org.apache.kafka.clients.producer.ProducerConfig) > [2015-08-25 18:20:48,236] WARN The configuration security.protocol = SSL was > supplied but isn't a known config. > (org.apache.kafka.clients.producer.ProducerConfig) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2472) Fix kafka ssl configs to not throw warnings
[ https://issues.apache.org/jira/browse/KAFKA-2472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964788#comment-14964788 ] Ismael Juma commented on KAFKA-2472: [~junrao], the reason why we have the warnings is that we are passing a Map to the various `configure` methods and we do that by calling `AbstractConfig.values()`. This means that the usage of the parameters is never recorded and we also have to cast instead of using the nicer `get{String, Int, ...}` methods. And we also have `KafkaConfig.channelConfigs` where we must remember to add the relevant configs (which is error-prone). Is there a reason why the `configure` methods can't accept an `AbstractConfig` instead of `Map`? > Fix kafka ssl configs to not throw warnings > --- > > Key: KAFKA-2472 > URL: https://issues.apache.org/jira/browse/KAFKA-2472 > Project: Kafka > Issue Type: Bug >Reporter: Sriharsha Chintalapani >Assignee: Ismael Juma > Fix For: 0.9.0.0 > > > This is a follow-up fix on kafka-1690. > [2015-08-25 18:20:48,236] WARN The configuration ssl.truststore.password = > striker was supplied but isn't a known config. > (org.apache.kafka.clients.producer.ProducerConfig) > [2015-08-25 18:20:48,236] WARN The configuration security.protocol = SSL was > supplied but isn't a known config. > (org.apache.kafka.clients.producer.ProducerConfig) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2472) Fix kafka ssl configs to not throw warnings
[ https://issues.apache.org/jira/browse/KAFKA-2472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963229#comment-14963229 ] Ismael Juma commented on KAFKA-2472: Thank you. > Fix kafka ssl configs to not throw warnings > --- > > Key: KAFKA-2472 > URL: https://issues.apache.org/jira/browse/KAFKA-2472 > Project: Kafka > Issue Type: Bug >Reporter: Sriharsha Chintalapani >Assignee: Ismael Juma > Fix For: 0.9.0.0 > > > This is a follow-up fix on kafka-1690. > [2015-08-25 18:20:48,236] WARN The configuration ssl.truststore.password = > striker was supplied but isn't a known config. > (org.apache.kafka.clients.producer.ProducerConfig) > [2015-08-25 18:20:48,236] WARN The configuration security.protocol = SSL was > supplied but isn't a known config. > (org.apache.kafka.clients.producer.ProducerConfig) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2472) Fix kafka ssl configs to not throw warnings
[ https://issues.apache.org/jira/browse/KAFKA-2472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963213#comment-14963213 ] Sriharsha Chintalapani commented on KAFKA-2472: --- [~ijuma] No worries. Take it over. > Fix kafka ssl configs to not throw warnings > --- > > Key: KAFKA-2472 > URL: https://issues.apache.org/jira/browse/KAFKA-2472 > Project: Kafka > Issue Type: Bug >Reporter: Sriharsha Chintalapani >Assignee: Sriharsha Chintalapani > Fix For: 0.9.0.0 > > > This is a follow-up fix on kafka-1690. > [2015-08-25 18:20:48,236] WARN The configuration ssl.truststore.password = > striker was supplied but isn't a known config. > (org.apache.kafka.clients.producer.ProducerConfig) > [2015-08-25 18:20:48,236] WARN The configuration security.protocol = SSL was > supplied but isn't a known config. > (org.apache.kafka.clients.producer.ProducerConfig) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2472) Fix kafka ssl configs to not throw warnings
[ https://issues.apache.org/jira/browse/KAFKA-2472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963188#comment-14963188 ] Ismael Juma commented on KAFKA-2472: [~harsha_ch], do you mind if I take this? > Fix kafka ssl configs to not throw warnings > --- > > Key: KAFKA-2472 > URL: https://issues.apache.org/jira/browse/KAFKA-2472 > Project: Kafka > Issue Type: Bug >Reporter: Sriharsha Chintalapani >Assignee: Sriharsha Chintalapani > Fix For: 0.9.0.0 > > > This is a follow-up fix on kafka-1690. > [2015-08-25 18:20:48,236] WARN The configuration ssl.truststore.password = > striker was supplied but isn't a known config. > (org.apache.kafka.clients.producer.ProducerConfig) > [2015-08-25 18:20:48,236] WARN The configuration security.protocol = SSL was > supplied but isn't a known config. > (org.apache.kafka.clients.producer.ProducerConfig) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2472) Fix kafka ssl configs to not throw warnings
[ https://issues.apache.org/jira/browse/KAFKA-2472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14726338#comment-14726338 ] Jun Rao commented on KAFKA-2472: The original intention is to warn people of mis-spelled config names. Also, we are only supposed to log those unused properties as warning and we do that (config.logUnused()) at the end of the instantiation of the producer. So, not sure why those warning will show up. > Fix kafka ssl configs to not throw warnings > --- > > Key: KAFKA-2472 > URL: https://issues.apache.org/jira/browse/KAFKA-2472 > Project: Kafka > Issue Type: Bug >Reporter: Sriharsha Chintalapani >Assignee: Sriharsha Chintalapani > Fix For: 0.8.3 > > > This is a follow-up fix on kafka-1690. > [2015-08-25 18:20:48,236] WARN The configuration ssl.truststore.password = > striker was supplied but isn't a known config. > (org.apache.kafka.clients.producer.ProducerConfig) > [2015-08-25 18:20:48,236] WARN The configuration security.protocol = SSL was > supplied but isn't a known config. > (org.apache.kafka.clients.producer.ProducerConfig) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2472) Fix kafka ssl configs to not throw warnings
[ https://issues.apache.org/jira/browse/KAFKA-2472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14711506#comment-14711506 ] Sriharsha Chintalapani commented on KAFKA-2472: --- [~gwenshap] I think we should remove the warning. > Fix kafka ssl configs to not throw warnings > --- > > Key: KAFKA-2472 > URL: https://issues.apache.org/jira/browse/KAFKA-2472 > Project: Kafka > Issue Type: Bug >Reporter: Sriharsha Chintalapani >Assignee: Sriharsha Chintalapani > Fix For: 0.8.3 > > > This is a follow-up fix on kafka-1690. > [2015-08-25 18:20:48,236] WARN The configuration ssl.truststore.password = > striker was supplied but isn't a known config. > (org.apache.kafka.clients.producer.ProducerConfig) > [2015-08-25 18:20:48,236] WARN The configuration security.protocol = SSL was > supplied but isn't a known config. > (org.apache.kafka.clients.producer.ProducerConfig) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-2472) Fix kafka ssl configs to not throw warnings
[ https://issues.apache.org/jira/browse/KAFKA-2472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14711500#comment-14711500 ] Gwen Shapira commented on KAFKA-2472: - I'm wondering if we still need the unknown config warnings at all - the entire system was designed to pass arguments to SSL, serializers, reporters, etc. Unknown configs are expected at this point. > Fix kafka ssl configs to not throw warnings > --- > > Key: KAFKA-2472 > URL: https://issues.apache.org/jira/browse/KAFKA-2472 > Project: Kafka > Issue Type: Bug >Reporter: Sriharsha Chintalapani >Assignee: Sriharsha Chintalapani > Fix For: 0.8.3 > > > This is a follow-up fix on kafka-1690. > [2015-08-25 18:20:48,236] WARN The configuration ssl.truststore.password = > striker was supplied but isn't a known config. > (org.apache.kafka.clients.producer.ProducerConfig) > [2015-08-25 18:20:48,236] WARN The configuration security.protocol = SSL was > supplied but isn't a known config. > (org.apache.kafka.clients.producer.ProducerConfig) -- This message was sent by Atlassian JIRA (v6.3.4#6332)