[jira] [Created] (KAFKA-8095) update ReplicationVerification to support command-config
Yuexin Zhang created KAFKA-8095: --- Summary: update ReplicationVerification to support command-config Key: KAFKA-8095 URL: https://issues.apache.org/jira/browse/KAFKA-8095 Project: Kafka Issue Type: Improvement Affects Versions: 2.0.0 Reporter: Yuexin Zhang Currently, there's no way to provide a config file to switch to SASL security protocol. We'd enable ReplicationVerification tool to be able pick up a command-config, like other tools such as [ConsumerGroupCommand.scala|https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/admin/ConsumerGroupCommand.scala#L433-L436], that way ReplicationVerification tool can support SASL client: [https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/admin/ConsumerGroupCommand.scala#L734-L737] [https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/admin/ConsumerGroupCommand.scala#L433-L436] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KAFKA-8095) update ReplicationVerification to support command-config
[ https://issues.apache.org/jira/browse/KAFKA-8095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuexin Zhang updated KAFKA-8095: Description: Currently, there's no way to provide a config file to switch to SASL security protocol. We'd enable ReplicationVerification tool to be able pick up a command-config, like other tools such as [ConsumerGroupCommand.scala|https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/admin/ConsumerGroupCommand.scala], that way ReplicationVerification tool can support SASL client: [https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/admin/ConsumerGroupCommand.scala#L734-L737] [https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/admin/ConsumerGroupCommand.scala#L433-L436] was: Currently, there's no way to provide a config file to switch to SASL security protocol. We'd enable ReplicationVerification tool to be able pick up a command-config, like other tools such as [ConsumerGroupCommand.scala|https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/admin/ConsumerGroupCommand.scala#L433-L436], that way ReplicationVerification tool can support SASL client: [https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/admin/ConsumerGroupCommand.scala#L734-L737] [https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/admin/ConsumerGroupCommand.scala#L433-L436] > update ReplicationVerification to support command-config > > > Key: KAFKA-8095 > URL: https://issues.apache.org/jira/browse/KAFKA-8095 > Project: Kafka > Issue Type: Improvement >Affects Versions: 2.0.0 >Reporter: Yuexin Zhang >Priority: Minor > > Currently, there's no way to provide a config file to switch to SASL security > protocol. We'd enable ReplicationVerification tool to be able pick up a > command-config, like other tools such as > [ConsumerGroupCommand.scala|https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/admin/ConsumerGroupCommand.scala], > that way ReplicationVerification tool can support SASL client: > > [https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/admin/ConsumerGroupCommand.scala#L734-L737] > > [https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/admin/ConsumerGroupCommand.scala#L433-L436] > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (KAFKA-6105) group.id is not picked by kafka.tools.EndToEndLatency
Yuexin Zhang created KAFKA-6105: --- Summary: group.id is not picked by kafka.tools.EndToEndLatency Key: KAFKA-6105 URL: https://issues.apache.org/jira/browse/KAFKA-6105 Project: Kafka Issue Type: Bug Components: tools Affects Versions: 0.11.0.0 Reporter: Yuexin Zhang As per these lines: https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/tools/EndToEndLatency.scala#L64-L67 the property file is loaded first, and later a auto generated group.id is used: consumerProps.put(ConsumerConfig.GROUP_ID_CONFIG, "test-group-" + System.currentTimeMillis()) so even user gives the group.id in a property file, it is not picked up. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (KAFKA-5574) kafka-consumer-perf-test.sh report header has one less column in show-detailed-stats mode
[ https://issues.apache.org/jira/browse/KAFKA-5574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuexin Zhang resolved KAFKA-5574. - Resolution: Duplicate Resolved in KAFKA-5358 https://github.com/apache/kafka/blame/trunk/core/src/main/scala/kafka/tools/ConsumerPerformance.scala#L132 > kafka-consumer-perf-test.sh report header has one less column in > show-detailed-stats mode > - > > Key: KAFKA-5574 > URL: https://issues.apache.org/jira/browse/KAFKA-5574 > Project: Kafka > Issue Type: Bug > Components: tools >Affects Versions: 0.9.0.0, 0.10.0.0 >Reporter: Yuexin Zhang > > time, data.consumed.in.MB, MB.sec, data.consumed.in.nMsg, nMsg.sec > 2017-07-09 21:40:40:369, 0, 0.1492, 2.6176, 5000, 87719.2982 > 2017-07-09 21:40:40:386, 0, 0.2983, 149.0479, 1, 500. > 2017-07-09 21:40:40:387, 0, 0.4473, 149.0812, 15000, 500. > there's one more column between "time" and "data.consumed.in.MB", it's > currently set to 0: > https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/tools/ConsumerPerformance.scala#L158 > https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/tools/ConsumerPerformance.scala#L175 > is it a thread id? what is this id used for? -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (KAFKA-5574) kafka-consumer-perf-test.sh report header has one less column in show-detailed-stats mode
[ https://issues.apache.org/jira/browse/KAFKA-5574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuexin Zhang updated KAFKA-5574: Description: time, data.consumed.in.MB, MB.sec, data.consumed.in.nMsg, nMsg.sec 2017-07-09 21:40:40:369, 0, 0.1492, 2.6176, 5000, 87719.2982 2017-07-09 21:40:40:386, 0, 0.2983, 149.0479, 1, 500. 2017-07-09 21:40:40:387, 0, 0.4473, 149.0812, 15000, 500. there's one more column between "time" and "data.consumed.in.MB", it's currently set to 0: https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/tools/ConsumerPerformance.scala#L158 https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/tools/ConsumerPerformance.scala#L175 is it a thread id? what is this id used for? was: time, data.consumed.in.MB, MB.sec, data.consumed.in.nMsg, nMsg.sec 2017-07-09 21:40:40:369, 0, 0.1492, 2.6176, 5000, 87719.2982 2017-07-09 21:40:40:386, 0, 0.2983, 149.0479, 1, 500. 2017-07-09 21:40:40:387, 0, 0.4473, 149.0812, 15000, 500. there's one more column between "time" and "data.consumed.in.MB", it's currently set to 0: https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/tools/ConsumerPerformance.scala#L158 is it a thread id? what is this id used for? > kafka-consumer-perf-test.sh report header has one less column in > show-detailed-stats mode > - > > Key: KAFKA-5574 > URL: https://issues.apache.org/jira/browse/KAFKA-5574 > Project: Kafka > Issue Type: Bug > Components: tools >Affects Versions: 0.9.0.0, 0.10.0.0 >Reporter: Yuexin Zhang > > time, data.consumed.in.MB, MB.sec, data.consumed.in.nMsg, nMsg.sec > 2017-07-09 21:40:40:369, 0, 0.1492, 2.6176, 5000, 87719.2982 > 2017-07-09 21:40:40:386, 0, 0.2983, 149.0479, 1, 500. > 2017-07-09 21:40:40:387, 0, 0.4473, 149.0812, 15000, 500. > there's one more column between "time" and "data.consumed.in.MB", it's > currently set to 0: > https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/tools/ConsumerPerformance.scala#L158 > https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/tools/ConsumerPerformance.scala#L175 > is it a thread id? what is this id used for? -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (KAFKA-5574) kafka-consumer-perf-test.sh report header has one less column in show-detailed-stats mode
[ https://issues.apache.org/jira/browse/KAFKA-5574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuexin Zhang updated KAFKA-5574: Affects Version/s: 0.10.0.0 > kafka-consumer-perf-test.sh report header has one less column in > show-detailed-stats mode > - > > Key: KAFKA-5574 > URL: https://issues.apache.org/jira/browse/KAFKA-5574 > Project: Kafka > Issue Type: Bug > Components: tools >Affects Versions: 0.9.0.0, 0.10.0.0 >Reporter: Yuexin Zhang > > time, data.consumed.in.MB, MB.sec, data.consumed.in.nMsg, nMsg.sec > 2017-07-09 21:40:40:369, 0, 0.1492, 2.6176, 5000, 87719.2982 > 2017-07-09 21:40:40:386, 0, 0.2983, 149.0479, 1, 500. > 2017-07-09 21:40:40:387, 0, 0.4473, 149.0812, 15000, 500. > there's one more column between "time" and "data.consumed.in.MB", it's > currently set to 0: > https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/tools/ConsumerPerformance.scala#L158 > is it a thread id? what is this id used for? -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (KAFKA-5574) kafka-consumer-perf-test.sh report header has one less column in show-detailed-stats mode
Yuexin Zhang created KAFKA-5574: --- Summary: kafka-consumer-perf-test.sh report header has one less column in show-detailed-stats mode Key: KAFKA-5574 URL: https://issues.apache.org/jira/browse/KAFKA-5574 Project: Kafka Issue Type: Bug Components: tools Affects Versions: 0.9.0.0 Reporter: Yuexin Zhang time, data.consumed.in.MB, MB.sec, data.consumed.in.nMsg, nMsg.sec 2017-07-09 21:40:40:369, 0, 0.1492, 2.6176, 5000, 87719.2982 2017-07-09 21:40:40:386, 0, 0.2983, 149.0479, 1, 500. 2017-07-09 21:40:40:387, 0, 0.4473, 149.0812, 15000, 500. there's one more column between "time" and "data.consumed.in.MB", it's currently set to 0: https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/tools/ConsumerPerformance.scala#L158 is it a thread id? what is this id used for? -- This message was sent by Atlassian JIRA (v6.4.14#64029)
