Try to remove the space after the comma. -Matthias
On 7/10/18 10:43 AM, Jayaraman, AshokKumar (CCI-Atlanta-CON) wrote:
> Hi,
>
> When we try to use the same (square brackets), the internal topics are
> failing to get created. Any suggestions?
>
> changelogConfig.put("cleanup.policy", "[compact, delete]");
>
>
> org.apache.kafka.streams.errors.StreamsException: Could not create topic
> stream_digital_01-hrly-changelog.
> at
> org.apache.kafka.streams.processor.internals.InternalTopicManager.makeReady(InternalTopicManager.java:137)
> at
> org.apache.kafka.streams.processor.internals.StreamPartitionAssignor.prepareTopic(StreamPartitionAssignor.java:655)
> at
> org.apache.kafka.streams.processor.internals.StreamPartitionAssignor.assign(StreamPartitionAssignor.java:463)
> at
> org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.performAssignment(ConsumerCoordinator.java:358)
> at
> org.apache.kafka.clients.consumer.internals.AbstractCoordinator.onJoinLeader(AbstractCoordinator.java:520)
> at
> org.apache.kafka.clients.consumer.internals.AbstractCoordinator.access$1100(AbstractCoordinator.java:93)
> at
> org.apache.kafka.clients.consumer.internals.AbstractCoordinator$JoinGroupResponseHandler.handle(AbstractCoordinator.java:472)
> at
> org.apache.kafka.clients.consumer.internals.AbstractCoordinator$JoinGroupResponseHandler.handle(AbstractCoordinator.java:455)
> at
> org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:822)
> at
> org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:802)
> at
> org.apache.kafka.clients.consumer.internals.RequestFuture$1.onSuccess(RequestFuture.java:204)
> at
> org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:167)
> at
> org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:127)
> at
> org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler.fireCompletion(ConsumerNetworkClient.java:563)
> at
> org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.firePendingCompletedRequests(ConsumerNetworkClient.java:390)
> at
> org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:293)
> at
> org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:233)
> at
> org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:193)
> at
> org.apache.kafka.clients.consumer.internals.AbstractCoordinator.joinGroupIfNeeded(AbstractCoordinator.java:364)
> at
> org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:316)
> at
> org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:290)
> at
> org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1149)
> at
> org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1115)
> at
> org.apache.kafka.streams.processor.internals.StreamThread.pollRequests(StreamThread.java:827)
> at
> org.apache.kafka.streams.processor.internals.StreamThread.runOnce(StreamThread.java:784)
> at
> org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:750)
> at
> org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:720)
> Caused by: java.util.concurrent.ExecutionException:
> org.apache.kafka.common.errors.UnknownServerException: Invalid value [compact
> for configuration cleanup.policy: String must be one of: compact, delete
> at
> org.apache.kafka.common.internals.KafkaFutureImpl.wrapAndThrow(KafkaFutureImpl.java:45)
> at
> org.apache.kafka.common.internals.KafkaFutureImpl.access$000(KafkaFutureImpl.java:32)
> at
> org.apache.kafka.common.internals.KafkaFutureImpl$SingleWaiter.await(KafkaFutureImpl.java:89)
> at
> org.apache.kafka.common.internals.KafkaFutureImpl.get(KafkaFutureImpl.java:258)
> at
> org.apache.kafka.streams.processor.internals.InternalTopicManager.makeReady(InternalTopicManager.java:121)
>
>
>
> Thanks & Regards,
>
> Ashok
>
> -----Original Message-----
> From: Manikumar [mailto:manikumar.re...@gmail.com]
> Sent: Thursday, June 07, 2018 12:11 AM
> To: Users
> Subject: Re: cleanup.policy - doesn't accept compact,delete
>
> As described in usage description, to group the values which contain commas,
> we need to use square brackets.
>
> ex: --add-config cleanup.policy=[compact,delete]
>
> On Thu, Jun 7, 2018 at 8:49 AM, Jayaraman, AshokKumar (CCI-Atlanta-CON) <
> ashokkumar.jayara...@cox.com> wrote:
>
>> Hi,
>>
>> We are on Kafka version 1.0.0. Per the below new feature, a topic can
>> allow both compact and delete. I tried all the combinations, but they all
>> fail to accept values that are not either compact OR delete. Is this
>> feature valid in updated releases, since 0.10.2? If this is not a
>> feature available, how to cleanup the growing compacted topic scenario?
>>
>> https://issues.apache.org/jira/browse/KAFKA-4015
>>
>> $ ./kafka-configs.sh --zookeeper <<XXXXX>>:2181--alter --entity-type
>> topics --entity-name stream_output --add-config
>> cleanup.policy=compact,delete Error while executing config command
>> requirement failed: Invalid entity
>> config: all configs to be added must be in the format "key=val".
>> java.lang.IllegalArgumentException: requirement failed: Invalid entity
>> config: all configs to be added must be in the format "key=val".
>> at scala.Predef$.require(Predef.scala:233)
>> at kafka.admin.ConfigCommand$.parseConfigsToBeAdded(
>> ConfigCommand.scala:128)
>> at kafka.admin.ConfigCommand$.alterConfig(ConfigCommand.scala:78)
>> at kafka.admin.ConfigCommand$.main(ConfigCommand.scala:65)
>> at kafka.admin.ConfigCommand.main(ConfigCommand.scala)
>>
>>
>> $ ./kafka-configs.sh --zookeeper <<XXXXX>>:2181 --alter --entity-type
>> topics --entity-name ash_stream_output --add-config
>> cleanup.policy=compact_delete Error while executing config command
>> Invalid value compact_delete for configuration cleanup.policy: String
>> must be one of: compact, delete
>> org.apache.kafka.common.config.ConfigException: Invalid value
>> compact_delete for configuration cleanup.policy: String must be one of:
>> compact, delete
>> at org.apache.kafka.common.config.ConfigDef$ValidString.
>> ensureValid(ConfigDef.java:851)
>> at org.apache.kafka.common.config.ConfigDef$ValidList.
>> ensureValid(ConfigDef.java:827)
>> at org.apache.kafka.common.config.ConfigDef.parse(
>> ConfigDef.java:427)
>> at kafka.log.LogConfig$.validate(LogConfig.scala:331)
>> at kafka.admin.AdminUtils$.changeTopicConfig(AdminUtils.scala:524)
>> at kafka.admin.ConfigCommand$.alterConfig(ConfigCommand.scala:90)
>> at kafka.admin.ConfigCommand$.main(ConfigCommand.scala:65)
>> at kafka.admin.ConfigCommand.main(ConfigCommand.scala)
>>
>>
>> $ ./kafka-configs.sh --zookeeper <<XXXXX>>:2181 --alter --entity-type
>> topics --entity-name ash_stream_output --add-config
>> cleanup.policy=compact_and_delete Error while executing config command
>> Invalid value compact_delete for configuration cleanup.policy: String
>> must be one of: compact, delete
>> org.apache.kafka.common.config.ConfigException: Invalid value
>> compact_delete for configuration cleanup.policy: String must be one of:
>> compact, delete
>> at org.apache.kafka.common.config.ConfigDef$ValidString.
>> ensureValid(ConfigDef.java:851)
>> at org.apache.kafka.common.config.ConfigDef$ValidList.
>> ensureValid(ConfigDef.java:827)
>> at org.apache.kafka.common.config.ConfigDef.parse(
>> ConfigDef.java:427)
>> at kafka.log.LogConfig$.validate(LogConfig.scala:331)
>> at kafka.admin.AdminUtils$.changeTopicConfig(AdminUtils.scala:524)
>> at kafka.admin.ConfigCommand$.alterConfig(ConfigCommand.scala:90)
>> at kafka.admin.ConfigCommand$.main(ConfigCommand.scala:65)
>> at kafka.admin.ConfigCommand.main(ConfigCommand.scala)
>>
>>
>> Thanks & Regards,
>> Ashok
>>
>>
signature.asc
Description: OpenPGP digital signature
