Hi Shafana,
I tried the following step in the "PublishKafkaInCustomAvroFormat" sample.
Navigate to {ConfluentHome} and start the schema registry node using,
bin/schema-registry-start ./etc/schema-registry/schema-registry.properties
And it resulted me with the following.
Ramindus-MacBook-Pro:confluent-5.2.1 ramindu$ bin/schema-registry-start
./etc/schema-registry/schema-registry.properties
[2019-04-25 22:10:21,661] INFO SchemaRegistryConfig values:
resource.extension.class = []
metric.reporters = []
kafkastore.sasl.kerberos.kinit.cmd = /usr/bin/kinit
response.mediatype.default = application/vnd.schemaregistry.v1+json
resource.extension.classes = []
kafkastore.ssl.trustmanager.algorithm = PKIX
inter.instance.protocol = http
authentication.realm =
ssl.keystore.type = JKS
kafkastore.topic = _schemas
metrics.jmx.prefix = kafka.schema.registry
kafkastore.ssl.enabled.protocols = TLSv1.2,TLSv1.1,TLSv1
kafkastore.topic.replication.factor = 3
ssl.truststore.password = [hidden]
kafkastore.timeout.ms = 500
host.name = localhost
kafkastore.bootstrap.servers = []
schema.registry.zk.namespace = schema_registry
kafkastore.sasl.kerberos.ticket.renew.window.factor = 0.8
kafkastore.sasl.kerberos.service.name =
schema.registry.resource.extension.class = []
ssl.endpoint.identification.algorithm =
compression.enable = true
kafkastore.ssl.truststore.type = JKS
avro.compatibility.level = backward
kafkastore.ssl.protocol = TLS
kafkastore.ssl.provider =
kafkastore.ssl.truststore.location =
response.mediatype.preferred = [application/vnd.schemaregistry.v1+json,
application/vnd.schemaregistry+json, application/json]
kafkastore.ssl.keystore.type = JKS
authentication.skip.paths = []
ssl.truststore.type = JKS
websocket.servlet.initializor.classes = []
kafkastore.ssl.truststore.password = [hidden]
access.control.allow.origin =
ssl.truststore.location =
ssl.keystore.password = [hidden]
port = 8081
access.control.allow.headers =
kafkastore.ssl.keystore.location =
metrics.tag.map = {}
master.eligibility = true
ssl.client.auth = false
kafkastore.ssl.keystore.password = [hidden]
rest.servlet.initializor.classes = []
websocket.path.prefix = /ws
kafkastore.security.protocol = PLAINTEXT
ssl.trustmanager.algorithm =
authentication.method = NONE
request.logger.name = io.confluent.rest-utils.requests
ssl.key.password = [hidden]
kafkastore.zk.session.timeout.ms = 30000
kafkastore.sasl.mechanism = GSSAPI
kafkastore.sasl.kerberos.ticket.renew.jitter = 0.05
kafkastore.ssl.key.password = [hidden]
zookeeper.set.acl = false
schema.registry.inter.instance.protocol =
authentication.roles = [*]
metrics.num.samples = 2
ssl.protocol = TLS
schema.registry.group.id = schema-registry
kafkastore.ssl.keymanager.algorithm = SunX509
kafkastore.connection.url = localhost:2181
debug = false
listeners = [http://0.0.0.0:8081]
kafkastore.group.id =
ssl.provider =
ssl.enabled.protocols = []
shutdown.graceful.ms = 1000
ssl.keystore.location =
resource.static.locations = []
ssl.cipher.suites = []
kafkastore.ssl.endpoint.identification.algorithm =
mode.mutability = false
kafkastore.ssl.cipher.suites =
access.control.allow.methods =
kafkastore.sasl.kerberos.min.time.before.relogin = 60000
ssl.keymanager.algorithm =
metrics.sample.window.ms = 30000
kafkastore.init.timeout.ms = 60000
(io.confluent.kafka.schemaregistry.rest.SchemaRegistryConfig:179)
[2019-04-25 22:10:21,717] INFO Logging initialized @629ms to
org.eclipse.jetty.util.log.Slf4jLog (org.eclipse.jetty.util.log:193)
[2019-04-25 22:10:22,725] INFO Created schema registry namespace
localhost:2181 /schema_registry
(io.confluent.kafka.schemaregistry.rest.SchemaRegistryConfig:709)
[2019-04-25 22:10:22,852] INFO Initializing KafkaStore with broker
endpoints: PLAINTEXT://localhost:9092
(io.confluent.kafka.schemaregistry.storage.KafkaStore:105)
[2019-04-25 22:10:23,105] INFO Creating schemas topic _schemas
(io.confluent.kafka.schemaregistry.storage.KafkaStore:190)
[2019-04-25 22:10:23,107] WARN Creating the schema topic _schemas using a
replication factor of 1, which is less than the desired one of 3. If this
is a production environment, it's crucial to add more brokers and increase
the replication factor of the topic.
(io.confluent.kafka.schemaregistry.storage.KafkaStore:200)
[2019-04-25 22:10:23,116] ERROR Error starting the schema registry
(io.confluent.kafka.schemaregistry.rest.SchemaRegistryRestApplication:67)
io.confluent.kafka.schemaregistry.exceptions.SchemaRegistryInitializationException:
Error initializing kafka store while initializing schema registry
at
io.confluent.kafka.schemaregistry.storage.KafkaSchemaRegistry.init(KafkaSchemaRegistry.java:219)
at
io.confluent.kafka.schemaregistry.rest.SchemaRegistryRestApplication.initSchemaRegistry(SchemaRegistryRestApplication.java:65)
at
io.confluent.kafka.schemaregistry.rest.SchemaRegistryRestApplication.setupResources(SchemaRegistryRestApplication.java:76)
at
io.confluent.kafka.schemaregistry.rest.SchemaRegistryRestApplication.setupResources(SchemaRegistryRestApplication.java:43)
at io.confluent.rest.Application.createServer(Application.java:201)
at
io.confluent.kafka.schemaregistry.rest.SchemaRegistryMain.main(SchemaRegistryMain.java:42)
Caused by:
io.confluent.kafka.schemaregistry.storage.exceptions.StoreInitializationException:
Failed trying to create or validate schema topic configuration
at
io.confluent.kafka.schemaregistry.storage.KafkaStore.createOrVerifySchemaTopic(KafkaStore.java:179)
at
io.confluent.kafka.schemaregistry.storage.KafkaStore.init(KafkaStore.java:116)
at
io.confluent.kafka.schemaregistry.storage.KafkaSchemaRegistry.init(KafkaSchemaRegistry.java:217)
... 5 more
Caused by: java.util.concurrent.ExecutionException:
org.apache.kafka.common.errors.UnsupportedVersionException: The broker does
not support CREATE_TOPICS
at
org.apache.kafka.common.internals.KafkaFutureImpl.wrapAndThrow(KafkaFutureImpl.java:45)
at
org.apache.kafka.common.internals.KafkaFutureImpl.access$000(KafkaFutureImpl.java:32)
at
org.apache.kafka.common.internals.KafkaFutureImpl$SingleWaiter.await(KafkaFutureImpl.java:104)
at
org.apache.kafka.common.internals.KafkaFutureImpl.get(KafkaFutureImpl.java:272)
at
io.confluent.kafka.schemaregistry.storage.KafkaStore.createSchemaTopic(KafkaStore.java:218)
at
io.confluent.kafka.schemaregistry.storage.KafkaStore.createOrVerifySchemaTopic(KafkaStore.java:171)
... 7 more
Caused by: org.apache.kafka.common.errors.UnsupportedVersionException: The
broker does not support CREATE_TOPICS
Im using kafka_2.11-0.10.0.0 and confluent-5.2.1
What would be the correct version to use?
Best Regards,
Ramindu.
On Wed, Jan 9, 2019 at 11:42 AM Shafana Safwan <[email protected]> wrote:
> Hi Suho,
>
> Samples are done and PR is merged.
>
> Thank you.
>
> Regards,
>
> On Wed, Jan 9, 2019 at 9:03 AM Tishan Dahanayakage <[email protected]>
> wrote:
>
>> Hi Shafana,
>>
>> Added a comment. Please check.
>>
>> On Wed, Jan 9, 2019 at 12:41 AM Shafana Safwan <[email protected]> wrote:
>>
>>> Hi Tishan,
>>>
>>> Please merge my PR on Avro mapper samples for product sp.
>>>
>>> https://github.com/wso2/product-sp/pull/906
>>>
>>> Thank you.
>>> Regards,
>>>
>>> On Tue, Jan 8, 2019 at 5:49 PM Shafana Safwan <[email protected]> wrote:
>>>
>>>> +1
>>>>
>>>> ---------- Forwarded message ---------
>>>> From: Shafana Safwan <[email protected]>
>>>> Date: Tue, 8 Jan 2019, 09:32
>>>> Subject: Re: Avro mapper not working with SP
>>>> To: Suhothayan Sriskandarajah <[email protected]>
>>>>
>>>>
>>>> Hi suho,
>>>>
>>>> I am almost done with it. Will put the PR today.
>>>>
>>>> Thank you.
>>>>
>>>>
>>>> On Tue, 8 Jan 2019, 00:10 Sriskandarajah Suhothayan, <[email protected]>
>>>> wrote:
>>>>
>>>>> Any update on this?
>>>>>
>>>>>
>>>>> On Fri, Jan 4, 2019 at 5:02 PM Sriskandarajah Suhothayan <
>>>>> [email protected]> wrote:
>>>>>
>>>>>> Thanks a lot.
>>>>>>
>>>>>> On Fri, Jan 4, 2019 at 4:21 PM Shafana Safwan <[email protected]>
>>>>>> wrote:
>>>>>>
>>>>>>> Hi Suho,
>>>>>>>
>>>>>>> I will get the avro mapper sample ready by next week.
>>>>>>>
>>>>>>> Thank you.
>>>>>>>
>>>>>>> On Fri, Jan 4, 2019 at 2:21 PM Sriskandarajah Suhothayan <
>>>>>>> [email protected]> wrote:
>>>>>>>
>>>>>>>> Please inform the team get this done, and continue the team's work!
>>>>>>>>
>>>>>>>> Suho
>>>>>>>>
>>>>>>>> On Fri, Jan 4, 2019 at 1:46 PM Shafana Safwan <[email protected]>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> Hi,
>>>>>>>>>
>>>>>>>>> I am in working in Installation Experience team.
>>>>>>>>>
>>>>>>>>> On Fri, Jan 4, 2019 at 1:14 PM Sriskandarajah Suhothayan <
>>>>>>>>> [email protected]> wrote:
>>>>>>>>>
>>>>>>>>>> Can you finish this first and move to the development as it has
>>>>>>>>>> delayed for a long time already.
>>>>>>>>>> This might need only about 2 days, is it?
>>>>>>>>>> What team are you working on?
>>>>>>>>>>
>>>>>>>>>> On Fri, Jan 4, 2019 at 1:12 PM Shafana Safwan <[email protected]>
>>>>>>>>>> wrote:
>>>>>>>>>>
>>>>>>>>>>> Hi Suho,
>>>>>>>>>>>
>>>>>>>>>>> I have fixed the above issue and made sure it will not occur
>>>>>>>>>>> again. Now Avro mapper can be used without any problem.
>>>>>>>>>>> No additional jars are need to be added.
>>>>>>>>>>>
>>>>>>>>>>> I have started working on writing a sample on avro mapper for
>>>>>>>>>>> SP. But I would need some time, since I am currently working on some
>>>>>>>>>>> developments in my team as well.
>>>>>>>>>>>
>>>>>>>>>>> Thank you.
>>>>>>>>>>> Regards,
>>>>>>>>>>> --
>>>>>>>>>>> *Shafana Safwan*
>>>>>>>>>>> Software Engineer
>>>>>>>>>>> WSO2
>>>>>>>>>>> lean . enterprise . middleware
>>>>>>>>>>> Mobile : +94(0) 754515687
>>>>>>>>>>> <https://wso2.com/signature>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> On Mon, Dec 10, 2018 at 10:28 AM Shafana Safwan <
>>>>>>>>>>> [email protected]> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> Hi Suho,
>>>>>>>>>>>>
>>>>>>>>>>>> Will do ASAP.
>>>>>>>>>>>>
>>>>>>>>>>>> Regards,
>>>>>>>>>>>> Shafana
>>>>>>>>>>>>
>>>>>>>>>>>> On Sun, Dec 9, 2018 at 8:08 PM Sriskandarajah Suhothayan <
>>>>>>>>>>>> [email protected]> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> Please share the doc how to use SP with Kafka and avro
>>>>>>>>>>>>> registry.
>>>>>>>>>>>>>
>>>>>>>>>>>>> Regards
>>>>>>>>>>>>> Suho
>>>>>>>>>>>>>
>>>>>>>>>>>>> On Sun, Dec 9, 2018 at 12:07 PM Sriskandarajah Suhothayan <
>>>>>>>>>>>>> [email protected]> wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>>> Hi Shafana
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> When I add the latest Avro mapper it's throwing the following
>>>>>>>>>>>>>> exception:
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> org.osgi.framework.BundleException: Could not resolve module:
>>>>>>>>>>>>>> siddhi-map-avro [146]
>>>>>>>>>>>>>> Unresolved requirement: Import-Package:
>>>>>>>>>>>>>> org.apache.tapestry5.json
>>>>>>>>>>>>>> at org.eclipse.osgi.container.Module.start(Module.java:444)
>>>>>>>>>>>>>> at
>>>>>>>>>>>>>> org.eclipse.osgi.internal.framework.EquinoxBundle.start(EquinoxBundle.java:383)
>>>>>>>>>>>>>> at
>>>>>>>>>>>>>> org.eclipse.osgi.internal.framework.EquinoxBundle.start(EquinoxBundle.java:402)
>>>>>>>>>>>>>> at
>>>>>>>>>>>>>> org.eclipse.equinox.internal.simpleconfigurator.ConfigApplier.startBundles(ConfigApplier.java:453)
>>>>>>>>>>>>>> at
>>>>>>>>>>>>>> org.eclipse.equinox.internal.simpleconfigurator.ConfigApplier.install(ConfigApplier.java:111)
>>>>>>>>>>>>>> at
>>>>>>>>>>>>>> org.eclipse.equinox.internal.simpleconfigurator.SimpleConfiguratorImpl.applyConfiguration(SimpleConfiguratorImpl.java:191)
>>>>>>>>>>>>>> at
>>>>>>>>>>>>>> org.eclipse.equinox.internal.simpleconfigurator.SimpleConfiguratorImpl.applyConfiguration(SimpleConfiguratorImpl.java:205)
>>>>>>>>>>>>>> at
>>>>>>>>>>>>>> org.eclipse.equinox.internal.simpleconfigurator.Activator.start(Activator.java:60)
>>>>>>>>>>>>>> at
>>>>>>>>>>>>>> org.eclipse.osgi.internal.framework.BundleContextImpl$3.run(BundleContextImpl.java:774)
>>>>>>>>>>>>>> at
>>>>>>>>>>>>>> org.eclipse.osgi.internal.framework.BundleContextImpl$3.run(BundleContextImpl.java:1)
>>>>>>>>>>>>>> at java.security.AccessController.doPrivileged(Native Method)
>>>>>>>>>>>>>> at
>>>>>>>>>>>>>> org.eclipse.osgi.internal.framework.BundleContextImpl.startActivator(BundleContextImpl.java:767)
>>>>>>>>>>>>>> at
>>>>>>>>>>>>>> org.eclipse.osgi.internal.framework.BundleContextImpl.start(BundleContextImpl.java:724)
>>>>>>>>>>>>>> at
>>>>>>>>>>>>>> org.eclipse.osgi.internal.framework.EquinoxBundle.startWorker0(EquinoxBundle.java:932)
>>>>>>>>>>>>>> at
>>>>>>>>>>>>>> org.eclipse.osgi.internal.framework.EquinoxBundle$EquinoxModule.startWorker(EquinoxBundle.java:309)
>>>>>>>>>>>>>> at org.eclipse.osgi.container.Module.doStart(Module.java:581)
>>>>>>>>>>>>>> at org.eclipse.osgi.container.Module.start(Module.java:449)
>>>>>>>>>>>>>> at
>>>>>>>>>>>>>> org.eclipse.osgi.internal.framework.EquinoxBundle.start(EquinoxBundle.java:383)
>>>>>>>>>>>>>> at
>>>>>>>>>>>>>> org.eclipse.osgi.internal.framework.EquinoxBundle.start(EquinoxBundle.java:402)
>>>>>>>>>>>>>> at
>>>>>>>>>>>>>> org.wso2.carbon.launcher.CarbonServer.loadInitialBundles(CarbonServer.java:242)
>>>>>>>>>>>>>> at
>>>>>>>>>>>>>> org.wso2.carbon.launcher.CarbonServer.start(CarbonServer.java:83)
>>>>>>>>>>>>>> at org.wso2.carbon.launcher.Main.main(Main.java:84)
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Can you please update the Avro documentation home page with
>>>>>>>>>>>>>> the relevant other jars we need to add with this to make it work
>>>>>>>>>>>>>> on SP.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Regards
>>>>>>>>>>>>>> Suho
>>>>>>>>>>>>>> --
>>>>>>>>>>>>>> *S. Suhothayan* | Director | WSO2 Inc. <https://wso2.com/>
>>>>>>>>>>>>>> (m) (+94) 779 756 757 | (e) [email protected] | (t) @suhothayan
>>>>>>>>>>>>>> <https://twitter.com/suhothayan>
>>>>>>>>>>>>>> GET INTEGRATION AGILE
>>>>>>>>>>>>>> Integration Agility for Digitally Driven Business
>>>>>>>>>>>>>>
>>>>>>>>>>>>> --
>>>>>>>>>>>>> *S. Suhothayan* | Director | WSO2 Inc. <https://wso2.com/>
>>>>>>>>>>>>> (m) (+94) 779 756 757 | (e) [email protected] | (t) @suhothayan
>>>>>>>>>>>>> <https://twitter.com/suhothayan>
>>>>>>>>>>>>> GET INTEGRATION AGILE
>>>>>>>>>>>>> Integration Agility for Digitally Driven Business
>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> --
>>>>>>>>>>>> *Shafana Safwan*
>>>>>>>>>>>> Software Engineer
>>>>>>>>>>>> WSO2
>>>>>>>>>>>> lean . enterprise . middleware
>>>>>>>>>>>> Mobile : +94(0) 754515687
>>>>>>>>>>>> <https://wso2.com/signature>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> *S. Suhothayan* | Director | WSO2 Inc. <https://wso2.com/>
>>>>>>>>>> (m) (+94) 779 756 757 | (e) [email protected] | (t) @suhothayan
>>>>>>>>>> <https://twitter.com/suhothayan>
>>>>>>>>>> GET INTEGRATION AGILE
>>>>>>>>>> Integration Agility for Digitally Driven Business
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> *Shafana Safwan*
>>>>>>>>> Software Engineer
>>>>>>>>> WSO2
>>>>>>>>> lean . enterprise . middleware
>>>>>>>>> Mobile : +94(0) 754515687
>>>>>>>>> <https://wso2.com/signature>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> *S. Suhothayan* | Director | WSO2 Inc. <https://wso2.com/>
>>>>>>>> (m) (+94) 779 756 757 | (e) [email protected] | (t) @suhothayan
>>>>>>>> <https://twitter.com/suhothayan>
>>>>>>>> GET INTEGRATION AGILE
>>>>>>>> Integration Agility for Digitally Driven Business
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> *Shafana Safwan*
>>>>>>> Software Engineer
>>>>>>> WSO2
>>>>>>> lean . enterprise . middleware
>>>>>>> Mobile : +94(0) 754515687
>>>>>>> <https://wso2.com/signature>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>> --
>>>>>> *S. Suhothayan* | Director | WSO2 Inc. <https://wso2.com/>
>>>>>> (m) (+94) 779 756 757 | (e) [email protected] | (t) @suhothayan
>>>>>> <https://twitter.com/suhothayan>
>>>>>> GET INTEGRATION AGILE
>>>>>> Integration Agility for Digitally Driven Business
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> *S. Suhothayan* | Director | WSO2 Inc. <https://wso2.com/>
>>>>> (m) (+94) 779 756 757 | (e) [email protected] | (t) @suhothayan
>>>>> <https://twitter.com/suhothayan>
>>>>> GET INTEGRATION AGILE
>>>>> Integration Agility for Digitally Driven Business
>>>>>
>>>>
>>>
>>> --
>>> *Shafana Safwan*
>>> Software Engineer
>>> WSO2
>>> lean . enterprise . middleware
>>> Mobile : +94(0) 754515687
>>> <https://wso2.com/signature>
>>>
>>>
>>
>> --
>> *Tishan Dahanayakage* | Associate Technical Lead | WSO2 Inc.
>> (m) +94716481328 | (w) +94112145345 | (e) [email protected]
>> GET INTEGRATION AGILE
>> Integration Agility for Digitally Driven Business
>>
>> Disclaimer: This communication may contain privileged or other
>> confidential information and is intended exclusively for the addressee/s.
>> If you are not the intended recipient/s, or believe that you may have
>> received this communication in error, please reply to the sender indicating
>> that fact and delete the copy you received and in addition, you should not
>> print, copy, re-transmit, disseminate, or otherwise use the information
>> contained in this communication. Internet communications cannot be
>> guaranteed to be timely, secure, error or virus-free. The sender does not
>> accept liability for any errors or omissions.
>>
>
>
> --
> *Shafana Safwan*
> Software Engineer
> WSO2
> lean . enterprise . middleware
> Mobile : +94(0) 754515687
> <https://wso2.com/signature>
>
> --
> You received this message because you are subscribed to the Google Groups
> "WSO2 Engineering Group" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to [email protected].
> For more options, visit https://groups.google.com/a/wso2.com/d/optout.
>
--
*Ramindu De Silva*
Associate Technical Lead
WSO2 Inc.: http://wso2.com
lean.enterprise.middleware
email: [email protected] <[email protected]>
mob: +94 719678895
_______________________________________________
Dev mailing list
[email protected]
http://wso2.org/cgi-bin/mailman/listinfo/dev
