Hi Shafana, Any update on this?
Best Regards, Ramindu. On Thu, Apr 25, 2019 at 10:28 PM Ramindu De Silva <[email protected]> wrote: > Hi Shafana, > > I tried the following step in the "PublishKafkaInCustomAvroFormat" sample. > > Navigate to {ConfluentHome} and start the schema registry node using, > bin/schema-registry-start ./etc/schema-registry/schema-registry.properties > > And it resulted me with the following. > > Ramindus-MacBook-Pro:confluent-5.2.1 ramindu$ bin/schema-registry-start > ./etc/schema-registry/schema-registry.properties > [2019-04-25 22:10:21,661] INFO SchemaRegistryConfig values: > resource.extension.class = [] > metric.reporters = [] > kafkastore.sasl.kerberos.kinit.cmd = /usr/bin/kinit > response.mediatype.default = application/vnd.schemaregistry.v1+json > resource.extension.classes = [] > kafkastore.ssl.trustmanager.algorithm = PKIX > inter.instance.protocol = http > authentication.realm = > ssl.keystore.type = JKS > kafkastore.topic = _schemas > metrics.jmx.prefix = kafka.schema.registry > kafkastore.ssl.enabled.protocols = TLSv1.2,TLSv1.1,TLSv1 > kafkastore.topic.replication.factor = 3 > ssl.truststore.password = [hidden] > kafkastore.timeout.ms = 500 > host.name = localhost > kafkastore.bootstrap.servers = [] > schema.registry.zk.namespace = schema_registry > kafkastore.sasl.kerberos.ticket.renew.window.factor = 0.8 > kafkastore.sasl.kerberos.service.name = > schema.registry.resource.extension.class = [] > ssl.endpoint.identification.algorithm = > compression.enable = true > kafkastore.ssl.truststore.type = JKS > avro.compatibility.level = backward > kafkastore.ssl.protocol = TLS > kafkastore.ssl.provider = > kafkastore.ssl.truststore.location = > response.mediatype.preferred = [application/vnd.schemaregistry.v1+json, > application/vnd.schemaregistry+json, application/json] > kafkastore.ssl.keystore.type = JKS > authentication.skip.paths = [] > ssl.truststore.type = JKS > websocket.servlet.initializor.classes = [] > kafkastore.ssl.truststore.password = [hidden] > access.control.allow.origin = > ssl.truststore.location = > ssl.keystore.password = [hidden] > port = 8081 > access.control.allow.headers = > kafkastore.ssl.keystore.location = > metrics.tag.map = {} > master.eligibility = true > ssl.client.auth = false > kafkastore.ssl.keystore.password = [hidden] > rest.servlet.initializor.classes = [] > websocket.path.prefix = /ws > kafkastore.security.protocol = PLAINTEXT > ssl.trustmanager.algorithm = > authentication.method = NONE > request.logger.name = io.confluent.rest-utils.requests > ssl.key.password = [hidden] > kafkastore.zk.session.timeout.ms = 30000 > kafkastore.sasl.mechanism = GSSAPI > kafkastore.sasl.kerberos.ticket.renew.jitter = 0.05 > kafkastore.ssl.key.password = [hidden] > zookeeper.set.acl = false > schema.registry.inter.instance.protocol = > authentication.roles = [*] > metrics.num.samples = 2 > ssl.protocol = TLS > schema.registry.group.id = schema-registry > kafkastore.ssl.keymanager.algorithm = SunX509 > kafkastore.connection.url = localhost:2181 > debug = false > listeners = [http://0.0.0.0:8081] > kafkastore.group.id = > ssl.provider = > ssl.enabled.protocols = [] > shutdown.graceful.ms = 1000 > ssl.keystore.location = > resource.static.locations = [] > ssl.cipher.suites = [] > kafkastore.ssl.endpoint.identification.algorithm = > mode.mutability = false > kafkastore.ssl.cipher.suites = > access.control.allow.methods = > kafkastore.sasl.kerberos.min.time.before.relogin = 60000 > ssl.keymanager.algorithm = > metrics.sample.window.ms = 30000 > kafkastore.init.timeout.ms = 60000 > (io.confluent.kafka.schemaregistry.rest.SchemaRegistryConfig:179) > [2019-04-25 22:10:21,717] INFO Logging initialized @629ms to > org.eclipse.jetty.util.log.Slf4jLog (org.eclipse.jetty.util.log:193) > [2019-04-25 22:10:22,725] INFO Created schema registry namespace > localhost:2181 /schema_registry > (io.confluent.kafka.schemaregistry.rest.SchemaRegistryConfig:709) > [2019-04-25 22:10:22,852] INFO Initializing KafkaStore with broker > endpoints: PLAINTEXT://localhost:9092 > (io.confluent.kafka.schemaregistry.storage.KafkaStore:105) > [2019-04-25 22:10:23,105] INFO Creating schemas topic _schemas > (io.confluent.kafka.schemaregistry.storage.KafkaStore:190) > [2019-04-25 22:10:23,107] WARN Creating the schema topic _schemas using a > replication factor of 1, which is less than the desired one of 3. If this > is a production environment, it's crucial to add more brokers and increase > the replication factor of the topic. > (io.confluent.kafka.schemaregistry.storage.KafkaStore:200) > [2019-04-25 22:10:23,116] ERROR Error starting the schema registry > (io.confluent.kafka.schemaregistry.rest.SchemaRegistryRestApplication:67) > io.confluent.kafka.schemaregistry.exceptions.SchemaRegistryInitializationException: > Error initializing kafka store while initializing schema registry > at > io.confluent.kafka.schemaregistry.storage.KafkaSchemaRegistry.init(KafkaSchemaRegistry.java:219) > at > io.confluent.kafka.schemaregistry.rest.SchemaRegistryRestApplication.initSchemaRegistry(SchemaRegistryRestApplication.java:65) > at > io.confluent.kafka.schemaregistry.rest.SchemaRegistryRestApplication.setupResources(SchemaRegistryRestApplication.java:76) > at > io.confluent.kafka.schemaregistry.rest.SchemaRegistryRestApplication.setupResources(SchemaRegistryRestApplication.java:43) > at io.confluent.rest.Application.createServer(Application.java:201) > at > io.confluent.kafka.schemaregistry.rest.SchemaRegistryMain.main(SchemaRegistryMain.java:42) > Caused by: > io.confluent.kafka.schemaregistry.storage.exceptions.StoreInitializationException: > Failed trying to create or validate schema topic configuration > at > io.confluent.kafka.schemaregistry.storage.KafkaStore.createOrVerifySchemaTopic(KafkaStore.java:179) > at > io.confluent.kafka.schemaregistry.storage.KafkaStore.init(KafkaStore.java:116) > at > io.confluent.kafka.schemaregistry.storage.KafkaSchemaRegistry.init(KafkaSchemaRegistry.java:217) > ... 5 more > Caused by: java.util.concurrent.ExecutionException: > org.apache.kafka.common.errors.UnsupportedVersionException: The broker does > not support CREATE_TOPICS > at > org.apache.kafka.common.internals.KafkaFutureImpl.wrapAndThrow(KafkaFutureImpl.java:45) > at > org.apache.kafka.common.internals.KafkaFutureImpl.access$000(KafkaFutureImpl.java:32) > at > org.apache.kafka.common.internals.KafkaFutureImpl$SingleWaiter.await(KafkaFutureImpl.java:104) > at > org.apache.kafka.common.internals.KafkaFutureImpl.get(KafkaFutureImpl.java:272) > at > io.confluent.kafka.schemaregistry.storage.KafkaStore.createSchemaTopic(KafkaStore.java:218) > at > io.confluent.kafka.schemaregistry.storage.KafkaStore.createOrVerifySchemaTopic(KafkaStore.java:171) > ... 7 more > Caused by: org.apache.kafka.common.errors.UnsupportedVersionException: The > broker does not support CREATE_TOPICS > > Im using kafka_2.11-0.10.0.0 and confluent-5.2.1 > What would be the correct version to use? > > Best Regards, > Ramindu. > > On Wed, Jan 9, 2019 at 11:42 AM Shafana Safwan <[email protected]> wrote: > >> Hi Suho, >> >> Samples are done and PR is merged. >> >> Thank you. >> >> Regards, >> >> On Wed, Jan 9, 2019 at 9:03 AM Tishan Dahanayakage <[email protected]> >> wrote: >> >>> Hi Shafana, >>> >>> Added a comment. Please check. >>> >>> On Wed, Jan 9, 2019 at 12:41 AM Shafana Safwan <[email protected]> wrote: >>> >>>> Hi Tishan, >>>> >>>> Please merge my PR on Avro mapper samples for product sp. >>>> >>>> https://github.com/wso2/product-sp/pull/906 >>>> >>>> Thank you. >>>> Regards, >>>> >>>> On Tue, Jan 8, 2019 at 5:49 PM Shafana Safwan <[email protected]> wrote: >>>> >>>>> +1 >>>>> >>>>> ---------- Forwarded message --------- >>>>> From: Shafana Safwan <[email protected]> >>>>> Date: Tue, 8 Jan 2019, 09:32 >>>>> Subject: Re: Avro mapper not working with SP >>>>> To: Suhothayan Sriskandarajah <[email protected]> >>>>> >>>>> >>>>> Hi suho, >>>>> >>>>> I am almost done with it. Will put the PR today. >>>>> >>>>> Thank you. >>>>> >>>>> >>>>> On Tue, 8 Jan 2019, 00:10 Sriskandarajah Suhothayan, <[email protected]> >>>>> wrote: >>>>> >>>>>> Any update on this? >>>>>> >>>>>> >>>>>> On Fri, Jan 4, 2019 at 5:02 PM Sriskandarajah Suhothayan < >>>>>> [email protected]> wrote: >>>>>> >>>>>>> Thanks a lot. >>>>>>> >>>>>>> On Fri, Jan 4, 2019 at 4:21 PM Shafana Safwan <[email protected]> >>>>>>> wrote: >>>>>>> >>>>>>>> Hi Suho, >>>>>>>> >>>>>>>> I will get the avro mapper sample ready by next week. >>>>>>>> >>>>>>>> Thank you. >>>>>>>> >>>>>>>> On Fri, Jan 4, 2019 at 2:21 PM Sriskandarajah Suhothayan < >>>>>>>> [email protected]> wrote: >>>>>>>> >>>>>>>>> Please inform the team get this done, and continue the team's work! >>>>>>>>> >>>>>>>>> Suho >>>>>>>>> >>>>>>>>> On Fri, Jan 4, 2019 at 1:46 PM Shafana Safwan <[email protected]> >>>>>>>>> wrote: >>>>>>>>> >>>>>>>>>> Hi, >>>>>>>>>> >>>>>>>>>> I am in working in Installation Experience team. >>>>>>>>>> >>>>>>>>>> On Fri, Jan 4, 2019 at 1:14 PM Sriskandarajah Suhothayan < >>>>>>>>>> [email protected]> wrote: >>>>>>>>>> >>>>>>>>>>> Can you finish this first and move to the development as it has >>>>>>>>>>> delayed for a long time already. >>>>>>>>>>> This might need only about 2 days, is it? >>>>>>>>>>> What team are you working on? >>>>>>>>>>> >>>>>>>>>>> On Fri, Jan 4, 2019 at 1:12 PM Shafana Safwan <[email protected]> >>>>>>>>>>> wrote: >>>>>>>>>>> >>>>>>>>>>>> Hi Suho, >>>>>>>>>>>> >>>>>>>>>>>> I have fixed the above issue and made sure it will not occur >>>>>>>>>>>> again. Now Avro mapper can be used without any problem. >>>>>>>>>>>> No additional jars are need to be added. >>>>>>>>>>>> >>>>>>>>>>>> I have started working on writing a sample on avro mapper for >>>>>>>>>>>> SP. But I would need some time, since I am currently working on >>>>>>>>>>>> some >>>>>>>>>>>> developments in my team as well. >>>>>>>>>>>> >>>>>>>>>>>> Thank you. >>>>>>>>>>>> Regards, >>>>>>>>>>>> -- >>>>>>>>>>>> *Shafana Safwan* >>>>>>>>>>>> Software Engineer >>>>>>>>>>>> WSO2 >>>>>>>>>>>> lean . enterprise . middleware >>>>>>>>>>>> Mobile : +94(0) 754515687 >>>>>>>>>>>> <https://wso2.com/signature> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> On Mon, Dec 10, 2018 at 10:28 AM Shafana Safwan < >>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>> >>>>>>>>>>>>> Hi Suho, >>>>>>>>>>>>> >>>>>>>>>>>>> Will do ASAP. >>>>>>>>>>>>> >>>>>>>>>>>>> Regards, >>>>>>>>>>>>> Shafana >>>>>>>>>>>>> >>>>>>>>>>>>> On Sun, Dec 9, 2018 at 8:08 PM Sriskandarajah Suhothayan < >>>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>> >>>>>>>>>>>>>> Please share the doc how to use SP with Kafka and avro >>>>>>>>>>>>>> registry. >>>>>>>>>>>>>> >>>>>>>>>>>>>> Regards >>>>>>>>>>>>>> Suho >>>>>>>>>>>>>> >>>>>>>>>>>>>> On Sun, Dec 9, 2018 at 12:07 PM Sriskandarajah Suhothayan < >>>>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>>> >>>>>>>>>>>>>>> Hi Shafana >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> When I add the latest Avro mapper it's throwing the >>>>>>>>>>>>>>> following exception: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> org.osgi.framework.BundleException: Could not resolve >>>>>>>>>>>>>>> module: siddhi-map-avro [146] >>>>>>>>>>>>>>> Unresolved requirement: Import-Package: >>>>>>>>>>>>>>> org.apache.tapestry5.json >>>>>>>>>>>>>>> at org.eclipse.osgi.container.Module.start(Module.java:444) >>>>>>>>>>>>>>> at >>>>>>>>>>>>>>> org.eclipse.osgi.internal.framework.EquinoxBundle.start(EquinoxBundle.java:383) >>>>>>>>>>>>>>> at >>>>>>>>>>>>>>> org.eclipse.osgi.internal.framework.EquinoxBundle.start(EquinoxBundle.java:402) >>>>>>>>>>>>>>> at >>>>>>>>>>>>>>> org.eclipse.equinox.internal.simpleconfigurator.ConfigApplier.startBundles(ConfigApplier.java:453) >>>>>>>>>>>>>>> at >>>>>>>>>>>>>>> org.eclipse.equinox.internal.simpleconfigurator.ConfigApplier.install(ConfigApplier.java:111) >>>>>>>>>>>>>>> at >>>>>>>>>>>>>>> org.eclipse.equinox.internal.simpleconfigurator.SimpleConfiguratorImpl.applyConfiguration(SimpleConfiguratorImpl.java:191) >>>>>>>>>>>>>>> at >>>>>>>>>>>>>>> org.eclipse.equinox.internal.simpleconfigurator.SimpleConfiguratorImpl.applyConfiguration(SimpleConfiguratorImpl.java:205) >>>>>>>>>>>>>>> at >>>>>>>>>>>>>>> org.eclipse.equinox.internal.simpleconfigurator.Activator.start(Activator.java:60) >>>>>>>>>>>>>>> at >>>>>>>>>>>>>>> org.eclipse.osgi.internal.framework.BundleContextImpl$3.run(BundleContextImpl.java:774) >>>>>>>>>>>>>>> at >>>>>>>>>>>>>>> org.eclipse.osgi.internal.framework.BundleContextImpl$3.run(BundleContextImpl.java:1) >>>>>>>>>>>>>>> at java.security.AccessController.doPrivileged(Native Method) >>>>>>>>>>>>>>> at >>>>>>>>>>>>>>> org.eclipse.osgi.internal.framework.BundleContextImpl.startActivator(BundleContextImpl.java:767) >>>>>>>>>>>>>>> at >>>>>>>>>>>>>>> org.eclipse.osgi.internal.framework.BundleContextImpl.start(BundleContextImpl.java:724) >>>>>>>>>>>>>>> at >>>>>>>>>>>>>>> org.eclipse.osgi.internal.framework.EquinoxBundle.startWorker0(EquinoxBundle.java:932) >>>>>>>>>>>>>>> at >>>>>>>>>>>>>>> org.eclipse.osgi.internal.framework.EquinoxBundle$EquinoxModule.startWorker(EquinoxBundle.java:309) >>>>>>>>>>>>>>> at org.eclipse.osgi.container.Module.doStart(Module.java:581) >>>>>>>>>>>>>>> at org.eclipse.osgi.container.Module.start(Module.java:449) >>>>>>>>>>>>>>> at >>>>>>>>>>>>>>> org.eclipse.osgi.internal.framework.EquinoxBundle.start(EquinoxBundle.java:383) >>>>>>>>>>>>>>> at >>>>>>>>>>>>>>> org.eclipse.osgi.internal.framework.EquinoxBundle.start(EquinoxBundle.java:402) >>>>>>>>>>>>>>> at >>>>>>>>>>>>>>> org.wso2.carbon.launcher.CarbonServer.loadInitialBundles(CarbonServer.java:242) >>>>>>>>>>>>>>> at >>>>>>>>>>>>>>> org.wso2.carbon.launcher.CarbonServer.start(CarbonServer.java:83) >>>>>>>>>>>>>>> at org.wso2.carbon.launcher.Main.main(Main.java:84) >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Can you please update the Avro documentation home page with >>>>>>>>>>>>>>> the relevant other jars we need to add with this to make it >>>>>>>>>>>>>>> work on SP. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Regards >>>>>>>>>>>>>>> Suho >>>>>>>>>>>>>>> -- >>>>>>>>>>>>>>> *S. Suhothayan* | Director | WSO2 Inc. <https://wso2.com/> >>>>>>>>>>>>>>> (m) (+94) 779 756 757 | (e) [email protected] | (t) @suhothayan >>>>>>>>>>>>>>> <https://twitter.com/suhothayan> >>>>>>>>>>>>>>> GET INTEGRATION AGILE >>>>>>>>>>>>>>> Integration Agility for Digitally Driven Business >>>>>>>>>>>>>>> >>>>>>>>>>>>>> -- >>>>>>>>>>>>>> *S. Suhothayan* | Director | WSO2 Inc. <https://wso2.com/> >>>>>>>>>>>>>> (m) (+94) 779 756 757 | (e) [email protected] | (t) @suhothayan >>>>>>>>>>>>>> <https://twitter.com/suhothayan> >>>>>>>>>>>>>> GET INTEGRATION AGILE >>>>>>>>>>>>>> Integration Agility for Digitally Driven Business >>>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> -- >>>>>>>>>>>>> *Shafana Safwan* >>>>>>>>>>>>> Software Engineer >>>>>>>>>>>>> WSO2 >>>>>>>>>>>>> lean . enterprise . middleware >>>>>>>>>>>>> Mobile : +94(0) 754515687 >>>>>>>>>>>>> <https://wso2.com/signature> >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> -- >>>>>>>>>>> *S. Suhothayan* | Director | WSO2 Inc. <https://wso2.com/> >>>>>>>>>>> (m) (+94) 779 756 757 | (e) [email protected] | (t) @suhothayan >>>>>>>>>>> <https://twitter.com/suhothayan> >>>>>>>>>>> GET INTEGRATION AGILE >>>>>>>>>>> Integration Agility for Digitally Driven Business >>>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> -- >>>>>>>>>> *Shafana Safwan* >>>>>>>>>> Software Engineer >>>>>>>>>> WSO2 >>>>>>>>>> lean . enterprise . middleware >>>>>>>>>> Mobile : +94(0) 754515687 >>>>>>>>>> <https://wso2.com/signature> >>>>>>>>>> >>>>>>>>>> >>>>>>>>> >>>>>>>>> -- >>>>>>>>> *S. Suhothayan* | Director | WSO2 Inc. <https://wso2.com/> >>>>>>>>> (m) (+94) 779 756 757 | (e) [email protected] | (t) @suhothayan >>>>>>>>> <https://twitter.com/suhothayan> >>>>>>>>> GET INTEGRATION AGILE >>>>>>>>> Integration Agility for Digitally Driven Business >>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>>>> *Shafana Safwan* >>>>>>>> Software Engineer >>>>>>>> WSO2 >>>>>>>> lean . enterprise . middleware >>>>>>>> Mobile : +94(0) 754515687 >>>>>>>> <https://wso2.com/signature> >>>>>>>> >>>>>>>> >>>>>>> >>>>>>> -- >>>>>>> *S. Suhothayan* | Director | WSO2 Inc. <https://wso2.com/> >>>>>>> (m) (+94) 779 756 757 | (e) [email protected] | (t) @suhothayan >>>>>>> <https://twitter.com/suhothayan> >>>>>>> GET INTEGRATION AGILE >>>>>>> Integration Agility for Digitally Driven Business >>>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> *S. Suhothayan* | Director | WSO2 Inc. <https://wso2.com/> >>>>>> (m) (+94) 779 756 757 | (e) [email protected] | (t) @suhothayan >>>>>> <https://twitter.com/suhothayan> >>>>>> GET INTEGRATION AGILE >>>>>> Integration Agility for Digitally Driven Business >>>>>> >>>>> >>>> >>>> -- >>>> *Shafana Safwan* >>>> Software Engineer >>>> WSO2 >>>> lean . enterprise . middleware >>>> Mobile : +94(0) 754515687 >>>> <https://wso2.com/signature> >>>> >>>> >>> >>> -- >>> *Tishan Dahanayakage* | Associate Technical Lead | WSO2 Inc. >>> (m) +94716481328 | (w) +94112145345 | (e) [email protected] >>> GET INTEGRATION AGILE >>> Integration Agility for Digitally Driven Business >>> >>> Disclaimer: This communication may contain privileged or other >>> confidential information and is intended exclusively for the addressee/s. >>> If you are not the intended recipient/s, or believe that you may have >>> received this communication in error, please reply to the sender indicating >>> that fact and delete the copy you received and in addition, you should not >>> print, copy, re-transmit, disseminate, or otherwise use the information >>> contained in this communication. Internet communications cannot be >>> guaranteed to be timely, secure, error or virus-free. The sender does not >>> accept liability for any errors or omissions. >>> >> >> >> -- >> *Shafana Safwan* >> Software Engineer >> WSO2 >> lean . enterprise . middleware >> Mobile : +94(0) 754515687 >> <https://wso2.com/signature> >> >> -- >> You received this message because you are subscribed to the Google Groups >> "WSO2 Engineering Group" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to [email protected]. >> For more options, visit https://groups.google.com/a/wso2.com/d/optout. >> > > > -- > *Ramindu De Silva* > Associate Technical Lead > WSO2 Inc.: http://wso2.com > lean.enterprise.middleware > > email: [email protected] <[email protected]> > mob: +94 719678895 > -- *Ramindu De Silva* Associate Technical Lead WSO2 Inc.: http://wso2.com lean.enterprise.middleware email: [email protected] <[email protected]> mob: +94 719678895
_______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev
