Re: [Dev] Avro mapper not working with SP
Folks,
Shafana is on maternity leave, so i don't think she'll be able to look into
this.
On Fri, Apr 26, 2019 at 9:43 PM Ramindu De Silva wrote:
> Hi Shafana,
>
> Any update on this?
>
> Best Regards,
> Ramindu.
>
> On Thu, Apr 25, 2019 at 10:28 PM Ramindu De Silva
> wrote:
>
>> Hi Shafana,
>>
>> I tried the following step in the "PublishKafkaInCustomAvroFormat" sample.
>>
>> Navigate to {ConfluentHome} and start the schema registry node using,
>> bin/schema-registry-start ./etc/schema-registry/schema-registry.properties
>>
>> And it resulted me with the following.
>>
>> Ramindus-MacBook-Pro:confluent-5.2.1 ramindu$ bin/schema-registry-start
>> ./etc/schema-registry/schema-registry.properties
>> [2019-04-25 22:10:21,661] INFO SchemaRegistryConfig values:
>> resource.extension.class = []
>> metric.reporters = []
>> kafkastore.sasl.kerberos.kinit.cmd = /usr/bin/kinit
>> response.mediatype.default = application/vnd.schemaregistry.v1+json
>> resource.extension.classes = []
>> kafkastore.ssl.trustmanager.algorithm = PKIX
>> inter.instance.protocol = http
>> authentication.realm =
>> ssl.keystore.type = JKS
>> kafkastore.topic = _schemas
>> metrics.jmx.prefix = kafka.schema.registry
>> kafkastore.ssl.enabled.protocols = TLSv1.2,TLSv1.1,TLSv1
>> kafkastore.topic.replication.factor = 3
>> ssl.truststore.password = [hidden]
>> kafkastore.timeout.ms = 500
>> host.name = localhost
>> kafkastore.bootstrap.servers = []
>> schema.registry.zk.namespace = schema_registry
>> kafkastore.sasl.kerberos.ticket.renew.window.factor = 0.8
>> kafkastore.sasl.kerberos.service.name =
>> schema.registry.resource.extension.class = []
>> ssl.endpoint.identification.algorithm =
>> compression.enable = true
>> kafkastore.ssl.truststore.type = JKS
>> avro.compatibility.level = backward
>> kafkastore.ssl.protocol = TLS
>> kafkastore.ssl.provider =
>> kafkastore.ssl.truststore.location =
>> response.mediatype.preferred = [application/vnd.schemaregistry.v1+json,
>> application/vnd.schemaregistry+json, application/json]
>> kafkastore.ssl.keystore.type = JKS
>> authentication.skip.paths = []
>> ssl.truststore.type = JKS
>> websocket.servlet.initializor.classes = []
>> kafkastore.ssl.truststore.password = [hidden]
>> access.control.allow.origin =
>> ssl.truststore.location =
>> ssl.keystore.password = [hidden]
>> port = 8081
>> access.control.allow.headers =
>> kafkastore.ssl.keystore.location =
>> metrics.tag.map = {}
>> master.eligibility = true
>> ssl.client.auth = false
>> kafkastore.ssl.keystore.password = [hidden]
>> rest.servlet.initializor.classes = []
>> websocket.path.prefix = /ws
>> kafkastore.security.protocol = PLAINTEXT
>> ssl.trustmanager.algorithm =
>> authentication.method = NONE
>> request.logger.name = io.confluent.rest-utils.requests
>> ssl.key.password = [hidden]
>> kafkastore.zk.session.timeout.ms = 3
>> kafkastore.sasl.mechanism = GSSAPI
>> kafkastore.sasl.kerberos.ticket.renew.jitter = 0.05
>> kafkastore.ssl.key.password = [hidden]
>> zookeeper.set.acl = false
>> schema.registry.inter.instance.protocol =
>> authentication.roles = [*]
>> metrics.num.samples = 2
>> ssl.protocol = TLS
>> schema.registry.group.id = schema-registry
>> kafkastore.ssl.keymanager.algorithm = SunX509
>> kafkastore.connection.url = localhost:2181
>> debug = false
>> listeners = [http://0.0.0.0:8081]
>> kafkastore.group.id =
>> ssl.provider =
>> ssl.enabled.protocols = []
>> shutdown.graceful.ms = 1000
>> ssl.keystore.location =
>> resource.static.locations = []
>> ssl.cipher.suites = []
>> kafkastore.ssl.endpoint.identification.algorithm =
>> mode.mutability = false
>> kafkastore.ssl.cipher.suites =
>> access.control.allow.methods =
>> kafkastore.sasl.kerberos.min.time.before.relogin = 6
>> ssl.keymanager.algorithm =
>> metrics.sample.window.ms = 3
>> kafkastore.init.timeout.ms = 6
>> (io.confluent.kafka.schemaregistry.rest.SchemaRegistryConfig:179)
>> [2019-04-25 22:10:21,717] INFO Logging initialized @629ms to
>> org.eclipse.jetty.util.log.Slf4jLog (org.eclipse.jetty.util.log:193)
>> [2019-04-25 22:10:22,725] INFO Created schema registry namespace
>> localhost:2181 /schema_registry
>> (io.confluent.kafka.schemaregistry.rest.SchemaRegistryConfig:709)
>> [2019-04-25 22:10:22,852] INFO Initializing KafkaStore with broker
>> endpoints: PLAINTEXT://localhost:9092
>> (io.confluent.kafka.schemaregistry.storage.KafkaStore:105)
>> [2019-04-25 22:10:23,105] INFO Creating schemas topic _schemas
>> (io.confluent.kafka.schemaregistry.storage.KafkaStore:190)
>> [2019-04-25 22:10:23,107] WARN Creating the schema topic _schemas using a
>> replication factor of 1, which is less than the desired one of 3. If this
>> is a production environment, it's crucial to add more brokers and increase
>> the replication factor of the topic.
>> (io.confluent.kafka.schemaregistry.storage.KafkaStore:200)
>> [2019-04-25 22:10:23,116] ERROR Error starting the schema registry
>> (io.confluent.kafka.schemaregistry.rest.SchemaRegistryRestApplication:67)
>> io.
Re: [Dev] Avro mapper not working with SP
Hi Shafana,
Any update on this?
Best Regards,
Ramindu.
On Thu, Apr 25, 2019 at 10:28 PM Ramindu De Silva wrote:
> Hi Shafana,
>
> I tried the following step in the "PublishKafkaInCustomAvroFormat" sample.
>
> Navigate to {ConfluentHome} and start the schema registry node using,
> bin/schema-registry-start ./etc/schema-registry/schema-registry.properties
>
> And it resulted me with the following.
>
> Ramindus-MacBook-Pro:confluent-5.2.1 ramindu$ bin/schema-registry-start
> ./etc/schema-registry/schema-registry.properties
> [2019-04-25 22:10:21,661] INFO SchemaRegistryConfig values:
> resource.extension.class = []
> metric.reporters = []
> kafkastore.sasl.kerberos.kinit.cmd = /usr/bin/kinit
> response.mediatype.default = application/vnd.schemaregistry.v1+json
> resource.extension.classes = []
> kafkastore.ssl.trustmanager.algorithm = PKIX
> inter.instance.protocol = http
> authentication.realm =
> ssl.keystore.type = JKS
> kafkastore.topic = _schemas
> metrics.jmx.prefix = kafka.schema.registry
> kafkastore.ssl.enabled.protocols = TLSv1.2,TLSv1.1,TLSv1
> kafkastore.topic.replication.factor = 3
> ssl.truststore.password = [hidden]
> kafkastore.timeout.ms = 500
> host.name = localhost
> kafkastore.bootstrap.servers = []
> schema.registry.zk.namespace = schema_registry
> kafkastore.sasl.kerberos.ticket.renew.window.factor = 0.8
> kafkastore.sasl.kerberos.service.name =
> schema.registry.resource.extension.class = []
> ssl.endpoint.identification.algorithm =
> compression.enable = true
> kafkastore.ssl.truststore.type = JKS
> avro.compatibility.level = backward
> kafkastore.ssl.protocol = TLS
> kafkastore.ssl.provider =
> kafkastore.ssl.truststore.location =
> response.mediatype.preferred = [application/vnd.schemaregistry.v1+json,
> application/vnd.schemaregistry+json, application/json]
> kafkastore.ssl.keystore.type = JKS
> authentication.skip.paths = []
> ssl.truststore.type = JKS
> websocket.servlet.initializor.classes = []
> kafkastore.ssl.truststore.password = [hidden]
> access.control.allow.origin =
> ssl.truststore.location =
> ssl.keystore.password = [hidden]
> port = 8081
> access.control.allow.headers =
> kafkastore.ssl.keystore.location =
> metrics.tag.map = {}
> master.eligibility = true
> ssl.client.auth = false
> kafkastore.ssl.keystore.password = [hidden]
> rest.servlet.initializor.classes = []
> websocket.path.prefix = /ws
> kafkastore.security.protocol = PLAINTEXT
> ssl.trustmanager.algorithm =
> authentication.method = NONE
> request.logger.name = io.confluent.rest-utils.requests
> ssl.key.password = [hidden]
> kafkastore.zk.session.timeout.ms = 3
> kafkastore.sasl.mechanism = GSSAPI
> kafkastore.sasl.kerberos.ticket.renew.jitter = 0.05
> kafkastore.ssl.key.password = [hidden]
> zookeeper.set.acl = false
> schema.registry.inter.instance.protocol =
> authentication.roles = [*]
> metrics.num.samples = 2
> ssl.protocol = TLS
> schema.registry.group.id = schema-registry
> kafkastore.ssl.keymanager.algorithm = SunX509
> kafkastore.connection.url = localhost:2181
> debug = false
> listeners = [http://0.0.0.0:8081]
> kafkastore.group.id =
> ssl.provider =
> ssl.enabled.protocols = []
> shutdown.graceful.ms = 1000
> ssl.keystore.location =
> resource.static.locations = []
> ssl.cipher.suites = []
> kafkastore.ssl.endpoint.identification.algorithm =
> mode.mutability = false
> kafkastore.ssl.cipher.suites =
> access.control.allow.methods =
> kafkastore.sasl.kerberos.min.time.before.relogin = 6
> ssl.keymanager.algorithm =
> metrics.sample.window.ms = 3
> kafkastore.init.timeout.ms = 6
> (io.confluent.kafka.schemaregistry.rest.SchemaRegistryConfig:179)
> [2019-04-25 22:10:21,717] INFO Logging initialized @629ms to
> org.eclipse.jetty.util.log.Slf4jLog (org.eclipse.jetty.util.log:193)
> [2019-04-25 22:10:22,725] INFO Created schema registry namespace
> localhost:2181 /schema_registry
> (io.confluent.kafka.schemaregistry.rest.SchemaRegistryConfig:709)
> [2019-04-25 22:10:22,852] INFO Initializing KafkaStore with broker
> endpoints: PLAINTEXT://localhost:9092
> (io.confluent.kafka.schemaregistry.storage.KafkaStore:105)
> [2019-04-25 22:10:23,105] INFO Creating schemas topic _schemas
> (io.confluent.kafka.schemaregistry.storage.KafkaStore:190)
> [2019-04-25 22:10:23,107] WARN Creating the schema topic _schemas using a
> replication factor of 1, which is less than the desired one of 3. If this
> is a production environment, it's crucial to add more brokers and increase
> the replication factor of the topic.
> (io.confluent.kafka.schemaregistry.storage.KafkaStore:200)
> [2019-04-25 22:10:23,116] ERROR Error starting the schema registry
> (io.confluent.kafka.schemaregistry.rest.SchemaRegistryRestApplication:67)
> io.confluent.kafka.schemaregistry.exceptions.SchemaRegistryInitializationException:
> Error initializing kafka store while initializing schema registry
> at
> io.confluent.kafka.schemaregistry.storage.KafkaSchemaRegistry.init(KafkaSchemaRegistry.java:219)
> at
> io.confluent.kafka
