Re: Schema Registry

2023-07-19 Thread Joe Witt
And looks like with NiFi 2.0 though we will drop the Hortonworks Schema Registry as shown here [1]. If maintenance becomes more active for it we could revisit as needed. [1] https://issues.apache.org/jira/browse/NIFI-11095 On Wed, Jul 19, 2023 at 12:32 PM Joe Witt wrote: > Hello >

Re: Schema Registry

2023-07-19 Thread Joe Witt
Hello You will want to check with Cloudera for the status of the Schema Registry in question here. From a NiFi point of view we will continue to integrate with schema registries we see in common usage and it should be set up well to plug in new ones and phase older ones as we go. Support

Re: Schema Registry

2023-07-19 Thread Dennis Suhari
Hi, as far as I know the Schema registry has developed into https://docs.cloudera.com/runtime/7.2.16/schema-registry-overview/topics/csp-schema_registry_overview.html with features like authorization and proper get schema (without proprietary envelope) methods. Br, Dennis Von meinem iPhone

Schema Registry

2023-07-18 Thread Jennifer L Tress
Hello, Is the Hortonworks Schema Registry still actively developed and supported? I would like to use RecordReaders and Writers in my NiFi data flow for transformations between schemas. Since Hortonworks was bought by Cloudera, I wanted to check that record serialization was still a use case

Re: How to use Confluent schema-registry with Publish/ConsumeKafka_2_0?

2020-05-04 Thread Bryan Bende
Hello, In your record readers/writer you need to use a Schema Access Strategy that uses a Schema Registry, like "Schema by Name" or in your case "Confluent Content-Encoded Schema Reference", which then goes to whichever schema registry is configured and asks for the schema

How to use Confluent schema-registry with Publish/ConsumeKafka_2_0?

2020-05-01 Thread David Hoffer
We are using the standard PublishKafka_2_0 and ConsumeKafka_2_0 NiFi processors but we would now like to use Confluent/Kafka schema-registry as well. How can I integrate this with these or other processors? Thanks, -Dave

NIFI - Kafka & confluent Schema registry example

2019-10-01 Thread KhajaAsmath Mohammed
Hi, I am looking for an example where I need to push data to kafka topic and at the same time use schema registry of confluent to use the schema for this topic. can anyone please share examples/templates if anyone has it. That would be really helpful. Thanks, Asmath

Re: Unable to connect to Confluent Schema Registry with credentials

2019-08-20 Thread Ali Nazemian
me and password, and then pass them down to the client calls. > > Feel free to create a JIRA to capture this improvement. > > On Mon, Aug 19, 2019 at 8:17 PM Ali Nazemian > wrote: > > > > I would like to use Confluent Schema Registry processor to retrieve a >

Re: Unable to connect to Confluent Schema Registry with credentials

2019-08-20 Thread Bryan Bende
> I would like to use Confluent Schema Registry processor to retrieve a schema > and use it accordingly. SSL is enabled for the confluent schema registry with > basic authentication. I am not able to get the Confluent Schema Registry > processor to work with the credentials. If I disa

Unable to connect to Confluent Schema Registry with credentials

2019-08-19 Thread Ali Nazemian
I would like to use Confluent Schema Registry processor to retrieve a schema and use it accordingly. SSL is enabled for the confluent schema registry with basic authentication. I am not able to get the Confluent Schema Registry processor to work with the credentials. If I disable credentials

Re: Weird behavior w/ HWX schema registry new builds

2019-04-15 Thread Juan Pablo Gardella
On Mon, 15 Apr 2019 at 13:46, Michael Pearce wrote: > Sounds like a client compatibility issue, maybe raise a bug on HWX schema > registry, pretty bad to be breaking api calls. > > > > *From: *Juan Pablo Gardella > *Reply-To: *"users@nifi.apache.org" > *

Re: Weird behavior w/ HWX schema registry new builds

2019-04-15 Thread Michael Pearce
Sounds like a client compatibility issue, maybe raise a bug on HWX schema registry, pretty bad to be breaking api calls. From: Juan Pablo Gardella Reply-To: "users@nifi.apache.org" Date: Monday, April 15, 2019 at 5:44 PM To: "users@nifi.apache.org" Subject: Re: Weird be

Re: Weird behavior w/ HWX schema registry new builds

2019-04-15 Thread Mike Thomsen
Worked fine after that? If so, I'll write up a PR. Thanks, Mike On Mon, Apr 15, 2019 at 12:44 PM Juan Pablo Gardella < gardellajuanpa...@gmail.com> wrote: > I had to rebuild it using a newer version of HWX client. > > On Mon, 15 Apr 2019 at 13:24, Mike Thomsen wrote: > >> We deployed 0.7.0

Re: Weird behavior w/ HWX schema registry new builds

2019-04-15 Thread Juan Pablo Gardella
I had to rebuild it using a newer version of HWX client. On Mon, 15 Apr 2019 at 13:24, Mike Thomsen wrote: > We deployed 0.7.0 and started running into issues with it saying it could > not find a schema. Really weird since we can see the schema in the UI and > get the metadata about it with the

Weird behavior w/ HWX schema registry new builds

2019-04-15 Thread Mike Thomsen
We deployed 0.7.0 and started running into issues with it saying it could not find a schema. Really weird since we can see the schema in the UI and get the metadata about it with the same call that returns a failure message. Anyone seen similar behavior or have any idea what might be happening?

Re: Preferred schema registry

2019-01-16 Thread Andrew Grande
Isn't AvroSchemaRegistry an embedded one to NiFi? I.e. it's not a comparable alternative to an external dedicated schema registry. Andrew On Wed, Jan 16, 2019 at 7:43 AM Mike Thomsen wrote: > I think I figured out what it was. We backed out a change and it was > fungible with an e

Re: Preferred schema registry

2019-01-16 Thread Mike Thomsen
at 10:39 AM Bryan Bende wrote: > Mike, > > Do you have anymore details about why the Hortonworks schema registry > stopped working? > > I have used it before and didn’t have any issues. > > Thanks > > Bryan > > On Tue, Jan 15, 2019 at 8:38 PM dan young wrote:

Re: Preferred schema registry

2019-01-16 Thread Bryan Bende
Mike, Do you have anymore details about why the Hortonworks schema registry stopped working? I have used it before and didn’t have any issues. Thanks Bryan On Tue, Jan 15, 2019 at 8:38 PM dan young wrote: > We used the AvroSchemaRegistry > > Dano > > On Tue, Jan 15, 2019

Re: Preferred schema registry

2019-01-15 Thread dan young
We used the AvroSchemaRegistry Dano On Tue, Jan 15, 2019, 12:51 PM Mike Thomsen What schema registry are others using in production use cases? We tried > out the HortonWorks registry, but it seemed to stop accepting updates once > we hit "v3" of our schema (we didn't na

Re: Preferred schema registry

2019-01-15 Thread Sivaprasanna
We are using AvroSchemaRegistry on our side. On Wed, 16 Jan 2019 at 1:21 AM, Mike Thomsen wrote: > What schema registry are others using in production use cases? We tried > out the HortonWorks registry, but it seemed to stop accepting updates once > we hit "v3" of our sch

Preferred schema registry

2019-01-15 Thread Mike Thomsen
What schema registry are others using in production use cases? We tried out the HortonWorks registry, but it seemed to stop accepting updates once we hit "v3" of our schema (we didn't name it v3, that's the version it showed in the UI). So I'd like to know what others are doing for thei

Re: Kafka Schema registry

2016-04-13 Thread Joe Witt
Joe, >> >> We are using Confluent version Kafka and using its schema registry to store >> Avro schema. we would like continue same with Nifi writing avro file to >> Confluent Kafka Schema registry. >> >> http://docs.confluent.io/2.0.0/schema-registry/docs/index.h

Re: Kafka Schema registry

2016-04-13 Thread Joe Witt
at 2:09 PM, Madhukar Thota <madhukar.th...@gmail.com> wrote: > Hi Joe, > > We are using Confluent version Kafka and using its schema registry to store > Avro schema. we would like continue same with Nifi writing avro file to > Confluent Kafka Schema registry. > > http://doc

Re: Kafka Schema registry

2016-04-13 Thread Madhukar Thota
Hi Joe, We are using Confluent version Kafka and using its schema registry to store Avro schema. we would like continue same with Nifi writing avro file to Confluent Kafka Schema registry. http://docs.confluent.io/2.0.0/schema-registry/docs/index.html -Madhu On Wed, Apr 13, 2016 at 1:48 PM

Re: Kafka Schema registry

2016-04-13 Thread Joe Witt
? Thanks Joe On Wed, Apr 13, 2016 at 1:34 PM, Madhukar Thota <madhukar.th...@gmail.com> wrote: > Friends, > > Is it possible to use Schema registry with Kafka Processors to store and > retrive Avro schema? > > -Madhu

Kafka Schema registry

2016-04-13 Thread Madhukar Thota
Friends, Is it possible to use Schema registry with Kafka Processors to store and retrive Avro schema? -Madhu