Re: How to read a schema from a ScriptedReader

2020-04-09 Thread Jairo Henao
Thanks Matt, Yes, I am subscribed to the development list. I will review your comments. At the moment I am adding the schemas as additional properties to the ScriptedReader. I will try what you mention to access SchemaRegistry and send you some comments. On Wed, Apr 8, 2020 at 10:30 PM Matt Bu

Re: How to read a schema from a ScriptedReader

2020-04-08 Thread Matt Burgess
As a follow up, while implementing [1] I ran into [2] which is a larger issue but affects the RecordSetWriters more than Readers as they add more properties that are expected to come (in our case) from the script. That makes things a bit more complicated, but I am still looking into it. If you are

Re: How to read a schema from a ScriptedReader

2020-04-08 Thread Matt Burgess
Jairo, We should probably move this to the dev list since we're getting into the NiFi API, but I wasn't sure you were subscribed, if you are let me know and we can move it over there. StandardConfigurationContext is in framework-core so you should not count on being able to use that class per se.

Re: How to read a schema from a ScriptedReader

2020-04-08 Thread Jairo Henao
Thanks Matt, I have made some changes using AvroReader as an example, but I am still able to access other ControllerServices. >From the RecordReaderFactory I have access to a context that is of type *org.apache.nifi.controller.service.StandardConfigurationContext* but with this I don't know how t

Re: How to read a schema from a ScriptedReader

2020-04-08 Thread Matt Burgess
Jairo, It is possible for a ScriptedReader to use a SchemaRegistry, although it isn't currently as easy as it could be. When the Scripted Reader/Writer components were added [1], much of the reusable code for schema registry processing was in the service implementation NAR, so the aforementioned J

How to read a schema from a ScriptedReader

2020-04-08 Thread Jairo Henao
Hi all, Is there a way from a ScriptedReader (Controller Service) to read a schema that is stored in an AvroSchemaRegistry? I am using Groovy as a language. Additionally, how can I read additional properties that I have added to my ControllerService from Groovy code. Thanks in advance -- Sal