Re: *Kafka processors

2017-07-27 Thread Joe Witt
Lauren, The PublishKafka processor series is where we really dug into the details of the Kafka API and build the processors in a manner far more aligned to the Kafka style. They work well. The PublishKafkaRecord processor though is *really* nice in terms of performance and it means it is part of

*Kafka processors

2017-07-27 Thread Laurens Vets
Hi list, Simple question really, which Kafka processor should I use to stream items into Kafka, more specifically, Kafka as it is used in Apache Metron 0.4.0. The sources are very small (1KB) JSON messages.

Re: Using QueryDatabaseTable processor in MiNiFi

2017-07-27 Thread Aldrin Piri
Okay, thanks for the update. Figuring out where things went awry would be helpful to make that process easier. We certainly have a lot of room to improve on our documentation. On Thu, Jul 27, 2017 at 3:27 PM, Jeff Zemerick wrote: > I went through the steps again and it worked fine so it was

Re: Using QueryDatabaseTable processor in MiNiFi

2017-07-27 Thread Jeff Zemerick
I went through the steps again and it worked fine so it was total user failure somewhere on my part. I am curious as to where I went wrong so I am trying to reproduce it to see if it's worth any documentation updates. Thanks, Jeff On Thu, Jul 27, 2017 at 10:09 AM, Aldrin Piri wrote: > Hey Jeff

Re: Issue with GenerateTableFetch bulk load when using MS SQL Server database type

2017-07-27 Thread Matt Burgess
This can be considered a bug, at least in the sense that it is not consistent with how the Generic DB Adapter handles it (i.e. no requirement for an order by clause). Not to say that it's a good idea to not have an ORDER BY clause when you are getting pages of rows, but in this case, the incrementa

Re: Using QueryDatabaseTable processor in MiNiFi

2017-07-27 Thread Aldrin Piri
Hey Jeff, Could you please provide a full nifi-app.log of the startup? Thanks, Aldrin On Thu, Jul 27, 2017 at 10:04 AM, Jeff Zemerick wrote: > I have a small flow that was exported from NiFi and it uses a > QueryDatabaseTable processor. When the flow is converted to yaml and set in > MiNiFi I

Using QueryDatabaseTable processor in MiNiFi

2017-07-27 Thread Jeff Zemerick
I have a small flow that was exported from NiFi and it uses a QueryDatabaseTable processor. When the flow is converted to yaml and set in MiNiFi I get the following error in MiNiFi's app log: ERROR [main] o.apache.nifi.controller.FlowController Could not create Processor of type org.apache.nifi.pr

Re: Reload authorizers.xml file at runtime

2017-07-27 Thread Matt Gilman
Kumar, There is no alternative solution. During your initial configuration, you need to define the admin user. See your SO question for answers to those questions. Thanks Matt On Thu, Jul 27, 2017 at 5:42 AM, kumar r wrote: > Hi Matt, > > Thank you for the response. > > Is there any alternate

Re: Reload authorizers.xml file at runtime

2017-07-27 Thread kumar r
Hi Matt, Thank you for the response. Is there any alternate solution to achieve this? Also please look at my another stack overflow question https://stackoverflow.com/questions/45346902/multiple-initial-admin-or-initial-admin-group Thanks, Kumar On Wed, Jul 26, 2017 at 6:57 PM, Matt Gilman wr