Fwd: Large scale Secure MiNiFi deployments

2016-12-06 Thread Andre
Devs, Following up on this message I posted on Users, I have raised the following Feature Proposal so we can cater for controlled access of MiNiFi agents using exist, without creating too much overhead around access policy management. https://cwiki.apache.org/confluence/display/NIFI/Feature+propo

Re: Providing a uuid for a FlowFile

2016-12-06 Thread Stefán Baxter
it does, thank you. -Stefán On Tue, Dec 6, 2016 at 9:06 PM, Bryan Bende wrote: > Stefan, > > I believe the UUID attribute is treated as a special attribute internally > in NiFi. > > Depending how the data comes in to the system, such as site-to-site or > ListenHTTP, it will usually look to see

ComponentLog missing from 0.7.1 JAR...

2016-12-06 Thread Russell Bateman
I've had this problem with an old version for some time (I'm really concentrating more on NiFi 1.x now) and I have to fix it. I'm pulling my hair out a bit. We eliminated all use of ProcessorLogeven in this older code that we're trying to keep running on 0.7.1 and maintaining when we must. In

Re: Providing a uuid for a FlowFile

2016-12-06 Thread Bryan Bende
Stefan, I believe the UUID attribute is treated as a special attribute internally in NiFi. Depending how the data comes in to the system, such as site-to-site or ListenHTTP, it will usually look to see if there is a UUID attribute (or a head in the case of ListenHTTP) and use that UUID to create

Re: Issues with GetSolr

2016-12-06 Thread Bryan Bende
Hello, GetSolr was made to do incremental extraction of new records from a core/collection. The idea would be to schedule the processor on a standard interval, say every 5 mins, and extract the new records in the last 5 minutes. In order to do this it needs a way to determine which records were ne

Ideas for drop-in NiFi processor scheduling

2016-12-06 Thread Irizarry Jr., Nazario
I have been looking at how/whether NiFi can be used for mission-critical workflow orchestration. While there are various aspects to what this means, I am interested in how to modify/adapt NiFi to factor in task deadlines and task duration to do predictive scheduling. This is pretty different th

Re: Unable to List Queue with Policy

2016-12-06 Thread Ricky Saltzer
Joe - You're a life saver! Cheers! Ricky On Tue, Dec 6, 2016 at 2:21 PM, Joe Gresock wrote: > Hi Ricky, > > I ran into this recently: you have to give your proxying server access to > View the Data. > > On Tue, Dec 6, 2016 at 7:15 PM, Ricky Saltzer wrote: > > > Hi - > > > > I am struggling wi

Re: Unable to List Queue with Policy

2016-12-06 Thread Joe Gresock
Hi Ricky, I ran into this recently: you have to give your proxying server access to View the Data. On Tue, Dec 6, 2016 at 7:15 PM, Ricky Saltzer wrote: > Hi - > > I am struggling with allowing myself to list any connection queue. I have > given myself every permission possible for the entire da

Unable to List Queue with Policy

2016-12-06 Thread Ricky Saltzer
Hi - I am struggling with allowing myself to list any connection queue. I have given myself every permission possible for the entire data flow, but even still, I am told I do not have permission to list a data queue. In addition, there is seemingly zero records in the provenance reporter, even tho

Issues with GetSolr

2016-12-06 Thread srini
Hello, - Why is date field mandatory field? - On our solr, standard and version is 3.6, I am getting this error "Expected mime type application/octet-stream but got text/html" - On our solr, cloud and version 5.3.1, I am getting this error "org.apache.solr.common.SolrException: java.util.concurren