Re: need parse first few lines to customize a header for csv

Hi What about the ReplaceText. If you know it will always be 4 header lines, you could use a regex like this: ^topic.*?$ ^.*?$ ^.*?$ ^.*?$ or using 4 ReplaceText after each other, only replacing First-Line. regards Jens M. Kofoed Den fre. 31. jul. 2020 kl. 21.09 skrev gemlan123 : > I have some

need parse first few lines to customize a header for csv

I have some csv files with first few lines like this: topic: abc ,, some comments: xxx,, col1,col2,col3,flag , ,,,col4,col5 data1,data2,data3,data4,data5 .. I want to parse the first 4 lines and have a flowfile like: col1,col2,col3,col4,col5 data1,data2,data3,data4,data5 try to use Rout

Re: Updating the Concurent Tasks of a NiFi processor using Rest API

It's just update processor with that property altered, simples :) On Fri, 31 Jul 2020, 16:32 Mohit Jain, wrote: > Thanks Otto, > > That helped. > > > On Fri, Jul 31, 2020 at 4:54 PM Otto Fowler > wrote: > >> If you do it from a browser, and are using the browser debugging tools, >> you will be

Re: NiFi Merge Content Processor Use Case

I have created a JIRA issue for this: https://issues.apache.org/jira/browse/NIFI-7699 On Fri, Jul 31, 2020 at 10:20 AM Eric Secules wrote: > Hi Joe, > > Thanks for your suggestions and analysis! > > I was also thinking that the MergeContent processor could also have a wait > relationship so that

Re: NiFi Merge Content Processor Use Case

Hi Joe, Thanks for your suggestions and analysis! I was also thinking that the MergeContent processor could also have a wait relationship so that way we can distinguish between new flowfiles and flowfiles that didn't fit into a bucket before. Does NiFi have the ability to distinguish between flow

Re: Updating the Concurent Tasks of a NiFi processor using Rest API

Thanks Otto, That helped. On Fri, Jul 31, 2020 at 4:54 PM Otto Fowler wrote: > If you do it from a browser, and are using the browser debugging tools, > you will be able to catch the call. Everything you do in the web can be > done from rest somehow. > > > > > On July 31, 2020 at 06:47:06, Mo

Re: NiFi Merge Content Processor Use Case

Eric I believe for now the most appropriate option available is to figure out what the maximum set of outstanding in process buckets could be and set that. Hopefully there is enough memory in the system to handle whatever that worse case could be in terms of flowfiles attributes being held in mem

NiFi Merge Content Processor Use Case

Is it possible to surround the merge content processor with a wait/notify to enforce that only unique fragment identifiers are allowed into the merge process at one time? I'd rather have the merge processor only force buckets out based on time. If there's contention for buckets I'd rather the inco

Re: ExecuteSQL Unable to resolve union for value

Hi Matt, we're having here the same issue but with InformixDB, where we can not fetch 'serial' type column. What is weird it only happens when we use ExecuteSQL processor, and with ExecuteSQLRecord with AvroRecordSetWriter (default settings) somehow it works. The reason why we don't use ExecuteSQL

Re: Updating the Concurent Tasks of a NiFi processor using Rest API

If you do it from a browser, and are using the browser debugging tools, you will be able to catch the call. Everything you do in the web can be done from rest somehow. On July 31, 2020 at 06:47:06, Mohit Jain (mo...@open-insights.com) wrote: Hi Team, Is there a Rest API to change the number

Updating the Concurent Tasks of a NiFi processor using Rest API

Hi Team, Is there a Rest API to change the number of concurrent tasks? I wasn't able to find any in the doc. Any leads would be appreciated. Thanks, Mohit