Multiple Database Inserts and Strategy.

2017-07-19 Thread Noel Alex Makumuli
Hello, I have two simple questions regarding Nifi and inserting a bunch of data into MySQL. My data is coming from xml sources and I need to extract then transform to get the data I need and then load it into MySQL database. Now I am facing two issues which are specifically how to go on about si

Re: Tools to directly edit flowfile.xml.gz?

2017-07-19 Thread James McMahon
I sure will. Thank you very much for your insights Andy. On Wed, Jul 19, 2017 at 3:59 PM, Andy LoPresto wrote: > No, you can simply recompress it using gzip and NiFi will read it just > fine. For a programmatic example, you can also look at ConfigEncryptionTool > in the NiFi toolkit. > > Andy Lo

Re: Tools to directly edit flowfile.xml.gz?

2017-07-19 Thread Andy LoPresto
No, you can simply recompress it using gzip and NiFi will read it just fine. For a programmatic example, you can also look at ConfigEncryptionTool in the NiFi toolkit. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF

Re: Tools to directly edit flowfile.xml.gz?

2017-07-19 Thread James McMahon
Thank you Andy. After any edits to the unzipped xml file, are there any particular options required by NiFi when the file is re-zipped with, say, gzip, so that NiFi does not reject it at start time? -Jim On Wed, Jul 19, 2017 at 2:58 PM, Andy LoPresto wrote: > Jim, > > It is compressed using GZIP

Re: Tools to directly edit flowfile.xml.gz?

2017-07-19 Thread Andy LoPresto
Jim, It is compressed using GZIP, so you can simply uncompress the file to view/modify the raw XML content of the flow definition. I wouldn’t recommend editing the file directly in daily use, but I certainly do this for debugging problematic user flows or when I was working on the sensitive pro

Tools to directly edit flowfile.xml.gz?

2017-07-19 Thread James McMahon
Had an inquiry today whether flowfile.xml.gz can be modified indirectly outside of the UI? It appears to be an encoded file of some sort so I am guessing it is not possible, but wondered whether any tools had been developed to do that? The use case would be to apply changes to a baseline flowfile.

Re: ExecuteSQL with MSSQL Server Express

2017-07-19 Thread Andrew Grande
Try with forward slashes, please. On Wed, Jul 19, 2017, 12:17 PM Praveen Reddy wrote: > Hi, > > I am using ExecuteSQL processor to connect with MSSql server express to > get some data. But I am getting the below exception: > > [image: Inline image 1] > > My Connection URL is: > *jdbc:sqlserv

ExecuteSQL with MSSQL Server Express

2017-07-19 Thread Praveen Reddy
Hi, I am using ExecuteSQL processor to connect with MSSql server express to get some data. But I am getting the below exception: [image: Inline image 1] My Connection URL is: *jdbc:sqlserver:\\localhost\SQLEXPRESS:1433;Database=Test* Driver class name is* : com.microsoft.sqlserver.jdbc.S

Re: Accessing SQL data and Updating the attributes

2017-07-19 Thread Praveen Reddy
Hi Andy, Thank you for your thoughts. I will try out this. With Best Regards, Praveen.B On Tue, Jul 18, 2017 at 10:52 PM, Andy LoPresto wrote: > You will likely need to use ExecuteSQL to query the database and you can > reference attributes on the incoming flowfile using Expression Language. >

Re: NiFi v1.1.1 - org.apache.nifi.controller.FlowController cannot be cast to org.apache.nifi.controller.FlowController

2017-07-19 Thread Mark Payne
Santosh, That is accurate. Each NAR has its own isolated ClassLoader. Each NAR can also have a Parent NAR, which results in specifying the parent ClassLoader. This is explained in more detail in the Developer Guide [1], in the NiFi Archive (NAR) section [2]. Thanks -Mark [1] http://nifi.apach

Re: Nifi doesn't work behind reverse proxy

2017-07-19 Thread Matt Gilman
Awesome. Glad you got everything working. I've filed a JIRA for updating the documentation accordingly [1]. Matt [1] https://issues.apache.org/jira/browse/NIFI-4206 On Wed, Jul 19, 2017 at 8:31 AM, Raviteja Lokineni < raviteja.lokin...@gmail.com> wrote: > Hi all, > > This is what I used in http

Re: Nifi doesn't work behind reverse proxy

2017-07-19 Thread Raviteja Lokineni
Hi all, This is what I used in httpd/conf.d/nifi.conf to resolve the problem: ProxyPass/ http://:8080/ > ProxyPassReverse / http://:8080/ > RequestHeader add X-ProxyScheme "http" > RequestHeader add X-ProxyHost "" > RequestHeader add X-ProxyPort "80" > RequestHeader add X-ProxyContextPa

Nifi doesn't work behind reverse proxy

2017-07-19 Thread Raviteja Lokineni
Hi all, I was trying to configure a Nifi instance under Apache HTTPD reverse proxy. So I have set the following property: nifi.web.http.port.forwarding=80 but the nifi api still tries to communicate over 8080. Am I missing something? Version: 1.3.0 Thanks, -- *Raviteja Lokineni* | Business Inte

Re: NiFi v1.1.1 - org.apache.nifi.controller.FlowController cannot be cast to org.apache.nifi.controller.FlowController

2017-07-19 Thread Santosh Pingale
For the curious people, here is something which confirms that NARs have their own isolated Classloader. https://docs.hortonworks.com/HDPDocuments/HDF2/HDF-2.1.2/bk_dataflow-developer-guide/content/nars.html EventAccess is an interface which has been loaded parent classloader(I guess) and hence it

Re: MaxHistoryNot Worked in logback-1.2.3?

2017-07-19 Thread prabhu Mahendran
Hi Aldrin, Thanks for your response. i wants to keep only 5 files each file should having size 100KB. If total size of the files reaches 500KB then it will delete oldest file and then write new file. I have tried SizeAndTimeBasedPolicy then it couldn't preferable for me to use with respect to m

Listen TCP - uses

2017-07-19 Thread karthi keyan
I want to split the incoming message based on the Batching message delimiter(ETX) from PUT TCP. am not able to split the message using listen TCP . Can any one clarify and explain the process of put tcp and listen tcp processor to achieve the same as mentioned above. -Karthik

Re: Need to view all the flow files in the queue via list queue option

2017-07-19 Thread Manojkumar Ravichandran
Joe, I don't have any particular use case for that but it will makes more convenient for the user if we provide the customized row option rather than the default rows(100) *For example* If I use update attribute to update the date time format in the incoming flow files which holds 1000 rows.Amon