How can datetime to month conversion failed in french language?

In NiFi How JVM Check language of machine? is that take any default language like English(US) else System DateTime Selected language? I face issue while converting datetime format into Month using expression language with NiFi package installed with French OS. But it worked in English(US) Select

Re: Options for increasing performance?

Thanks very much Juan. I do not find Wireshark in the apps available to me, but will ask our infrastructure folks about that this morning. -Jim On Wed, Apr 5, 2017 at 4:01 PM, Juan Sequeiros wrote: > If you have wireshark you could use: > > tshark -f "port 8446 or port 9448" > > > On Wed, Apr 5

Re: Options for increasing performance?

Intriguing. I'm one of those who have employed the "single flowfile" approach. I'm certainly willing to test out this refinement. So to press your point, this is more efficient than setting the processor's "Concurrent tasks" to 10 because it assumes the burden of initialization for ExecuteScript on

Re: Options for increasing performance?

Thinking more on ways to conquer this problem, I believe I may attack it from another perspective. Not a very refined one, somewhat Neanderthal, and doesn't really get ot the heart of the matter. But I think it just may work. The behavior we consider slow is at the HandleHttpRequest processor. I h

Re: apache nifi 1.1.2 startup really slow on openstack environment

Hi, Glad it helped! Also note the fix has already been merged to 1.2.0 Cheers On 6 Apr 2017 11:53, "尹文才" wrote: > Hi Arnaud and Andre, thanks very much for your help, now the NiFi cluster > is able to start up very fast after updating the bootstrap.conf to use > /dev/./urandom as an extra Java

Re: GetHDFS and triggering

Hi Matt, Thank you very much for your time and detailed answer. I will try to explain a little bit more the use case, as I suppose that this should be close to standard patterns. My current use case involve the extraction of data from a Web API. This data is not as clean as we would like to but

nifi attributes logics

Hello, I cant find a way to take 2 attributes and create an attribute with only the difference between them. Has anyone accomplished that? In general want to define routing to processing groups that do things. I want to define end points ( say customer1 / customer2 / customer3 ) I get one flowfi

Re: Help with SFTP processor

Joe and Juan - Thank you very much for the help. It turned out to be the prompt for verifying the authenticity of the host. With that fixed, I have a new question: I'm using ListFile and FetchFile to identify new files as they are added to a directory. When they are I am using SFTP to transfer t

Re: Help with SFTP processor

Jim, Glad you've made progress on the SFTP side. Please file a JIRA with your suggestions for the docs and the ideal case then is you'd file a Pull Request (https://cwiki.apache.org/confluence/display/NIFI/Contributor+Guide) which actually provides the suggested documentation changes. For the L

Re: Multiple log entries from InvokeScriptedProcessor initialize() ?

Hi. Wanted to close the loop in case it might help someone in the future who has a similar interest. This is how I got logging to work from an InvokeScriptedProcessor processor to a specific log file of my choosing, executed from a Jython script (some hybrid of java and python that I don't yet full

Re: Help with SFTP processor

Thanks for getting back to me. I will follow up on the documentation Pull Request. As to the directory question, I wasn't specific enough. I've already configured the setting you described. Here is what is going on: Say the source directory is /home/source and the destination is /www/files This

ExtractMediaMetadata temp files

Hello, I'm using the ExtractMediaMetadata to make use of apache tika to validate content types and metadata. It appears that this processor is filling up my /tmp folder with apache-tika-.tmp files. Is there a way to get the processor or nifi to clean up these tmp files? I'm currently using nif

Re: nifi attributes logics

Hi, I’m not sure I fully understand the question, as you say that “customers” have attributes, but I was under the impression that the customers were various processors/“endpoints”. Flowfiles are the atomic units of data passing through the flow, and that is where attributes are stored. Regard

Re: ExtractMediaMetadata temp files

Dan, Good find, this looks like a bug in ExtractMediaMetadata. I'm creating a Jira ticket to fix it. I'll reply with the ticket number once created. Regards, JoeS On Thu, Apr 6, 2017 at 1:01 PM, Dan Morris wrote: > Hello, > > I'm using the ExtractMediaMetadata to make use of apache tika to v

Re: ExtractMediaMetadata temp files

Thanks! Thanks, Dan Morris 443-992-2848 On Thu, Apr 6, 2017 at 1:25 PM, Joe Skora wrote: > Dan, > > Good find, this looks like a bug in ExtractMediaMetadata. > > I'm creating a Jira ticket to fix it. I'll reply with the ticket number > once created. > > Regards, > JoeS > > On Thu, Apr 6, 201

Re: ExtractMediaMetadata temp files

Dan, You are welcome. You can track it on NIFI-3677 . Regards, Joe On Thu, Apr 6, 2017 at 1:32 PM, Dan Morris wrote: > Thanks! > > > Thanks, > > Dan Morris > 443-992-2848 <(443)%20992-2848> > > On Thu, Apr 6, 2017 at 1:25 PM, Joe Skora wrote:

Re: nifi attributes logics

Thank you Andy. We have n number of data points that send data to us to normalize and our end points have different normalized requirements. So we are also juggling ease of dataflow configuration ( many people implementing dataflows ) so trying to keep things simple and have only one point in whic

Re: Help with SFTP processor

Jim, Yep I understand your question and how to support that is what I was trying to convey. ListFile should pull from "/home/source". Lets say it finds that 'home/source/test/newfile.txt file. The resulting flowfile will have an attribute called 'path' that says 'test' Then you use FetchFile t

Is it possible to dynamically spawn a Processor Group ?

Hi, I am just a Nifi Inquisitor, Is it, or could it be possible to Dynamically spawn a "Processor Group" when the input flow reaches a certain threshold. Thanking you in aniticipation. Stephen

Re: Is it possible to dynamically spawn a Processor Group ?

Hello Stephen, It's possible to watch the status of NiFi, and upon observing a particular status in which you're interested, you can use the REST API to create new processor groups. You'd also have to populate that processor group with processors and other components. Based on the scenario you m

Re: How can datetime to month conversion failed in french language?

What is the expression language statement that you're attempting to use? On Thu, Apr 6, 2017 at 3:12 AM prabhu Mahendran wrote: > In NiFi How JVM Check language of machine? > > is that take any default language like English(US) else System DateTime > Selected language? > > I face issue while con

Re: Is it possible to dynamically spawn a Processor Group ?

Thanks for the quick reply. Yes, that is quite correct. The scenario is the following: The input flow is a "GetFile" process that collects csv files (>100,000 lines) which in turn queues the file and parses each line to a locally built processor (MyImportProcessor say) that submits them via the R

Re: Help with SFTP processor

Thank you. That was the final detail I was not getting. The use of the ${path} expression variable. I now see that I needed to look at the writes attributes section of the ListFile processor. Jim K. On Thu, Apr 6, 2017 at 2:30 PM Joe Witt wrote: > Jim, > > Yep I understand your question and how

Re: Help with SFTP processor

No problem. Remember you can use live queue listing and data viewing to see all the attributes we know about the object at each stage. That is exactly how I figured out how to wire this together and what I needed from each step. Thanks Joe On Thu, Apr 6, 2017 at 4:43 PM, James Keeney wrote: > T

Re: Help with SFTP processor

Thanks again. When you refer to live queue listing and data viewing what are you referring to? The dashboard or something else. Jim K. On Thu, Apr 6, 2017 at 4:49 PM Joe Witt wrote: > No problem. Remember you can use live queue listing and data viewing > to see all the attributes we know about

Re: Help with SFTP processor

I just mean while designing/interacting with the flow you can start/stop processors, you can click on the connections and say 'list queue' and then you can click on each object in the queue and see its attributes and content. Really helps step through the flow at each step. On Thu, Apr 6, 2017 at

Re: Help with SFTP processor

Thanks. On Thu, Apr 6, 2017 at 5:24 PM Joe Witt wrote: > I just mean while designing/interacting with the flow you can > start/stop processors, you can click on the connections and say 'list > queue' and then you can click on each object in the queue and see its > attributes and content. Really

Re: Options for increasing performance?

Scott, The slowness if I recall correctly is mostly related to jython initiation time. There have been some discussions in past about this: https://lists.apache.org/thread.html/a4a56c91e43857df0e2e38797585d0f496f8723b550d6b866f2e28e4@ Cheers On 6 Apr 2017 06:26, "Scott Wagner" wrote: > On

Re: How can datetime to month conversion failed in french language?

jeff, Thanks for your reply. Attribute 'ds' having the '07/04/2017'. And convert that into month using UpdateAttribute. ${ds:toDate('dd/MM/'):format('MMM')}. if i use that code in windows having language English(India) then it worked. If i use that code in windows having language French(