Re: transfer relationship not specified

2017-03-31 Thread Joe Witt
MIke, This part [1] needs to do something with those flowfiles. You've pulled them from the queue and then during this logic/flow do not do anything with them. You have a 'toProcess' collection and perhaps you need a "toRetry" collection for these that exceed the total data size. I believe you c

Secured Nifi Cluster Setup

2017-03-31 Thread Anishkumar Valsalam
I am trying to configure the 3node secured Nifi cluster setup by followinng the below Link . But between nodes the connection not happened after enabled SSL/LDAP and i am getting the below error. 2017-04-01 09:05:4

transfer relationship not specified

2017-03-31 Thread Mikhail Sosonkin
Hi All, Wondering if someone could help me with a custom processor error. I'm getting an error when doing a session commit in onTrigger [0]. 017-03-31 23:50:44,684 ERROR [Timer-Driven Process Thread-8] c.s.n.g.p.publisher.GcpPubsubPublisher org.apache.nifi.processor.exception.FlowFileHandlingExce

Re: Deconstructing SMTP /Mime emails

2017-03-31 Thread Andre
David, The original email is part of the content produced by ListenSMTP itself. The challenge with emails is that sometimes the body itself may be encoded and this may or may not be extracted via ExtractEmailAttachments. Do you have a particular example of message you want to process? Cheers On

Re: Making the server hostname available in NiFi

2017-03-31 Thread DAVID SMITH
Thanks for the replies, I was using ${hostname()}, I found the reason it wasn't working was that the NiFi instance was running in a Docker container. When I tried it on a non Docker container instance it worked fine. Dave On Thursday, 30 March 2017, 0:43, Mark Payne wrote: Dave, You

Deconstructing SMTP /Mime emails

2017-03-31 Thread DAVID SMITH
Hi I have a scenario where I use listenSMTP to listen for emails, and then I use ExtractEmailHeaders and ExtractEmailAttachments to deconstruct these emails into their constituent parts, however, I don't seem to be able to get the body text of the email as either an attribute or a FlowFile. Can

Re: 'bad_weak_ptr' on second run

2017-03-31 Thread jbkuyke
Great-- that seems (after a short test) to have fixed it. Thanks so much, Marc! On Fri, Mar 31, 2017 at 2:44 PM, Marc wrote: > John, > Could you fetch the latest from that branch? It has one of the commits > for MINIFI-246 within it. > > On Fri, Mar 31, 2017 at 11:05 AM, Marc P. wrote: > > >

Re: 'bad_weak_ptr' on second run

2017-03-31 Thread Marc
John, Could you fetch the latest from that branch? It has one of the commits for MINIFI-246 within it. On Fri, Mar 31, 2017 at 11:05 AM, Marc P. wrote: > The issue is related to https://issues.apache.org/jira/browse/MINIFI-246. > > I'm able to easily re-produce it. I submitted a PR for that bu

Elasticsearch dynamic index name from data attribute possible?

2017-03-31 Thread shahbazatta
Hi, We have dynamic indexes in elastic search like signal-.MM.DD => (which resolved as signal-2017.03.31) I was try hard to find the way to specify the dynamic index in nifi processor. I already have a field in my data which i want to use as dynamic index. for example "index_name". I just wante

Re: 'bad_weak_ptr' on second run

2017-03-31 Thread Marc P.
The issue is related to https://issues.apache.org/jira/browse/MINIFI-246. I'm able to easily re-produce it. I submitted a PR for that but I'm going to verify that it is indeed fixed and push the fix to that branch so you can test it. I'll update you shortly. On Fri, Mar 31, 2017 at 11:03 AM, jbku

Re: 'bad_weak_ptr' on second run

2017-03-31 Thread jbkuyke
Hi, Marc-- It's actually from one of your branches: https://github.com/phrocker/ nifi-minifi-cpp/tree/MINIFI-239. Config file below. Thanks! # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work

Re: 'bad_weak_ptr' on second run

2017-03-31 Thread Marc
Hi Jon, Are you running this from master? I have seen that error. Can you provide your config YAML file? On Fri, Mar 31, 2017 at 10:53 AM, John Kuykendall wrote: > Hello-- > > I'm new to nifi development. I'm working with a minifi graph that runs > successfully the first time I set it up,

Re: NiFi Processors show 30 Second Execution time, 0 executions

2017-03-31 Thread Joseph Niemiec
What version of Java are you running on ? Major_minor? On Fri, Mar 31, 2017 at 10:49 AM, Peter Wicks (pwicks) wrote: > I misread my own screenshot, it says 30 minutes, not seconds. Also, I did > a restart of NiFi and opened it up in a fresh instance of Chrome; no > change. I kicked off a Generat

'bad_weak_ptr' on second run

2017-03-31 Thread John Kuykendall
Hello-- I'm new to nifi development. I'm working with a minifi graph that runs successfully the first time I set it up, but then each subsequent time it terminates with: terminate called after throwing an instance of 'std::bad_weak_ptr' what(): bad_weak_ptr Aborted (core dumped) If I rebuild

RE: NiFi Processors show 30 Second Execution time, 0 executions

2017-03-31 Thread Peter Wicks (pwicks)
I misread my own screenshot, it says 30 minutes, not seconds. Also, I did a restart of NiFi and opened it up in a fresh instance of Chrome; no change. I kicked off a GenerateFlowFile processor and the milliseconds are going up, but the 30 minutes is remaining the same... -Original Message

Re: NiFi Processors show 30 Second Execution time, 0 executions

2017-03-31 Thread Joseph Niemiec
Doing a clean build of 091359b450a7d0fb6bb04e2238c9171728cd2720, I will have to see if I have a windows 7 VM anywhere, I know Witt was using Win10 and didnt see it... I find it odd that ALL your processors have a 30 second number not just the UpdateAttribute. Anything else about your environment yo

RE: NiFi Processors show 30 Second Execution time, 0 executions

2017-03-31 Thread Peter Wicks (pwicks)
091359b450a7d0fb6bb04e2238c9171728cd2720, so just one commit behind master. I am testing on Windows 7. Lee, yield isn't a bad idea, but UpdateAttribute in my screenshot has never run; not even once. I don't think it's had the opportunity to yield. -Original Message- From: Joseph Niemiec

Re: NiFi Processors show 30 Second Execution time, 0 executions

2017-03-31 Thread Joseph Niemiec
I just built the latest and am unable to see the issue as well. I also played with yield duration with no luck. Can you provide us what build your on so I can check that one out exactly? I did my last trunk test as of - 6a64b3cd9cca70e6a27b9034eba520ae0c0cb6ca git rev-parse HEAD On Fri, Mar 31,

Re: NiFi Processors show 30 Second Execution time, 0 executions

2017-03-31 Thread Lee Laim
Is it potentially related to yield duration? > On Mar 31, 2017, at 6:58 AM, Peter Wicks (pwicks) wrote: > > channel.

Re: NiFi Processors bundle pom.xml deploying artifacts to Artifactory

2017-03-31 Thread Bryan Bende
Just following up on what Joe said, take a look at this section on the wiki: https://cwiki.apache.org/confluence/display/NIFI/Maven+Projects+for+Extensions#MavenProjectsforExtensions-Inheritance Thanks, Bryan On Fri, Mar 31, 2017 at 9:08 AM, Joe Witt wrote: > Michal > > The archetype and exist

Re: NiFi Processors show 30 Second Execution time, 0 executions

2017-03-31 Thread Joe Witt
Peter - that definitely seems odd and thanks for flagging that. I'm not seeing that behavior myself (or at least have not noticed it). On Fri, Mar 31, 2017 at 8:58 AM, Peter Wicks (pwicks) wrote: > Not sure why the image didn't come through. I uploaded it to Google Photos, > we'll try that: ht

Re: NiFi Processors bundle pom.xml deploying artifacts to Artifactory

2017-03-31 Thread Joe Witt
Michal The archetype and existing components all extend from a common parent in nifi. If you want to build extensions that are not part of the apache nifi maven build/structure/hierarchy you can have your own parent and details. This is a perfectly fine thing to do. The sort of customization yo

RE: NiFi Processors show 30 Second Execution time, 0 executions

2017-03-31 Thread Peter Wicks (pwicks)
Not sure why the image didn't come through. I uploaded it to Google Photos, we'll try that: https://goo.gl/photos/iu1cccMXUf8ntSZV9 -Original Message- From: Joseph Niemiec [mailto:josephx...@gmail.com] Sent: Friday, March 31, 2017 8:37 PM To: dev@nifi.apache.org Subject: Re: NiFi Proce

Re: NiFi Processors show 30 Second Execution time, 0 executions

2017-03-31 Thread Joseph Niemiec
Are you attempting to also attach a screenshot? My Email seems to think so but no photo is coming out. The zero tasks makes sense (see below) but I am not 100% sure where your getting 30 seconds from, maybe another dev has an idea on that one... Can we get a screenshot? ~~ Ran on 1.1.1... Zero t

NiFi Processors bundle pom.xml deploying artifacts to Artifactory

2017-03-31 Thread Michal Klempa
Hi there, I am working on my own processor bundle, however, I came into trouble with deployment of my bundle as maven artifact into Artifactory. My bundle was create using the maven archetype and there are three projects: 1. main pom.xml: org.apache.nifi nifi-nar-bundles

NiFi Processors show 30 Second Execution time, 0 executions

2017-03-31 Thread Peter Wicks (pwicks)
I just noticed that on the latest version (which is now working for me) that all processors that have not recently run show 0 Tasks and 30 Seconds of Time. Is this a bug, or something that just isn't obvious? I previously executed ExecuteSQL and GenerateTableFetch in this view, but it was over f