Source code for Version 0.3.0

2015-09-21 Thread Esteban Aliverti
Hi there,
I want to give v. 0.3.0 a try and I would like to know where the source
code for that version is.
Right now, master has 0.3.1-SNAPSHOT version. I noticed there is a
nifi-0.3.0-RC1

tag
that has 0.3.0 version in its poms. Should I use 0.3.0-RC1 then? Is this
branch already frozen? It will be any other branch for 0.3.0 final?

Regards,



Esteban Aliverti
- Blog @ http://ilesteban.wordpress.com


Re: Source code for Version 0.3.0

2015-09-21 Thread Joe Witt
Esteban

The tag you mention is the correct tag for the 0.3.0 source.

Thanks
Joe
On Sep 21, 2015 4:43 AM, "Esteban Aliverti" 
wrote:

> Hi there,
> I want to give v. 0.3.0 a try and I would like to know where the source
> code for that version is.
> Right now, master has 0.3.1-SNAPSHOT version. I noticed there is a
> nifi-0.3.0-RC1
> <
> https://git1-us-west.apache.org/repos/asf?p=nifi.git;a=commit;h=2ec735e35025fed3c63d51128ec0609ffe1fa7e3
> >
> tag
> that has 0.3.0 version in its poms. Should I use 0.3.0-RC1 then? Is this
> branch already frozen? It will be any other branch for 0.3.0 final?
>
> Regards,
>
> 
>
> Esteban Aliverti
> - Blog @ http://ilesteban.wordpress.com
>


Re: Source code for Version 0.3.0

2015-09-21 Thread Esteban Aliverti
Thanks!




Esteban Aliverti
- Blog @ http://ilesteban.wordpress.com

On Mon, Sep 21, 2015 at 12:21 PM, Joe Witt  wrote:

> Esteban
>
> The tag you mention is the correct tag for the 0.3.0 source.
>
> Thanks
> Joe
> On Sep 21, 2015 4:43 AM, "Esteban Aliverti" 
> wrote:
>
> > Hi there,
> > I want to give v. 0.3.0 a try and I would like to know where the source
> > code for that version is.
> > Right now, master has 0.3.1-SNAPSHOT version. I noticed there is a
> > nifi-0.3.0-RC1
> > <
> >
> https://git1-us-west.apache.org/repos/asf?p=nifi.git;a=commit;h=2ec735e35025fed3c63d51128ec0609ffe1fa7e3
> > >
> > tag
> > that has 0.3.0 version in its poms. Should I use 0.3.0-RC1 then? Is this
> > branch already frozen? It will be any other branch for 0.3.0 final?
> >
> > Regards,
> >
> > 
> >
> > Esteban Aliverti
> > - Blog @ http://ilesteban.wordpress.com
> >
>


Dynamic Properties for Processor

2015-09-21 Thread wizz
Hi Guys,

I am new to Nifi, it looks great but I am exploring what it can be done. Is
it possible to have something similar to this flow: GetFile --> SplitText
--> GetHttp --> Zip?

1. GetFile gets file (dog.txt) which contains list of link:
http://pic.pedigreedatabase.com/dogbreeds/samoyed.jpg
http://pic.pedigreedatabase.com/dogbreeds/bichon_frise.jpg
http://pic.pedigreedatabase.com/dogbreeds/norwich_terrier.jpg
http://pic.pedigreedatabase.com/dogbreeds/west_highland_white_terrier.jpg

2. SplitText will get each of the line of text
3. The line feeds to GetHttp to property URL which it will download the file
and save it accordingly

Is this possible guys? It seems the properties of processor is immutable and
the only dynamic is when the expression language is allowed in the property.

Another question would be, the source text (dog.txt) it seems being executed
multiple times, how do I mark it that the NiFi got the inputs each line and
no repeat?

Thanks!!



--
View this message in context: 
http://apache-nifi-developer-list.39713.n7.nabble.com/Dynamic-Properties-for-Processor-tp2895.html
Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.


Re: Source code for Version 0.3.0

2015-09-21 Thread Adam Taft
What's the thoughts on creating a proper 0.3.0 tag, as would be traditional
for a final release?  It is arguably a little confusing to only have the RC
tags, when looking for the final release.  I found this head scratching for
0.2.0 as well.

Adam


On Mon, Sep 21, 2015 at 7:44 AM, Esteban Aliverti <
esteban.alive...@gmail.com> wrote:

> Thanks!
>
>
> 
>
> Esteban Aliverti
> - Blog @ http://ilesteban.wordpress.com
>
> On Mon, Sep 21, 2015 at 12:21 PM, Joe Witt  wrote:
>
> > Esteban
> >
> > The tag you mention is the correct tag for the 0.3.0 source.
> >
> > Thanks
> > Joe
> > On Sep 21, 2015 4:43 AM, "Esteban Aliverti" 
> > wrote:
> >
> > > Hi there,
> > > I want to give v. 0.3.0 a try and I would like to know where the source
> > > code for that version is.
> > > Right now, master has 0.3.1-SNAPSHOT version. I noticed there is a
> > > nifi-0.3.0-RC1
> > > <
> > >
> >
> https://git1-us-west.apache.org/repos/asf?p=nifi.git;a=commit;h=2ec735e35025fed3c63d51128ec0609ffe1fa7e3
> > > >
> > > tag
> > > that has 0.3.0 version in its poms. Should I use 0.3.0-RC1 then? Is
> this
> > > branch already frozen? It will be any other branch for 0.3.0 final?
> > >
> > > Regards,
> > >
> > > 
> > >
> > > Esteban Aliverti
> > > - Blog @ http://ilesteban.wordpress.com
> > >
> >
>


Re: Source code for Version 0.3.0

2015-09-21 Thread Sean Busbey
The pattern I've liked the most on other projects is to create a
proper release tag, signed by the RM on passage of the release vote. I
don't recall off-hand what the phrasing was in the VOTE thread (if
any).

On Mon, Sep 21, 2015 at 8:13 AM, Adam Taft  wrote:
> What's the thoughts on creating a proper 0.3.0 tag, as would be traditional
> for a final release?  It is arguably a little confusing to only have the RC
> tags, when looking for the final release.  I found this head scratching for
> 0.2.0 as well.
>
> Adam
>
>
> On Mon, Sep 21, 2015 at 7:44 AM, Esteban Aliverti <
> esteban.alive...@gmail.com> wrote:
>
>> Thanks!
>>
>>
>> 
>>
>> Esteban Aliverti
>> - Blog @ http://ilesteban.wordpress.com
>>
>> On Mon, Sep 21, 2015 at 12:21 PM, Joe Witt  wrote:
>>
>> > Esteban
>> >
>> > The tag you mention is the correct tag for the 0.3.0 source.
>> >
>> > Thanks
>> > Joe
>> > On Sep 21, 2015 4:43 AM, "Esteban Aliverti" 
>> > wrote:
>> >
>> > > Hi there,
>> > > I want to give v. 0.3.0 a try and I would like to know where the source
>> > > code for that version is.
>> > > Right now, master has 0.3.1-SNAPSHOT version. I noticed there is a
>> > > nifi-0.3.0-RC1
>> > > <
>> > >
>> >
>> https://git1-us-west.apache.org/repos/asf?p=nifi.git;a=commit;h=2ec735e35025fed3c63d51128ec0609ffe1fa7e3
>> > > >
>> > > tag
>> > > that has 0.3.0 version in its poms. Should I use 0.3.0-RC1 then? Is
>> this
>> > > branch already frozen? It will be any other branch for 0.3.0 final?
>> > >
>> > > Regards,
>> > >
>> > > 
>> > >
>> > > Esteban Aliverti
>> > > - Blog @ http://ilesteban.wordpress.com
>> > >
>> >
>>



-- 
Sean


Re: Source code for Version 0.3.0

2015-09-21 Thread Ryan Blue
+1 for a nifi-0.3.0 release tag. Signed is even better, but I don't 
think I'd mind if it weren't signed.


rb

On 09/21/2015 06:35 AM, Sean Busbey wrote:

The pattern I've liked the most on other projects is to create a
proper release tag, signed by the RM on passage of the release vote. I
don't recall off-hand what the phrasing was in the VOTE thread (if
any).

On Mon, Sep 21, 2015 at 8:13 AM, Adam Taft  wrote:

What's the thoughts on creating a proper 0.3.0 tag, as would be traditional
for a final release?  It is arguably a little confusing to only have the RC
tags, when looking for the final release.  I found this head scratching for
0.2.0 as well.

Adam




--
Ryan Blue
Software Engineer
Cloudera, Inc.


Re: NIFI DBCP connection pool not working for hive

2015-09-21 Thread vthiru2006
Thanks for your help guys. We tried to add hadoop-common jar in classpath and
reload the NIFI instance and it throws us back error connection through
Kerberos now. Below is the stack trace for your reference. 

Has NIFI have an limitation on hive2 working with Kerberos? Thoughts?

STACK TRACE:

2015-09-21 12:50:17,659 ERROR [pool-28-thread-3]
o.a.n.c.s.StandardControllerServiceNode
[DBCPConnectionPool[id=909a0541-5abc-451b-ad5c-0f45b0bb6a9f]] Failed to
invoke @OnEnabled method due to {}
java.lang.NoClassDefFoundError: Could not initialize class
org.apache.hadoop.security.UserGroupInformation
at
org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge.createClientWithConf(HadoopThriftAuthBridge.java:85)
~[na:na]
at
org.apache.hive.service.auth.KerberosSaslHelper.getKerberosTransport(KerberosSaslHelper.java:54)
~[na:na]
at
org.apache.hive.jdbc.HiveConnection.createBinaryTransport(HiveConnection.java:371)
~[na:na]
at
org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:193)
~[na:na]
at
org.apache.hive.jdbc.HiveConnection.(HiveConnection.java:167) ~[na:na]
at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105)
~[na:na]
at org.apache.nifi.dbcp.DriverShim.connect(DriverShim.java:46)
~[na:na]
at
org.apache.commons.dbcp.DriverConnectionFactory.createConnection(DriverConnectionFactory.java:38)
~[na:na]
at
org.apache.commons.dbcp.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:582)
~[na:na]
at
org.apache.commons.dbcp.BasicDataSource.validateConnectionFactory(BasicDataSource.java:1556)
~[na:na]
at
org.apache.commons.dbcp.BasicDataSource.createPoolableConnectionFactory(BasicDataSource.java:1545)
~[na:na]
at
org.apache.commons.dbcp.BasicDataSource.createDataSource(BasicDataSource.java:1388)
~[na:na]
at
org.apache.commons.dbcp.BasicDataSource.getConnection(BasicDataSource.java:1044)
~[na:na]
at
org.apache.nifi.dbcp.DBCPConnectionPool.onConfigured(DBCPConnectionPool.java:169)
~[na:na]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
~[na:1.7.0_75]
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
~[na:1.7.0_75]
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[na:1.7.0_75]
at java.lang.reflect.Method.invoke(Method.java:606) ~[na:1.7.0_75]
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:102)
~[na:na]
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotation(ReflectionUtils.java:47)
~[na:na]
at
org.apache.nifi.controller.scheduling.StandardProcessScheduler$6.run(StandardProcessScheduler.java:649)
~[na:na]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[na:1.7.0_75]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[na:1.7.0_75]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_75]
2015-09-21 12:50:17,659 ERROR [pool-28-thread-3]
o.a.n.c.s.StandardProcessScheduler Failed to invoke @OnEnabled method of
DBCPConnectionPool[id=909a0541-5abc-451b-ad5c-0f45b0bb6a9f] due to
java.lang.NoClassDefFoundError: Could not initialize class
org.apache.hadoop.security.UserGroupInformation




--
View this message in context: 
http://apache-nifi-developer-list.39713.n7.nabble.com/NIFI-DBCP-connection-pool-not-working-for-hive-tp2863p2899.html
Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.


Re: Source code for Version 0.3.0

2015-09-21 Thread Joe Witt
Looks fairly straightforward to sign a release [1].

What is the workflow you'd suggest?  Can we keep our current process
and once the vote is done just add a step to make a new identical (but
signed) tag with a name that doesn't include '-RC#'?

I'm good with that.  I understand why the RC# throws folks off so
happy to sort this out.

[1] http://gitready.com/advanced/2014/11/02/gpg-sign-releases.html

On Mon, Sep 21, 2015 at 12:42 PM, Ryan Blue  wrote:
> +1 for a nifi-0.3.0 release tag. Signed is even better, but I don't think
> I'd mind if it weren't signed.
>
> rb
>
>
> On 09/21/2015 06:35 AM, Sean Busbey wrote:
>>
>> The pattern I've liked the most on other projects is to create a
>> proper release tag, signed by the RM on passage of the release vote. I
>> don't recall off-hand what the phrasing was in the VOTE thread (if
>> any).
>>
>> On Mon, Sep 21, 2015 at 8:13 AM, Adam Taft  wrote:
>>>
>>> What's the thoughts on creating a proper 0.3.0 tag, as would be
>>> traditional
>>> for a final release?  It is arguably a little confusing to only have the
>>> RC
>>> tags, when looking for the final release.  I found this head scratching
>>> for
>>> 0.2.0 as well.
>>>
>>> Adam
>
>
>
>
> --
> Ryan Blue
> Software Engineer
> Cloudera, Inc.


Re: NIFI DBCP connection pool not working for hive

2015-09-21 Thread Joe Witt
Hello

At this point you're playing a classpath game and this is precisely
what Maven and NiFi's NAR concept exists to address.  With many JDBC
drivers you can throw the basic jar in and be good but since that
isn't the case here it will be more involved.  We should really just
build proper support for Hive in.  That could mean we extend our
current JDBC/SQL friendly processor to support Hive's dependencies.

JIRA created for this: https://issues.apache.org/jira/browse/NIFI-981

Thanks
Joe

On Mon, Sep 21, 2015 at 12:23 PM, vthiru2006  wrote:
> Thanks for your help guys. We tried to add hadoop-common jar in classpath and
> reload the NIFI instance and it throws us back error connection through
> Kerberos now. Below is the stack trace for your reference.
>
> Has NIFI have an limitation on hive2 working with Kerberos? Thoughts?
>
> STACK TRACE:
>
> 2015-09-21 12:50:17,659 ERROR [pool-28-thread-3]
> o.a.n.c.s.StandardControllerServiceNode
> [DBCPConnectionPool[id=909a0541-5abc-451b-ad5c-0f45b0bb6a9f]] Failed to
> invoke @OnEnabled method due to {}
> java.lang.NoClassDefFoundError: Could not initialize class
> org.apache.hadoop.security.UserGroupInformation
> at
> org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge.createClientWithConf(HadoopThriftAuthBridge.java:85)
> ~[na:na]
> at
> org.apache.hive.service.auth.KerberosSaslHelper.getKerberosTransport(KerberosSaslHelper.java:54)
> ~[na:na]
> at
> org.apache.hive.jdbc.HiveConnection.createBinaryTransport(HiveConnection.java:371)
> ~[na:na]
> at
> org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:193)
> ~[na:na]
> at
> org.apache.hive.jdbc.HiveConnection.(HiveConnection.java:167) ~[na:na]
> at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105)
> ~[na:na]
> at org.apache.nifi.dbcp.DriverShim.connect(DriverShim.java:46)
> ~[na:na]
> at
> org.apache.commons.dbcp.DriverConnectionFactory.createConnection(DriverConnectionFactory.java:38)
> ~[na:na]
> at
> org.apache.commons.dbcp.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:582)
> ~[na:na]
> at
> org.apache.commons.dbcp.BasicDataSource.validateConnectionFactory(BasicDataSource.java:1556)
> ~[na:na]
> at
> org.apache.commons.dbcp.BasicDataSource.createPoolableConnectionFactory(BasicDataSource.java:1545)
> ~[na:na]
> at
> org.apache.commons.dbcp.BasicDataSource.createDataSource(BasicDataSource.java:1388)
> ~[na:na]
> at
> org.apache.commons.dbcp.BasicDataSource.getConnection(BasicDataSource.java:1044)
> ~[na:na]
> at
> org.apache.nifi.dbcp.DBCPConnectionPool.onConfigured(DBCPConnectionPool.java:169)
> ~[na:na]
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> ~[na:1.7.0_75]
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> ~[na:1.7.0_75]
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ~[na:1.7.0_75]
> at java.lang.reflect.Method.invoke(Method.java:606) ~[na:1.7.0_75]
> at
> org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:102)
> ~[na:na]
> at
> org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotation(ReflectionUtils.java:47)
> ~[na:na]
> at
> org.apache.nifi.controller.scheduling.StandardProcessScheduler$6.run(StandardProcessScheduler.java:649)
> ~[na:na]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> [na:1.7.0_75]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> [na:1.7.0_75]
> at java.lang.Thread.run(Thread.java:745) [na:1.7.0_75]
> 2015-09-21 12:50:17,659 ERROR [pool-28-thread-3]
> o.a.n.c.s.StandardProcessScheduler Failed to invoke @OnEnabled method of
> DBCPConnectionPool[id=909a0541-5abc-451b-ad5c-0f45b0bb6a9f] due to
> java.lang.NoClassDefFoundError: Could not initialize class
> org.apache.hadoop.security.UserGroupInformation
>
>
>
>
> --
> View this message in context: 
> http://apache-nifi-developer-list.39713.n7.nabble.com/NIFI-DBCP-connection-pool-not-working-for-hive-tp2863p2899.html
> Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.


Re: NIFI DBCP connection pool not working for hive

2015-09-21 Thread vthiru2006
Thank you Joe. I thought of creating a JIRA ticket for this and you did it.

For now, is there any solution for this? 



--
View this message in context: 
http://apache-nifi-developer-list.39713.n7.nabble.com/NIFI-DBCP-connection-pool-not-working-for-hive-tp2863p2902.html
Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.


Merge Content issues

2015-09-21 Thread Edgardo Vega
Just created a jira ticket for the following issues:


   - In the Merge Content processor the property Max Bin Age does not
   support the other commonly used time units (e.g s, sec). It only supports
   seconds and does not throw a validation error you put in another time unit.
   - Also noticed that if you make the Maximum number of Bins 1 the
   behavior is not consistent and Minimum Number of Entries and Max Bin Age
   are ignored.
   - You are also not allowed to set the Header, Footer, and Demarcator to
   an empty value or you will get null pointer exceptions.


https://issues.apache.org/jira/browse/NIFI-982

-- 
Cheers,

Edgardo


Re: Dynamic Properties for Processor

2015-09-21 Thread Joe Percivall
Welcome to NiFi! 

This can certainly be done. The processor you're looking for to execute 
arbitrary URLs is the InvokeHTTP processor [1]. So your flow would be GetFile 
-> SplitText -> ExtractText (to get the URL to an attribute) -> InvokeHTTP.  In 
the InvokeHTTP you'll use the expression language [2] to reference the proper 
attribute.
For the second part, under the configuration for getFile if you uncheck "Keep 
Source File" it'll only get the dog.txt once then get rid of the file 
afterwards.
Also as a note, I am in the process of making a RouteText processor that will 
make it much easier to work with individual lines of text. You can check out 
the ticket here [3].
[1] 
https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi.processors.standard.InvokeHTTP/index.html[2]
 https://nifi.apache.org/docs/nifi-docs/html/expression-language-guide.html[3] 
https://issues.apache.org/jira/browse/NIFI-942
Hope this helps!Joe- - - - - - Joseph Percivalllinkedin.com/in/Percivalle: 
joeperciv...@yahoo.com
 


 On Monday, September 21, 2015 8:59 AM, wizz  wrote:
   

 Hi Guys,

I am new to Nifi, it looks great but I am exploring what it can be done. Is
it possible to have something similar to this flow: GetFile --> SplitText
--> GetHttp --> Zip?

1. GetFile gets file (dog.txt) which contains list of link:
http://pic.pedigreedatabase.com/dogbreeds/samoyed.jpg
http://pic.pedigreedatabase.com/dogbreeds/bichon_frise.jpg
http://pic.pedigreedatabase.com/dogbreeds/norwich_terrier.jpg
http://pic.pedigreedatabase.com/dogbreeds/west_highland_white_terrier.jpg

2. SplitText will get each of the line of text
3. The line feeds to GetHttp to property URL which it will download the file
and save it accordingly

Is this possible guys? It seems the properties of processor is immutable and
the only dynamic is when the expression language is allowed in the property.

Another question would be, the source text (dog.txt) it seems being executed
multiple times, how do I mark it that the NiFi got the inputs each line and
no repeat?

Thanks!!



--
View this message in context: 
http://apache-nifi-developer-list.39713.n7.nabble.com/Dynamic-Properties-for-Processor-tp2895.html
Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.


  

Re: Dynamic Properties for Processor

2015-09-21 Thread Joe Percivall
Here's a better formatted version. Email decided to switch back to RTF.


Welcome to NiFi! 

This can certainly be done. The processor you're looking for to execute 
arbitrary URLs is the InvokeHTTP processor [1]. So your flow would be GetFile 
-> SplitText -> ExtractText (to get the URL to an attribute) -> InvokeHTTP.  In 
the InvokeHTTP you'll use the expression language [2] to reference the proper 
attribute.

For the second part, under the configuration for getFile if you uncheck "Keep 
Source File" it'll only get the dog.txt once then get rid of the file 
afterwards.

Also as a note, I am in the process of making a RouteText processor that will 
make it much easier to work with individual lines of text. You can check out 
the ticket here [3].

[1] 
https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi.processors.standard.InvokeHTTP/index.html
[2] https://nifi.apache.org/docs/nifi-docs/html/expression-language-guide.html
[3] https://issues.apache.org/jira/browse/NIFI-942

Hope this helps!
Joe
- - - - - - 
Joseph Percivall
linkedin.com/in/Percivall
e: joeperciv...@yahoo.com

 
- - - - - - 
Joseph Percivall
linkedin.com/in/Percivall
e: joeperciv...@yahoo.com




On Monday, September 21, 2015 5:01 PM, Joe Percivall 
 wrote:



Welcome to NiFi! 

This can certainly be done. The processor you're looking for to execute 
arbitrary URLs is the InvokeHTTP processor [1]. So your flow would be GetFile 
-> SplitText -> ExtractText (to get the URL to an attribute) -> InvokeHTTP.  In 
the InvokeHTTP you'll use the expression language [2] to reference the proper 
attribute.
For the second part, under the configuration for getFile if you uncheck "Keep 
Source File" it'll only get the dog.txt once then get rid of the file 
afterwards.
Also as a note, I am in the process of making a RouteText processor that will 
make it much easier to work with individual lines of text. You can check out 
the ticket here [3].
[1] 
https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi.processors.standard.InvokeHTTP/index.html[2]
 https://nifi.apache.org/docs/nifi-docs/html/expression-language-guide.html[3] 
https://issues.apache.org/jira/browse/NIFI-942
Hope this helps!Joe- - - - - - Joseph Percivalllinkedin.com/in/Percivalle: 
joeperciv...@yahoo.com




 On Monday, September 21, 2015 8:59 AM, wizz  wrote:
  

Hi Guys,

I am new to Nifi, it looks great but I am exploring what it can be done. Is
it possible to have something similar to this flow: GetFile --> SplitText
--> GetHttp --> Zip?

1. GetFile gets file (dog.txt) which contains list of link:
http://pic.pedigreedatabase.com/dogbreeds/samoyed.jpg
http://pic.pedigreedatabase.com/dogbreeds/bichon_frise.jpg
http://pic.pedigreedatabase.com/dogbreeds/norwich_terrier.jpg
http://pic.pedigreedatabase.com/dogbreeds/west_highland_white_terrier.jpg

2. SplitText will get each of the line of text
3. The line feeds to GetHttp to property URL which it will download the file
and save it accordingly

Is this possible guys? It seems the properties of processor is immutable and
the only dynamic is when the expression language is allowed in the property.

Another question would be, the source text (dog.txt) it seems being executed
multiple times, how do I mark it that the NiFi got the inputs each line and
no repeat?

Thanks!!



--
View this message in context: 
http://apache-nifi-developer-list.39713.n7.nabble.com/Dynamic-Properties-for-Processor-tp2895.html
Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.


How to get upstream connections or parent Processors

2015-09-21 Thread Huang, Jie
Hi all,

I need to get the connection information or parents for further action in 
onTriger event.
Is there any way to get the upstream connections or parent processors from any 
customized Processor?

Thank you && Best Regards,
Grace (Huang Jie)



Re: How to get upstream connections or parent Processors

2015-09-21 Thread Rick Braddy
Me, too.

And I need the ability to determine which connection(s) are linked to each 
relationship, along with a way to auto-terminate unused relationships from my 
processor.

Thanks
Rick

> On Sep 21, 2015, at 10:22 PM, Huang, Jie  wrote:
> 
> Hi all,
> 
> I need to get the connection information or parents for further action in 
> onTriger event.
> Is there any way to get the upstream connections or parent processors from 
> any customized Processor?
> 
> Thank you && Best Regards,
> Grace (Huang Jie)
>