[GitHub] nifi pull request: NIFI-1918 Ignored failing test because timing i...

2016-05-24 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/nifi/pull/465


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Re: Apache NiFi expression language

2016-05-24 Thread Andy LoPresto
Hi Ilaria,

I tried to implement what you were asking for in the expression language and I 
think I discovered a bug in our implementation, which I have reported as 
NIFI-1919 [1]. The expression language evaluation delegates to String 
replace/replaceAll for the respective EL functions, but the invocation of 
replace compiles a Pattern with Pattern.LITERAL, which means it does not 
evaluate the regular expression. ReplaceAll works as expected, but obviously if 
you only want to match on the first occurrence of your pattern, this will not 
work for you.

I have provided a unit test [2] which demonstrates this issue, and I will be 
working on it soon.

Until this fix is in, I think the ExecuteScript processor with a simple Groovy 
line invoking replaceFirst is your easiest option.

[1] https://issues.apache.org/jira/browse/NIFI-1919 

[2] 
https://github.com/alopresto/nifi/blob/NIFI-1919/nifi-commons/nifi-expression-language/src/test/groovy/org/apache/nifi/attribute/expression/language/QueryGroovyTest.groovy
 


Andy LoPresto
alopre...@apache.org
alopresto.apa...@gmail.com
PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4  BACE 3C6E F65B 2F7D EF69

> On May 24, 2016, at 1:47 PM, Joe Percivall  
> wrote:
> 
> Hello,
> 
> Is there a specific reason you want to do this within Expression Language and 
> not a Processor? You can use the ExtractTest processor and it will add 
> attributes for the first occurrence of the pattern in the content of a 
> FlowFile.
> 
> Joe
> 
> 
> - - - - - -
> Joseph Percivall
> linkedin.com/in/Percivall
> e: joeperciv...@yahoo.com
> 
> 
> 
> On Sunday, May 22, 2016 5:56 PM, idioma  wrote:
> 
> 
> 
> Hi,
> I am interested to understand whether in NiFi it is possible to write
> regular expressions that only match the first occurrence of a pattern. I do
> not seem to be able to make this work and wonder whether it is just
> something not possible at all. Here is an example of what I mean:
> 
> https://regex101.com/r/nF3lE2/2
> 
> Thank you
> 
> 
> 
> --
> View this message in context: 
> http://apache-nifi-developer-list.39713.n7.nabble.com/Apache-NiFi-expression-language-tp10610.html
> Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.



signature.asc
Description: Message signed with OpenPGP using GPGMail


[GitHub] nifi pull request: NIFI-1915 Fixed '$' escape logic.

2016-05-24 Thread olegz
Github user olegz commented on the pull request:

https://github.com/apache/nifi/pull/463#issuecomment-221441775
  
Closing it as there are more work to be done


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] nifi pull request: NIFI-1915 Fixed '$' escape logic.

2016-05-24 Thread olegz
Github user olegz closed the pull request at:

https://github.com/apache/nifi/pull/463


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] nifi pull request: NIFI-1799 Implements auto-scaling flow layout

2016-05-24 Thread alopresto
Github user alopresto commented on the pull request:

https://github.com/apache/nifi/pull/442#issuecomment-221410007
  
Merged and closed. Did *not* port to 0.x branch as this code is for 
migration from 0.x to 1.0. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] nifi pull request: NIFI-1799 Implements auto-scaling flow layout

2016-05-24 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/nifi/pull/442


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] nifi pull request: NIFI-1799 Implements auto-scaling flow layout

2016-05-24 Thread alopresto
Github user alopresto commented on the pull request:

https://github.com/apache/nifi/pull/442#issuecomment-221405938
  
Reviewing to merge...


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] nifi pull request: NIFI-1662 Initial commit of adding Decimal and ...

2016-05-24 Thread JPercivall
Github user JPercivall closed the pull request at:

https://github.com/apache/nifi/pull/320


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Re: Contribution ListFTP and FetchSTP processors

2016-05-24 Thread Joe Percivall
Hello Joris,

Very sorry that no one has gotten back to you earlier. We are always happy to 
get contributions tackling Jira tickets! To get start with contributing I'd 
suggest checking out our contributor guide[1]. You can either post a patch to 
the Jira ticket or open a pull request, the guide should explain them. If there 
is anything that is confusing feel free to ask.

As for why it hadn't been developed earlier, simply no user prior had the need 
for them (or did and didn't contribute them) and there were more pressing 
general tickets for contributors to address.


[1] https://cwiki.apache.org/confluence/display/NIFI/Contributor+Guide

Once again thanks for thinking to contribute the processors,
Joe
- - - - - - 
Joseph Percivall
linkedin.com/in/Percivall
e: joeperciv...@yahoo.com




On Friday, May 20, 2016 8:06 AM, Joris Mees  wrote:
Hi,

We (Data Minded) are a company mainly active in consultancy services regarding 
data solutions. We have recently deployed a Nifi instance at a client and 
needed functionality for a ListFTP and FetchFTP processor as described in the 
following Jira issue:

https://issues.apache.org/jira/browse/NIFI-1844?jql=text%20~%20%22listftp%22 


As this Jira ticket was still open we developed our own ListFTP and FecthFTP 
processors based on the already available SFTP processors. It turned out that 
almost all functionality was already there in the FTPTransfer class. Is there 
any particular reason why the FTP processors are not yet part of the standard 
processors as despite of some small changes they are already there?

We are currently testing the processors but for now they seem to work fine. We 
are happy to contribute them to the community, please let us know the following 
steps and requirements to do so.

Kind regards
Joris Mees

Data Minded
joris.m...@dataminded.be 
http://www.dataminded.be  


Re: Apache NiFi expression language

2016-05-24 Thread Joe Percivall
Hello,

Is there a specific reason you want to do this within Expression Language and 
not a Processor? You can use the ExtractTest processor and it will add 
attributes for the first occurrence of the pattern in the content of a FlowFile.
 
Joe


- - - - - - 
Joseph Percivall
linkedin.com/in/Percivall
e: joeperciv...@yahoo.com



On Sunday, May 22, 2016 5:56 PM, idioma  wrote:



Hi,
I am interested to understand whether in NiFi it is possible to write
regular expressions that only match the first occurrence of a pattern. I do
not seem to be able to make this work and wonder whether it is just
something not possible at all. Here is an example of what I mean:

https://regex101.com/r/nF3lE2/2

Thank you



--
View this message in context: 
http://apache-nifi-developer-list.39713.n7.nabble.com/Apache-NiFi-expression-language-tp10610.html
Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.


[GitHub] nifi pull request: NIFI-1808 Creating general MQTT processors

2016-05-24 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/nifi/pull/392


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] nifi pull request: NIFI-1808 Creating general MQTT processors

2016-05-24 Thread olegz
Github user olegz commented on the pull request:

https://github.com/apache/nifi/pull/392#issuecomment-221343071
  
+1, all is good, test are passing.
You'll need another PR for 0.x branch since the commits can not be cherry 
picked cleanly.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] nifi pull request: NIFI-1913 Properly removing flowfile in HandleH...

2016-05-24 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/nifi/pull/462


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Re: Nifi Installation and configeration

2016-05-24 Thread Joe Witt
Vishnu,

The community has done a nice job of providing a lot of documentation
to help people get started.  You can find that here:
  https://nifi.apache.org/docs.html

Thanks
Joe

On Tue, May 24, 2016 at 10:34 AM, Bapathi, Vishnu
 wrote:
> Hi,
>
> We are in a process of exploring new ETL tools for our requirements and want 
> to try Nifi.
> Can you please provide us the basic steps to download and install Nifi on 
> Linux platform and how to make configuration changes to get connected to 
> different files systems and Data bases.
>
> It would be great if you can provide us with some details to start.
>
> Thanks,
> Vishnu Bapathi,
> Senior ETL Analyst | DST Systems | 1055 Broadway, Kansas City, MO 64105
> Ex: 53929 m: 408-859-5451 email: vbapa...@dstsystems.com
>
>
>
> Please consider the environment before printing this email and any 
> attachments.
>
>
>
> This e-mail and any attachments are intended only for the individual or 
> company to which it is addressed and may contain information which is 
> privileged, confidential and prohibited from disclosure or unauthorized use 
> under applicable law. If you are not the intended recipient of this e-mail, 
> you are hereby notified that any use, dissemination, or copying of this 
> e-mail or the information contained in this e-mail is strictly prohibited by 
> the sender. If you have received this transmission in error, please return 
> the material received to the sender and delete all copies from your system.


Nifi Installation and configeration

2016-05-24 Thread Bapathi, Vishnu
Hi,

We are in a process of exploring new ETL tools for our requirements and want to 
try Nifi.
Can you please provide us the basic steps to download and install Nifi on Linux 
platform and how to make configuration changes to get connected to different 
files systems and Data bases.

It would be great if you can provide us with some details to start.

Thanks,
Vishnu Bapathi,
Senior ETL Analyst | DST Systems | 1055 Broadway, Kansas City, MO 64105
Ex: 53929 m: 408-859-5451 email: vbapa...@dstsystems.com



Please consider the environment before printing this email and any attachments.

This e-mail and any attachments are intended only for the individual or company 
to which it is addressed and may contain information which is privileged, 
confidential and prohibited from disclosure or unauthorized use under 
applicable law. If you are not the intended recipient of this e-mail, you are 
hereby notified that any use, dissemination, or copying of this e-mail or the 
information contained in this e-mail is strictly prohibited by the sender. If 
you have received this transmission in error, please return the material 
received to the sender and delete all copies from your system.


[GitHub] nifi pull request: NIFI-1913 Properly removing flowfile in HandleH...

2016-05-24 Thread JPercivall
Github user JPercivall commented on the pull request:

https://github.com/apache/nifi/pull/462#issuecomment-221296594
  
Thanks @pvillard31, github was being weird when I pushed this originally so 
it didn't get built. I re-pushed, addressing the double space, and it passes. I 
will merge it in.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] nifi pull request: NIFI-1907 Moving lazy init of SSLContext...

2016-05-24 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/nifi/pull/457


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] nifi pull request: NIFI-1915 Fixed '$' escape logic.

2016-05-24 Thread olegz
GitHub user olegz opened a pull request:

https://github.com/apache/nifi/pull/463

NIFI-1915 Fixed '$' escape logic.

Fixed '$' escape logic (if not followed by number) to use 
Matcher.quoteReplacement(java.lang.String) to
suppress its special meaning so it could be treated as literal.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/olegz/nifi NIFI-1915

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/nifi/pull/463.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #463


commit 0d436e64348488156bc4f7c313d97aee06813501
Author: Oleg Zhurakousky 
Date:   2016-05-24T13:30:51Z

NIFI-1915 Fixed '$' escape logic.
Fixed '$' escape logic (if not followed by number) to use 
Matcher.quoteReplacement(java.lang.String) to
suppress its special meaning so it could be treated as literal.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] nifi pull request: NIFI-1907 Moving lazy init of SSLContext...

2016-05-24 Thread bbende
Github user bbende commented on the pull request:

https://github.com/apache/nifi/pull/457#issuecomment-221268368
  
Going to merge this in since Joe was a +1...


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Re: NIFI & IBM MQ

2016-05-24 Thread Oleg Zhurakousky
Christian

Get/PutJMS* processors are effectively deprecated since they only work with 
ActiveMQ.
The new processors that you should use that were specifically developed to 
support multiple JMS providers (tested with IBM MQ, Tibco and ActiveMQ) are 
PublishJMS and ConsumeJMS.

Give it a try and let us know if you need more help.
Cheers
Oleg

> On May 24, 2016, at 5:47 AM, christianv 
>  wrote:
> 
> Hi,
> 
> I am in need of help I am trying to use GetJMSQueue to connect to an IBM MQ
> Queue and I need an example of the property setting I am unable to compile
> the UTI.
> 
> Kind Regards
> 
> 
> 
> --
> View this message in context: 
> http://apache-nifi-developer-list.39713.n7.nabble.com/NIFI-IBM-MQ-tp10651.html
> Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.
> 



NIFI & IBM MQ

2016-05-24 Thread christianv
Hi,

I am in need of help I am trying to use GetJMSQueue to connect to an IBM MQ
Queue and I need an example of the property setting I am unable to compile
the UTI.

Kind Regards



--
View this message in context: 
http://apache-nifi-developer-list.39713.n7.nabble.com/NIFI-IBM-MQ-tp10651.html
Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.