[GitHub] [nifi] MikeThomsen commented on issue #3845: NIFI-6809 Make use of ASF shortened URL to point to community SLack i…

2019-10-25 Thread GitBox
MikeThomsen commented on issue #3845: NIFI-6809 Make use of ASF shortened URL 
to point to community SLack i…
URL: https://github.com/apache/nifi/pull/3845#issuecomment-546278904
 
 
   @apiri looks like @markap14 already merged this.


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[jira] [Updated] (NIFI-6805) When ControllerServiceNode is logged, it no longer includes the UUID of the Controller Service

2019-10-25 Thread Mike Thomsen (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-6805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mike Thomsen updated NIFI-6805:
---
Fix Version/s: (was: 1.11.0)
   1.10.0

> When ControllerServiceNode is logged, it no longer includes the UUID of the 
> Controller Service
> --
>
> Key: NIFI-6805
> URL: https://issues.apache.org/jira/browse/NIFI-6805
> Project: Apache NiFi
>  Issue Type: Bug
>  Components: Core Framework
>Affects Versions: 1.10.0
>Reporter: Mark Payne
>Assignee: Mark Payne
>Priority: Critical
> Fix For: 1.10.0
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> The `toString()` method of StandardControllerServiceNode was changed in 
> NIFI-6201. The new `toString()` method no longer contains the CS's UUID. This 
> means that when log messages are generated about a Controller Service, 
> there's no easy way to track it back to the Controller Service that is 
> affected.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (NIFI-6805) When ControllerServiceNode is logged, it no longer includes the UUID of the Controller Service

2019-10-25 Thread Mike Thomsen (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-6805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mike Thomsen updated NIFI-6805:
---
Resolution: Fixed
Status: Resolved  (was: Patch Available)

> When ControllerServiceNode is logged, it no longer includes the UUID of the 
> Controller Service
> --
>
> Key: NIFI-6805
> URL: https://issues.apache.org/jira/browse/NIFI-6805
> Project: Apache NiFi
>  Issue Type: Bug
>  Components: Core Framework
>Affects Versions: 1.10.0
>Reporter: Mark Payne
>Assignee: Mark Payne
>Priority: Critical
> Fix For: 1.11.0
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> The `toString()` method of StandardControllerServiceNode was changed in 
> NIFI-6201. The new `toString()` method no longer contains the CS's UUID. This 
> means that when log messages are generated about a Controller Service, 
> there's no easy way to track it back to the Controller Service that is 
> affected.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[GitHub] [nifi] asfgit closed pull request #3827: NIFI-6793 Fix NumberFormatException at CaptureChangeMySQL

2019-10-25 Thread GitBox
asfgit closed pull request #3827: NIFI-6793 Fix NumberFormatException at 
CaptureChangeMySQL
URL: https://github.com/apache/nifi/pull/3827
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[jira] [Resolved] (NIFI-6793) CaptureChangeMySQL throws NumberFormatException when sequence id exceeds maximum Integer

2019-10-25 Thread Mike Thomsen (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-6793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mike Thomsen resolved NIFI-6793.

Fix Version/s: 1.10.0
   Resolution: Fixed

> CaptureChangeMySQL throws NumberFormatException when sequence id exceeds 
> maximum Integer
> 
>
> Key: NIFI-6793
> URL: https://issues.apache.org/jira/browse/NIFI-6793
> Project: Apache NiFi
>  Issue Type: Bug
>  Components: Extensions
>Reporter: Koji Kawamura
>Assignee: Koji Kawamura
>Priority: Major
> Fix For: 1.10.0
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> NumberFormatException can be thrown because the internal sequence id is 
> parsed as an integer where it should be a long.
> https://github.com/apache/nifi/blob/master/nifi-nar-bundles/nifi-cdc/nifi-cdc-mysql-bundle/nifi-cdc-mysql-processors/src/main/java/org/apache/nifi/cdc/mysql/processors/CaptureChangeMySQL.java#L492
> {code}
> 2019-10-14 04:45:54,727 WARN [Timer-Driven Process Thread-15] 
> o.a.n.controller.tasks.ConnectableTask Administratively Yielding 
> CaptureChangeMySQL[id=719232e6-2e6e-1d73-82b8-4f59a42c5e52] due to uncaught 
> Exception: java.lang.NumberFormatException: For input string: "2291535530"
> java.lang.NumberFormatException: For input string: "2291535530"
> at 
> java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
> at java.lang.Integer.parseInt(Integer.java:583)
> at java.lang.Integer.parseInt(Integer.java:615)
> at 
> org.apache.nifi.cdc.mysql.processors.CaptureChangeMySQL.setup(CaptureChangeMySQL.java:492)
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (NIFI-6793) CaptureChangeMySQL throws NumberFormatException when sequence id exceeds maximum Integer

2019-10-25 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/NIFI-6793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16959617#comment-16959617
 ] 

ASF subversion and git services commented on NIFI-6793:
---

Commit 87838e6c31ed8b104f79b7c7930b110e31bf7de7 in nifi's branch 
refs/heads/master from Koji Kawamura
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=87838e6 ]

NIFI-6793 Fix NumberFormatException at CaptureChangeMySQL

This closes #3827

Signed-off-by: Mike Thomsen 


> CaptureChangeMySQL throws NumberFormatException when sequence id exceeds 
> maximum Integer
> 
>
> Key: NIFI-6793
> URL: https://issues.apache.org/jira/browse/NIFI-6793
> Project: Apache NiFi
>  Issue Type: Bug
>  Components: Extensions
>Reporter: Koji Kawamura
>Assignee: Koji Kawamura
>Priority: Major
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> NumberFormatException can be thrown because the internal sequence id is 
> parsed as an integer where it should be a long.
> https://github.com/apache/nifi/blob/master/nifi-nar-bundles/nifi-cdc/nifi-cdc-mysql-bundle/nifi-cdc-mysql-processors/src/main/java/org/apache/nifi/cdc/mysql/processors/CaptureChangeMySQL.java#L492
> {code}
> 2019-10-14 04:45:54,727 WARN [Timer-Driven Process Thread-15] 
> o.a.n.controller.tasks.ConnectableTask Administratively Yielding 
> CaptureChangeMySQL[id=719232e6-2e6e-1d73-82b8-4f59a42c5e52] due to uncaught 
> Exception: java.lang.NumberFormatException: For input string: "2291535530"
> java.lang.NumberFormatException: For input string: "2291535530"
> at 
> java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
> at java.lang.Integer.parseInt(Integer.java:583)
> at java.lang.Integer.parseInt(Integer.java:615)
> at 
> org.apache.nifi.cdc.mysql.processors.CaptureChangeMySQL.setup(CaptureChangeMySQL.java:492)
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Resolved] (MINIFICPP-1048) Add PublishKafka docker tests

2019-10-25 Thread Nghia Le (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-1048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nghia Le resolved MINIFICPP-1048.
-
Resolution: Fixed

> Add PublishKafka docker tests
> -
>
> Key: MINIFICPP-1048
> URL: https://issues.apache.org/jira/browse/MINIFICPP-1048
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Task
>Reporter: Dániel Bakai
>Assignee: Nghia Le
>Priority: Major
>  Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> We should test:
>  - how the processor works with running, not running and flapping kafka 
> servers
>  - all processor properties



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Resolved] (MINIFICPP-976) Add Kafka broker to docker verify

2019-10-25 Thread Nghia Le (Jira)


 [ 
https://issues.apache.org/jira/browse/MINIFICPP-976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nghia Le resolved MINIFICPP-976.

Resolution: Fixed

> Add Kafka broker to docker verify 
> --
>
> Key: MINIFICPP-976
> URL: https://issues.apache.org/jira/browse/MINIFICPP-976
> Project: Apache NiFi MiNiFi C++
>  Issue Type: Improvement
>Reporter: Marc Parisi
>Assignee: Nghia Le
>Priority: Major
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> Add docker kafka tests



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[GitHub] [nifi] apiri commented on issue #3845: NIFI-6809 Make use of ASF shortened URL to point to community SLack i…

2019-10-25 Thread GitBox
apiri commented on issue #3845: NIFI-6809 Make use of ASF shortened URL to 
point to community SLack i…
URL: https://github.com/apache/nifi/pull/3845#issuecomment-546333012
 
 
   @MikeThomsen Not seeing it in the commit history.  Am I overlooking 
something?


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[jira] [Created] (NIFIREG-342) streamline nifi-registry docker projects to it's NiFi counterpart

2019-10-25 Thread Endre Kovacs (Jira)
Endre Kovacs created NIFIREG-342:


 Summary: streamline nifi-registry docker projects to it's NiFi 
counterpart
 Key: NIFIREG-342
 URL: https://issues.apache.org/jira/browse/NIFIREG-342
 Project: NiFi Registry
  Issue Type: Task
Affects Versions: 1.0.0
Reporter: Endre Kovacs
Assignee: Endre Kovacs


currently i see a few differences between the layout of NiFi vs. 
nifi-registry's docker projects.

# {code}nifi-registry-docker{code} is a child project of 
{code}nifi-registry/nifi-registry-core{code} it's NiFi counterpart lives in the 
project root. Having it in the project-root is beneficial as it allows us to 
defer its execution order after the assembly, so we could leverage the build 
artifacts for docker build. Such docker build can be initiated with the 
{code}-P docker{code} maven build profile, provided by NIFIREG-252 
# currently nifi-registry/nifi-registry-core/nifi-registry-docker/dockerhub is 
not a maven project (no pom.xml in its folder) this is another difference 
between the NiFi dockerhub and the NiFi Registry counter part. 


cc.: [~kdoran]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[GitHub] [nifi] asfgit closed pull request #3845: NIFI-6809 Make use of ASF shortened URL to point to community SLack i…

2019-10-25 Thread GitBox
asfgit closed pull request #3845: NIFI-6809 Make use of ASF shortened URL to 
point to community SLack i…
URL: https://github.com/apache/nifi/pull/3845
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [nifi-registry] ekovacs commented on issue #245: NIFIREG-252: adding mavendocker build profile

2019-10-25 Thread GitBox
ekovacs commented on issue #245: NIFIREG-252: adding mavendocker build profile
URL: https://github.com/apache/nifi-registry/pull/245#issuecomment-546347391
 
 
   > +1 for relocating it and making it a maven project, as well as for doing 
that as a separate jira/pr. I will re-review this PR as-is.
   
   just created a follow up JIRA about it:
   https://issues.apache.org/jira/browse/NIFIREG-342


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [nifi] MikeThomsen commented on issue #3845: NIFI-6809 Make use of ASF shortened URL to point to community SLack i…

2019-10-25 Thread GitBox
MikeThomsen commented on issue #3845: NIFI-6809 Make use of ASF shortened URL 
to point to community SLack i…
URL: https://github.com/apache/nifi/pull/3845#issuecomment-546347445
 
 
   NM. It was an early morning screw up on my part.


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[jira] [Commented] (NIFI-6809) Update README to make use of ASF url for community slack channel

2019-10-25 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/NIFI-6809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16959753#comment-16959753
 ] 

ASF subversion and git services commented on NIFI-6809:
---

Commit 20f70357a364c103f4d669c48bc8920550993467 in nifi's branch 
refs/heads/master from Aldrin Piri
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=20f7035 ]

NIFI-6809 Make use of ASF shortened URL to point to community SLack invite link.

This closes #3845

Signed-off-by: Mike Thomsen 


> Update README to make use of ASF url for community slack channel
> 
>
> Key: NIFI-6809
> URL: https://issues.apache.org/jira/browse/NIFI-6809
> Project: Apache NiFi
>  Issue Type: Improvement
>Reporter: Aldrin Piri
>Assignee: Aldrin Piri
>Priority: Trivial
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> We can use the shortened URL https://s.apache.org/nifi-community-slack to 
> point to the community slack invite link should it need to be refreshed.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (NIFI-6687) Update Ranger dependencies

2019-10-25 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/NIFI-6687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16959765#comment-16959765
 ] 

ASF subversion and git services commented on NIFI-6687:
---

Commit 2cef010b06ee0e3db82ea0272733e426c8e5d884 in nifi's branch 
refs/heads/master from Matt Gilman
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=2cef010 ]

NIFI-6687:
- Using correct NiFi Ranger Service name in unit tests.

This closes #3842.

Signed-off-by: Bryan Bende 


> Update Ranger dependencies
> --
>
> Key: NIFI-6687
> URL: https://issues.apache.org/jira/browse/NIFI-6687
> Project: Apache NiFi
>  Issue Type: Improvement
>  Components: Extensions
>Reporter: Matt Gilman
>Assignee: Matt Gilman
>Priority: Major
> Fix For: 1.11.0
>
>  Time Spent: 50m
>  Remaining Estimate: 0h
>
> Upgrade the Ranger authorizer to leverage version 2.x.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[GitHub] [nifi] asfgit closed pull request #3842: NIFI-6687: Fixing Ranger unit tests

2019-10-25 Thread GitBox
asfgit closed pull request #3842: NIFI-6687: Fixing Ranger unit tests
URL: https://github.com/apache/nifi/pull/3842
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [nifi] bbende commented on issue #3842: NIFI-6687: Fixing Ranger unit tests

2019-10-25 Thread GitBox
bbende commented on issue #3842: NIFI-6687: Fixing Ranger unit tests
URL: https://github.com/apache/nifi/pull/3842#issuecomment-546355362
 
 
   Looks good, merged


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[jira] [Resolved] (NIFI-6687) Update Ranger dependencies

2019-10-25 Thread Bryan Bende (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-6687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bryan Bende resolved NIFI-6687.
---
Resolution: Fixed

> Update Ranger dependencies
> --
>
> Key: NIFI-6687
> URL: https://issues.apache.org/jira/browse/NIFI-6687
> Project: Apache NiFi
>  Issue Type: Improvement
>  Components: Extensions
>Reporter: Matt Gilman
>Assignee: Matt Gilman
>Priority: Major
> Fix For: 1.11.0
>
>  Time Spent: 1h
>  Remaining Estimate: 0h
>
> Upgrade the Ranger authorizer to leverage version 2.x.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[GitHub] [nifi-registry] bbende merged pull request #246: NIFIREG-341 Make use of ASF shortened URL to point to community Slack…

2019-10-25 Thread GitBox
bbende merged pull request #246: NIFIREG-341 Make use of ASF shortened URL to 
point to community Slack…
URL: https://github.com/apache/nifi-registry/pull/246
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[jira] [Resolved] (NIFIREG-341) Update README to make use of ASF url for community slack channel

2019-10-25 Thread Bryan Bende (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFIREG-341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bryan Bende resolved NIFIREG-341.
-
Fix Version/s: 1.0.0
   Resolution: Fixed

> Update README to make use of ASF url for community slack channel
> 
>
> Key: NIFIREG-341
> URL: https://issues.apache.org/jira/browse/NIFIREG-341
> Project: NiFi Registry
>  Issue Type: Improvement
>Reporter: Aldrin Piri
>Assignee: Aldrin Piri
>Priority: Trivial
> Fix For: 1.0.0
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> We can use the shortened URL https://s.apache.org/nifi-community-slack to 
> point to the community slack invite link should it need to be refreshed.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[GitHub] [nifi] ivan1221 edited a comment on issue #3837: NIFI-6800: Fix hashmap counter overwritten in highThroughputSession

2019-10-25 Thread GitBox
ivan1221 edited a comment on issue #3837: NIFI-6800: Fix hashmap counter 
overwritten in highThroughputSession
URL: https://github.com/apache/nifi/pull/3837#issuecomment-545435939
 
 
   Fix this issue:
   
   
[https://issues.apache.org/jira/browse/NIFI-6800](https://issues.apache.org/jira/browse/NIFI-6800)
   
   This video shows the error comparing a normal session with a high 
performance:
   
   [NIFI - BUG - StandardProcessSession error - hashmap counter overwritten in 
highThroughputSession](https://youtu.be/DzwEQWmxNKc)
   
   This video shows a comparison between version 1.9.2 and the version that I 
compiled with the fix myself:
   
   [NIFI-6800 - FIX -hashmap counter overwritten in 
highThroughputSession](https://youtu.be/zlAQ69WX0tw)
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [nifi] rfellows commented on issue #3846: NIFI-6811: Allow enterGroup to complete prior to loading CS table

2019-10-25 Thread GitBox
rfellows commented on issue #3846: NIFI-6811: Allow enterGroup to complete 
prior to loading CS table
URL: https://github.com/apache/nifi/pull/3846#issuecomment-546360639
 
 
   Reviewing...


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [nifi] bbende commented on issue #3836: NIFI-6798: When checking that referenced Controller Services are vali…

2019-10-25 Thread GitBox
bbende commented on issue #3836: NIFI-6798: When checking that referenced 
Controller Services are vali…
URL: https://github.com/apache/nifi/pull/3836#issuecomment-546362262
 
 
   Looks good, going to merge


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [nifi] asfgit closed pull request #3836: NIFI-6798: When checking that referenced Controller Services are vali…

2019-10-25 Thread GitBox
asfgit closed pull request #3836: NIFI-6798: When checking that referenced 
Controller Services are vali…
URL: https://github.com/apache/nifi/pull/3836
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[jira] [Updated] (NIFI-6798) Validate Controller Services referenced via dynamic properties

2019-10-25 Thread Bryan Bende (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-6798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bryan Bende updated NIFI-6798:
--
Resolution: Fixed
Status: Resolved  (was: Patch Available)

> Validate Controller Services referenced via dynamic properties
> --
>
> Key: NIFI-6798
> URL: https://issues.apache.org/jira/browse/NIFI-6798
> Project: Apache NiFi
>  Issue Type: Bug
>  Components: Core Framework
>Reporter: Peter Turcsanyi
>Assignee: Mark Payne
>Priority: Major
> Fix For: 1.11.0
>
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> If a Controller Service referenced by another component is disabled, then the 
> referencing component should be in invalid state.
> It works fine for statically referenced Controller Services (configured via 
> static properties of the processor / another service), but it seems the 
> framework does not check it for dynamically configured services.
> The validator method can be found here:
> [https://github.com/apache/nifi/blob/master/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-framework-core-api/src/main/java/org/apache/nifi/controller/AbstractComponentNode.java#L679]
> Components that have Controller Service references configured via dynamic 
> properties:
>  * DBCPConnectionPoolLookup
>  * AzureStorageCredentialsControllerServiceLookup
>  * (there might be others, needs to be checked)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (NIFI-6798) Validate Controller Services referenced via dynamic properties

2019-10-25 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/NIFI-6798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16959775#comment-16959775
 ] 

ASF subversion and git services commented on NIFI-6798:
---

Commit 81fc2768c9d6cb61be10ba5adc805517c29816c7 in nifi's branch 
refs/heads/master from Mark Payne
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=81fc276 ]

NIFI-6798: When checking that referenced Controller Services are valid, use 
ValidationContext.getProperties() rather than 
ComponentNode.getSupportedPropertyDescriptors() because the latter does not 
include dynamic properties

This closes #3836.

Signed-off-by: Bryan Bende 


> Validate Controller Services referenced via dynamic properties
> --
>
> Key: NIFI-6798
> URL: https://issues.apache.org/jira/browse/NIFI-6798
> Project: Apache NiFi
>  Issue Type: Bug
>  Components: Core Framework
>Reporter: Peter Turcsanyi
>Assignee: Mark Payne
>Priority: Major
> Fix For: 1.11.0
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> If a Controller Service referenced by another component is disabled, then the 
> referencing component should be in invalid state.
> It works fine for statically referenced Controller Services (configured via 
> static properties of the processor / another service), but it seems the 
> framework does not check it for dynamically configured services.
> The validator method can be found here:
> [https://github.com/apache/nifi/blob/master/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-framework-core-api/src/main/java/org/apache/nifi/controller/AbstractComponentNode.java#L679]
> Components that have Controller Service references configured via dynamic 
> properties:
>  * DBCPConnectionPoolLookup
>  * AzureStorageCredentialsControllerServiceLookup
>  * (there might be others, needs to be checked)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[GitHub] [nifi-registry] asfgit closed pull request #234: [NIFIREG-324] add hammerJS to testbed

2019-10-25 Thread GitBox
asfgit closed pull request #234: [NIFIREG-324] add hammerJS to testbed
URL: https://github.com/apache/nifi-registry/pull/234
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[jira] [Resolved] (NIFIREG-324) UI - include hammerJS with unit tests

2019-10-25 Thread Bryan Bende (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFIREG-324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bryan Bende resolved NIFIREG-324.
-
Fix Version/s: 1.0.0
   Resolution: Fixed

Looks good, merged

> UI - include hammerJS with unit tests
> -
>
> Key: NIFIREG-324
> URL: https://issues.apache.org/jira/browse/NIFIREG-324
> Project: NiFi Registry
>  Issue Type: Bug
>Reporter: Scott Aslan
>Assignee: Scott Aslan
>Priority: Major
>  Labels: ui
> Fix For: 1.0.0
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> We see 
> WARN LOG: 'The "longpress" event cannot be bound because Hammer.JS is not 
> loaded and no custom loader has been specified.'
> in the logs when running JS unit tests. Including hammerJS will clean up 
> these warnings.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[GitHub] [nifi] asfgit closed pull request #3841: NIFI-6807: When a Controller Service's state is transitioned to ENABL…

2019-10-25 Thread GitBox
asfgit closed pull request #3841: NIFI-6807: When a Controller Service's state 
is transitioned to ENABL…
URL: https://github.com/apache/nifi/pull/3841
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [nifi] mcgilman commented on issue #3841: NIFI-6807: When a Controller Service's state is transitioned to ENABL…

2019-10-25 Thread GitBox
mcgilman commented on issue #3841: NIFI-6807: When a Controller Service's state 
is transitioned to ENABL…
URL: https://github.com/apache/nifi/pull/3841#issuecomment-546404420
 
 
   Thanks @markap14! This has been merged to master.


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[jira] [Updated] (NIFI-6807) When enabling Controller Service and referencing components, some references may fail to enable

2019-10-25 Thread Matt Gilman (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-6807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Matt Gilman updated NIFI-6807:
--
Resolution: Fixed
Status: Resolved  (was: Patch Available)

> When enabling Controller Service and referencing components, some references 
> may fail to enable
> ---
>
> Key: NIFI-6807
> URL: https://issues.apache.org/jira/browse/NIFI-6807
> Project: Apache NiFi
>  Issue Type: Bug
>  Components: Core Framework
>Reporter: Mark Payne
>Assignee: Mark Payne
>Priority: Critical
> Fix For: 1.10.0
>
>  Time Spent: 40m
>  Remaining Estimate: 0h
>
> When a user chooses to enable a Controller Service and its referencing 
> components, there exists a situation where we can sometimes see the 
> referencing Controller Service fail to enable. This is particularly 
> problematic in a clustered environment, as it can result in nodes being 
> disconnected from the cluster because the service didn't enable.
> To replicate, create a JSONRecordSetWriter service and an AvroSchemaRegistry 
> service. Configure the record writer to depend on the schema registry (and 
> all other necessary configuration to make the services valid). Now, enable 
> AvroSchemaRegistry and all referencing components. The JSONRecordSetWriter 
> will sometimes fail to enable because it is not yet valid.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (NIFI-6807) When enabling Controller Service and referencing components, some references may fail to enable

2019-10-25 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/NIFI-6807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16959865#comment-16959865
 ] 

ASF subversion and git services commented on NIFI-6807:
---

Commit 3f270f184c22f9686587bcedff396c434bd8f7d5 in nifi's branch 
refs/heads/master from Mark Payne
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=3f270f1 ]

NIFI-6807: When a Controller Service's state is transitioned to ENABLING, 
complete the Future successfully, even if the Controller Service is not valid. 
The Controller Service will remain in the ENABLING state until it is made 
valid, at which point it will ENABLE (unless explicitly disabled first). This 
allows us to Enable a Controller Service and its referencing components, even 
if the referencing component is still invalid due to it not yet recognizing the 
the referenced service has been enabled.

This closes #3841


> When enabling Controller Service and referencing components, some references 
> may fail to enable
> ---
>
> Key: NIFI-6807
> URL: https://issues.apache.org/jira/browse/NIFI-6807
> Project: Apache NiFi
>  Issue Type: Bug
>  Components: Core Framework
>Reporter: Mark Payne
>Assignee: Mark Payne
>Priority: Critical
> Fix For: 1.11.0
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> When a user chooses to enable a Controller Service and its referencing 
> components, there exists a situation where we can sometimes see the 
> referencing Controller Service fail to enable. This is particularly 
> problematic in a clustered environment, as it can result in nodes being 
> disconnected from the cluster because the service didn't enable.
> To replicate, create a JSONRecordSetWriter service and an AvroSchemaRegistry 
> service. Configure the record writer to depend on the schema registry (and 
> all other necessary configuration to make the services valid). Now, enable 
> AvroSchemaRegistry and all referencing components. The JSONRecordSetWriter 
> will sometimes fail to enable because it is not yet valid.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (NIFI-6807) When enabling Controller Service and referencing components, some references may fail to enable

2019-10-25 Thread Matt Gilman (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-6807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Matt Gilman updated NIFI-6807:
--
Fix Version/s: (was: 1.11.0)
   1.10.0

> When enabling Controller Service and referencing components, some references 
> may fail to enable
> ---
>
> Key: NIFI-6807
> URL: https://issues.apache.org/jira/browse/NIFI-6807
> Project: Apache NiFi
>  Issue Type: Bug
>  Components: Core Framework
>Reporter: Mark Payne
>Assignee: Mark Payne
>Priority: Critical
> Fix For: 1.10.0
>
>  Time Spent: 40m
>  Remaining Estimate: 0h
>
> When a user chooses to enable a Controller Service and its referencing 
> components, there exists a situation where we can sometimes see the 
> referencing Controller Service fail to enable. This is particularly 
> problematic in a clustered environment, as it can result in nodes being 
> disconnected from the cluster because the service didn't enable.
> To replicate, create a JSONRecordSetWriter service and an AvroSchemaRegistry 
> service. Configure the record writer to depend on the schema registry (and 
> all other necessary configuration to make the services valid). Now, enable 
> AvroSchemaRegistry and all referencing components. The JSONRecordSetWriter 
> will sometimes fail to enable because it is not yet valid.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[GitHub] [nifi] asfgit closed pull request #3846: NIFI-6811: Allow enterGroup to complete prior to loading CS table

2019-10-25 Thread GitBox
asfgit closed pull request #3846: NIFI-6811: Allow enterGroup to complete prior 
to loading CS table
URL: https://github.com/apache/nifi/pull/3846
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[jira] [Resolved] (NIFI-6811) UI - Go to controller service issue

2019-10-25 Thread Rob Fellows (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-6811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rob Fellows resolved NIFI-6811.
---
Resolution: Fixed

> UI - Go to controller service issue
> ---
>
> Key: NIFI-6811
> URL: https://issues.apache.org/jira/browse/NIFI-6811
> Project: Apache NiFi
>  Issue Type: Bug
>  Components: Core UI
>Reporter: Matt Gilman
>Assignee: Matt Gilman
>Priority: Critical
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> When going to a controller service in an ancestor group from the controller 
> service table in a descendant group, we need to wait for enterGroup to 
> complete before attempting to load the table. This is because the table will 
> ask for the parameter context which is loaded conditionally based on the 
> currently loaded group. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (NIFI-6811) UI - Go to controller service issue

2019-10-25 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/NIFI-6811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16959890#comment-16959890
 ] 

ASF subversion and git services commented on NIFI-6811:
---

Commit 9364f7d2e80e7f3695f175d2d3c5d23883ad2ce4 in nifi's branch 
refs/heads/master from Matt Gilman
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=9364f7d ]

NIFI-6811:
- Allowing enterGroup to complete prior to loading the controller service table.

This closes #3846.


> UI - Go to controller service issue
> ---
>
> Key: NIFI-6811
> URL: https://issues.apache.org/jira/browse/NIFI-6811
> Project: Apache NiFi
>  Issue Type: Bug
>  Components: Core UI
>Reporter: Matt Gilman
>Assignee: Matt Gilman
>Priority: Critical
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> When going to a controller service in an ancestor group from the controller 
> service table in a descendant group, we need to wait for enterGroup to 
> complete before attempting to load the table. This is because the table will 
> ask for the parameter context which is loaded conditionally based on the 
> currently loaded group. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (NIFI-6812) Add LICENSE/NOTICE files to nifi-azure-services-api-nar

2019-10-25 Thread Peter Turcsanyi (Jira)
Peter Turcsanyi created NIFI-6812:
-

 Summary: Add LICENSE/NOTICE files to nifi-azure-services-api-nar
 Key: NIFI-6812
 URL: https://issues.apache.org/jira/browse/NIFI-6812
 Project: Apache NiFi
  Issue Type: Bug
Reporter: Peter Turcsanyi
 Fix For: 1.10.0


nifi-azure-services-api uses a subset of the dependencies of 
nifi-azure-processor.

So the licenses can be copied from there and the main NOTICE file in the 
assembly module should already be fine.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Assigned] (NIFI-6812) Add LICENSE/NOTICE files to nifi-azure-services-api-nar

2019-10-25 Thread Matt Gilman (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-6812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Matt Gilman reassigned NIFI-6812:
-

Assignee: Matt Gilman

> Add LICENSE/NOTICE files to nifi-azure-services-api-nar
> ---
>
> Key: NIFI-6812
> URL: https://issues.apache.org/jira/browse/NIFI-6812
> Project: Apache NiFi
>  Issue Type: Bug
>Reporter: Peter Turcsanyi
>Assignee: Matt Gilman
>Priority: Major
> Fix For: 1.10.0
>
>
> nifi-azure-services-api uses a subset of the dependencies of 
> nifi-azure-processor.
> So the licenses can be copied from there and the main NOTICE file in the 
> assembly module should already be fine.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[GitHub] [nifi] mcgilman opened a new pull request #3847: NIFI-6812: Establishing the L&N for the azure-services-api-nar

2019-10-25 Thread GitBox
mcgilman opened a new pull request #3847: NIFI-6812: Establishing the L&N for 
the azure-services-api-nar
URL: https://github.com/apache/nifi/pull/3847
 
 
   NIFI-6812:
   - Establishing the L&N for the azure-services-api-nar.


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[jira] [Updated] (NIFI-6812) Add LICENSE/NOTICE files to nifi-azure-services-api-nar

2019-10-25 Thread Matt Gilman (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-6812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Matt Gilman updated NIFI-6812:
--
Status: Patch Available  (was: Open)

> Add LICENSE/NOTICE files to nifi-azure-services-api-nar
> ---
>
> Key: NIFI-6812
> URL: https://issues.apache.org/jira/browse/NIFI-6812
> Project: Apache NiFi
>  Issue Type: Bug
>Reporter: Peter Turcsanyi
>Assignee: Matt Gilman
>Priority: Major
> Fix For: 1.10.0
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> nifi-azure-services-api uses a subset of the dependencies of 
> nifi-azure-processor.
> So the licenses can be copied from there and the main NOTICE file in the 
> assembly module should already be fine.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[GitHub] [nifi] asfgit closed pull request #3847: NIFI-6812: Establishing the L&N for the azure-services-api-nar

2019-10-25 Thread GitBox
asfgit closed pull request #3847: NIFI-6812: Establishing the L&N for the 
azure-services-api-nar
URL: https://github.com/apache/nifi/pull/3847
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[jira] [Updated] (NIFI-6812) Add LICENSE/NOTICE files to nifi-azure-services-api-nar

2019-10-25 Thread Joe Witt (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-6812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Joe Witt updated NIFI-6812:
---
Resolution: Fixed
Status: Resolved  (was: Patch Available)

> Add LICENSE/NOTICE files to nifi-azure-services-api-nar
> ---
>
> Key: NIFI-6812
> URL: https://issues.apache.org/jira/browse/NIFI-6812
> Project: Apache NiFi
>  Issue Type: Bug
>Reporter: Peter Turcsanyi
>Assignee: Matt Gilman
>Priority: Major
> Fix For: 1.10.0
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> nifi-azure-services-api uses a subset of the dependencies of 
> nifi-azure-processor.
> So the licenses can be copied from there and the main NOTICE file in the 
> assembly module should already be fine.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (NIFI-6812) Add LICENSE/NOTICE files to nifi-azure-services-api-nar

2019-10-25 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/NIFI-6812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16959942#comment-16959942
 ] 

ASF subversion and git services commented on NIFI-6812:
---

Commit 4f5718bf50f0e53f859824bd0fbb29e4ec27e8ff in nifi's branch 
refs/heads/master from Matt Gilman
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=4f5718b ]

NIFI-6812: This closes #3847
- Establishing the L&N for the azure-services-api-nar.

Signed-off-by: Joe Witt 


> Add LICENSE/NOTICE files to nifi-azure-services-api-nar
> ---
>
> Key: NIFI-6812
> URL: https://issues.apache.org/jira/browse/NIFI-6812
> Project: Apache NiFi
>  Issue Type: Bug
>Reporter: Peter Turcsanyi
>Assignee: Matt Gilman
>Priority: Major
> Fix For: 1.10.0
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> nifi-azure-services-api uses a subset of the dependencies of 
> nifi-azure-processor.
> So the licenses can be copied from there and the main NOTICE file in the 
> assembly module should already be fine.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (NIFI-6806) IllegalStateExceptionMapper, etc. should always log full stack trace

2019-10-25 Thread Joe Witt (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-6806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Joe Witt updated NIFI-6806:
---
Fix Version/s: (was: 1.11.0)
   1.10.0

> IllegalStateExceptionMapper, etc. should always log full stack trace
> 
>
> Key: NIFI-6806
> URL: https://issues.apache.org/jira/browse/NIFI-6806
> Project: Apache NiFi
>  Issue Type: Bug
>  Components: Core Framework
>Reporter: Mark Payne
>Assignee: Mark Payne
>Priority: Major
> Fix For: 1.10.0
>
>
> The IllegalStateExceptionMapper is used when any IllegalStateException makes 
> its way all the way back to the web tier. This happens, for instance, if a 
> Controller Service cannot be enabled. When this happens, the Exception Mapper 
> only logs the stack trace if DEBUG is enabled. This is an old pattern that 
> was followed during early releases to prevent such verbose logging, but this 
> Exception Mapper needs to be updated to always log the stack traces. 
> Otherwise, we have no way of knowing the underlying cause of the failure.
> IllegalArgumentExceptionMapper and a few others also appear to follow this 
> same pattern and need to be updated.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (NIFI-6798) Validate Controller Services referenced via dynamic properties

2019-10-25 Thread Joe Witt (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-6798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Joe Witt updated NIFI-6798:
---
Fix Version/s: (was: 1.11.0)
   1.10.0

> Validate Controller Services referenced via dynamic properties
> --
>
> Key: NIFI-6798
> URL: https://issues.apache.org/jira/browse/NIFI-6798
> Project: Apache NiFi
>  Issue Type: Bug
>  Components: Core Framework
>Reporter: Peter Turcsanyi
>Assignee: Mark Payne
>Priority: Major
> Fix For: 1.10.0
>
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> If a Controller Service referenced by another component is disabled, then the 
> referencing component should be in invalid state.
> It works fine for statically referenced Controller Services (configured via 
> static properties of the processor / another service), but it seems the 
> framework does not check it for dynamically configured services.
> The validator method can be found here:
> [https://github.com/apache/nifi/blob/master/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-framework-core-api/src/main/java/org/apache/nifi/controller/AbstractComponentNode.java#L679]
> Components that have Controller Service references configured via dynamic 
> properties:
>  * DBCPConnectionPoolLookup
>  * AzureStorageCredentialsControllerServiceLookup
>  * (there might be others, needs to be checked)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (NIFI-6687) Update Ranger dependencies

2019-10-25 Thread Joe Witt (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-6687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Joe Witt updated NIFI-6687:
---
Fix Version/s: (was: 1.11.0)
   1.10.0

> Update Ranger dependencies
> --
>
> Key: NIFI-6687
> URL: https://issues.apache.org/jira/browse/NIFI-6687
> Project: Apache NiFi
>  Issue Type: Improvement
>  Components: Extensions
>Reporter: Matt Gilman
>Assignee: Matt Gilman
>Priority: Major
> Fix For: 1.10.0
>
>  Time Spent: 1h 10m
>  Remaining Estimate: 0h
>
> Upgrade the Ranger authorizer to leverage version 2.x.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (NIFI-6801) Connection analytics models should be distinct for connections

2019-10-25 Thread Joe Witt (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-6801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Joe Witt updated NIFI-6801:
---
Fix Version/s: (was: 1.11.0)
   1.10.0

> Connection analytics models should be distinct for connections
> --
>
> Key: NIFI-6801
> URL: https://issues.apache.org/jira/browse/NIFI-6801
> Project: Apache NiFi
>  Issue Type: Bug
>  Components: Core Framework
>Affects Versions: 1.10.0
>Reporter: Yolanda M. Davis
>Assignee: Yolanda M. Davis
>Priority: Major
> Fix For: 1.10.0
>
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> Connections should have Status Analytics Model instances that are unique for 
> each connection such that calculations for the model can be referred to or 
> updated when new observations are available.  Currently the model appears to 
> be shared across connection objects which leads to erroneous results, 
> especially when a connection does not have enough observations to update the 
> model (since the older values of a previous connection may still be present). 
> This behavior can be seen when debugging is enabled for analytics and noting 
> differences between a Timer Driven Thread execution of predictions vs the 
> NiFi Web Server thread predictions for multiple connections (a flow with one 
> connection would not exhibit this issue).  The Time Driven thread may not 
> retrieve enough connection status observations to refresh the model, and when 
> that occurs, it may still contain calculations from a previous model and use 
> that for predictions. Observers may see behavior where web server  and timer 
> driven predictions only have similar or matching predictions for one 
> connection but others may be mismatched, such as in the below (where 
> connection   has similar prediction between threads but , and  do 
> not): 
> {code:java}
> 2019-10-22 08:01:34,539 INFO [NiFi Web Server-23] 
> o.a.nifi.reporting.StandardEventAccess  : predicted time to COUNT 
> backpressure = 00:44:13 / 2653416
> 2019-10-22 08:01:34,539 INFO [NiFi Web Server-23] 
> o.a.nifi.reporting.StandardEventAccess  : predicted time to BYTES 
> backpressure = 01:09:13 / 4153511
> 2019-10-22 08:01:34,540 INFO [NiFi Web Server-23] 
> o.a.nifi.reporting.StandardEventAccess  : predicted time to COUNT 
> backpressure = 00:32:31 / 1951609
> 2019-10-22 08:01:34,540 INFO [NiFi Web Server-23] 
> o.a.nifi.reporting.StandardEventAccess  : predicted time to BYTES 
> backpressure = 00:32:28 / 1948504
> 2019-10-22 08:01:34,541 INFO [NiFi Web Server-23] 
> o.a.nifi.reporting.StandardEventAccess  : predicted time to COUNT 
> backpressure = 07:29:14 / 26954837
> 2019-10-22 08:01:34,541 INFO [NiFi Web Server-23] 
> o.a.nifi.reporting.StandardEventAccess  : predicted time to BYTES 
> backpressure = 05:24:56 / 19496954 
> 2019-10-22 08:02:02,767 INFO [Timer-Driven Process Thread-2] 
> o.a.nifi.reporting.StandardEventAccess  : predicted time to COUNT 
> backpressure = 04:08:36 / 14916150
> 2019-10-22 08:02:02,767 INFO [Timer-Driven Process Thread-2] 
> o.a.nifi.reporting.StandardEventAccess  : predicted time to BYTES 
> backpressure = 04:17:49 / 15469243
> 2019-10-22 08:02:02,769 INFO [Timer-Driven Process Thread-2] 
> o.a.nifi.reporting.StandardEventAccess  : predicted time to COUNT 
> backpressure = 01:13:42 / 4422829
> 2019-10-22 08:02:02,769 INFO [Timer-Driven Process Thread-2] 
> o.a.nifi.reporting.StandardEventAccess  : predicted time to BYTES 
> backpressure = 00:57:15 / 3435109
> 2019-10-22 08:02:02,770 INFO [Timer-Driven Process Thread-2] 
> o.a.nifi.reporting.StandardEventAccess  : predicted time to COUNT 
> backpressure = 07:28:46 / 26926608
> 2019-10-22 08:02:02,770 INFO [Timer-Driven Process Thread-2] 
> o.a.nifi.reporting.StandardEventAccess  : predicted time to BYTES 
> backpressure = 05:24:28 / 19468725
> {code}
>  A workaround for this is to increase the nifi.analytics.query.interval 
> property or decrease the nifi.components.status.snapshot.frequency property 
> to ensure obtaining enough observations for a refresh. However an appropriate 
> fix is to ensure model instances are unique for each connection and to ensure 
> that, by default, all threads will obtain enough observations for predictions.
>   



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (NIFI-6797) PublishKafka* Processors should support a property for Kafka Partition

2019-10-25 Thread Joe Witt (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-6797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Joe Witt updated NIFI-6797:
---
Fix Version/s: (was: 1.11.0)
   1.10.0

> PublishKafka* Processors should support a property for Kafka Partition
> --
>
> Key: NIFI-6797
> URL: https://issues.apache.org/jira/browse/NIFI-6797
> Project: Apache NiFi
>  Issue Type: Improvement
>  Components: Extensions
>Reporter: Mark Payne
>Assignee: Mark Payne
>Priority: Major
> Fix For: 1.10.0
>
>  Time Spent: 40m
>  Remaining Estimate: 0h
>
> PublishKafka_* and PublishKafkaRecord_* processors do not provide the ability 
> to set the partition for each message. PublishKafka_* should support 
> indicating which partition a FlowFile goes to based on Expression Language 
> (including Attributes) and should use its own custom partitioner to handle 
> that. PublishKafkaRecord_* processors should do the same but should also 
> support using RecordPath to allow for sending records to different partitions.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[GitHub] [nifi-registry] kevdoran closed pull request #245: NIFIREG-252: adding mavendocker build profile

2019-10-25 Thread GitBox
kevdoran closed pull request #245: NIFIREG-252: adding mavendocker build profile
URL: https://github.com/apache/nifi-registry/pull/245
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [nifi] alopresto commented on a change in pull request #3844: NIFI-1474 Added validation for p in scrypt

2019-10-25 Thread GitBox
alopresto commented on a change in pull request #3844: NIFI-1474 Added 
validation for p in scrypt
URL: https://github.com/apache/nifi/pull/3844#discussion_r339188444
 
 

 ##
 File path: 
nifi-commons/nifi-security-utils/src/main/java/org/apache/nifi/security/util/crypto/ScryptCipherProvider.java
 ##
 @@ -78,6 +79,17 @@ public ScryptCipherProvider(int n, int r, int p) {
 if (p < DEFAULT_P) {
 logger.warn("The provided parallelization factor {} is below the 
recommended minimum {}", p, DEFAULT_P);
 }
+
+if (!isPValid(r, p)) {
+logger.warn("Based on the provided block size {}, the provided 
parallelization factor {} is out of bounds", r, p);
+throw new IllegalArgumentException("Invalid p value exceeds p 
boundary");
+}
+}
+
+public static boolean isPValid(int r, int p) {
 
 Review comment:
   Please add a Javadoc comment for this public method. 


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [nifi] alopresto commented on a change in pull request #3844: NIFI-1474 Added validation for p in scrypt

2019-10-25 Thread GitBox
alopresto commented on a change in pull request #3844: NIFI-1474 Added 
validation for p in scrypt
URL: https://github.com/apache/nifi/pull/3844#discussion_r339188702
 
 

 ##
 File path: 
nifi-commons/nifi-security-utils/src/test/groovy/org/apache/nifi/security/util/crypto/ScryptCipherProviderGroovyTest.groovy
 ##
 @@ -513,6 +513,81 @@ class ScryptCipherProviderGroovyTest {
 assert params[2] == EXPECTED_P
 }
 
+@Test
+void testShouldVerifyPBoundary() throws Exception {
+// Arrange
+final int r = 8;
+final int p = 1;
+
+// Act
+boolean valid = ScryptCipherProvider.isPValid(r, p)
+
+// Assert
+assert valid
+}
+
+@Test
+void testShouldFailPBoundary() throws Exception {
+// Arrange
+// The p upper bound is calculated with the formula below:
+// pBoundary = ((Math.pow(2,32))-1) * (32.0/(r * 128)), where 
pBoundary = 134217727.96875;
 
 Review comment:
   Update this comment to note that this particular `p` value is for `r = 8`. 


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [nifi] alopresto commented on a change in pull request #3844: NIFI-1474 Added validation for p in scrypt

2019-10-25 Thread GitBox
alopresto commented on a change in pull request #3844: NIFI-1474 Added 
validation for p in scrypt
URL: https://github.com/apache/nifi/pull/3844#discussion_r339188893
 
 

 ##
 File path: 
nifi-commons/nifi-security-utils/src/test/groovy/org/apache/nifi/security/util/crypto/ScryptCipherProviderGroovyTest.groovy
 ##
 @@ -513,6 +513,81 @@ class ScryptCipherProviderGroovyTest {
 assert params[2] == EXPECTED_P
 }
 
+@Test
+void testShouldVerifyPBoundary() throws Exception {
+// Arrange
+final int r = 8;
+final int p = 1;
+
+// Act
+boolean valid = ScryptCipherProvider.isPValid(r, p)
+
+// Assert
+assert valid
+}
+
+@Test
+void testShouldFailPBoundary() throws Exception {
+// Arrange
+// The p upper bound is calculated with the formula below:
+// pBoundary = ((Math.pow(2,32))-1) * (32.0/(r * 128)), where 
pBoundary = 134217727.96875;
+Map costParameters = [8:134217729, 128:8388608, 4096: 0]
+
+// Act
+def results = costParameters.collectEntries { r, p ->
+def isValid = ScryptCipherProvider.isPValid(r, p)
+[r, isValid]
+}
+
+// results => [8: false, 128: false, 4096: false]
+
+// Assert
+results.each { r, isPValid ->
+logger.info("For r ${r}, p is ${isPValid}")
+assert !isPValid
+}
+
+
+
+}
+//*
 
 Review comment:
   Remove this comment block. 


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [nifi] aramcodz opened a new pull request #3848: Nifi 6762: Submit new List Processor - ListMultipleS3Buckets

2019-10-25 Thread GitBox
aramcodz opened a new pull request #3848: Nifi 6762: Submit new List Processor 
- ListMultipleS3Buckets
URL: https://github.com/apache/nifi/pull/3848
 
 
    Description of PR
   Nifi 6762: Submit new List Processor - ListMultipleS3Buckets
   
   ### For all changes:
   - [ ] Is there a JIRA ticket associated with this PR? Is it referenced in 
the commit message?
   https://issues.apache.org/jira/browse/NIFI-6762
   
   - [ ] Does your PR title start with **NIFI-** where  is the JIRA 
number you are trying to resolve? Pay particular attention to the hyphen "-" 
character.
   Yes
   
   - [ ] Has your PR been rebased against the latest commit within the target 
branch (typically `master`)?
   Yes, just rebased.
   
   - [ ] Is your initial contribution a single, squashed commit? 
   Two commits in this PR Contribution.
   
   ### For code changes:
   - [ ] Have you ensured that the full suite of tests is executed via `mvn 
-Pcontrib-check clean install` at the root `nifi` folder?
   YES
   - [ ] Have you written or updated unit tests to verify your changes?
   YES
   - [ ] Have you verified that the full build is successful on both JDK 8 and 
JDK 11?
   YES
   - [ ] If adding new dependencies to the code, are these dependencies 
licensed in a way that is compatible for inclusion under [ASF 
2.0](http://www.apache.org/legal/resolved.html#category-a)? YES
   - [ ] If applicable, have you updated the `LICENSE` file, including the main 
`LICENSE` file under `nifi-assembly`?
   NOT Applicable
   - [ ] If applicable, have you updated the `NOTICE` file, including the main 
`NOTICE` file found under `nifi-assembly`?
   NOT Applicable
   - [ ] If adding new Properties, have you added `.displayName` in addition to 
.name (programmatic access) for each of the new properties?
   NOT Applicable
   
   ### For documentation related changes:
   - [ ] Have you ensured that format looks appropriate for the output in which 
it is rendered?
   NOT Applicable


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [nifi] asfgit closed pull request #3844: NIFI-1474 Added validation for p in scrypt

2019-10-25 Thread GitBox
asfgit closed pull request #3844: NIFI-1474 Added validation for p in scrypt
URL: https://github.com/apache/nifi/pull/3844
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [nifi] alopresto commented on issue #3844: NIFI-1474 Added validation for p in scrypt

2019-10-25 Thread GitBox
alopresto commented on issue #3844: NIFI-1474 Added validation for p in scrypt
URL: https://github.com/apache/nifi/pull/3844#issuecomment-546520492
 
 
   Thanks for your first contribution. I have merged it and closed the ticket. 


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[jira] [Commented] (NIFI-1474) Enforce p boundary in Scrypt

2019-10-25 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/NIFI-1474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16960138#comment-16960138
 ] 

ASF subversion and git services commented on NIFI-1474:
---

Commit 4d25b6341ccba0ee24da15198d030d8132972e7c in nifi's branch 
refs/heads/master from mtien
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=4d25b63 ]

NIFI-1474 Added method to check p boundary. Added a unit test.
NIFI-1474 Added unit test for constructor p boundaries. Added p boundary 
conditions.
NIFI-1474 Updated documentation regarding p boundary.
NIFI-1474 Added r validation and unit tests. Added Javadoc for new methods.

This closes #3844.

Signed-off-by: Andy LoPresto 


> Enforce p boundary in Scrypt
> 
>
> Key: NIFI-1474
> URL: https://issues.apache.org/jira/browse/NIFI-1474
> Project: Apache NiFi
>  Issue Type: Improvement
>  Components: Core Framework
>Affects Versions: 0.5.0
>Reporter: Andy LoPresto
>Assignee: M Tien
>Priority: Trivial
>  Labels: encryption, security
>   Original Estimate: 24h
>  Time Spent: 1h
>  Remaining Estimate: 23h
>
> According to the Scrypt specification, there is a maximum boundary for {{p}} 
> of {{(2^32 - 1) * 32 / MFlen}}. In practice, {{p}} almost always has a value 
> of {{1}}. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (NIFI-1474) Enforce p boundary in Scrypt

2019-10-25 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/NIFI-1474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16960140#comment-16960140
 ] 

ASF subversion and git services commented on NIFI-1474:
---

Commit 4d25b6341ccba0ee24da15198d030d8132972e7c in nifi's branch 
refs/heads/master from mtien
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=4d25b63 ]

NIFI-1474 Added method to check p boundary. Added a unit test.
NIFI-1474 Added unit test for constructor p boundaries. Added p boundary 
conditions.
NIFI-1474 Updated documentation regarding p boundary.
NIFI-1474 Added r validation and unit tests. Added Javadoc for new methods.

This closes #3844.

Signed-off-by: Andy LoPresto 


> Enforce p boundary in Scrypt
> 
>
> Key: NIFI-1474
> URL: https://issues.apache.org/jira/browse/NIFI-1474
> Project: Apache NiFi
>  Issue Type: Improvement
>  Components: Core Framework
>Affects Versions: 0.5.0
>Reporter: Andy LoPresto
>Assignee: M Tien
>Priority: Trivial
>  Labels: encryption, security
>   Original Estimate: 24h
>  Time Spent: 1h 10m
>  Remaining Estimate: 22h 50m
>
> According to the Scrypt specification, there is a maximum boundary for {{p}} 
> of {{(2^32 - 1) * 32 / MFlen}}. In practice, {{p}} almost always has a value 
> of {{1}}. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (NIFI-1474) Enforce p boundary in Scrypt

2019-10-25 Thread Andy LoPresto (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-1474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andy LoPresto updated NIFI-1474:

Status: Patch Available  (was: Open)

> Enforce p boundary in Scrypt
> 
>
> Key: NIFI-1474
> URL: https://issues.apache.org/jira/browse/NIFI-1474
> Project: Apache NiFi
>  Issue Type: Improvement
>  Components: Core Framework
>Affects Versions: 0.5.0
>Reporter: Andy LoPresto
>Assignee: M Tien
>Priority: Trivial
>  Labels: encryption, security
>   Original Estimate: 24h
>  Time Spent: 1h 20m
>  Remaining Estimate: 22h 40m
>
> According to the Scrypt specification, there is a maximum boundary for {{p}} 
> of {{(2^32 - 1) * 32 / MFlen}}. In practice, {{p}} almost always has a value 
> of {{1}}. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (NIFI-1474) Enforce p boundary in Scrypt

2019-10-25 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/NIFI-1474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16960139#comment-16960139
 ] 

ASF subversion and git services commented on NIFI-1474:
---

Commit 4d25b6341ccba0ee24da15198d030d8132972e7c in nifi's branch 
refs/heads/master from mtien
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=4d25b63 ]

NIFI-1474 Added method to check p boundary. Added a unit test.
NIFI-1474 Added unit test for constructor p boundaries. Added p boundary 
conditions.
NIFI-1474 Updated documentation regarding p boundary.
NIFI-1474 Added r validation and unit tests. Added Javadoc for new methods.

This closes #3844.

Signed-off-by: Andy LoPresto 


> Enforce p boundary in Scrypt
> 
>
> Key: NIFI-1474
> URL: https://issues.apache.org/jira/browse/NIFI-1474
> Project: Apache NiFi
>  Issue Type: Improvement
>  Components: Core Framework
>Affects Versions: 0.5.0
>Reporter: Andy LoPresto
>Assignee: M Tien
>Priority: Trivial
>  Labels: encryption, security
>   Original Estimate: 24h
>  Time Spent: 1h
>  Remaining Estimate: 23h
>
> According to the Scrypt specification, there is a maximum boundary for {{p}} 
> of {{(2^32 - 1) * 32 / MFlen}}. In practice, {{p}} almost always has a value 
> of {{1}}. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (NIFI-1474) Enforce p boundary in Scrypt

2019-10-25 Thread Andy LoPresto (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-1474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andy LoPresto updated NIFI-1474:

Fix Version/s: 1.11.0
   Resolution: Fixed
   Status: Resolved  (was: Patch Available)

> Enforce p boundary in Scrypt
> 
>
> Key: NIFI-1474
> URL: https://issues.apache.org/jira/browse/NIFI-1474
> Project: Apache NiFi
>  Issue Type: Improvement
>  Components: Core Framework
>Affects Versions: 0.5.0
>Reporter: Andy LoPresto
>Assignee: M Tien
>Priority: Trivial
>  Labels: encryption, security
> Fix For: 1.11.0
>
>   Original Estimate: 24h
>  Time Spent: 1h 20m
>  Remaining Estimate: 22h 40m
>
> According to the Scrypt specification, there is a maximum boundary for {{p}} 
> of {{(2^32 - 1) * 32 / MFlen}}. In practice, {{p}} almost always has a value 
> of {{1}}. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (NIFI-1474) Enforce p boundary in Scrypt

2019-10-25 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/NIFI-1474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16960141#comment-16960141
 ] 

ASF subversion and git services commented on NIFI-1474:
---

Commit 4d25b6341ccba0ee24da15198d030d8132972e7c in nifi's branch 
refs/heads/master from mtien
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=4d25b63 ]

NIFI-1474 Added method to check p boundary. Added a unit test.
NIFI-1474 Added unit test for constructor p boundaries. Added p boundary 
conditions.
NIFI-1474 Updated documentation regarding p boundary.
NIFI-1474 Added r validation and unit tests. Added Javadoc for new methods.

This closes #3844.

Signed-off-by: Andy LoPresto 


> Enforce p boundary in Scrypt
> 
>
> Key: NIFI-1474
> URL: https://issues.apache.org/jira/browse/NIFI-1474
> Project: Apache NiFi
>  Issue Type: Improvement
>  Components: Core Framework
>Affects Versions: 0.5.0
>Reporter: Andy LoPresto
>Assignee: M Tien
>Priority: Trivial
>  Labels: encryption, security
>   Original Estimate: 24h
>  Time Spent: 1h 10m
>  Remaining Estimate: 22h 50m
>
> According to the Scrypt specification, there is a maximum boundary for {{p}} 
> of {{(2^32 - 1) * 32 / MFlen}}. In practice, {{p}} almost always has a value 
> of {{1}}. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[GitHub] [nifi] asfgit closed pull request #3772: NIFI-6682 SplitJson does not work if the input is null

2019-10-25 Thread GitBox
asfgit closed pull request #3772: NIFI-6682 SplitJson does not work if the 
input is null
URL: https://github.com/apache/nifi/pull/3772
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[jira] [Commented] (NIFI-6682) SplitJson does not work if the input is String "null"

2019-10-25 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/NIFI-6682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16960149#comment-16960149
 ] 

ASF subversion and git services commented on NIFI-6682:
---

Commit cfcf2e698df34eb097c23a404c1a346a4aeb9c60 in nifi's branch 
refs/heads/master from Otto Fowler
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=cfcf2e6 ]

NIFI-6682 SplitJson does not work if the input is null

This closes #3772

Signed-off-by: Mike Thomsen 


> SplitJson does not work if the input is String "null" 
> --
>
> Key: NIFI-6682
> URL: https://issues.apache.org/jira/browse/NIFI-6682
> Project: Apache NiFi
>  Issue Type: Bug
>  Components: Extensions
>Affects Versions: 1.9.2
>Reporter: Frank Chen
>Assignee: Otto Fowler
>Priority: Major
>  Labels: patch-available
> Attachments: image-2019-09-17-18-18-19-860.png, 
> image-2019-09-17-18-33-33-708.png
>
>  Time Spent: 2h 10m
>  Remaining Estimate: 0h
>
> When the input is String "null", the SplitJson processor should output to 
> failure route  rather than report error.As a result, the flowfile is not 
> processed in the queue all the time.
>  
>  
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Resolved] (NIFI-6682) SplitJson does not work if the input is String "null"

2019-10-25 Thread Mike Thomsen (Jira)


 [ 
https://issues.apache.org/jira/browse/NIFI-6682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mike Thomsen resolved NIFI-6682.

Fix Version/s: 1.10.0
   Resolution: Fixed

> SplitJson does not work if the input is String "null" 
> --
>
> Key: NIFI-6682
> URL: https://issues.apache.org/jira/browse/NIFI-6682
> Project: Apache NiFi
>  Issue Type: Bug
>  Components: Extensions
>Affects Versions: 1.9.2
>Reporter: Frank Chen
>Assignee: Otto Fowler
>Priority: Major
>  Labels: patch-available
> Fix For: 1.10.0
>
> Attachments: image-2019-09-17-18-18-19-860.png, 
> image-2019-09-17-18-33-33-708.png
>
>  Time Spent: 2h 20m
>  Remaining Estimate: 0h
>
> When the input is String "null", the SplitJson processor should output to 
> failure route  rather than report error.As a result, the flowfile is not 
> processed in the queue all the time.
>  
>  
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[GitHub] [nifi] MikeThomsen commented on issue #3816: Nifi-6682 SplitJson does not work if the input is String "null"

2019-10-25 Thread GitBox
MikeThomsen commented on issue #3816: Nifi-6682 SplitJson does not work if the 
input is String "null"
URL: https://github.com/apache/nifi/pull/3816#issuecomment-546524010
 
 
   @aloneface I merged @ottobackwards's version of the PR. You can close this.


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [nifi] MikeThomsen commented on a change in pull request #3624: NIFI-6255 NIFI-6287: Hash function for expression language and record…

2019-10-25 Thread GitBox
MikeThomsen commented on a change in pull request #3624: NIFI-6255 NIFI-6287: 
Hash function for expression language and record…
URL: https://github.com/apache/nifi/pull/3624#discussion_r339251539
 
 

 ##
 File path: 
nifi-commons/nifi-record-path/src/main/java/org/apache/nifi/record/path/functions/Hash.java
 ##
 @@ -0,0 +1,88 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements.  See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License.  You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.nifi.record.path.functions;
+
+import org.apache.nifi.record.path.FieldValue;
+import org.apache.nifi.record.path.RecordPathEvaluationContext;
+import org.apache.nifi.record.path.StandardFieldValue;
+import org.apache.nifi.record.path.exception.RecordPathException;
+import org.apache.nifi.record.path.paths.RecordPathSegment;
+import org.apache.nifi.record.path.util.RecordPathUtils;
+import org.apache.nifi.serialization.record.util.DataTypeUtils;
+
+import java.security.MessageDigest;
+import java.security.NoSuchAlgorithmException;
+import java.security.Security;
+import java.util.stream.Stream;
+
+public class Hash extends RecordPathSegment {
+private static final char[] DIGITS = { '0', '1', '2', '3', '4', '5', '6', 
'7', '8', '9', 'a', 'b', 'c', 'd', 'e', 'f' };
 
 Review comment:
   Same here.


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [nifi] MikeThomsen commented on a change in pull request #3624: NIFI-6255 NIFI-6287: Hash function for expression language and record…

2019-10-25 Thread GitBox
MikeThomsen commented on a change in pull request #3624: NIFI-6255 NIFI-6287: 
Hash function for expression language and record…
URL: https://github.com/apache/nifi/pull/3624#discussion_r339251426
 
 

 ##
 File path: 
nifi-commons/nifi-expression-language/src/main/java/org/apache/nifi/attribute/expression/language/evaluation/functions/HashEvaluator.java
 ##
 @@ -0,0 +1,84 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements.  See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License.  You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+package org.apache.nifi.attribute.expression.language.evaluation.functions;
+
+
+import java.security.MessageDigest;
+import java.security.NoSuchAlgorithmException;
+import java.security.Security;
+import org.apache.nifi.attribute.expression.language.EvaluationContext;
+import org.apache.nifi.attribute.expression.language.evaluation.Evaluator;
+import org.apache.nifi.attribute.expression.language.evaluation.QueryResult;
+import 
org.apache.nifi.attribute.expression.language.evaluation.StringEvaluator;
+import 
org.apache.nifi.attribute.expression.language.evaluation.StringQueryResult;
+import 
org.apache.nifi.attribute.expression.language.exception.AttributeExpressionLanguageException;
+
+public class HashEvaluator extends StringEvaluator {
+private static final char[] DIGITS = { '0', '1', '2', '3', '4', '5', '6', 
'7', '8', '9', 'a', 'b', 'c', 'd', 'e', 'f' };
 
 Review comment:
   Would be good to see this refactored to use 
[DigestUtils](https://commons.apache.org/proper/commons-codec/apidocs/org/apache/commons/codec/digest/DigestUtils.html)


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[jira] [Commented] (NIFI-6762) New Processor - Watch Multiple S3 Buckets for content changes

2019-10-25 Thread Aram S Openden (Jira)


[ 
https://issues.apache.org/jira/browse/NIFI-6762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16960070#comment-16960070
 ] 

Aram S Openden commented on NIFI-6762:
--

[~ste...@apache.org]

Please check out my PR (just posted today): 
[https://github.com/apache/nifi/pull/3848.]

Let me know if this adequately answers your design questions or if I need to 
provide more info. in some other format.

> New Processor - Watch Multiple S3 Buckets for content changes
> -
>
> Key: NIFI-6762
> URL: https://issues.apache.org/jira/browse/NIFI-6762
> Project: Apache NiFi
>  Issue Type: New Feature
>  Components: Extensions
>Affects Versions: 1.9.2
>Reporter: Aram S Openden
>Priority: Major
>  Labels: Processor, S3, watch
>   Original Estimate: 384h
>  Remaining Estimate: 384h
>
> Proposing New S3 processor that is a "variation" on the existing ListS3 
> Processor. For lack of better term, I will call this "Watch Multiple S3 
> Buckets Processor" (naming here is open to feedback). This new Processor 
> takes an input attribute "Bucket" from the FlowFile, which could use NiFi 
> ExpressionLanguage  to compute that value. Hence, the Processor could "watch" 
> different buckets in an S3 Object Store.
> This processor must handle the State Management logic for multiple S3 
> buckets. The simplest solution for this problem add to modify the State 
> Management logic to prepend the bucket name to this key/objectName that is 
> being used to track state.
> Finally, the Dev should document the maximum number of buckets it will 
> monitor at once, maximum amount of state/storage it can have to track the 
> various listings in various buckets.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)