[jira] [Updated] (NIFI-4180) Site To Site Port Math Seemingly Incorrect

2017-07-12 Thread Tommy Young (JIRA)

 [ 
https://issues.apache.org/jira/browse/NIFI-4180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tommy Young updated NIFI-4180:
--
Description: 
It seems as though Nifi is either using something other than flow file count 
when logging the "will receive x% of data" message (in which case it would be 
nice to print the value of what it is using in the logs) OR there is a math 
error, based on the below log messages.

PeerStatus[hostname=node1,port=9090,secure=true,flowFileCount=0] will receive 
0.78125% of data
PeerStatus[hostname=node2,port=9090,secure=true,flowFileCount=2] will receive 
28.125% of data
PeerStatus[hostname=node3,port=9090,secure=true,flowFileCount=5] will receive 
71.09375% of data 

PeerStatus[hostname=node1,port=9090,secure=true,flowFileCount=0] will receive 
0.9615384615384616% of data
PeerStatus[hostname=node3,port=9090,secure=true,flowFileCount=0] will receive 
0.9615384615384616% of data
PeerStatus[hostname=node2,port=9090,secure=true,flowFileCount=1] will receive 
98.07692307692308% of data 

  was:
It seems as though Nifi is either using something other than flow file count 
when logging the "will receive x% of data" message (in which case it would be 
nice to print the value of what it is using in the logs) OR there is a math 
error, based on the below log messages.

PeerStatus[hostname=node1,port=9090,secure=true,flowFileCount=0] will receive 
0.78125% of data
PeerStatus[hostname=node2,port=9090,secure=true,flowFileCount=2] will receive 
28.125% of data
PeerStatus[hostname=node1,port=9090,secure=true,flowFileCount=5] will receive 
71.09375% of data 

PeerStatus[hostname=node1,port=9090,secure=true,flowFileCount=0] will receive 
0.9615384615384616% of data
PeerStatus[hostname=node3,port=9090,secure=true,flowFileCount=0] will receive 
0.9615384615384616% of data
PeerStatus[hostname=node2,port=9090,secure=true,flowFileCount=1] will receive 
98.07692307692308% of data 


> Site To Site Port Math Seemingly Incorrect
> --
>
> Key: NIFI-4180
> URL: https://issues.apache.org/jira/browse/NIFI-4180
> Project: Apache NiFi
>  Issue Type: Bug
>  Components: Core Framework
>Affects Versions: 1.2.0
> Environment: SLES 11
>Reporter: Tommy Young
>Priority: Minor
>
> It seems as though Nifi is either using something other than flow file count 
> when logging the "will receive x% of data" message (in which case it would be 
> nice to print the value of what it is using in the logs) OR there is a math 
> error, based on the below log messages.
> PeerStatus[hostname=node1,port=9090,secure=true,flowFileCount=0] will receive 
> 0.78125% of data
> PeerStatus[hostname=node2,port=9090,secure=true,flowFileCount=2] will receive 
> 28.125% of data
> PeerStatus[hostname=node3,port=9090,secure=true,flowFileCount=5] will receive 
> 71.09375% of data 
> PeerStatus[hostname=node1,port=9090,secure=true,flowFileCount=0] will receive 
> 0.9615384615384616% of data
> PeerStatus[hostname=node3,port=9090,secure=true,flowFileCount=0] will receive 
> 0.9615384615384616% of data
> PeerStatus[hostname=node2,port=9090,secure=true,flowFileCount=1] will receive 
> 98.07692307692308% of data 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Created] (NIFI-4180) Site To Site Port Math Seemingly Incorrect

2017-07-12 Thread Tommy Young (JIRA)
Tommy Young created NIFI-4180:
-

 Summary: Site To Site Port Math Seemingly Incorrect
 Key: NIFI-4180
 URL: https://issues.apache.org/jira/browse/NIFI-4180
 Project: Apache NiFi
  Issue Type: Bug
  Components: Core Framework
Affects Versions: 1.2.0
 Environment: SLES 11
Reporter: Tommy Young
Priority: Minor


It seems as though Nifi is either using something other than flow file count 
when logging the "will receive x% of data" message (in which case it would be 
nice to print the value of what it is using in the logs) OR there is a math 
error, based on the below log messages.

PeerStatus[hostname=node1,port=9090,secure=true,flowFileCount=0] will receive 
0.78125% of data
PeerStatus[hostname=node2,port=9090,secure=true,flowFileCount=2] will receive 
28.125% of data
PeerStatus[hostname=node1,port=9090,secure=true,flowFileCount=5] will receive 
71.09375% of data 

PeerStatus[hostname=node1,port=9090,secure=true,flowFileCount=0] will receive 
0.9615384615384616% of data
PeerStatus[hostname=node3,port=9090,secure=true,flowFileCount=0] will receive 
0.9615384615384616% of data
PeerStatus[hostname=node2,port=9090,secure=true,flowFileCount=1] will receive 
98.07692307692308% of data 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Created] (NIFI-3693) Improve Nifi Cluster Behavior In Down Scenarios

2017-04-12 Thread Tommy Young (JIRA)
Tommy Young created NIFI-3693:
-

 Summary: Improve Nifi Cluster Behavior In Down Scenarios
 Key: NIFI-3693
 URL: https://issues.apache.org/jira/browse/NIFI-3693
 Project: Apache NiFi
  Issue Type: Improvement
  Components: Configuration Management
Reporter: Tommy Young


Improve Nifi cluster behavior by allowing nodes to receive flow changes when 
not all cluster nodes are online, so long as the node(s?) receiving the changes 
are registered/active with Zookeeper. Then when require down nodes to update to 
latest flow version with cluster before cluster re-join is completed. This 
would probably require external/non-embedded zookeeper to insure valid quorum. 
For any flow files already queued up on a node, process them on the old flow 
prior to changing to the new flow and make sure flow is current before starting 
any processors consuming data from outside systems.
This was born out of a situation where one of our pre-prod cluster nodes has 
been down for nearly a week, and the cluster being read-only until all nodes 
are back online has prevented any further development work from being done.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)