[jira] [Created] (STORM-2792) Clean up RAS and remove possible loops

2017-10-30 Thread Robert Joseph Evans (JIRA)
Robert Joseph Evans created STORM-2792:
--

 Summary: Clean up RAS and remove possible loops
 Key: STORM-2792
 URL: https://issues.apache.org/jira/browse/STORM-2792
 Project: Apache Storm
  Issue Type: Improvement
Reporter: Robert Joseph Evans
Assignee: Robert Joseph Evans


The code for RAS is rather complex, and we have found that if there is a 
mismatch between the priority strategy and the eviction strategy that it can 
result in infinite loops.  To make this simpler there really should just be one 
strategy to prioritize all topologies.  Scheduling happens for the highest 
priority topologies and eviction happens for the lowest priority ones. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Resolved] (STORM-2790) Add nimbus admin groups

2017-10-30 Thread Robert Joseph Evans (JIRA)

 [ 
https://issues.apache.org/jira/browse/STORM-2790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Robert Joseph Evans resolved STORM-2790.

   Resolution: Fixed
Fix Version/s: 2.0.0

Thanks [~kishorvpatil],

I merged this into master.

> Add nimbus admin groups
> ---
>
> Key: STORM-2790
> URL: https://issues.apache.org/jira/browse/STORM-2790
> Project: Apache Storm
>  Issue Type: New Feature
>  Components: storm-client, storm-server
>Reporter: Kishor Patil
>Assignee: Kishor Patil
>  Labels: pull-request-available
> Fix For: 2.0.0
>
>  Time Spent: 1h 10m
>  Remaining Estimate: 0h
>
> Add "nimbus.admins.groups" to help enabling group level permissions part from 
> individuals using "nimbus.admins"



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (STORM-2782) Refactor partial key grouping for greater flexibility

2017-10-30 Thread Robert Joseph Evans (JIRA)

[ 
https://issues.apache.org/jira/browse/STORM-2782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225368#comment-16225368
 ] 

Robert Joseph Evans commented on STORM-2782:


2.x should be fine.  No one else but you has been asking for this, and it is 
going to be a real pain to try and make it backwards compatible.  So if someone 
else speaks up and says that they really want it we can look into how to 
support them.

> Refactor partial key grouping for greater flexibility
> -
>
> Key: STORM-2782
> URL: https://issues.apache.org/jira/browse/STORM-2782
> Project: Apache Storm
>  Issue Type: Improvement
>  Components: storm-core
>Reporter: Kevin Peek
>Assignee: Kevin Peek
>Priority: Minor
>  Labels: pull-request-available
> Fix For: 2.0.0
>
>  Time Spent: 3h 10m
>  Remaining Estimate: 0h
>
> My organization needed behavior similar to the PartialKeyGrouping. This is a 
> port of our refactoring which makes it possible to use the PartialkeyGrouping 
> in new ways. The simplest such usecase would be to send tuples to one out of 
> N downstream instances instead of always one out of two.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (STORM-2782) Refactor partial key grouping for greater flexibility

2017-10-30 Thread Kevin Peek (JIRA)

[ 
https://issues.apache.org/jira/browse/STORM-2782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225330#comment-16225330
 ] 

Kevin Peek commented on STORM-2782:
---

Personally I would imagine 2.0.0 only is ok. Do you think it ought to be ported 
for 1.x?

> Refactor partial key grouping for greater flexibility
> -
>
> Key: STORM-2782
> URL: https://issues.apache.org/jira/browse/STORM-2782
> Project: Apache Storm
>  Issue Type: Improvement
>  Components: storm-core
>Reporter: Kevin Peek
>Assignee: Kevin Peek
>Priority: Minor
>  Labels: pull-request-available
> Fix For: 2.0.0
>
>  Time Spent: 3h 10m
>  Remaining Estimate: 0h
>
> My organization needed behavior similar to the PartialKeyGrouping. This is a 
> port of our refactoring which makes it possible to use the PartialkeyGrouping 
> in new ways. The simplest such usecase would be to send tuples to one out of 
> N downstream instances instead of always one out of two.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Resolved] (STORM-2782) Refactor partial key grouping for greater flexibility

2017-10-30 Thread Robert Joseph Evans (JIRA)

 [ 
https://issues.apache.org/jira/browse/STORM-2782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Robert Joseph Evans resolved STORM-2782.

   Resolution: Fixed
Fix Version/s: 2.0.0

Thanks [~kevpeek],

I merged this into master.  If you want this in a 1.x release we are going to 
have to make some changed to it, because the current code is not going to be a 
rolling upgrade. We changed the serialization in a non-backwards compatible way.

> Refactor partial key grouping for greater flexibility
> -
>
> Key: STORM-2782
> URL: https://issues.apache.org/jira/browse/STORM-2782
> Project: Apache Storm
>  Issue Type: Improvement
>  Components: storm-core
>Reporter: Kevin Peek
>Assignee: Kevin Peek
>Priority: Minor
>  Labels: pull-request-available
> Fix For: 2.0.0
>
>  Time Spent: 3h 10m
>  Remaining Estimate: 0h
>
> My organization needed behavior similar to the PartialKeyGrouping. This is a 
> port of our refactoring which makes it possible to use the PartialkeyGrouping 
> in new ways. The simplest such usecase would be to send tuples to one out of 
> N downstream instances instead of always one out of two.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (STORM-2790) Add nimbus admin groups

2017-10-30 Thread ASF GitHub Bot (JIRA)

 [ 
https://issues.apache.org/jira/browse/STORM-2790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated STORM-2790:
--
Labels: pull-request-available  (was: )

> Add nimbus admin groups
> ---
>
> Key: STORM-2790
> URL: https://issues.apache.org/jira/browse/STORM-2790
> Project: Apache Storm
>  Issue Type: New Feature
>  Components: storm-client, storm-server
>Reporter: Kishor Patil
>Assignee: Kishor Patil
>  Labels: pull-request-available
>
> Add "nimbus.admins.groups" to help enabling group level permissions part from 
> individuals using "nimbus.admins"



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)