[jira] [Comment Edited] (STORM-2796) Flux: Provide means for invoking static factory methods

2017-11-06 Thread Roshan Naik (JIRA)

[ 
https://issues.apache.org/jira/browse/STORM-2796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238504#comment-16238504
 ] 

Roshan Naik edited comment on STORM-2796 at 11/7/17 12:09 AM:
--

Yaml looks fine. Would be nice to make sure that  its works with this type of 
method signatures as well:

{code}
public static MyComponent newInstance(Integer x, SomeObject... variadic)
{code}

Basically be able to pass a mix of objects and arrays/variadics as args. I 
think the ability to pass array args is done via an undocumented feature called 
`reflist`. Just want to make sure it is supported for factory methods as well.

Which reminds me that it would be good to update the docs on 'reflist'  while 
updating the docs about factory methods.



was (Author: roshan_naik):
Yaml looks fine. Would be nice to make sure that  its works with this type of 
method signatures as well:

{code}
public static MyComponent newInstance(Integer x, SomeObject... variadic)
{code}

Basically be able to pass a mix of objects and arrays/variadics as args. I 
think the ability to pass array args is done via an undocumented feature called 
`reflist`. Just want to make sure it it supported for factory methods as well.

Which reminds me that it would be good to update the docs on 'reflist'  while 
updating the docs about factor methods.


> Flux: Provide means for invoking static factory methods
> ---
>
> Key: STORM-2796
> URL: https://issues.apache.org/jira/browse/STORM-2796
> Project: Apache Storm
>  Issue Type: Improvement
>  Components: Flux
>Affects Versions: 2.0.0, 1.1.1, 1.2.0, 1.0.6
>Reporter: P. Taylor Goetz
>Assignee: P. Taylor Goetz
>
> Provide a means to invoke static factory methods for flux components. E.g:
> Java signature:
> {code}
> public static MyComponent newInstance(String... params)
> {code}
> Yaml:
> {code}
> className: "org.apache.storm.flux.test.MyComponent"
> factory: "newInstance"
> factoryArgs: ["a", "b", "c"]
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (STORM-2803) SlotTest failing on travis frequently

2017-11-06 Thread JIRA

[ 
https://issues.apache.org/jira/browse/STORM-2803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16240980#comment-16240980
 ] 

Stig Rohde Døssing commented on STORM-2803:
---

This is due to leaking threads from Nimbus/TimeCacheMap. I'll put up a PR 
tomorrow.

> SlotTest failing on travis frequently
> -
>
> Key: STORM-2803
> URL: https://issues.apache.org/jira/browse/STORM-2803
> Project: Apache Storm
>  Issue Type: Bug
>Affects Versions: 2.0.0
>Reporter: Robert Joseph Evans
>Assignee: Stig Rohde Døssing
>
> I have seen SlotTest fail way too frequently on travis, but it never fails 
> off of travis.
> My guess is that there is some kind of a race condition happening and on 
> slower hardware (aka VMs or Containers on overloaded build machines) that the 
> tests tend to fail.
> I'll try to find some time to look at this, but if someone else wants to 
> steal it from me feel free to.  I don't know exactly when I will find time to 
> do it.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Assigned] (STORM-2803) SlotTest failing on travis frequently

2017-11-06 Thread JIRA

 [ 
https://issues.apache.org/jira/browse/STORM-2803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Stig Rohde Døssing reassigned STORM-2803:
-

Assignee: Stig Rohde Døssing  (was: Robert Joseph Evans)

> SlotTest failing on travis frequently
> -
>
> Key: STORM-2803
> URL: https://issues.apache.org/jira/browse/STORM-2803
> Project: Apache Storm
>  Issue Type: Bug
>Affects Versions: 2.0.0
>Reporter: Robert Joseph Evans
>Assignee: Stig Rohde Døssing
>
> I have seen SlotTest fail way too frequently on travis, but it never fails 
> off of travis.
> My guess is that there is some kind of a race condition happening and on 
> slower hardware (aka VMs or Containers on overloaded build machines) that the 
> tests tend to fail.
> I'll try to find some time to look at this, but if someone else wants to 
> steal it from me feel free to.  I don't know exactly when I will find time to 
> do it.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (STORM-2306) Redeisgn Messaging Subsystem and switch to JCTools Queues

2017-11-06 Thread ASF GitHub Bot (JIRA)

 [ 
https://issues.apache.org/jira/browse/STORM-2306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated STORM-2306:
--
Labels: pull-request-available  (was: )

> Redeisgn Messaging Subsystem and switch to JCTools Queues
> -
>
> Key: STORM-2306
> URL: https://issues.apache.org/jira/browse/STORM-2306
> Project: Apache Storm
>  Issue Type: Sub-task
>  Components: storm-core
>Affects Versions: 2.0.0
>Reporter: Roshan Naik
>Assignee: Roshan Naik
>  Labels: pull-request-available
>  Time Spent: 32h 40m
>  Remaining Estimate: 0h
>
> Details in these documents:
> 1) *Redesign of the messaging subsystem*
> https://docs.google.com/document/d/1NK1DJ3aAkta-Im0m-2FObQ4cSRp8xSa301y6zoqcBeE/edit?usp=sharing
> This doc discusses the new design for the messaging system. Plus some of the 
> optimizations being made.
> 2) *Choosing a high performance messaging queue:*
> https://docs.google.com/document/d/1PpQaWVHg06-OqxTzYxQlzg1yEhzA4Y46_NC7HMO6tsI/edit?usp=sharing
> This doc looks into how fast hardware can do inter-thread messaging and why 
> we chose the JCTools queues.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (STORM-1464) storm-hdfs should support writing to multiple files

2017-11-06 Thread ASF GitHub Bot (JIRA)

 [ 
https://issues.apache.org/jira/browse/STORM-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated STORM-1464:
--
Labels: avro pull-request-available  (was: avro)

> storm-hdfs should support writing to multiple files
> ---
>
> Key: STORM-1464
> URL: https://issues.apache.org/jira/browse/STORM-1464
> Project: Apache Storm
>  Issue Type: Improvement
>  Components: storm-hdfs
>Reporter: Aaron Dossett
>Assignee: Aaron Dossett
>  Labels: avro, pull-request-available
> Fix For: 2.0.0, 1.1.0
>
>  Time Spent: 1h 20m
>  Remaining Estimate: 0h
>
> Examples of when this is needed include:
> - One avro bolt writing multiple schemas, each of which require a different 
> file. Schema evolution is a common use of avro and the avro bolt should 
> support that seamlessly.
> - Partitioning output to different directories based on the tuple contents.  
> For example, if the tuple contains a "USER" field, it should be possible to 
> partition based on that value.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Created] (STORM-2803) SlotTest failing on travis frequently

2017-11-06 Thread Robert Joseph Evans (JIRA)
Robert Joseph Evans created STORM-2803:
--

 Summary: SlotTest failing on travis frequently
 Key: STORM-2803
 URL: https://issues.apache.org/jira/browse/STORM-2803
 Project: Apache Storm
  Issue Type: Bug
Affects Versions: 2.0.0
Reporter: Robert Joseph Evans
Assignee: Robert Joseph Evans


I have seen SlotTest fail way too frequently on travis, but it never fails off 
of travis.

My guess is that there is some kind of a race condition happening and on slower 
hardware (aka VMs or Containers on overloaded build machines) that the tests 
tend to fail.

I'll try to find some time to look at this, but if someone else wants to steal 
it from me feel free to.  I don't know exactly when I will find time to do it.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)