[GitHub] storm issue #2789: STORM-3173: flush metrics to ScheduledReporter on shutdow...

2018-09-16 Thread srdo
Github user srdo commented on the issue: https://github.com/apache/storm/pull/2789 @zd-project I'm happy to take a look at implementing https://github.com/apache/storm/pull/2764 once the non-static PR is merged. I don't think it makes sense to mix more stuff into the current PR, and i

[GitHub] storm issue #2829: STORM-3222: Fix KafkaSpout internals to use LinkedList in...

2018-09-16 Thread roshannaik
Github user roshannaik commented on the issue: https://github.com/apache/storm/pull/2829 @HeartSaVioR 1) pendingEmitsQ prevents nextTuple() from blocking when downstream queue is full. It holds the overflow emits (one or more) that occurred within a **single** nextTuple(

[GitHub] storm issue #2829: STORM-3222: Fix KafkaSpout internals to use LinkedList in...

2018-09-16 Thread roshannaik
Github user roshannaik commented on the issue: https://github.com/apache/storm/pull/2829 @arunmahadevan .. need to be careful when that we are not doing too many emits in a single nextTuple()... it can cause a OOM situation by flooding the pendingQ. Worth checking if there

Re: Is the powered-by file in the Storm repository necessary?

2018-09-16 Thread Roshan Naik
Having it in the site is sufficient IMO as well.  On Saturday, September 15, 2018, 4:16:05 AM PDT, Stig Rohde Døssing wrote: Hi, We have a powered-by.md file in the Storm repository's /docs directory. There's also a powered-by file in the storm-site repo root, as well as in each releas

[GitHub] storm issue #2829: STORM-3222: Fix KafkaSpout internals to use LinkedList in...

2018-09-16 Thread srdo
Github user srdo commented on the issue: https://github.com/apache/storm/pull/2829 Even if we change the spout to emit all the fetched records in one `nextTuple` call, the number and size of records returned in a fetch is limited by the `max.poll.records` KafkaConsumer setting (500 by

[GitHub] storm pull request #2837: Remove powered-by.md, it lives in the storm-site r...

2018-09-16 Thread srdo
GitHub user srdo opened a pull request: https://github.com/apache/storm/pull/2837 Remove powered-by.md, it lives in the storm-site repository now Copied off the mailing list post: We have a powered-by.md file in the Storm repository's /docs directory. There's also a powered

[GitHub] storm-site pull request #7: Add XenonStack to powered-by

2018-09-16 Thread srdo
GitHub user srdo opened a pull request: https://github.com/apache/storm-site/pull/7 Add XenonStack to powered-by You can merge this pull request into a Git repository by running: $ git pull https://github.com/srdo/storm-site add-xenonstack Alternatively you can review and app

Re: Companies Using Apache Storm Listing - XenonStack

2018-09-16 Thread Stig Rohde Døssing
Hi XenonStack, Thanks. We'll update the site. Den tor. 13. sep. 2018 kl. 13.21 skrev XenonStack A Stack Innovator < busin...@xenonstack.com>: > At XenonStack we use Storm for building real-time data integration systems > and Enabling Predictive analysis >