Re: Storm cluster specifications

2016-03-20 Thread sam mohel
Is there any help ? On Monday, March 21, 2016, sam mohel wrote: > I have 2 machine one has core 2duo and other has core i5 . which one > should I run nimbus and zookeeper on it and which one should I run > supervisor ? > > Should worker run on machine with high core or it shouldn't ? > > Appreci

[GitHub] storm pull request: STORM-1641: make subtree node creation consist...

2016-03-20 Thread abellina
GitHub user abellina opened a pull request: https://github.com/apache/storm/pull/1241 STORM-1641: make subtree node creation consistent This doesn't appear to make a difference. When starting nimbus, I get 9 znodes inside of /storm either way. However, it was inconsistent. You can

[jira] [Commented] (STORM-1641) Inconsistency when creating backpressure znode subtree

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203730#comment-15203730 ] ASF GitHub Bot commented on STORM-1641: --- GitHub user abellina opened a pull request:

[jira] [Created] (STORM-1641) Inconsistency when creating backpressure znode subtree

2016-03-20 Thread Alessandro Bellina (JIRA)
Alessandro Bellina created STORM-1641: - Summary: Inconsistency when creating backpressure znode subtree Key: STORM-1641 URL: https://issues.apache.org/jira/browse/STORM-1641 Project: Apache Storm

[jira] [Commented] (STORM-1229) port backtype.storm.metric.testing to java

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203712#comment-15203712 ] ASF GitHub Bot commented on STORM-1229: --- Github user abhishekagarwal87 commented on

[GitHub] storm pull request: STORM-1229: port backtype.storm.metric.testing...

2016-03-20 Thread abhishekagarwal87
Github user abhishekagarwal87 commented on the pull request: https://github.com/apache/storm/pull/1238#issuecomment-199126076 @hustfxj the implementation of handleDataPoints may not be straightforward with AtomicReferences. I found emulating clojure atom operators verbatim tricky so I

[jira] [Commented] (STORM-1229) port backtype.storm.metric.testing to java

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203704#comment-15203704 ] ASF GitHub Bot commented on STORM-1229: --- Github user abhishekagarwal87 commented on

[GitHub] storm pull request: STORM-1229: port backtype.storm.metric.testing...

2016-03-20 Thread abhishekagarwal87
Github user abhishekagarwal87 commented on a diff in the pull request: https://github.com/apache/storm/pull/1238#discussion_r56782340 --- Diff: storm-core/test/jvm/org/apache/storm/metric/FakeMetricConsumer.java --- @@ -0,0 +1,88 @@ +/** + * Licensed to the Apache Software

[jira] [Commented] (STORM-1625) Move storm-sql dependencies out of lib folder

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203703#comment-15203703 ] ASF GitHub Bot commented on STORM-1625: --- Github user abhishekagarwal87 commented on

[GitHub] storm pull request: STORM-1625: Move storm-sql dependencies out of...

2016-03-20 Thread abhishekagarwal87
Github user abhishekagarwal87 commented on the pull request: https://github.com/apache/storm/pull/1239#issuecomment-199120735 @haohui Those jars will be present in external/sql/storm-sql-core directory and they get added automatically when `storm sql` is run. Below is a sample run. Le

[jira] [Commented] (STORM-1625) Move storm-sql dependencies out of lib folder

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203663#comment-15203663 ] ASF GitHub Bot commented on STORM-1625: --- Github user haohui commented on the pull re

[GitHub] storm pull request: STORM-1625: Move storm-sql dependencies out of...

2016-03-20 Thread haohui
Github user haohui commented on the pull request: https://github.com/apache/storm/pull/1239#issuecomment-199093496 Might need to run some manual tests to validate. I think there are several jars (e.g., guava) need to be bundled as well. Is it a good place to put them in as wel

Re: [ANNOUNCE] Storm MySql Spout

2016-03-20 Thread Jon Logan
Just a heads up but the MySQL connector is GPL. I would think this would make it prohibited to be part of the Storm repository? On Sun, Mar 20, 2016 at 10:34 PM, Harsha wrote: > Hi Sourav, > I just took a look. This looks great. It would be great if > you can contribute

[jira] [Commented] (STORM-1625) Move storm-sql dependencies out of lib folder

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203650#comment-15203650 ] ASF GitHub Bot commented on STORM-1625: --- Github user harshach commented on the pull

Re: [ANNOUNCE] Storm MySql Spout

2016-03-20 Thread Harsha
Hi Sourav, I just took a look. This looks great. It would be great if you can contribute to this connector Apache Storm. If so can you please open a JIRA and open a PR https://github.com/apache/storm. Thanks, Harsha On Sun, Mar 20, 2016, at 08:0

[GitHub] storm pull request: STORM-1625: Move storm-sql dependencies out of...

2016-03-20 Thread harshach
Github user harshach commented on the pull request: https://github.com/apache/storm/pull/1239#issuecomment-199088609 +1. @haohui can you take a look as well. Do we need to change anything else to deploy topologies using storm sql. --- If your project is set up for it, you can reply t

[jira] [Commented] (STORM-1229) port backtype.storm.metric.testing to java

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203610#comment-15203610 ] ASF GitHub Bot commented on STORM-1229: --- Github user hustfxj commented on the pull r

[GitHub] storm pull request: STORM-1229: port backtype.storm.metric.testing...

2016-03-20 Thread hustfxj
Github user hustfxj commented on the pull request: https://github.com/apache/storm/pull/1238#issuecomment-199075001 @abhishekagarwal87 thank you. It have better use AtomicReference to replace the Map, then we can avoid to use the "synchronized". And do HashBasedTable.create() gener

[GitHub] storm pull request: [Storm-1585] Add DDL support for UDFs in storm...

2016-03-20 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/storm/pull/1169#discussion_r56775610 --- Diff: external/sql/storm-sql-core/src/codegen/includes/parserImpls.ftl --- @@ -83,4 +83,23 @@ SqlNode SqlCreateTable() : input_format_class_na

[GitHub] storm pull request: [Storm-1585] Add DDL support for UDFs in storm...

2016-03-20 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/storm/pull/1169#discussion_r56775558 --- Diff: external/sql/storm-sql-core/src/test/org/apache/storm/sql/TestStormSql.java --- @@ -129,4 +134,20 @@ public void testExternalNestedInvalidAccess() th

[GitHub] storm pull request: [Storm-1585] Add DDL support for UDFs in storm...

2016-03-20 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/storm/pull/1169#discussion_r56775507 --- Diff: external/sql/storm-sql-core/src/jvm/org/apache/storm/sql/parser/SqlCreateFunction.java --- @@ -0,0 +1,68 @@ +package org.apache.storm.sql.parser

Storm cluster specifications

2016-03-20 Thread sam mohel
I have 2 machine one has core 2duo and other has core i5 . which one should I run nimbus and zookeeper on it and which one should I run supervisor ? Should worker run on machine with high core or it shouldn't ? Appreciate your help Thanks in advance

[jira] [Commented] (STORM-1464) storm-hdfs should support writing to multiple files

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203466#comment-15203466 ] ASF GitHub Bot commented on STORM-1464: --- Github user arunmahadevan commented on the

[GitHub] storm pull request: STORM-1464: Support multiple file outputs

2016-03-20 Thread arunmahadevan
Github user arunmahadevan commented on the pull request: https://github.com/apache/storm/pull/1044#issuecomment-198995107 @dossett thanks for the clarification. So the tuples with different schema are written to the next rotated file. I was assuming some association between the writer

[jira] [Commented] (STORM-676) Storm Trident support for sliding/tumbling windows

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203452#comment-15203452 ] ASF GitHub Bot commented on STORM-676: -- Github user arunmahadevan commented on a diff

[jira] [Commented] (STORM-676) Storm Trident support for sliding/tumbling windows

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203454#comment-15203454 ] ASF GitHub Bot commented on STORM-676: -- Github user arunmahadevan commented on a diff

[jira] [Commented] (STORM-676) Storm Trident support for sliding/tumbling windows

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203456#comment-15203456 ] ASF GitHub Bot commented on STORM-676: -- Github user arunmahadevan commented on a diff

[jira] [Commented] (STORM-676) Storm Trident support for sliding/tumbling windows

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203453#comment-15203453 ] ASF GitHub Bot commented on STORM-676: -- Github user arunmahadevan commented on a diff

[GitHub] storm pull request: STORM-676 Trident implementation for sliding a...

2016-03-20 Thread arunmahadevan
Github user arunmahadevan commented on a diff in the pull request: https://github.com/apache/storm/pull/1072#discussion_r56769644 --- Diff: storm-core/src/jvm/org/apache/storm/trident/Stream.java --- @@ -565,19 +578,155 @@ public Stream aggregate(Fields inputFields, ReducerAggregat

[jira] [Commented] (STORM-676) Storm Trident support for sliding/tumbling windows

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203450#comment-15203450 ] ASF GitHub Bot commented on STORM-676: -- Github user arunmahadevan commented on a diff

[GitHub] storm pull request: STORM-676 Trident implementation for sliding a...

2016-03-20 Thread arunmahadevan
Github user arunmahadevan commented on a diff in the pull request: https://github.com/apache/storm/pull/1072#discussion_r56769635 --- Diff: storm-core/src/jvm/org/apache/storm/trident/Stream.java --- @@ -6,9 +6,9 @@ * to you under the Apache License, Version 2.0 (the * "

[jira] [Commented] (STORM-676) Storm Trident support for sliding/tumbling windows

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203448#comment-15203448 ] ASF GitHub Bot commented on STORM-676: -- Github user arunmahadevan commented on a diff

[GitHub] storm pull request: STORM-676 Trident implementation for sliding a...

2016-03-20 Thread arunmahadevan
Github user arunmahadevan commented on a diff in the pull request: https://github.com/apache/storm/pull/1072#discussion_r56769652 --- Diff: storm-core/src/jvm/org/apache/storm/trident/operation/builtin/Debug.java --- @@ -40,7 +42,7 @@ public Debug(String name) { @Ove

[jira] [Commented] (STORM-676) Storm Trident support for sliding/tumbling windows

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203449#comment-15203449 ] ASF GitHub Bot commented on STORM-676: -- Github user arunmahadevan commented on a diff

[GitHub] storm pull request: STORM-676 Trident implementation for sliding a...

2016-03-20 Thread arunmahadevan
Github user arunmahadevan commented on a diff in the pull request: https://github.com/apache/storm/pull/1072#discussion_r56769629 --- Diff: external/storm-hbase/src/main/java/org/apache/storm/hbase/trident/windowing/HBaseWindowsStore.java --- @@ -0,0 +1,275 @@ +/** + * Lic

[GitHub] storm pull request: STORM-676 Trident implementation for sliding a...

2016-03-20 Thread arunmahadevan
Github user arunmahadevan commented on a diff in the pull request: https://github.com/apache/storm/pull/1072#discussion_r56769646 --- Diff: storm-core/src/jvm/org/apache/storm/trident/Stream.java --- @@ -565,19 +578,155 @@ public Stream aggregate(Fields inputFields, ReducerAggregat

[jira] [Commented] (STORM-676) Storm Trident support for sliding/tumbling windows

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203451#comment-15203451 ] ASF GitHub Bot commented on STORM-676: -- Github user arunmahadevan commented on a diff

[GitHub] storm pull request: STORM-676 Trident implementation for sliding a...

2016-03-20 Thread arunmahadevan
Github user arunmahadevan commented on a diff in the pull request: https://github.com/apache/storm/pull/1072#discussion_r56769600 --- Diff: examples/storm-starter/src/jvm/org/apache/storm/starter/trident/TridentHBaseWindowingStoreTopology.java --- @@ -0,0 +1,122 @@ +/** +

[GitHub] storm pull request: STORM-676 Trident implementation for sliding a...

2016-03-20 Thread arunmahadevan
Github user arunmahadevan commented on a diff in the pull request: https://github.com/apache/storm/pull/1072#discussion_r56769622 --- Diff: examples/storm-starter/src/jvm/org/apache/storm/starter/trident/TridentWindowingInmemoryStoreTopology.java --- @@ -0,0 +1,133 @@ +/**

[GitHub] storm pull request: STORM-676 Trident implementation for sliding a...

2016-03-20 Thread arunmahadevan
Github user arunmahadevan commented on a diff in the pull request: https://github.com/apache/storm/pull/1072#discussion_r56769608 --- Diff: examples/storm-starter/src/jvm/org/apache/storm/starter/trident/TridentHBaseWindowingStoreTopology.java --- @@ -0,0 +1,122 @@ +/** +

[jira] [Commented] (STORM-676) Storm Trident support for sliding/tumbling windows

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203440#comment-15203440 ] ASF GitHub Bot commented on STORM-676: -- Github user arunmahadevan commented on a diff

[GitHub] storm pull request: STORM-676 Trident implementation for sliding a...

2016-03-20 Thread arunmahadevan
Github user arunmahadevan commented on a diff in the pull request: https://github.com/apache/storm/pull/1072#discussion_r56769596 --- Diff: examples/storm-starter/src/jvm/org/apache/storm/starter/trident/TridentHBaseWindowingStoreTopology.java --- @@ -0,0 +1,122 @@ +/** +

[jira] [Commented] (STORM-676) Storm Trident support for sliding/tumbling windows

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203442#comment-15203442 ] ASF GitHub Bot commented on STORM-676: -- Github user arunmahadevan commented on a diff

[GitHub] storm pull request: STORM-676 Trident implementation for sliding a...

2016-03-20 Thread arunmahadevan
Github user arunmahadevan commented on a diff in the pull request: https://github.com/apache/storm/pull/1072#discussion_r56769621 --- Diff: examples/storm-starter/src/jvm/org/apache/storm/starter/trident/TridentWindowingInmemoryStoreTopology.java --- @@ -0,0 +1,133 @@ +/**

[jira] [Commented] (STORM-676) Storm Trident support for sliding/tumbling windows

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203439#comment-15203439 ] ASF GitHub Bot commented on STORM-676: -- Github user arunmahadevan commented on a diff

[jira] [Commented] (STORM-676) Storm Trident support for sliding/tumbling windows

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203447#comment-15203447 ] ASF GitHub Bot commented on STORM-676: -- Github user arunmahadevan commented on a diff

[jira] [Commented] (STORM-676) Storm Trident support for sliding/tumbling windows

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203446#comment-15203446 ] ASF GitHub Bot commented on STORM-676: -- Github user arunmahadevan commented on a diff

[jira] [Commented] (STORM-676) Storm Trident support for sliding/tumbling windows

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203444#comment-15203444 ] ASF GitHub Bot commented on STORM-676: -- Github user arunmahadevan commented on a diff

[GitHub] storm pull request: STORM-676 Trident implementation for sliding a...

2016-03-20 Thread arunmahadevan
Github user arunmahadevan commented on a diff in the pull request: https://github.com/apache/storm/pull/1072#discussion_r56769598 --- Diff: examples/storm-starter/src/jvm/org/apache/storm/starter/trident/TridentHBaseWindowingStoreTopology.java --- @@ -0,0 +1,122 @@ +/** +

[jira] [Commented] (STORM-676) Storm Trident support for sliding/tumbling windows

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203445#comment-15203445 ] ASF GitHub Bot commented on STORM-676: -- Github user arunmahadevan commented on a diff

[GitHub] storm pull request: STORM-676 Trident implementation for sliding a...

2016-03-20 Thread arunmahadevan
Github user arunmahadevan commented on a diff in the pull request: https://github.com/apache/storm/pull/1072#discussion_r56769589 --- Diff: examples/storm-starter/src/jvm/org/apache/storm/starter/trident/TridentHBaseWindowingStoreTopology.java --- @@ -0,0 +1,122 @@ +/** +

[GitHub] storm pull request: STORM-676 Trident implementation for sliding a...

2016-03-20 Thread arunmahadevan
Github user arunmahadevan commented on a diff in the pull request: https://github.com/apache/storm/pull/1072#discussion_r56769591 --- Diff: examples/storm-starter/src/jvm/org/apache/storm/starter/trident/TridentHBaseWindowingStoreTopology.java --- @@ -0,0 +1,122 @@ +/** +

[jira] [Commented] (STORM-676) Storm Trident support for sliding/tumbling windows

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203437#comment-15203437 ] ASF GitHub Bot commented on STORM-676: -- Github user arunmahadevan commented on a diff

[jira] [Commented] (STORM-676) Storm Trident support for sliding/tumbling windows

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203438#comment-15203438 ] ASF GitHub Bot commented on STORM-676: -- Github user arunmahadevan commented on a diff

[GitHub] storm pull request: STORM-676 Trident implementation for sliding a...

2016-03-20 Thread arunmahadevan
Github user arunmahadevan commented on a diff in the pull request: https://github.com/apache/storm/pull/1072#discussion_r56769587 --- Diff: examples/storm-starter/pom.xml --- @@ -177,6 +185,36 @@ storm-redis ${project.version} + +

[GitHub] storm pull request: STORM-676 Trident implementation for sliding a...

2016-03-20 Thread arunmahadevan
Github user arunmahadevan commented on a diff in the pull request: https://github.com/apache/storm/pull/1072#discussion_r56769581 --- Diff: examples/storm-starter/pom.xml --- @@ -149,6 +152,11 @@ storm-hdfs ${project.version} + +

[GitHub] storm pull request: STORM-676 Trident implementation for sliding a...

2016-03-20 Thread arunmahadevan
Github user arunmahadevan commented on a diff in the pull request: https://github.com/apache/storm/pull/1072#discussion_r56769585 --- Diff: examples/storm-starter/pom.xml --- @@ -177,6 +185,36 @@ storm-redis ${project.version} + +

[GitHub] storm pull request: STORM-676 Trident implementation for sliding a...

2016-03-20 Thread arunmahadevan
Github user arunmahadevan commented on a diff in the pull request: https://github.com/apache/storm/pull/1072#discussion_r56769580 --- Diff: examples/storm-starter/pom.xml --- @@ -31,10 +31,13 @@ storm-starter - UTF-8 - - provided +

[GitHub] storm pull request: STORM-1229: port backtype.storm.metric.testing...

2016-03-20 Thread unsleepy22
Github user unsleepy22 commented on a diff in the pull request: https://github.com/apache/storm/pull/1238#discussion_r56766748 --- Diff: storm-core/test/jvm/org/apache/storm/metric/FakeMetricConsumer.java --- @@ -0,0 +1,88 @@ +/** + * Licensed to the Apache Software Foundat

[jira] [Commented] (STORM-1229) port backtype.storm.metric.testing to java

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203340#comment-15203340 ] ASF GitHub Bot commented on STORM-1229: --- Github user unsleepy22 commented on a diff

[ANNOUNCE] Storm MySql Spout

2016-03-20 Thread Sourav Mitra
Hello, We have been developing a storm spout that reads off MySql Bin Logs directly and generates the events as a stream. Please have a look at the following project on github: https://github.com/flipkart-incubator/storm-mysql Its currently as a snapshot on Sonatype and will be released shortly

[GitHub] storm pull request: STORM-1616: Add RAS API for Trident

2016-03-20 Thread d2r
Github user d2r commented on a diff in the pull request: https://github.com/apache/storm/pull/1199#discussion_r56413444 --- Diff: storm-core/src/jvm/org/apache/storm/trident/TridentTopology.java --- @@ -431,6 +454,64 @@ public StormTopology build() { retu

[jira] [Assigned] (STORM-1514) add ability to configure read only option for storm UI

2016-03-20 Thread Abhishek Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Agarwal reassigned STORM-1514: --- Assignee: Abhishek Agarwal > add ability to configure read only option for storm UI >

[GitHub] storm pull request: STORM-1637: Correct the master version of stor...

2016-03-20 Thread revans2
Github user revans2 commented on the pull request: https://github.com/apache/storm/pull/1231#issuecomment-197933343 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[jira] [Commented] (STORM-1622) Topology jars referring to shaded classes of older version of storm jar cannot be run in Storm 1.0.0

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203281#comment-15203281 ] ASF GitHub Bot commented on STORM-1622: --- Github user abhishekagarwal87 commented on

[GitHub] storm pull request: STORM-1622: Rename classes with older third pa...

2016-03-20 Thread abhishekagarwal87
GitHub user abhishekagarwal87 opened a pull request: https://github.com/apache/storm/pull/1240 STORM-1622: Rename classes with older third party shaded packages You can merge this pull request into a Git repository by running: $ git pull https://github.com/abhishekagarwal87/st

[jira] [Commented] (STORM-1622) Topology jars referring to shaded classes of older version of storm jar cannot be run in Storm 1.0.0

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203279#comment-15203279 ] ASF GitHub Bot commented on STORM-1622: --- GitHub user abhishekagarwal87 opened a pull

RE: Not enough data to calculate spout lag

2016-03-20 Thread Sachin Pasalkar
Can someone help me out with this? -Original Message- From: Sachin Pasalkar [mailto:sachin_pasal...@symantec.com] Sent: Friday, March 18, 2016 9:37 PM To: dev@storm.apache.org Subject: Not enough data to calculate spout lag Hi, I found log "Metrics Tick: Not enough data to calculate spo

[GitHub] storm pull request: STORM-1622: Rename classes with older third pa...

2016-03-20 Thread abhishekagarwal87
Github user abhishekagarwal87 commented on the pull request: https://github.com/apache/storm/pull/1240#issuecomment-198922168 @revans2 - This additional support need not be in master. Let me know if you want me to raise a PR for master as well. Thanks in advance for considering this c

[jira] [Created] (STORM-1635) Master branch broken! Exception thrown immediately after submitting topology

2016-03-20 Thread Boyang Jerry Peng (JIRA)
Boyang Jerry Peng created STORM-1635: Summary: Master branch broken! Exception thrown immediately after submitting topology Key: STORM-1635 URL: https://issues.apache.org/jira/browse/STORM-1635 Pr

[GitHub] storm pull request: STORM-822: Kafka Spout New Consumer API

2016-03-20 Thread revans2
Github user revans2 commented on a diff in the pull request: https://github.com/apache/storm/pull/1131#discussion_r56534191 --- Diff: external/storm-kafka-client/src/main/java/org/apache/storm/kafka/spout/KafkaRecordTupleBuilder.java --- @@ -0,0 +1,44 @@ +/* + * Licensed t

[GitHub] storm pull request: Fix logging for LoggingMetricsConsumer STORM-5...

2016-03-20 Thread unsleepy22
Github user unsleepy22 commented on the pull request: https://github.com/apache/storm/pull/1221#issuecomment-197652505 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[jira] [Commented] (STORM-584) LoggingMetricsConsumer metrics.log file is shared by multiple topologies.

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198609#comment-15198609 ] ASF GitHub Bot commented on STORM-584: -- Github user unsleepy22 commented on the pull r

[jira] [Commented] (STORM-1611) port org.apache.storm.pacemaker.pacemaker to java

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197809#comment-15197809 ] ASF GitHub Bot commented on STORM-1611: --- Github user redsanket commented on a diff i

[jira] [Commented] (STORM-1625) Move storm-sql dependencies out of lib folder

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203240#comment-15203240 ] ASF GitHub Bot commented on STORM-1625: --- GitHub user abhishekagarwal87 opened a pull

[GitHub] storm pull request: STORM-1625: Move storm-sql dependencies out of...

2016-03-20 Thread abhishekagarwal87
GitHub user abhishekagarwal87 opened a pull request: https://github.com/apache/storm/pull/1239 STORM-1625: Move storm-sql dependencies out of lib folder You can merge this pull request into a Git repository by running: $ git pull https://github.com/abhishekagarwal87/storm stor

[jira] [Updated] (STORM-1625) Move storm-sql dependencies out of lib folder

2016-03-20 Thread Abhishek Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Agarwal updated STORM-1625: Summary: Move storm-sql dependencies out of lib folder (was: guava dependency is being ship

[jira] [Commented] (STORM-822) As a storm developer I’d like to use the new kafka consumer API (0.8.3) to reduce dependencies and use long term supported kafka apis

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15199656#comment-15199656 ] ASF GitHub Bot commented on STORM-822: -- Github user revans2 commented on a diff in the

[jira] [Commented] (STORM-1611) port org.apache.storm.pacemaker.pacemaker to java

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198576#comment-15198576 ] ASF GitHub Bot commented on STORM-1611: --- Github user hustfxj commented on the pull r

[GitHub] storm pull request: STORM-956: When the execute() or nextTuple() h...

2016-03-20 Thread srdo
Github user srdo commented on the pull request: https://github.com/apache/storm/pull/1209#issuecomment-198878063 Will reopen this when the PR is closer to done --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proje

[jira] [Commented] (STORM-956) When the execute() or nextTuple() hang on external resources, stop the Worker's heartbeat

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203177#comment-15203177 ] ASF GitHub Bot commented on STORM-956: -- Github user srdo commented on the pull request

[GitHub] storm pull request: STORM-956: When the execute() or nextTuple() h...

2016-03-20 Thread srdo
Github user srdo closed the pull request at: https://github.com/apache/storm/pull/1209 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enable

[jira] [Commented] (STORM-956) When the execute() or nextTuple() hang on external resources, stop the Worker's heartbeat

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203178#comment-15203178 ] ASF GitHub Bot commented on STORM-956: -- Github user srdo closed the pull request at:

[GitHub] storm pull request: STORM-1602 Blobstore UTs are failed on Windows

2016-03-20 Thread redsanket
Github user redsanket commented on the pull request: https://github.com/apache/storm/pull/1229#issuecomment-197915743 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled a

[jira] [Commented] (STORM-1057) Add throughput metric to spout/bolt and display them on web ui

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198268#comment-15198268 ] ASF GitHub Bot commented on STORM-1057: --- Github user harshach commented on the pull

[jira] [Resolved] (STORM-1623) nimbus.clj's minor bug

2016-03-20 Thread Boyang Jerry Peng (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Jerry Peng resolved STORM-1623. -- Resolution: Fixed Fix Version/s: 2.0.0 > nimbus.clj's minor bug > ---

Re: Question on Metrics Server to Alibaba team

2016-03-20 Thread Abhishek Agarwal
At Inmobi, we are using graphite to store metrics which works great for us. Metrics can be viewed as a time series on grafana dashboards. Are there more functionalities that the metric server provides? Excuse typos On Mar 18, 2016 9:22 PM, "Bobby Evans" wrote: > Yes we originally wanted to try a

[jira] [Commented] (STORM-1632) Disable event logging by default

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198092#comment-15198092 ] ASF GitHub Bot commented on STORM-1632: --- Github user abhishekagarwal87 commented on

[GitHub] storm pull request: [STORM-1636] - Supervisor shutdown with worker...

2016-03-20 Thread redsanket
Github user redsanket commented on the pull request: https://github.com/apache/storm/pull/1226#issuecomment-198013271 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled a

[jira] [Commented] (STORM-1611) port org.apache.storm.pacemaker.pacemaker to java

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198736#comment-15198736 ] ASF GitHub Bot commented on STORM-1611: --- Github user abhishekagarwal87 commented on

[jira] [Commented] (STORM-822) As a storm developer I’d like to use the new kafka consumer API (0.8.3) to reduce dependencies and use long term supported kafka apis

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198089#comment-15198089 ] ASF GitHub Bot commented on STORM-822: -- Github user abhishekagarwal87 commented on a d

[jira] [Commented] (STORM-1637) MongoDB pom.xml fails on JDK8 Travis

2016-03-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15199622#comment-15199622 ] ASF GitHub Bot commented on STORM-1637: --- GitHub user abhishekagarwal87 opened a pull

[jira] [Created] (STORM-1640) Provide an option to allow aggregating metrics before being reported

2016-03-20 Thread Abhishek Agarwal (JIRA)
Abhishek Agarwal created STORM-1640: --- Summary: Provide an option to allow aggregating metrics before being reported Key: STORM-1640 URL: https://issues.apache.org/jira/browse/STORM-1640 Project: Apa