[GitHub] storm issue #1674: STORM-2083: Blacklist scheduler

2016-09-07 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1674 Thanks @revans2 for the details. get it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] storm issue #1565: STORM-1970: external project examples refator

2016-09-10 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1565 I will add new external project examples (such as `storm-druid`, `storm-kinesis`) to the `examples` directory in a following up jira after this PR being merged. --- If your project is set up for

[GitHub] storm issue #1359: STORM-1239: port backtype.storm.scheduler.IsolationSchedu...

2016-09-10 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1359 @revans2 Do you have time to take a look? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] storm pull request #1682: STORM-2089 Replace Consumer of ISqlTridentDataSour...

2016-09-13 Thread vesense
Github user vesense commented on a diff in the pull request: https://github.com/apache/storm/pull/1682#discussion_r78509309 --- Diff: external/sql/storm-sql-runtime/src/jvm/org/apache/storm/sql/runtime/ISqlTridentDataSource.java --- @@ -17,14 +17,32 @@ */ package

[GitHub] storm pull request #1682: STORM-2089 Replace Consumer of ISqlTridentDataSour...

2016-09-13 Thread vesense
Github user vesense commented on a diff in the pull request: https://github.com/apache/storm/pull/1682#discussion_r78509264 --- Diff: external/sql/storm-sql-runtime/src/jvm/org/apache/storm/sql/runtime/ISqlTridentDataSource.java --- @@ -17,14 +17,32 @@ */ package

[GitHub] storm issue #1682: STORM-2089 Replace Consumer of ISqlTridentDataSource with...

2016-09-13 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1682 @HeartSaVioR one minor comment, others looks good to me. about sync send `.get()`, please take a look at previous comments: https://github.com/apache/storm/pull/743#commitcomment-14195354

[GitHub] storm issue #1682: STORM-2089 Replace Consumer of ISqlTridentDataSource with...

2016-09-13 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1682 +1 and I have filed a jira for improving the TridentKafkaState batch sending. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] storm pull request #1683: STORM-2092: optimize TridentKafkaState batch sendi...

2016-09-13 Thread vesense
GitHub user vesense opened a pull request: https://github.com/apache/storm/pull/1683 STORM-2092: optimize TridentKafkaState batch sending You can merge this pull request into a Git repository by running: $ git pull https://github.com/vesense/storm STORM-2092 Alternatively

[GitHub] storm issue #1683: STORM-2092: optimize TridentKafkaState batch sending

2016-09-13 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1683 ci failure is unrelated. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] storm pull request #1681: STORM-1444 Support EXPLAIN statement in StormSQL

2016-09-13 Thread vesense
Github user vesense commented on a diff in the pull request: https://github.com/apache/storm/pull/1681#discussion_r78530932 --- Diff: external/sql/storm-sql-core/src/jvm/org/apache/storm/sql/StormSqlImpl.java --- @@ -140,6 +142,40 @@ public void submit

[GitHub] storm issue #1681: STORM-1444 Support EXPLAIN statement in StormSQL

2016-09-13 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1681 Nice Job. one minor comment. LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] storm issue #1681: STORM-1444 Support EXPLAIN statement in StormSQL

2016-09-13 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1681 Btw, I'm ok with current explain output. Spark's is even better, maybe there is a chance to improve Calcite. --- If your project is set up for it, you can reply to this email and have

[GitHub] storm pull request #1683: STORM-2092: optimize TridentKafkaState batch sendi...

2016-09-13 Thread vesense
Github user vesense commented on a diff in the pull request: https://github.com/apache/storm/pull/1683#discussion_r78544642 --- Diff: external/storm-kafka/src/jvm/org/apache/storm/kafka/trident/TridentKafkaState.java --- @@ -73,30 +74,35 @@ public void prepare(Properties options

[GitHub] storm pull request #1683: STORM-2092: optimize TridentKafkaState batch sendi...

2016-09-13 Thread vesense
Github user vesense commented on a diff in the pull request: https://github.com/apache/storm/pull/1683#discussion_r78545097 --- Diff: external/storm-kafka/src/jvm/org/apache/storm/kafka/trident/TridentKafkaState.java --- @@ -73,30 +74,35 @@ public void prepare(Properties options

[GitHub] storm pull request #1683: STORM-2092: optimize TridentKafkaState batch sendi...

2016-09-17 Thread vesense
Github user vesense commented on a diff in the pull request: https://github.com/apache/storm/pull/1683#discussion_r79296575 --- Diff: external/storm-kafka/src/jvm/org/apache/storm/kafka/trident/TridentKafkaState.java --- @@ -73,30 +74,35 @@ public void prepare(Properties options

[GitHub] storm issue #1603: STORM-2012: Upgrade Kafka to 0.8.2.2

2016-09-17 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1603 @HeartSaVioR I recommend upgrading kafka to the 0.8.2.2 version since this version fixed some important bugs. this is a minor change. hope to be merged. --- If your project is set up for it, you

[GitHub] storm pull request #1746: STORM-1607: Add MongoMapState for supporting tride...

2016-10-27 Thread vesense
GitHub user vesense opened a pull request: https://github.com/apache/storm/pull/1746 STORM-1607: Add MongoMapState for supporting trident's exactly once semantics major changes as following: * new MongoMapState * new MongoStateQuery * new MongoLookupBolt * u

[GitHub] storm pull request #1748: [STORM-2103][SQL] Introduce new sql external modul...

2016-10-28 Thread vesense
GitHub user vesense opened a pull request: https://github.com/apache/storm/pull/1748 [STORM-2103][SQL] Introduce new sql external module: storm-sql-mongodb major changes as following: * new KafkaDataSourcesProvider & unit tests * change DataSourcesProvider me

[GitHub] storm issue #1748: [STORM-2103][SQL] Introduce new sql external module: stor...

2016-10-28 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1748 since this PR has some common logics, hope it will be merged ASAP. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] storm issue #1567: [STORM-1973] Using DefaultTopicSelector to replace Static...

2016-10-28 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1567 @darionyaphet This issue has been fixed. Can you close this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] storm issue #1748: [STORM-2103][SQL] Introduce new sql external module: stor...

2016-10-30 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1748 @HeartSaVioR they are independent. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] storm pull request #1751: [STORM-2172][SQL] Support Avro as input / output f...

2016-10-30 Thread vesense
GitHub user vesense opened a pull request: https://github.com/apache/storm/pull/1751 [STORM-2172][SQL] Support Avro as input / output format * new AvroScheme & AvroSerializer , unit tests * new avro CachedSchemas * new SerdeUtils You can merge this pull request into a

[GitHub] storm issue #1751: [STORM-2172][SQL] Support Avro as input / output format

2016-10-30 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1751 After https://github.com/apache/storm/pull/1748 getting merged, I will update this PR accordingly. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] storm pull request #1754: [STORM-2177][SQL] Support TSV as input / output fo...

2016-10-31 Thread vesense
GitHub user vesense opened a pull request: https://github.com/apache/storm/pull/1754 [STORM-2177][SQL] Support TSV as input / output format You can merge this pull request into a Git repository by running: $ git pull https://github.com/vesense/storm STORM-2177 Alternatively

[GitHub] storm issue #1754: [STORM-2177][SQL] Support TSV as input / output format

2016-10-31 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1754 This PR is on top of https://github.com/apache/storm/pull/1751 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] storm issue #1754: [STORM-2177][STORM-2173][SQL] Support TSV/CSV as input / ...

2016-11-01 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1754 I added STORM-2173 to current PR since it is on top of #1751 too. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] storm issue #1748: [STORM-2103][SQL] Introduce new sql external module: stor...

2016-11-02 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1748 I want to make it clear that PRs getting merged order is https://github.com/apache/storm/pull/1748 https://github.com/apache/storm/pull/1751 https://github.com/apache/storm/pull/1754 Hope these

[GitHub] storm issue #1748: [STORM-2103][SQL] Introduce new sql external module: stor...

2016-11-04 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1748 @HeartSaVioR Thanks for your quick reply. The reason tuple data is serialized to one field is that the method `write(List data, ByteBuffer buffer)` in interface `IOutputSerializer

[GitHub] storm issue #1748: [STORM-2103][SQL] Introduce new sql external module: stor...

2016-11-04 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1748 @HeartSaVioR Thanks for your quick reply. The reason tuple data is serialized to one field is that the method `write(List data, ByteBuffer buffer)` in interface `IOutputSerializer

[GitHub] storm issue #1748: [STORM-2103][SQL] Introduce new sql external module: stor...

2016-11-04 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1748 Thanks @HeartSaVioR for your response and field Jiras. After my current tasks completed, I will pick them up. I will update #1751 accordingly, and then you can take a look if you have time

[GitHub] storm issue #1751: [STORM-2172][SQL] Support Avro as input / output format

2016-11-05 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1751 @sachin-goyal @sachingsachin Thanks for your review. I think I have addressed all of your comments. Can you take a look again? --- If your project is set up for it, you can reply to this email

[GitHub] storm pull request #1751: [STORM-2172][SQL] Support Avro as input / output f...

2016-11-05 Thread vesense
Github user vesense commented on a diff in the pull request: https://github.com/apache/storm/pull/1751#discussion_r86676691 --- Diff: external/sql/storm-sql-runtime/src/jvm/org/apache/storm/sql/runtime/serde/avro/AvroScheme.java --- @@ -0,0 +1,81 @@ +/* + * Licensed to

[GitHub] storm pull request #1751: [STORM-2172][SQL] Support Avro as input / output f...

2016-11-05 Thread vesense
Github user vesense commented on a diff in the pull request: https://github.com/apache/storm/pull/1751#discussion_r86676696 --- Diff: external/sql/storm-sql-runtime/src/jvm/org/apache/storm/sql/runtime/utils/SerdeUtils.java --- @@ -0,0 +1,100 @@ +/* + * Licensed to the

[GitHub] storm pull request #1751: [STORM-2172][SQL] Support Avro as input / output f...

2016-11-05 Thread vesense
Github user vesense commented on a diff in the pull request: https://github.com/apache/storm/pull/1751#discussion_r86676693 --- Diff: external/sql/storm-sql-runtime/src/jvm/org/apache/storm/sql/runtime/utils/SerdeUtils.java --- @@ -0,0 +1,100 @@ +/* + * Licensed to the

[GitHub] storm issue #1751: [STORM-2172][SQL] Support Avro as input / output format

2016-11-05 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1751 @HeartSaVioR ready for merging after get responses from @sachin-goyal and @sachingsachin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] storm pull request #1751: [STORM-2172][SQL] Support Avro as input / output f...

2016-11-07 Thread vesense
Github user vesense commented on a diff in the pull request: https://github.com/apache/storm/pull/1751#discussion_r86734548 --- Diff: external/sql/storm-sql-runtime/src/jvm/org/apache/storm/sql/runtime/serde/avro/CachedSchemas.java --- @@ -0,0 +1,37 @@ +/* + * Licensed to

[GitHub] storm pull request #1751: [STORM-2172][SQL] Support Avro as input / output f...

2016-11-07 Thread vesense
Github user vesense commented on a diff in the pull request: https://github.com/apache/storm/pull/1751#discussion_r86734617 --- Diff: external/sql/storm-sql-runtime/src/jvm/org/apache/storm/sql/runtime/utils/SerdeUtils.java --- @@ -0,0 +1,115 @@ +/* + * Licensed to the

[GitHub] storm issue #1763: [STORM-2189] RAS_Node::freeCPU outputs incorrect info

2016-11-07 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1763 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] storm issue #1751: [STORM-2172][SQL] Support Avro as input / output format

2016-11-07 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1751 @sachingsachin Addressed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] storm pull request #1751: [STORM-2172][SQL] Support Avro as input / output f...

2016-11-08 Thread vesense
Github user vesense commented on a diff in the pull request: https://github.com/apache/storm/pull/1751#discussion_r87122964 --- Diff: external/sql/storm-sql-runtime/src/jvm/org/apache/storm/sql/runtime/utils/SerdeUtils.java --- @@ -0,0 +1,115 @@ +/* + * Licensed to the

[GitHub] storm pull request #1751: [STORM-2172][SQL] Support Avro as input / output f...

2016-11-08 Thread vesense
Github user vesense commented on a diff in the pull request: https://github.com/apache/storm/pull/1751#discussion_r87123062 --- Diff: external/sql/storm-sql-runtime/src/jvm/org/apache/storm/sql/runtime/utils/SerdeUtils.java --- @@ -0,0 +1,115 @@ +/* + * Licensed to the

[GitHub] storm issue #1751: [STORM-2172][SQL] Support Avro as input / output format

2016-11-08 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1751 @sachingsachin >Could you also add a small note on the JIRA STORM-2172 why you are trying to support avro? STORM-2172 is a part of STORM-2149, you can see the Jira Description for

[GitHub] storm issue #1751: [STORM-2172][SQL] Support Avro as input / output format

2016-11-09 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1751 @HeartSaVioR You can take a look at the code after I addressed that using `input.avro.schema` and `output.avro.schema` for input and output Avro Schemas. --- If your project is set up for it, you

[GitHub] storm issue #1751: [STORM-2172][SQL] Support Avro as input / output format

2016-11-10 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1751 example SQL: _NOTE: All the `\n` should be removed before you test it_ ``` CREATE EXTERNAL TABLE ORDERS (ID INT PRIMARY KEY, UNIT_PRICE INT, QUANTITY INT) STORED AS INPUTFORMAT

[GitHub] storm issue #1751: [STORM-2172][SQL] Support Avro as input / output format

2016-11-10 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1751 @HeartSaVioR I will create another PR for 1.x-branch because I find that `Utils.newInstance` has changed. We need a type casting in 1.x-branch. --- If your project is set up for it, you can

[GitHub] storm issue #1770: STORM 2197: NimbusClient connections leak due to ThriftCl...

2016-11-10 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1770 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] storm issue #1772: [STORM-2196] A typo in RAS_Node::consumeCPU

2016-11-10 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1772 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] storm pull request #1773: STORM-2198: perform RotationAction when stopping H...

2016-11-10 Thread vesense
GitHub user vesense opened a pull request: https://github.com/apache/storm/pull/1773 STORM-2198: perform RotationAction when stopping HdfsBolt You can merge this pull request into a Git repository by running: $ git pull https://github.com/vesense/storm STORM-2198

[GitHub] storm issue #1751: [STORM-2172][SQL] Support Avro as input / output format

2016-11-11 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1751 @HeartSaVioR Oh, the `NotSerializableException` is because that I removed `CachedSchemas` in previous commit. Sorry for that, fixed. --- If your project is set up for it, you can reply to this

[GitHub] storm issue #1751: [STORM-2172][SQL] Support Avro as input / output format

2016-11-11 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1751 Yes, I also find that the sql with Avro schema string is a little terrible. it's not easy to edit for users. maybe I can take time to improve later. --- If your project is set up for it, yo

[GitHub] storm issue #1751: [STORM-2172][SQL] Support Avro as input / output format

2016-11-11 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1751 @HeartSaVioR Thanks for your patience. After this PR getting merged, I will modify the PR for TSV/CSV format ASAP. --- If your project is set up for it, you can reply to this email and have your

[GitHub] storm issue #1751: [STORM-2172][SQL] Support Avro as input / output format

2016-11-11 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1751 @HeartSaVioR OK. I will create a PR for 1.x-branch --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] storm pull request #1774: [STORM-2172][SQL][1.x branch] Support Avro as inpu...

2016-11-11 Thread vesense
GitHub user vesense opened a pull request: https://github.com/apache/storm/pull/1774 [STORM-2172][SQL][1.x branch] Support Avro as input / output format You can merge this pull request into a Git repository by running: $ git pull https://github.com/vesense/storm STORM-2172-1

[GitHub] storm issue #1754: [STORM-2177][STORM-2173][SQL] Support TSV/CSV as input / ...

2016-11-11 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1754 The code is ready for reviewing. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] storm issue #1754: [STORM-2177][STORM-2173][SQL] Support TSV/CSV as input / ...

2016-11-13 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1754 @HeartSaVioR Do you have time to take a look? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] storm pull request #1778: [STORM-2082][SQL] add sql external module storm-sq...

2016-11-15 Thread vesense
GitHub user vesense opened a pull request: https://github.com/apache/storm/pull/1778 [STORM-2082][SQL] add sql external module storm-sql-hdfs You can merge this pull request into a Git repository by running: $ git pull https://github.com/vesense/storm STORM-2082

[GitHub] storm pull request #1777: STORM-2202 [Storm SQL] Document how to use support...

2016-11-15 Thread vesense
Github user vesense commented on a diff in the pull request: https://github.com/apache/storm/pull/1777#discussion_r87968161 --- Diff: docs/storm-sql-reference.md --- @@ -1203,4 +1203,103 @@ and class for aggregate function is here: For now users can skip implementing `result

[GitHub] storm pull request #1777: STORM-2202 [Storm SQL] Document how to use support...

2016-11-15 Thread vesense
Github user vesense commented on a diff in the pull request: https://github.com/apache/storm/pull/1777#discussion_r87967670 --- Diff: docs/storm-sql-reference.md --- @@ -1203,4 +1203,103 @@ and class for aggregate function is here: For now users can skip implementing `result

[GitHub] storm issue #1777: STORM-2202 [Storm SQL] Document how to use supported conn...

2016-11-15 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1777 Thanks @HeartSaVioR Just two minor comments. Others looks good to me. +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] storm pull request #1778: [STORM-2082][SQL] add sql external module storm-sq...

2016-11-15 Thread vesense
Github user vesense commented on a diff in the pull request: https://github.com/apache/storm/pull/1778#discussion_r87985832 --- Diff: external/sql/storm-sql-external/storm-sql-hdfs/src/jvm/org/apache/storm/sql/hdfs/HdfsDataSourcesProvider.java --- @@ -0,0 +1,132

[GitHub] storm pull request #1778: [STORM-2082][SQL] add sql external module storm-sq...

2016-11-15 Thread vesense
Github user vesense commented on a diff in the pull request: https://github.com/apache/storm/pull/1778#discussion_r87985904 --- Diff: external/sql/storm-sql-external/storm-sql-hdfs/src/test/org/apache/storm/sql/hdfs/TestHdfsDataSourcesProvider.java --- @@ -0,0 +1,152

[GitHub] storm issue #1778: [STORM-2082][SQL] add sql external module storm-sql-hdfs

2016-11-15 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1778 @HeartSaVioR Addressed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] storm issue #1746: STORM-1607: Add MongoMapState for supporting trident's ex...

2016-11-15 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1746 Any comments are welcome. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] storm issue #1410: STORM-1778: scheme extension framework for KafkaSourcePro...

2016-11-15 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1410 @chuanlei I think this issue has been fixed by STORM-2173. Can you close this? BTW, the` CsvScheme` in STORM-2173 uses standard RFC4180 CSV parser supporting strings like `a,"b,c",d`

[GitHub] storm issue #1773: STORM-2198: perform RotationAction when stopping HdfsBolt

2016-11-16 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1773 @HeartSaVioR OK. I'll do it right now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fe

[GitHub] storm pull request #1780: STORM-2198: [1.x-branch] perform RotationAction wh...

2016-11-16 Thread vesense
GitHub user vesense opened a pull request: https://github.com/apache/storm/pull/1780 STORM-2198: [1.x-branch] perform RotationAction when stopping HdfsBolt This is STORM-2198 for 1.x-branch. You can merge this pull request into a Git repository by running: $ git pull https

[GitHub] storm issue #1773: STORM-2198: perform RotationAction when stopping HdfsBolt

2016-11-16 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1773 Done. PTAL #1780 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] storm issue #1359: STORM-1239: port backtype.storm.scheduler.IsolationSchedu...

2016-11-16 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1359 @HeartSaVioR Yes, it's still failed. I may need some help in repairing the unit tests. --- If your project is set up for it, you can reply to this email and have your reply appear on GitH

[GitHub] storm pull request #1742: STORM-2170 [Storm SQL] Add built-in socket datasou...

2016-11-17 Thread vesense
Github user vesense commented on a diff in the pull request: https://github.com/apache/storm/pull/1742#discussion_r88449665 --- Diff: external/sql/storm-sql-runtime/src/jvm/org/apache/storm/sql/runtime/datasource/socket/SocketDataSourcesProvider.java --- @@ -0,0 +1,94

[GitHub] storm pull request #1742: STORM-2170 [Storm SQL] Add built-in socket datasou...

2016-11-17 Thread vesense
Github user vesense commented on a diff in the pull request: https://github.com/apache/storm/pull/1742#discussion_r88447536 --- Diff: external/sql/storm-sql-runtime/src/jvm/org/apache/storm/sql/runtime/datasource/socket/SocketDataSourcesProvider.java --- @@ -0,0 +1,94

[GitHub] storm pull request #1742: STORM-2170 [Storm SQL] Add built-in socket datasou...

2016-11-17 Thread vesense
Github user vesense commented on a diff in the pull request: https://github.com/apache/storm/pull/1742#discussion_r88448768 --- Diff: external/sql/storm-sql-runtime/src/resources/META-INF/services/org.apache.storm.sql.runtime.DataSourcesProvider --- @@ -0,0 +1,32

[GitHub] storm issue #1742: STORM-2170 [Storm SQL] Add built-in socket datasource to ...

2016-11-17 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1742 Thanks @HeartSaVioR LGTM +1 Just left several comments. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] storm issue #1739: STORM-1443 [Storm SQL] Support customizing parallelism in...

2016-11-17 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1739 @HeartSaVioR Overall looks good to me. And I have a question: Now I'm working on STORM-2147 which I think should be based on STORM-1443. Through this PR we can set the parallelism by speci

[GitHub] storm issue #1742: STORM-2170 [Storm SQL] Add built-in socket datasource to ...

2016-11-18 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1742 @HeartSaVioR It would be better to add some `how to use` document. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] storm issue #1742: STORM-2170 [Storm SQL] Add built-in socket datasource to ...

2016-11-18 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1742 OK. nice :smile: --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] storm issue #1739: STORM-1443 [Storm SQL] Support customizing parallelism in...

2016-11-18 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1739 @HeartSaVioR >There might be some ways to pass partition count to upstream, and easy way to do might be adding method to DataSourcesProvider. What I'm considering is that we

[GitHub] storm pull request #1789: STORM-2209: Update documents adding new integratio...

2016-11-19 Thread vesense
GitHub user vesense opened a pull request: https://github.com/apache/storm/pull/1789 STORM-2209: Update documents adding new integration for some external… … systems You can merge this pull request into a Git repository by running: $ git pull https://github.com/vesense

[GitHub] storm issue #1789: STORM-2209: Update documents adding new integration for s...

2016-11-22 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1789 @revans2 @HeartSaVioR Yes, the new files are copied from external modules README.md. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well

[GitHub] storm issue #1783: STORM-2204 Adding caching capabilities in HBaseLookupBolt

2016-11-22 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1783 Overall looks good to me. My major concern is that on-heap caches(like Guava cache, Ehcache) might cause bad GC situations. I didn't use Caffeine in the past, maybe is a candidate. --- If

[GitHub] storm issue #1783: STORM-2204 Adding caching capabilities in HBaseLookupBolt

2016-11-22 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1783 @revans2 Yes, we can find a balance between high rate of cache hits and full GCs. I'm OK for adding a built-in cache if we set parameters carefully. --- If your project is set up for it, yo

[GitHub] storm issue #1783: STORM-2204 Adding caching capabilities in HBaseLookupBolt

2016-11-22 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1783 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] storm pull request #1783: STORM-2204 Adding caching capabilities in HBaseLoo...

2016-11-22 Thread vesense
Github user vesense commented on a diff in the pull request: https://github.com/apache/storm/pull/1783#discussion_r89250230 --- Diff: external/storm-hbase/src/main/java/org/apache/storm/hbase/bolt/HBaseLookupBolt.java --- @@ -40,51 +48,81 @@ * */ public class

[GitHub] storm issue #1789: STORM-2209: Update documents adding new integration for s...

2016-11-23 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1789 Added kubernetes integration. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] storm issue #1778: [STORM-2082][SQL] add sql external module storm-sql-hdfs

2016-11-24 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1778 @HeartSaVioR Now I'm a little busy, I will add it later today. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] storm issue #1789: STORM-2209: Update documents adding new integration for s...

2016-11-24 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1789 @revans2 @HeartSaVioR I think this PR should be cherry-picked to 1.x-branch since 1.x has contained these new modules . And we'd better sync documents to storm site. --- If your project is s

[GitHub] storm issue #1778: [STORM-2082][SQL] add sql external module storm-sql-hdfs

2016-11-25 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1778 >provide `working SQL example statements` to test Kafka -> HDFS ``` CREATE EXTERNAL TABLE ORDERS (ID INT PRIMARY KEY, UNIT_PRICE INT, QUANTITY INT) LOCATION 'kafka:

[GitHub] storm pull request #1801: STORM-2220 Added config key support in Cassandra b...

2016-11-27 Thread vesense
Github user vesense commented on a diff in the pull request: https://github.com/apache/storm/pull/1801#discussion_r89728994 --- Diff: external/storm-cassandra/src/main/java/org/apache/storm/cassandra/bolt/BaseCassandraBolt.java --- @@ -92,6 +94,8 @@ public void prepare(Map

[GitHub] storm pull request #1801: STORM-2220 Added config key support in Cassandra b...

2016-11-27 Thread vesense
Github user vesense commented on a diff in the pull request: https://github.com/apache/storm/pull/1801#discussion_r89727286 --- Diff: external/storm-cassandra/src/main/java/org/apache/storm/cassandra/bolt/BaseCassandraBolt.java --- @@ -105,17 +109,43 @@ public BaseCassandraBolt

[GitHub] storm pull request #1802: STORM-2209: 1.x-branch Update documents adding new...

2016-11-28 Thread vesense
GitHub user vesense opened a pull request: https://github.com/apache/storm/pull/1802 STORM-2209: 1.x-branch Update documents adding new integration for some external systems This PR is STORM-2209 for 1.x-branch. PR for master branch has been merged. You can merge this pull

[GitHub] storm issue #1789: STORM-2209: Update documents adding new integration for s...

2016-11-28 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1789 I created https://github.com/apache/storm/pull/1802 for 1.x-branch. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] storm issue #1742: STORM-2170 [Storm SQL] Add built-in socket datasource to ...

2016-12-01 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1742 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] storm issue #1783: STORM-2204 Adding caching capabilities in HBaseLookupBolt

2016-12-01 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1783 +1 for merging to master after updating `docs/storm-hbase.md`. `external/storm-hbase/README.md` has been documented. --- If your project is set up for it, you can reply to this email and have your

[GitHub] storm issue #1816: STORM-2223: PMMLBolt

2016-12-06 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1816 hi @hmcl Maybe the licenses between Apache Storm and JPMML(licensed under AGPLv3) are incompatible. Accoding to https://www.apache.org/licenses/GPL-compatibility.html >GP

[GitHub] storm issue #1816: STORM-2223: PMMLBolt

2016-12-06 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1816 @hmcl @HeartSaVioR Got it. Thanks. But I wonder the legacy code(https://github.com/jpmml/jpmml) was updated three years ago and it seems would never been updated. This can be a problem. Also

[GitHub] storm issue #1816: STORM-2223: PMMLBolt

2016-12-07 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1816 @harshach Thanks for your detailed explanations. Yes, this is a good start. I'm +1 for adding this in. This might attract many people who interest NLP, ML. --- If your project is set up f

[GitHub] storm pull request #1816: STORM-2223: PMMLBolt

2016-12-07 Thread vesense
Github user vesense commented on a diff in the pull request: https://github.com/apache/storm/pull/1816#discussion_r91297902 --- Diff: external/storm-pmml/src/main/java/org/apache/storm/pmml/runner/ModelRunner.java --- @@ -0,0 +1,30 @@ +/* + * Licensed to the Apache

[GitHub] storm issue #1816: STORM-2223: PMMLBolt

2016-12-07 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1816 @hmcl Code looks good. Left one comment. I think it is also necessary to add a README file to let people know how to use it. --- If your project is set up for it, you can reply to this email and

[GitHub] storm issue #1823: modified incorrect and broken links

2016-12-11 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1823 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] storm issue #1822: STORM-2121: Overriding StringKeyValueScheme.getOutputFiel...

2016-12-11 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1822 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] storm issue #1823: modified incorrect and broken links

2016-12-12 Thread vesense
Github user vesense commented on the issue: https://github.com/apache/storm/pull/1823 Thanks @marblejenka Merged into 1.x-branch and cherry-picked to master branch. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

<    1   2   3   4   5   6   >