[GitHub] storm pull request #2443: STORM-2406 [Storm SQL] Change underlying API to St...

2018-07-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/storm/pull/2443 ---

[GitHub] storm issue #2443: STORM-2406 [Storm SQL] Change underlying API to Streams A...

2018-07-16 Thread HeartSaVioR
Github user HeartSaVioR commented on the issue: https://github.com/apache/storm/pull/2443 @srdo Thanks for the detailed review and nice suggestions! ---

[GitHub] storm issue #2443: STORM-2406 [Storm SQL] Change underlying API to Streams A...

2018-07-16 Thread srdo
Github user srdo commented on the issue: https://github.com/apache/storm/pull/2443 I think all my comments were addressed, thanks for your patience. LGTM, +1. ---

[GitHub] storm issue #2711: STORM-3100 : Introducing CustomIndexArray to speedup Hash...

2018-07-16 Thread HeartSaVioR
Github user HeartSaVioR commented on the issue: https://github.com/apache/storm/pull/2711 @roshannaik https://travis-ci.org/apache/storm/jobs/403972342 https://travis-ci.org/apache/storm/jobs/403972347 https://travis-ci.org/apache/storm/jobs/403972348

[GitHub] storm issue #2443: STORM-2406 [Storm SQL] Change underlying API to Streams A...

2018-07-16 Thread HeartSaVioR
Github user HeartSaVioR commented on the issue: https://github.com/apache/storm/pull/2443 @srdo I'd like to get final review and approval from you to check if I miss anything before merging. Could you please help to do this? Thanks! ---

[GitHub] storm issue #2443: STORM-2406 [Storm SQL] Change underlying API to Streams A...

2018-07-16 Thread srdo
Github user srdo commented on the issue: https://github.com/apache/storm/pull/2443 Looks great. ---

[GitHub] storm issue #2443: STORM-2406 [Storm SQL] Change underlying API to Streams A...

2018-07-16 Thread HeartSaVioR
Github user HeartSaVioR commented on the issue: https://github.com/apache/storm/pull/2443 @srdo Nice finding. Fixed. Also exported to xml once again. Please check again. Thanks for your patience!

[GitHub] storm issue #2443: STORM-2406 [Storm SQL] Change underlying API to Streams A...

2018-07-16 Thread srdo
Github user srdo commented on the issue: https://github.com/apache/storm/pull/2443 ![storm-sql-internal-example xml txt](https://user-images.githubusercontent.com/4324588/42765468-6bb488d0-8918-11e8-8800-99cdf4ff6819.png)

[GitHub] storm issue #2443: STORM-2406 [Storm SQL] Change underlying API to Streams A...

2018-07-16 Thread HeartSaVioR
Github user HeartSaVioR commented on the issue: https://github.com/apache/storm/pull/2443 @srdo I have exported these diagrams into xml : please download and rename below files to remove `.txt` (github doesn't allow uploading xml file directly) and see they're properly imported

[GitHub] storm issue #2443: STORM-2406 [Storm SQL] Change underlying API to Streams A...

2018-07-16 Thread HeartSaVioR
Github user HeartSaVioR commented on the issue: https://github.com/apache/storm/pull/2443 Raised https://issues.apache.org/jira/browse/STORM-3153 for addressing restoring tests. ---

[GitHub] storm pull request #2443: STORM-2406 [Storm SQL] Change underlying API to St...

2018-07-16 Thread HeartSaVioR
Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/storm/pull/2443#discussion_r202684941 --- Diff: docs/storm-sql-internal.md --- @@ -1,59 +0,0 @@ --- End diff -- Nice finding. Will fix it and also will attach source

[GitHub] storm pull request #2443: STORM-2406 [Storm SQL] Change underlying API to St...

2018-07-16 Thread srdo
Github user srdo commented on a diff in the pull request: https://github.com/apache/storm/pull/2443#discussion_r202683106 --- Diff: docs/storm-sql-internal.md --- @@ -1,59 +0,0 @@ --- End diff -- The second diagram on the page also mentions Trident. I don't

[GitHub] storm pull request #2443: STORM-2406 [Storm SQL] Change underlying API to St...

2018-07-16 Thread srdo
Github user srdo commented on a diff in the pull request: https://github.com/apache/storm/pull/2443#discussion_r202682665 --- Diff: docs/storm-sql-internal.md --- @@ -1,59 +0,0 @@ --- End diff -- Thanks, looks great. I think the dotted line box is missing the

[GitHub] storm pull request #2443: STORM-2406 [Storm SQL] Change underlying API to St...

2018-07-16 Thread HeartSaVioR
Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/storm/pull/2443#discussion_r202678116 --- Diff: docs/storm-sql-internal.md --- @@ -1,59 +0,0 @@ --- End diff -- Just finished it. ---

[GitHub] storm pull request #2443: STORM-2406 [Storm SQL] Change underlying API to St...

2018-07-16 Thread HeartSaVioR
Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/storm/pull/2443#discussion_r202674112 --- Diff: docs/storm-sql-internal.md --- @@ -1,59 +0,0 @@ --- End diff -- Yeah right. I didn't think about that. Drawing a new one.

[GitHub] storm issue #2443: STORM-2406 [Storm SQL] Change underlying API to Streams A...

2018-07-16 Thread srdo
Github user srdo commented on the issue: https://github.com/apache/storm/pull/2443 Sounds good. ---

[GitHub] storm issue #2443: STORM-2406 [Storm SQL] Change underlying API to Streams A...

2018-07-16 Thread HeartSaVioR
Github user HeartSaVioR commented on the issue: https://github.com/apache/storm/pull/2443 Yes test failures look unrelated, one is from server, another one is from cassandra. I'd like to address https://github.com/apache/storm/pull/2443#discussion_r202639091 but OK to

[GitHub] storm pull request #2443: STORM-2406 [Storm SQL] Change underlying API to St...

2018-07-16 Thread srdo
Github user srdo commented on a diff in the pull request: https://github.com/apache/storm/pull/2443#discussion_r202653817 --- Diff: docs/storm-sql-internal.md --- @@ -1,59 +0,0 @@ --- End diff -- It would probably be pretty quick to duplicate with e.g.

[GitHub] storm issue #2443: STORM-2406 [Storm SQL] Change underlying API to Streams A...

2018-07-16 Thread srdo
Github user srdo commented on the issue: https://github.com/apache/storm/pull/2443 The test failures look unrelated, not sure why it's suddenly failing. If they don't go away by rebasing to master, we might want to raise issues to track them. I don't know if you're looking

[GitHub] storm issue #2443: STORM-2406 [Storm SQL] Change underlying API to Streams A...

2018-07-16 Thread srdo
Github user srdo commented on the issue: https://github.com/apache/storm/pull/2443 I don't think we need to change it. I just wanted to make a note of it. When this has been merged, we might want to add a couple of notes about debugging to the docs, we can mention the log line there.

[GitHub] storm pull request #2443: STORM-2406 [Storm SQL] Change underlying API to St...

2018-07-16 Thread srdo
Github user srdo commented on a diff in the pull request: https://github.com/apache/storm/pull/2443#discussion_r202650814 --- Diff: sql/storm-sql-runtime/src/jvm/org/apache/storm/sql/runtime/datasource/socket/bolt/SocketBolt.java --- @@ -0,0 +1,108 @@ +/* + * Licensed to

[GitHub] storm pull request #2443: STORM-2406 [Storm SQL] Change underlying API to St...

2018-07-16 Thread srdo
Github user srdo commented on a diff in the pull request: https://github.com/apache/storm/pull/2443#discussion_r202650588 --- Diff: sql/storm-sql-external/storm-sql-mongodb/src/jvm/org/apache/storm/sql/mongodb/MongoDataSourcesProvider.java --- @@ -47,54 +45,60 @@ * The

[GitHub] storm pull request #2443: STORM-2406 [Storm SQL] Change underlying API to St...

2018-07-16 Thread srdo
Github user srdo commented on a diff in the pull request: https://github.com/apache/storm/pull/2443#discussion_r202650461 --- Diff: sql/storm-sql-core/src/jvm/org/apache/storm/sql/planner/streams/StreamsStormRuleSets.java --- @@ -72,13 +72,13 @@ // merge and push

[GitHub] storm pull request #2443: STORM-2406 [Storm SQL] Change underlying API to St...

2018-07-16 Thread HeartSaVioR
Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/storm/pull/2443#discussion_r202644352 --- Diff: docs/storm-sql-internal.md --- @@ -1,59 +0,0 @@ --- End diff -- We could even do some photo editing but not sure it is

[GitHub] storm pull request #2443: STORM-2406 [Storm SQL] Change underlying API to St...

2018-07-16 Thread HeartSaVioR
Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/storm/pull/2443#discussion_r202639091 --- Diff: sql/storm-sql-external/storm-sql-hdfs/src/test/org/apache/storm/sql/hdfs/TestHdfsDataSourcesProvider.java --- @@ -88,46 +75,12 @@ public void

[GitHub] storm pull request #2443: STORM-2406 [Storm SQL] Change underlying API to St...

2018-07-16 Thread HeartSaVioR
Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/storm/pull/2443#discussion_r202635190 --- Diff: sql/storm-sql-external/storm-sql-mongodb/src/jvm/org/apache/storm/sql/mongodb/MongoDataSourcesProvider.java --- @@ -47,54 +45,60 @@ *

[GitHub] storm pull request #2443: STORM-2406 [Storm SQL] Change underlying API to St...

2018-07-16 Thread HeartSaVioR
Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/storm/pull/2443#discussion_r202631700 --- Diff: sql/README.md --- @@ -1,187 +1,8 @@ # Storm SQL -Compile SQL queries to Storm topologies. +Compile SQL queries to Storm

[GitHub] storm pull request #2443: STORM-2406 [Storm SQL] Change underlying API to St...

2018-07-16 Thread HeartSaVioR
Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/storm/pull/2443#discussion_r202632910 --- Diff: sql/storm-sql-core/src/jvm/org/apache/storm/sql/planner/streams/StreamsStormRuleSets.java --- @@ -72,13 +72,13 @@ // merge

[GitHub] storm pull request #2443: STORM-2406 [Storm SQL] Change underlying API to St...

2018-07-16 Thread HeartSaVioR
Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/storm/pull/2443#discussion_r202638476 --- Diff: sql/storm-sql-runtime/src/test/org/apache/storm/sql/TestUtils.java --- @@ -41,7 +26,46 @@ import java.util.Map; import

[GitHub] storm pull request #2443: STORM-2406 [Storm SQL] Change underlying API to St...

2018-07-16 Thread HeartSaVioR
Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/storm/pull/2443#discussion_r202638239 --- Diff: sql/storm-sql-runtime/src/jvm/org/apache/storm/sql/runtime/datasource/socket/bolt/SocketBolt.java --- @@ -0,0 +1,108 @@ +/* + *

[GitHub] storm pull request #2443: STORM-2406 [Storm SQL] Change underlying API to St...

2018-07-16 Thread HeartSaVioR
Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/storm/pull/2443#discussion_r202633872 --- Diff: sql/storm-sql-core/src/jvm/org/apache/storm/sql/planner/streams/rel/StreamsStreamInsertRel.java --- @@ -0,0 +1,82 @@ +/* + * Licensed

[GitHub] storm pull request #2443: STORM-2406 [Storm SQL] Change underlying API to St...

2018-07-16 Thread HeartSaVioR
Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/storm/pull/2443#discussion_r202631939 --- Diff: sql/storm-sql-core/src/jvm/org/apache/storm/sql/compiler/CompilerUtil.java --- @@ -118,16 +138,32 @@ public RelDataType getRowType(

[GitHub] storm pull request #2443: STORM-2406 [Storm SQL] Change underlying API to St...

2018-07-16 Thread HeartSaVioR
Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/storm/pull/2443#discussion_r202638350 --- Diff: sql/storm-sql-runtime/src/jvm/org/apache/storm/sql/runtime/datasource/socket/bolt/SocketBolt.java --- @@ -0,0 +1,108 @@ +/* + *

[GitHub] storm issue #2443: STORM-2406 [Storm SQL] Change underlying API to Streams A...

2018-07-16 Thread HeartSaVioR
Github user HeartSaVioR commented on the issue: https://github.com/apache/storm/pull/2443 @srdo Yes, since Streams API doesn't have rich function like executor side initialization for now. We could address it but maybe better to file a new issue and handle it independently. What

[GitHub] storm pull request #2443: STORM-2406 [Storm SQL] Change underlying API to St...

2018-07-16 Thread HeartSaVioR
Github user HeartSaVioR commented on a diff in the pull request: https://github.com/apache/storm/pull/2443#discussion_r202631502 --- Diff: docs/storm-sql-internal.md --- @@ -1,59 +0,0 @@ --- End diff -- @srdo Agreed. Regarding updating the doc, I guess