[jira] [Commented] (GEARPUMP-281) Put dockerfiles used in interation test into integrationtest/docker

2017-02-27 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/GEARPUMP-281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15887399#comment-15887399
 ] 

ASF GitHub Bot commented on GEARPUMP-281:
-

Github user huafengw commented on a diff in the pull request:

https://github.com/apache/incubator-gearpump/pull/162#discussion_r103385452
  
--- Diff: integrationtest/docker/kafka/README.md ---
@@ -0,0 +1,89 @@
+Kafka in Docker
+===
+
+**This is a fork spotify/kafka image. We decided to make it, because the 
project does not maintain proper tagging. 
+For now our tests focus on Kafka 0.8.x, so here is a version that supports 
Kafka 0.8.x.
+For latest version of kafka image go to the original project.**
+   
+This repository provides everything you need to run Kafka in Docker.
+
+For convenience also contains a packaged proxy that can be used to get 
data from
+a legacy Kafka 7 cluster into a dockerized Kafka 8.
+
+Why?
+---
+The main hurdle of running Kafka in Docker is that it depends on Zookeeper.
+Compared to other Kafka docker images, this one runs both Zookeeper and 
Kafka
+in the same container. This means:
+
+* No dependency on an external Zookeeper host, or linking to another 
container
+* Zookeeper and Kafka are configured to work together out of the box
+
+Run
+---
+
+```bash
+docker run -p 2181:2181 -p 9092:9092 --env ADVERTISED_HOST=`docker-machine 
ip \`docker-machine active\`` --env ADVERTISED_PORT=9092 grubykarol/kafka
--- End diff --

it needs docker-machine?


> Put dockerfiles used in interation test into integrationtest/docker
> ---
>
> Key: GEARPUMP-281
> URL: https://issues.apache.org/jira/browse/GEARPUMP-281
> Project: Apache Gearpump
>  Issue Type: Task
>  Components: integrationtest
> Environment: N/A
>Reporter: Karol Brejna
>Assignee: Karol Brejna
>Priority: Minor
> Fix For: 0.8.3
>
>




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (GEARPUMP-281) Put dockerfiles used in interation test into integrationtest/docker

2017-02-27 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/GEARPUMP-281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15887358#comment-15887358
 ] 

ASF GitHub Bot commented on GEARPUMP-281:
-

Github user huafengw commented on a diff in the pull request:

https://github.com/apache/incubator-gearpump/pull/162#discussion_r103382851
  
--- Diff: integrationtest/docker/java/README.md ---
@@ -0,0 +1,18 @@
+A minimalistic Oracle JDK 8 container on top of busybox.
+
+We used to base Gearpump Cluster Launcher on errordeveloper/oracle-jre 
image but it stuck on version 8u66-b17 and doesn't support tagging.
+We also probably hit a Java bug 
(http://bugs.java.com/bugdatabase/view_bug.do?bug_id=8133205) that requires 
never version of JRE.
--- End diff --

also has typo here


> Put dockerfiles used in interation test into integrationtest/docker
> ---
>
> Key: GEARPUMP-281
> URL: https://issues.apache.org/jira/browse/GEARPUMP-281
> Project: Apache Gearpump
>  Issue Type: Task
>  Components: integrationtest
> Environment: N/A
>Reporter: Karol Brejna
>Assignee: Karol Brejna
>Priority: Minor
> Fix For: 0.8.3
>
>




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (GEARPUMP-281) Put dockerfiles used in interation test into integrationtest/docker

2017-02-27 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/GEARPUMP-281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15887355#comment-15887355
 ] 

ASF GitHub Bot commented on GEARPUMP-281:
-

Github user huafengw commented on a diff in the pull request:

https://github.com/apache/incubator-gearpump/pull/162#discussion_r103382701
  
--- Diff: integrationtest/docker/README.md ---
@@ -1,28 +1,23 @@
-# Gearpump Launcher Docker Image
-
-The image helps developer to setup/test a local 
[Gearpump](https://github.com/apache/incubator-gearpump.git) cluster quickly. 
The image is based on a minimal JRE8 environment with Python support. 
-
-## Usage
-
-Here are the commands to launch a cluster. You can launch as many worker 
containers as you wish but only one master for the time being.
-```
-export GEARPUMP_HOME=/path/to/gearpump
-
-docker run -d \
- -h master0 --name master0 \
- -v $GEARPUMP_HOME:/opt/gearpump \
- -e JAVA_OPTS=-Dgearpump.cluster.masters.0=master0:3000 \
- -p 8090:8090 \
- stanleyxu2005/gearpump-launcher \
- master -ip master0 -port 3000
-
-docker run -d \
- --link master0 \
- -v $GEARPUMP_HOME:/opt/gearpump \
- -e JAVA_OPTS=-Dgearpump.cluster.masters.0=master0:3000 \
- stanleyxu2005/gearpump-launcher \
- worker
-
-docker exec master0 gear info
-docker exec master0 gear app -jar /path/to/userapp.jar [mainclass] [args]
-```
+This folder contains docker images definitions used in integration tests 
of Gearpump.
+
+
+These include:
+
+ * [The standalone single node Kafka cluster with Zookeeper](/kafka)
+ * [The Hadoop image](/hadoop)
+ * [The Gearpump Cluster Launcher and Storm Client](/gearpump)
+ * [Java 8 JRE image](/java)
+
+
+We decided to fork spotify/kafka image, because the project does not 
maintain proper tagging. 
+For now our tests focus on Kafka 0.8.x, and the project does not support 
this version. 
+
+Hadoop docker image (https://hub.docker.com/r/sequenceiq/hadoop-docker/) 
is well maintained. 
+We rely on version 2.6.0 and we feel there is no need to duplicate it.
+
+Gearpump Cluster Launcher  helps developer to setup/test a local Gearpump 
cluster quickly. 
+The image is based on a minimal JRE8 environment with Python support.
+
+We used to base Gearpump Cluster Launcher on errordeveloper/oracle-jre 
image but it stuck on version 8u66-b17 and doesn't support tagging.
+We also probably hit a Java bug 
(http://bugs.java.com/bugdatabase/view_bug.do?bug_id=8133205) that requires 
never version of JRE.
--- End diff --

typo 'nerver' => 'newer'


> Put dockerfiles used in interation test into integrationtest/docker
> ---
>
> Key: GEARPUMP-281
> URL: https://issues.apache.org/jira/browse/GEARPUMP-281
> Project: Apache Gearpump
>  Issue Type: Task
>  Components: integrationtest
> Environment: N/A
>Reporter: Karol Brejna
>Assignee: Karol Brejna
>Priority: Minor
> Fix For: 0.8.3
>
>




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (GEARPUMP-267) Kafka integration test failure due to docker-kafka version incompatibility

2017-02-27 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/GEARPUMP-267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15887348#comment-15887348
 ] 

ASF GitHub Bot commented on GEARPUMP-267:
-

Github user huafengw commented on the issue:

https://github.com/apache/incubator-gearpump/pull/158
  
Hi Karol, this pull request includes the former GEARPUMP-236 and it's also 
covered by your another pr, so maybe we can close this one?


> Kafka integration test failure due to docker-kafka version incompatibility
> --
>
> Key: GEARPUMP-267
> URL: https://issues.apache.org/jira/browse/GEARPUMP-267
> Project: Apache Gearpump
>  Issue Type: Bug
>  Components: integrationtest
>Reporter: Manu Zhang
>Assignee: Karol Brejna
>
> The current "spotify/kafka" has been updated to kafka 0.10 while Gearpump 
> depends on kafka 0.8, and the author doesn't provide history tags.  There is 
> an open [issue|https://github.com/spotify/docker-kafka/issues/61] but the 
> repo doesn't seem to be under active development. An alternative is 
> https://github.com/wurstmeister/kafka-docker



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Resolved] (GEARPUMP-286) Different WindowAndGroups could end up in one due to hashCode collision

2017-02-27 Thread Manu Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/GEARPUMP-286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Manu Zhang resolved GEARPUMP-286.
-
   Resolution: Fixed
Fix Version/s: 0.8.3

> Different WindowAndGroups could end up in one due to hashCode collision 
> 
>
> Key: GEARPUMP-286
> URL: https://issues.apache.org/jira/browse/GEARPUMP-286
> Project: Apache Gearpump
>  Issue Type: Bug
>  Components: streaming
>Affects Versions: 0.8.2
>Reporter: Manu Zhang
>Assignee: Manu Zhang
> Fix For: 0.8.3
>
>
> Currently, we use a {{TreeMap}} to store and sort {{WindowAndGroup}}, which 
> requires {{WindowAndGroup}} to be {{Comparable}}. However, {{Group}} is not 
> and not supposed to be so I hacked with its {{hashCode}} for comparison. That 
> is wrong since two {{Group}} could have identical {{hashCode}}.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Resolved] (GEARPUMP-283) Return application exception to client

2017-02-27 Thread Manu Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/GEARPUMP-283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Manu Zhang resolved GEARPUMP-283.
-
   Resolution: Fixed
Fix Version/s: 0.8.3

> Return application exception to client 
> ---
>
> Key: GEARPUMP-283
> URL: https://issues.apache.org/jira/browse/GEARPUMP-283
> Project: Apache Gearpump
>  Issue Type: Improvement
>  Components: streaming
>Reporter: Manu Zhang
>Assignee: Manu Zhang
> Fix For: 0.8.3
>
>
> Currently, the error message is pulled out from the original {{Throwable}} 
> object, combined with some GP specific information and returned. It is 
> required by Beam tests to inspect the {{Throwable}}.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[GitHub] incubator-gearpump pull request #161: [GEARPUMP-283] Return app exception to...

2017-02-27 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/incubator-gearpump/pull/161


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Commented] (GEARPUMP-283) Return application exception to client

2017-02-27 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/GEARPUMP-283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15887138#comment-15887138
 ] 

ASF GitHub Bot commented on GEARPUMP-283:
-

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-gearpump/pull/161


> Return application exception to client 
> ---
>
> Key: GEARPUMP-283
> URL: https://issues.apache.org/jira/browse/GEARPUMP-283
> Project: Apache Gearpump
>  Issue Type: Improvement
>  Components: streaming
>Reporter: Manu Zhang
>Assignee: Manu Zhang
>
> Currently, the error message is pulled out from the original {{Throwable}} 
> object, combined with some GP specific information and returned. It is 
> required by Beam tests to inspect the {{Throwable}}.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[GitHub] incubator-gearpump issue #161: [GEARPUMP-283] Return app exception to client

2017-02-27 Thread manuzhang
Github user manuzhang commented on the issue:

https://github.com/apache/incubator-gearpump/pull/161
  
build passes at 
https://travis-ci.org/manuzhang/incubator-gearpump/builds/206019724


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-gearpump pull request #164: [GEARPUMP-286] Fix window and group im...

2017-02-27 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/incubator-gearpump/pull/164


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-gearpump issue #161: [GEARPUMP-283] Return app exception to client

2017-02-27 Thread huafengw
Github user huafengw commented on the issue:

https://github.com/apache/incubator-gearpump/pull/161
  
+1


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Commented] (GEARPUMP-283) Return application exception to client

2017-02-27 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/GEARPUMP-283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15887124#comment-15887124
 ] 

ASF GitHub Bot commented on GEARPUMP-283:
-

Github user huafengw commented on the issue:

https://github.com/apache/incubator-gearpump/pull/161
  
+1


> Return application exception to client 
> ---
>
> Key: GEARPUMP-283
> URL: https://issues.apache.org/jira/browse/GEARPUMP-283
> Project: Apache Gearpump
>  Issue Type: Improvement
>  Components: streaming
>Reporter: Manu Zhang
>Assignee: Manu Zhang
>
> Currently, the error message is pulled out from the original {{Throwable}} 
> object, combined with some GP specific information and returned. It is 
> required by Beam tests to inspect the {{Throwable}}.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (GEARPUMP-283) Return application exception to client

2017-02-27 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/GEARPUMP-283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15887073#comment-15887073
 ] 

ASF GitHub Bot commented on GEARPUMP-283:
-

Github user manuzhang commented on the issue:

https://github.com/apache/incubator-gearpump/pull/161
  
build passes at 
https://travis-ci.org/manuzhang/incubator-gearpump/builds/206019724


> Return application exception to client 
> ---
>
> Key: GEARPUMP-283
> URL: https://issues.apache.org/jira/browse/GEARPUMP-283
> Project: Apache Gearpump
>  Issue Type: Improvement
>  Components: streaming
>Reporter: Manu Zhang
>Assignee: Manu Zhang
>
> Currently, the error message is pulled out from the original {{Throwable}} 
> object, combined with some GP specific information and returned. It is 
> required by Beam tests to inspect the {{Throwable}}.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (GEARPUMP-286) Different WindowAndGroups could end up in one due to hashCode collision

2017-02-27 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/GEARPUMP-286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15887072#comment-15887072
 ] 

ASF GitHub Bot commented on GEARPUMP-286:
-

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-gearpump/pull/164


> Different WindowAndGroups could end up in one due to hashCode collision 
> 
>
> Key: GEARPUMP-286
> URL: https://issues.apache.org/jira/browse/GEARPUMP-286
> Project: Apache Gearpump
>  Issue Type: Bug
>  Components: streaming
>Affects Versions: 0.8.2
>Reporter: Manu Zhang
>Assignee: Manu Zhang
>
> Currently, we use a {{TreeMap}} to store and sort {{WindowAndGroup}}, which 
> requires {{WindowAndGroup}} to be {{Comparable}}. However, {{Group}} is not 
> and not supposed to be so I hacked with its {{hashCode}} for comparison. That 
> is wrong since two {{Group}} could have identical {{hashCode}}.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[GitHub] incubator-gearpump issue #164: [GEARPUMP-286] Fix window and group implement...

2017-02-27 Thread huafengw
Github user huafengw commented on the issue:

https://github.com/apache/incubator-gearpump/pull/164
  
Build passed: 
https://travis-ci.org/manuzhang/incubator-gearpump/builds/206019494
+1 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-gearpump pull request #162: [GEARPUMP-281] Using new version of do...

2017-02-27 Thread manuzhang
Github user manuzhang commented on a diff in the pull request:

https://github.com/apache/incubator-gearpump/pull/162#discussion_r103349793
  
--- Diff: integrationtest/docker/kafka/LICENSE ---
@@ -0,0 +1,201 @@
+Apache License
--- End diff --

We don't keep a separate license file for sub-folders. Instead, we add 
license headers to source files (except README).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-gearpump pull request #163: GEARPUMP-279 akka-streams test example...

2017-02-27 Thread kkasravi
GitHub user kkasravi opened a pull request:

https://github.com/apache/incubator-gearpump/pull/163

GEARPUMP-279 akka-streams test examples do not work

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the commit message is formatted like:
   `[GEARPUMP-] Meaningful description of pull request` 
 - [ ] Make sure tests pass via `sbt clean test`.
 - [ ] Make sure old documentation affected by the pull request has been 
updated and new documentation added for new functionality. 



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/kkasravi/incubator-gearpump GEARPUMP-279

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-gearpump/pull/163.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #163


commit dfc00833fd932391c680748e75e507d00c4be438
Author: Kam Kasravi 
Date:   2017-02-27T23:42:14Z

GEARPUMP-279 akka-streams test examples do not work




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-gearpump pull request #162: [GEARPUMP-281] Using new version of do...

2017-02-27 Thread manuzhang
Github user manuzhang commented on a diff in the pull request:

https://github.com/apache/incubator-gearpump/pull/162#discussion_r103349524
  
--- Diff: integrationtest/docker/java/README.md ---
@@ -0,0 +1,18 @@
+A minimalistic Oracle JDK 8 container on top of busybox.
--- End diff --

Great investigation and README


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-gearpump pull request #164: [GEARPUMP-286] Fix window and group im...

2017-02-27 Thread manuzhang
GitHub user manuzhang opened a pull request:

https://github.com/apache/incubator-gearpump/pull/164

[GEARPUMP-286] Fix window and group implementation in DefaultWindowRu…

…nner

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the commit message is formatted like:
   `[GEARPUMP-] Meaningful description of pull request` 
 - [ ] Make sure tests pass via `sbt clean test`.
 - [ ] Make sure old documentation affected by the pull request has been 
updated and new documentation added for new functionality. 



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/manuzhang/incubator-gearpump GEARPUMP-286

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-gearpump/pull/164.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #164






---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Commented] (GEARPUMP-286) Different WindowAndGroups could end up in one due to hashCode collision

2017-02-27 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/GEARPUMP-286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15887053#comment-15887053
 ] 

ASF GitHub Bot commented on GEARPUMP-286:
-

Github user huafengw commented on the issue:

https://github.com/apache/incubator-gearpump/pull/164
  
Build passed: 
https://travis-ci.org/manuzhang/incubator-gearpump/builds/206019494
+1 


> Different WindowAndGroups could end up in one due to hashCode collision 
> 
>
> Key: GEARPUMP-286
> URL: https://issues.apache.org/jira/browse/GEARPUMP-286
> Project: Apache Gearpump
>  Issue Type: Bug
>  Components: streaming
>Affects Versions: 0.8.2
>Reporter: Manu Zhang
>Assignee: Manu Zhang
>
> Currently, we use a {{TreeMap}} to store and sort {{WindowAndGroup}}, which 
> requires {{WindowAndGroup}} to be {{Comparable}}. However, {{Group}} is not 
> and not supposed to be so I hacked with its {{hashCode}} for comparison. That 
> is wrong since two {{Group}} could have identical {{hashCode}}.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (GEARPUMP-217) Add SQL support

2017-02-27 Thread Manu Zhang (JIRA)

[ 
https://issues.apache.org/jira/browse/GEARPUMP-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15886990#comment-15886990
 ] 

Manu Zhang commented on GEARPUMP-217:
-

Hi, Venkat

I'm sorry that our application for GSOC 2017 has been turned down and not sure 
whether we qualify under the Apache umbrella.
That said, you are more than welcome to work on this issue and make 
contribution to this project.
You may contact me at owenzhang1990 at gmail dot com or subscribe and write to 
our [mailing 
list|http://gearpump.incubator.apache.org/community.html#mailing-lists]

> Add SQL support 
> 
>
> Key: GEARPUMP-217
> URL: https://issues.apache.org/jira/browse/GEARPUMP-217
> Project: Apache Gearpump
>  Issue Type: New Feature
>Affects Versions: 0.8.1
>Reporter: Manu Zhang
>Assignee: Manu Zhang
>  Labels: gsoc2017, mentor
>
> SQL support will allow those unfamiliar with Scala/Java to use Gearpump. I 
> propose to build SQL layer with Apache Calcite because
> 1. It has done the hard job of parsing, translating logical plan to physical 
> plan and optimizing.
> 2. It is under active development and has a great community.
> 3. It's proved to be a good solution since Apache Storm, Apache Flink and 
> Apache Samza all build their Streaming SQL with Apache Calcite
> Note SQL here actually means Streaming SQL dialects supported by Calcite 
> (check reference 1 and 2). Please checkout reference 3 for an example 
> implementation. 
> The physical plan will be translated to Gearpump high level DSL.
> References:
> 1. http://www.slideshare.net/julianhyde/streaming-sql
> 2. https://calcite.apache.org/docs/stream.html
> 3. https://github.com/milinda/samza-sql



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (GEARPUMP-286) Different WindowAndGroups could end up in one due to hashCode collision

2017-02-27 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/GEARPUMP-286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15886966#comment-15886966
 ] 

ASF GitHub Bot commented on GEARPUMP-286:
-

GitHub user manuzhang opened a pull request:

https://github.com/apache/incubator-gearpump/pull/164

[GEARPUMP-286] Fix window and group implementation in DefaultWindowRu…

…nner

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the commit message is formatted like:
   `[GEARPUMP-] Meaningful description of pull request` 
 - [ ] Make sure tests pass via `sbt clean test`.
 - [ ] Make sure old documentation affected by the pull request has been 
updated and new documentation added for new functionality. 



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/manuzhang/incubator-gearpump GEARPUMP-286

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-gearpump/pull/164.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #164






> Different WindowAndGroups could end up in one due to hashCode collision 
> 
>
> Key: GEARPUMP-286
> URL: https://issues.apache.org/jira/browse/GEARPUMP-286
> Project: Apache Gearpump
>  Issue Type: Bug
>  Components: streaming
>Affects Versions: 0.8.2
>Reporter: Manu Zhang
>Assignee: Manu Zhang
>
> Currently, we use a {{TreeMap}} to store and sort {{WindowAndGroup}}, which 
> requires {{WindowAndGroup}} to be {{Comparable}}. However, {{Group}} is not 
> and not supposed to be so I hacked with its {{hashCode}} for comparison. That 
> is wrong since two {{Group}} could have identical {{hashCode}}.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Updated] (GEARPUMP-286) Different WindowAndGroups could end up in one due to hashCode collision

2017-02-27 Thread Manu Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/GEARPUMP-286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Manu Zhang updated GEARPUMP-286:

Description: Currently, we use a {{TreeMap}} to store and sort 
{{WindowAndGroup}}, which requires {{WindowAndGroup}} to be {{Comparable}}. 
However, {{Group}} is not and not supposed to be so I hacked with its 
{{hashCode}} for comparison. That is wrong since two {{Group}} could have 
identical {{hashCode}}.  (was: Currently, we use a {{TreeMap}} to store and 
sort {{WindowAndGroup}}s, which requires {{WindowAndGroup}} to be 
{{Comparable}}. However, {{Group}} is not and not supposed to be so I hacked 
with its {{hashCode}} for comparison. That is wrong since two {{Group}}s could 
have identical {{hashCode}}s.)

> Different WindowAndGroups could end up in one due to hashCode collision 
> 
>
> Key: GEARPUMP-286
> URL: https://issues.apache.org/jira/browse/GEARPUMP-286
> Project: Apache Gearpump
>  Issue Type: Bug
>  Components: streaming
>Affects Versions: 0.8.2
>Reporter: Manu Zhang
>Assignee: Manu Zhang
>
> Currently, we use a {{TreeMap}} to store and sort {{WindowAndGroup}}, which 
> requires {{WindowAndGroup}} to be {{Comparable}}. However, {{Group}} is not 
> and not supposed to be so I hacked with its {{hashCode}} for comparison. That 
> is wrong since two {{Group}} could have identical {{hashCode}}.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (GEARPUMP-286) Different WindowAndGroups could end up in one due to hashCode collision

2017-02-27 Thread Manu Zhang (JIRA)
Manu Zhang created GEARPUMP-286:
---

 Summary: Different WindowAndGroups could end up in one due to 
hashCode collision 
 Key: GEARPUMP-286
 URL: https://issues.apache.org/jira/browse/GEARPUMP-286
 Project: Apache Gearpump
  Issue Type: Bug
  Components: streaming
Affects Versions: 0.8.2
Reporter: Manu Zhang
Assignee: Manu Zhang


Currently, we use a {{TreeMap}} to store and sort {{WindowAndGroup}}s, which 
requires {{WindowAndGroup}} to be {{Comparable}}. However, {{Group}} is not and 
not supposed to be so I hacked with its {{hashCode}} for comparison. That is 
wrong since two {{Group}}s could have identical {{hashCode}}s.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (GEARPUMP-285) AppManager shut down executor time out

2017-02-27 Thread Manu Zhang (JIRA)
Manu Zhang created GEARPUMP-285:
---

 Summary: AppManager shut down executor time out
 Key: GEARPUMP-285
 URL: https://issues.apache.org/jira/browse/GEARPUMP-285
 Project: Apache Gearpump
  Issue Type: Bug
Affects Versions: 0.8.2
Reporter: Manu Zhang
Assignee: Huafeng Wang
Priority: Minor


When running Beam tests for about 10 seconds with {{EmbeddedCluster}}, I saw 
the "Shut down executor time out" error log which should be trigger only after 
30 seconds. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (GEARPUMP-281) Put dockerfiles used in interation test into integrationtest/docker

2017-02-27 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/GEARPUMP-281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15886914#comment-15886914
 ] 

ASF GitHub Bot commented on GEARPUMP-281:
-

Github user manuzhang commented on a diff in the pull request:

https://github.com/apache/incubator-gearpump/pull/162#discussion_r103349793
  
--- Diff: integrationtest/docker/kafka/LICENSE ---
@@ -0,0 +1,201 @@
+Apache License
--- End diff --

We don't keep a separate license file for sub-folders. Instead, we add 
license headers to source files (except README).


> Put dockerfiles used in interation test into integrationtest/docker
> ---
>
> Key: GEARPUMP-281
> URL: https://issues.apache.org/jira/browse/GEARPUMP-281
> Project: Apache Gearpump
>  Issue Type: Task
>  Components: integrationtest
> Environment: N/A
>Reporter: Karol Brejna
>Assignee: Karol Brejna
>Priority: Minor
> Fix For: 0.8.3
>
>




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (GEARPUMP-281) Put dockerfiles used in interation test into integrationtest/docker

2017-02-27 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/GEARPUMP-281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15886910#comment-15886910
 ] 

ASF GitHub Bot commented on GEARPUMP-281:
-

Github user manuzhang commented on a diff in the pull request:

https://github.com/apache/incubator-gearpump/pull/162#discussion_r103349524
  
--- Diff: integrationtest/docker/java/README.md ---
@@ -0,0 +1,18 @@
+A minimalistic Oracle JDK 8 container on top of busybox.
--- End diff --

Great investigation and README


> Put dockerfiles used in interation test into integrationtest/docker
> ---
>
> Key: GEARPUMP-281
> URL: https://issues.apache.org/jira/browse/GEARPUMP-281
> Project: Apache Gearpump
>  Issue Type: Task
>  Components: integrationtest
> Environment: N/A
>Reporter: Karol Brejna
>Assignee: Karol Brejna
>Priority: Minor
> Fix For: 0.8.3
>
>




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (GEARPUMP-279) akka-streams integration tests broken

2017-02-27 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/GEARPUMP-279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15886793#comment-15886793
 ] 

ASF GitHub Bot commented on GEARPUMP-279:
-

GitHub user kkasravi opened a pull request:

https://github.com/apache/incubator-gearpump/pull/163

GEARPUMP-279 akka-streams test examples do not work

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the commit message is formatted like:
   `[GEARPUMP-] Meaningful description of pull request` 
 - [ ] Make sure tests pass via `sbt clean test`.
 - [ ] Make sure old documentation affected by the pull request has been 
updated and new documentation added for new functionality. 



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/kkasravi/incubator-gearpump GEARPUMP-279

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-gearpump/pull/163.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #163


commit dfc00833fd932391c680748e75e507d00c4be438
Author: Kam Kasravi 
Date:   2017-02-27T23:42:14Z

GEARPUMP-279 akka-streams test examples do not work




> akka-streams integration tests broken
> -
>
> Key: GEARPUMP-279
> URL: https://issues.apache.org/jira/browse/GEARPUMP-279
> Project: Apache Gearpump
>  Issue Type: Bug
>Reporter: Kam Kasravi
>Assignee: Kam Kasravi
>
> The akkastreams project in sbt should be similar to yarn so all libraries are 
> included in order to run the tests



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[GitHub] incubator-gearpump pull request #161: [GEARPUMP-283] Return app exception to...

2017-02-27 Thread manuzhang
GitHub user manuzhang opened a pull request:

https://github.com/apache/incubator-gearpump/pull/161

[GEARPUMP-283] Return app exception to client

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the commit message is formatted like:
   `[GEARPUMP-] Meaningful description of pull request` 
 - [ ] Make sure tests pass via `sbt clean test`.
 - [ ] Make sure old documentation affected by the pull request has been 
updated and new documentation added for new functionality. 



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/manuzhang/incubator-gearpump GEARPUMP-283

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-gearpump/pull/161.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #161


commit f640a689e64f03bb032762ea29b7d18f492cb68f
Author: manuzhang 
Date:   2017-02-24T12:45:59Z

[GEARPUMP-283] Return app exception to client




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-gearpump issue #161: [GEARPUMP-283] Return app exception to client

2017-02-27 Thread manuzhang
Github user manuzhang commented on the issue:

https://github.com/apache/incubator-gearpump/pull/161
  
R: @huafengw 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-gearpump pull request #162: [GEARPUMP-281] Using new version of do...

2017-02-27 Thread karol-brejna-i
GitHub user karol-brejna-i opened a pull request:

https://github.com/apache/incubator-gearpump/pull/162

[GEARPUMP-281] Using new version of docker images for integration tests

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the commit message is formatted like:
   `[GEARPUMP-] Meaningful description of pull request` 
 - [ ] Make sure tests pass via `sbt clean test`.
 - [ ] Make sure old documentation affected by the pull request has been 
updated and new documentation added for new functionality. 

Changes include:
* adding docker project to integrationtest/docker (java, hadoop, kafka, 
gearpump-launcher)
* updating gearpump-launcher to include new version of java
* update the code to use new images


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/karol-brejna-i/incubator-gearpump GEARPUMP-281

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-gearpump/pull/162.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #162


commit 3cfdd6b3448be77ffd94c0aec27941c5d53d6bf4
Author: karol brejna 
Date:   2017-02-23T18:51:57Z

[GEARPUMP-281] Using new version of docker images for integration tests




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-gearpump issue #158: [GEARPUMP-267] Changing docker image for Kafk...

2017-02-27 Thread karol-brejna-i
Github user karol-brejna-i commented on the issue:

https://github.com/apache/incubator-gearpump/pull/158
  
I've collected docker definitions in one place (integrationtest/docker), 
upgraded java version for gearpump-launcher, switched to "our" kafka image 
(0.8.2.1): https://github.com/apache/incubator-gearpump/pull/162

It looks like all the integration tests pass now.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-gearpump issue #162: [GEARPUMP-281] Using new version of docker im...

2017-02-27 Thread codecov-io
Github user codecov-io commented on the issue:

https://github.com/apache/incubator-gearpump/pull/162
  
# 
[Codecov](https://codecov.io/gh/apache/incubator-gearpump/pull/162?src=pr&el=h1)
 Report
> Merging 
[#162](https://codecov.io/gh/apache/incubator-gearpump/pull/162?src=pr&el=desc) 
into 
[master](https://codecov.io/gh/apache/incubator-gearpump/commit/8cd0f0c9b31944d892972178365871b8134b1619?src=pr&el=desc)
 will **not change** coverage.
> The diff coverage is `n/a`.



```diff
@@  Coverage Diff   @@
##   master#162   +/-   ##
==
  Coverage71.5%   71.5%   
==
  Files 190 190   
  Lines60546054   
  Branches  523 523   
==
  Hits 43294329   
  Misses   17251725
```


--

[Continue to review full report at 
Codecov](https://codecov.io/gh/apache/incubator-gearpump/pull/162?src=pr&el=continue).
> **Legend** - [Click here to learn 
more](https://docs.codecov.io/docs/codecov-delta)
> `Δ = absolute  (impact)`, `ø = not affected`, `? = missing 
data`
> Powered by 
[Codecov](https://codecov.io/gh/apache/incubator-gearpump/pull/162?src=pr&el=footer).
 Last update 
[8cd0f0c...3cfdd6b](https://codecov.io/gh/apache/incubator-gearpump/compare/8cd0f0c9b31944d892972178365871b8134b1619...3cfdd6b3448be77ffd94c0aec27941c5d53d6bf4?el=footer&src=pr&el=lastupdated).
 Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-gearpump issue #158: [GEARPUMP-267] Changing docker image for Kafk...

2017-02-27 Thread karol-brejna-i
Github user karol-brejna-i commented on the issue:

https://github.com/apache/incubator-gearpump/pull/158
  
gearump-launcher that we use in integration tests uses 
errordeveloper/oracle-jre image that has JDK 8u45-b14. I updated JRE image and 
will use it in gearpump-launcher to see if new version of Java fixes the tests.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Commented] (GEARPUMP-217) Add SQL support

2017-02-27 Thread venkat kumar reddy (JIRA)

[ 
https://issues.apache.org/jira/browse/GEARPUMP-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15886215#comment-15886215
 ] 

venkat kumar reddy commented on GEARPUMP-217:
-

Hello Manu  Zhang,
I am interested in working on this feature for #GSOC 2017.
I am new to open source contribution.
Could you please let me know the how to communicate with you for discussing 
about this project.

Regards,
Venkat
  

> Add SQL support 
> 
>
> Key: GEARPUMP-217
> URL: https://issues.apache.org/jira/browse/GEARPUMP-217
> Project: Apache Gearpump
>  Issue Type: New Feature
>Affects Versions: 0.8.1
>Reporter: Manu Zhang
>Assignee: Manu Zhang
>  Labels: gsoc2017, mentor
>
> SQL support will allow those unfamiliar with Scala/Java to use Gearpump. I 
> propose to build SQL layer with Apache Calcite because
> 1. It has done the hard job of parsing, translating logical plan to physical 
> plan and optimizing.
> 2. It is under active development and has a great community.
> 3. It's proved to be a good solution since Apache Storm, Apache Flink and 
> Apache Samza all build their Streaming SQL with Apache Calcite
> Note SQL here actually means Streaming SQL dialects supported by Calcite 
> (check reference 1 and 2). Please checkout reference 3 for an example 
> implementation. 
> The physical plan will be translated to Gearpump high level DSL.
> References:
> 1. http://www.slideshare.net/julianhyde/streaming-sql
> 2. https://calcite.apache.org/docs/stream.html
> 3. https://github.com/milinda/samza-sql



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (GEARPUMP-281) Put dockerfiles used in interation test into integrationtest/docker

2017-02-27 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/GEARPUMP-281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15886014#comment-15886014
 ] 

ASF GitHub Bot commented on GEARPUMP-281:
-

Github user codecov-io commented on the issue:

https://github.com/apache/incubator-gearpump/pull/162
  
# 
[Codecov](https://codecov.io/gh/apache/incubator-gearpump/pull/162?src=pr&el=h1)
 Report
> Merging 
[#162](https://codecov.io/gh/apache/incubator-gearpump/pull/162?src=pr&el=desc) 
into 
[master](https://codecov.io/gh/apache/incubator-gearpump/commit/8cd0f0c9b31944d892972178365871b8134b1619?src=pr&el=desc)
 will **not change** coverage.
> The diff coverage is `n/a`.



```diff
@@  Coverage Diff   @@
##   master#162   +/-   ##
==
  Coverage71.5%   71.5%   
==
  Files 190 190   
  Lines60546054   
  Branches  523 523   
==
  Hits 43294329   
  Misses   17251725
```


--

[Continue to review full report at 
Codecov](https://codecov.io/gh/apache/incubator-gearpump/pull/162?src=pr&el=continue).
> **Legend** - [Click here to learn 
more](https://docs.codecov.io/docs/codecov-delta)
> `Δ = absolute  (impact)`, `ø = not affected`, `? = missing data`
> Powered by 
[Codecov](https://codecov.io/gh/apache/incubator-gearpump/pull/162?src=pr&el=footer).
 Last update 
[8cd0f0c...3cfdd6b](https://codecov.io/gh/apache/incubator-gearpump/compare/8cd0f0c9b31944d892972178365871b8134b1619...3cfdd6b3448be77ffd94c0aec27941c5d53d6bf4?el=footer&src=pr&el=lastupdated).
 Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments).


> Put dockerfiles used in interation test into integrationtest/docker
> ---
>
> Key: GEARPUMP-281
> URL: https://issues.apache.org/jira/browse/GEARPUMP-281
> Project: Apache Gearpump
>  Issue Type: Task
>  Components: integrationtest
> Environment: N/A
>Reporter: Karol Brejna
>Assignee: Karol Brejna
>Priority: Minor
> Fix For: 0.8.3
>
>




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (GEARPUMP-284) Oauth2 tests fail

2017-02-27 Thread Karol Brejna (JIRA)
Karol Brejna created GEARPUMP-284:
-

 Summary: Oauth2 tests fail
 Key: GEARPUMP-284
 URL: https://issues.apache.org/jira/browse/GEARPUMP-284
 Project: Apache Gearpump
  Issue Type: Bug
  Components: services
Affects Versions: 0.8.2
Reporter: Karol Brejna
Assignee: Karol Brejna


Running tests show that oauth2 tests fail.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (GEARPUMP-267) Kafka integration test failure due to docker-kafka version incompatibility

2017-02-27 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/GEARPUMP-267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15885821#comment-15885821
 ] 

ASF GitHub Bot commented on GEARPUMP-267:
-

Github user karol-brejna-i commented on the issue:

https://github.com/apache/incubator-gearpump/pull/158
  
I've collected docker definitions in one place (integrationtest/docker), 
upgraded java version for gearpump-launcher, switched to "our" kafka image 
(0.8.2.1): https://github.com/apache/incubator-gearpump/pull/162

It looks like all the integration tests pass now.


> Kafka integration test failure due to docker-kafka version incompatibility
> --
>
> Key: GEARPUMP-267
> URL: https://issues.apache.org/jira/browse/GEARPUMP-267
> Project: Apache Gearpump
>  Issue Type: Bug
>  Components: integrationtest
>Reporter: Manu Zhang
>Assignee: Karol Brejna
>
> The current "spotify/kafka" has been updated to kafka 0.10 while Gearpump 
> depends on kafka 0.8, and the author doesn't provide history tags.  There is 
> an open [issue|https://github.com/spotify/docker-kafka/issues/61] but the 
> repo doesn't seem to be under active development. An alternative is 
> https://github.com/wurstmeister/kafka-docker



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (GEARPUMP-281) Put dockerfiles used in interation test into integrationtest/docker

2017-02-27 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/GEARPUMP-281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15885814#comment-15885814
 ] 

ASF GitHub Bot commented on GEARPUMP-281:
-

GitHub user karol-brejna-i opened a pull request:

https://github.com/apache/incubator-gearpump/pull/162

[GEARPUMP-281] Using new version of docker images for integration tests

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the commit message is formatted like:
   `[GEARPUMP-] Meaningful description of pull request` 
 - [ ] Make sure tests pass via `sbt clean test`.
 - [ ] Make sure old documentation affected by the pull request has been 
updated and new documentation added for new functionality. 

Changes include:
* adding docker project to integrationtest/docker (java, hadoop, kafka, 
gearpump-launcher)
* updating gearpump-launcher to include new version of java
* update the code to use new images


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/karol-brejna-i/incubator-gearpump GEARPUMP-281

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-gearpump/pull/162.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #162


commit 3cfdd6b3448be77ffd94c0aec27941c5d53d6bf4
Author: karol brejna 
Date:   2017-02-23T18:51:57Z

[GEARPUMP-281] Using new version of docker images for integration tests




> Put dockerfiles used in interation test into integrationtest/docker
> ---
>
> Key: GEARPUMP-281
> URL: https://issues.apache.org/jira/browse/GEARPUMP-281
> Project: Apache Gearpump
>  Issue Type: Task
>  Components: integrationtest
> Environment: N/A
>Reporter: Karol Brejna
>Assignee: Karol Brejna
>Priority: Minor
> Fix For: 0.8.3
>
>




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (GEARPUMP-283) Return application exception to client

2017-02-27 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/GEARPUMP-283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15885649#comment-15885649
 ] 

ASF GitHub Bot commented on GEARPUMP-283:
-

Github user manuzhang commented on the issue:

https://github.com/apache/incubator-gearpump/pull/161
  
R: @huafengw 


> Return application exception to client 
> ---
>
> Key: GEARPUMP-283
> URL: https://issues.apache.org/jira/browse/GEARPUMP-283
> Project: Apache Gearpump
>  Issue Type: Improvement
>  Components: streaming
>Reporter: Manu Zhang
>Assignee: Manu Zhang
>
> Currently, the error message is pulled out from the original {{Throwable}} 
> object, combined with some GP specific information and returned. It is 
> required by Beam tests to inspect the {{Throwable}}.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (GEARPUMP-283) Return application exception to client

2017-02-27 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/GEARPUMP-283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15885648#comment-15885648
 ] 

ASF GitHub Bot commented on GEARPUMP-283:
-

GitHub user manuzhang opened a pull request:

https://github.com/apache/incubator-gearpump/pull/161

[GEARPUMP-283] Return app exception to client

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the commit message is formatted like:
   `[GEARPUMP-] Meaningful description of pull request` 
 - [ ] Make sure tests pass via `sbt clean test`.
 - [ ] Make sure old documentation affected by the pull request has been 
updated and new documentation added for new functionality. 



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/manuzhang/incubator-gearpump GEARPUMP-283

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-gearpump/pull/161.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #161


commit f640a689e64f03bb032762ea29b7d18f492cb68f
Author: manuzhang 
Date:   2017-02-24T12:45:59Z

[GEARPUMP-283] Return app exception to client




> Return application exception to client 
> ---
>
> Key: GEARPUMP-283
> URL: https://issues.apache.org/jira/browse/GEARPUMP-283
> Project: Apache Gearpump
>  Issue Type: Improvement
>  Components: streaming
>Reporter: Manu Zhang
>Assignee: Manu Zhang
>
> Currently, the error message is pulled out from the original {{Throwable}} 
> object, combined with some GP specific information and returned. It is 
> required by Beam tests to inspect the {{Throwable}}.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (GEARPUMP-267) Kafka integration test failure due to docker-kafka version incompatibility

2017-02-27 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/GEARPUMP-267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15885444#comment-15885444
 ] 

ASF GitHub Bot commented on GEARPUMP-267:
-

Github user karol-brejna-i commented on the issue:

https://github.com/apache/incubator-gearpump/pull/158
  
gearump-launcher that we use in integration tests uses 
errordeveloper/oracle-jre image that has JDK 8u45-b14. I updated JRE image and 
will use it in gearpump-launcher to see if new version of Java fixes the tests.


> Kafka integration test failure due to docker-kafka version incompatibility
> --
>
> Key: GEARPUMP-267
> URL: https://issues.apache.org/jira/browse/GEARPUMP-267
> Project: Apache Gearpump
>  Issue Type: Bug
>  Components: integrationtest
>Reporter: Manu Zhang
>Assignee: Karol Brejna
>
> The current "spotify/kafka" has been updated to kafka 0.10 while Gearpump 
> depends on kafka 0.8, and the author doesn't provide history tags.  There is 
> an open [issue|https://github.com/spotify/docker-kafka/issues/61] but the 
> repo doesn't seem to be under active development. An alternative is 
> https://github.com/wurstmeister/kafka-docker



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)