Shepherd for this month

2016-09-05 Thread Justin Mclean
Hi,

I’ve been assigned as a shepherd and was talking a look at your web site and 
noticed a couple of minor things you might want to do something about before 
graduation. Of course I don’t know much about the history of this project and 
these may already been looked into or already being dealt with somewhere, so 
apologies if I bring up anything that is known or anything that I’m mistaken 
about.

Looking at the website I think it could do with a little more branding [1] and 
make it clearer that this is an incubating site.[2] There seems to be two 
websites which may be adding to the confusion here [3][4]. I notice [4] is 
better re branding/disclaimer etc etc but [3] comes up a google search first.

The download link on [5] is not using the mirror scripts [6]. The download page 
here [7] includes a binary that is hosted outside of apache [8][10]

Perhaps a redirect from the old site to the new is in order as that would fix 
most of the above?

I also noticed an unanswered question re releases that your mentors could help 
with [9], but it seems (from what I can see from brief look) you only have one 
currently active mentor. Is this correct? Idk so do you think you may need to 
add an additional mentors or prompt existing mentors to see if they still have 
time to mentor?

Thanks,
Justin

PS I’m not subscribed to this list so please CC me on any replies.

1. http://incubator.apache.org/guides/branding.html
2. http://incubator.apache.org/guides/branding.html#disclaimers
3. http://www.gearpump.io/overview.html
4. http://gearpump.incubator.apache.org/overview.html
5. 
https://dist.apache.org/repos/dist/release/incubator/gearpump/0.8.1-incubating/
6. http://www.apache.org/dev/release-download-pages
7. http://www.gearpump.io/downloads.html
8. 
https://github.com/gearpump/gearpump/releases/download/0.8.0/gearpump-2.11-0.8.0.zip
9. 
https://lists.apache.org/thread.html/53c45abd3c188b06068c0d424a5510a33a622e9cc5535075da20d564@%3Cdev.gearpump.apache.org%3E
10. http://www.apache.org/dev/release.html#host-GA

[GitHub] incubator-gearpump issue #79: [GEARPUMP-201] integration test failure

2016-09-05 Thread huafengw
Github user huafengw commented on the issue:

https://github.com/apache/incubator-gearpump/pull/79
  
+1


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-gearpump pull request #79: [GEARPUMP-201] integration test failure

2016-09-05 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/incubator-gearpump/pull/79


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Re: Podling Report Reminder - September 2016

2016-09-05 Thread Vincent Wang
Hi All,

This is the Gearpump podling report for September 2016. Please help to
review.

Gearpump

Gearpump is a reactive real-time streaming engine based on the
micro-service actor model.
Gearpump has been incubating since 2016-03-08.

Three most important issues to address in the move towards graduation:

1. Make initial Apache branded release and release on a regular schedule.
2. Continue to evolve community interest and support.
3. Integrate with Apache Beam and akka-streams frameworks.

- Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware
of?
- None

- How has the community developed since the last report?
- Increased community contribution on integration with Apache Cassandra.

- How has the project developed since the last report?
- We released Apache Gearpump 0.8.1-incubating, which is Gearpump's first
release
as an Apache incubator project.
- Integration within Apache Beam (Gearpump Runner) has been merged into a
feature branch.
- Continued integration within akka-streams (Gearpump Materializer). Three
PRs committed.
- 28 issues created and 18 resolved.

Date of last release:  2016-08-16.

When were the last committers or PMC members elected?  No new committers or
PMC members elected yet.

Signed-off-by:  [ ](gearpump) Andrew Purtell  [ ](gearpump) Jarek
Jarcec Cecho  [ ](gearpump) Reynold Xin  [ ](gearpump) Todd Lipcon  [
](gearpump) Xuefu Zhang

Andrew Purtell 于2016年9月3日周六 上午8:27写道:

> Sounds good, thanks!
>
>
> On Thu, Sep 1, 2016 at 10:47 PM, Vincent Wang  wrote:
>
> > Hi Andrew,
> >
> >  I'd like to take it this time.
> >
> > Thanks,
> > Huafeng
> >
> > 2016-09-02 5:02 GMT+08:00 Andrew Purtell :
> >
> > > Time to report to the Board and IPMC. Do we have a volunteer from the
> > PPMC
> > > to produce the report this time?
> > >
> > > On Tue, Aug 30, 2016 at 3:46 AM,  wrote:
> > >
> > > > Dear podling,
> > > >
> > > > This email was sent by an automated system on behalf of the Apache
> > > > Incubator PMC. It is an initial reminder to give you plenty of time
> to
> > > > prepare your quarterly board report.
> > > >
> > > > The board meeting is scheduled for Wed, 21 September 2016, 10:30 am
> > PDT.
> > > > The report for your podling will form a part of the Incubator PMC
> > > > report. The Incubator PMC requires your report to be submitted 2
> weeks
> > > > before the board meeting, to allow sufficient time for review and
> > > > submission (Wed, September 07).
> > > >
> > > > Please submit your report with sufficient time to allow the Incubator
> > > > PMC, and subsequently board members to review and digest. Again, the
> > > > very latest you should submit your report is 2 weeks prior to the
> board
> > > > meeting.
> > > >
> > > > Thanks,
> > > >
> > > > The Apache Incubator PMC
> > > >
> > > > Submitting your Report
> > > >
> > > > --
> > > >
> > > > Your report should contain the following:
> > > >
> > > > *   Your project name
> > > > *   A brief description of your project, which assumes no knowledge
> of
> > > > the project or necessarily of its field
> > > > *   A list of the three most important issues to address in the move
> > > > towards graduation.
> > > > *   Any issues that the Incubator PMC or ASF Board might wish/need to
> > be
> > > > aware of
> > > > *   How has the community developed since the last report
> > > > *   How has the project developed since the last report.
> > > >
> > > > This should be appended to the Incubator Wiki page at:
> > > >
> > > > http://wiki.apache.org/incubator/September2016
> > > >
> > > > Note: This is manually populated. You may need to wait a little
> before
> > > > this page is created from a template.
> > > >
> > > > Mentors
> > > > ---
> > > >
> > > > Mentors should review reports for their project(s) and sign them off
> on
> > > > the Incubator wiki page. Signing off reports shows that you are
> > > > following the project - projects that are not signed may raise alarms
> > > > for the Incubator PMC.
> > > >
> > > > Incubator PMC
> > > >
> > >
> > >
> > >
> > > --
> > > Best regards,
> > >
> > >- Andy
> > >
> > > Problems worthy of attack prove their worth by hitting back. - Piet
> Hein
> > > (via Tom White)
> > >
> >
>
>
>
> --
> Best regards,
>
>- Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
>


[jira] [Assigned] (GEARPUMP-203) Use DataSourceTask / DataSinkTask for DSL

2016-09-05 Thread Manu Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/GEARPUMP-203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Manu Zhang reassigned GEARPUMP-203:
---

Assignee: Manu Zhang

> Use DataSourceTask / DataSinkTask for DSL 
> --
>
> Key: GEARPUMP-203
> URL: https://issues.apache.org/jira/browse/GEARPUMP-203
> Project: Apache Gearpump
>  Issue Type: Sub-task
>  Components: streaming
>Affects Versions: 0.8.1
>Reporter: Manu Zhang
>Assignee: Manu Zhang
>
> Currently, {{source}} operation in DSL will be translated to {{SourceTask}}  
> allowing for a passed-in operation processing input data while  
> {{DataSourceTask}} is default container running {{DataSource}} API without 
> any processing. {{SinkTask}} and {{DataSinkTask}} are almost identical. We 
> can improve the latter to account for both cases such that we don't keep two 
> sets of implementations. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (GEARPUMP-203) Use DataSourceTask / DataSinkTask for DSL

2016-09-05 Thread Manu Zhang (JIRA)
Manu Zhang created GEARPUMP-203:
---

 Summary: Use DataSourceTask / DataSinkTask for DSL 
 Key: GEARPUMP-203
 URL: https://issues.apache.org/jira/browse/GEARPUMP-203
 Project: Apache Gearpump
  Issue Type: Improvement
  Components: streaming
Affects Versions: 0.8.1
Reporter: Manu Zhang


Currently, {{source}} operation in DSL will be translated to {{SourceTask}}  
allowing for a passed-in operation processing input data while  
{{DataSourceTask}} is default container running {{DataSource}} API without any 
processing. {{SinkTask}} and {{DataSinkTask}} are almost identical. We can 
improve the latter to account for both cases such that we don't keep two sets 
of implementations. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (GEARPUMP-111) optimize Stream DSL broadcasting slave operations

2016-09-05 Thread Manu Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/GEARPUMP-111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Manu Zhang updated GEARPUMP-111:

Issue Type: Sub-task  (was: Improvement)
Parent: GEARPUMP-202

> optimize Stream DSL broadcasting slave operations
> -
>
> Key: GEARPUMP-111
> URL: https://issues.apache.org/jira/browse/GEARPUMP-111
> Project: Apache Gearpump
>  Issue Type: Sub-task
>  Components: streaming
>Reporter: Manu Zhang
>Assignee: Manu Zhang
>Priority: Minor
>
> In Stream DSL, all broadcasting slave operations tailing a master operation 
> will be translated to individual tasks. 
> For example, 
> {code}
> val stream = StreamApp.source(source, 1, "source")
> stream.filter(fn, "filter A")
> stream.filter(fn, "filter B")
> stream.filter(fn, "filter C")
> {code}
> This will be translated to 1 SourceTask and 3 FilterTasks although it's 
> possible for them to be done in 1 Task. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (GEARPUMP-201) integration test failure

2016-09-05 Thread Manu Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/GEARPUMP-201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Manu Zhang resolved GEARPUMP-201.
-
   Resolution: Fixed
Fix Version/s: 0.8.2

Issue resolved by pull request 79
[https://github.com/apache/incubator-gearpump/pull/79]

> integration test failure 
> -
>
> Key: GEARPUMP-201
> URL: https://issues.apache.org/jira/browse/GEARPUMP-201
> Project: Apache Gearpump
>  Issue Type: Bug
>  Components: integrationtest
>Affects Versions: 0.8.1
>Reporter: Manu Zhang
>Assignee: Manu Zhang
> Fix For: 0.8.2
>
>
> caused by 
> https://github.com/apache/incubator-gearpump/commit/a743a9ca6e9bd074c35097cd9602e606a351f46a



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (GEARPUMP-201) integration test failure

2016-09-05 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/GEARPUMP-201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15464354#comment-15464354
 ] 

ASF GitHub Bot commented on GEARPUMP-201:
-

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-gearpump/pull/79


> integration test failure 
> -
>
> Key: GEARPUMP-201
> URL: https://issues.apache.org/jira/browse/GEARPUMP-201
> Project: Apache Gearpump
>  Issue Type: Bug
>  Components: integrationtest
>Affects Versions: 0.8.1
>Reporter: Manu Zhang
>Assignee: Manu Zhang
> Fix For: 0.8.2
>
>
> caused by 
> https://github.com/apache/incubator-gearpump/commit/a743a9ca6e9bd074c35097cd9602e606a351f46a



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (GEARPUMP-107) Stream DSL three-way merge not supported

2016-09-05 Thread Manu Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/GEARPUMP-107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Manu Zhang updated GEARPUMP-107:

Issue Type: Sub-task  (was: Bug)
Parent: GEARPUMP-202

> Stream DSL three-way merge not supported
> 
>
> Key: GEARPUMP-107
> URL: https://issues.apache.org/jira/browse/GEARPUMP-107
> Project: Apache Gearpump
>  Issue Type: Sub-task
>Affects Versions: 0.8.0
>Reporter: Manu Zhang
>Assignee: Manu Zhang
>
> Three-way merge or more-than-three-way merge is decomposed into multiple 
> consecutive two-way merges. The current implementation assumes that a merge 
> will always be tailed by a SingleInputFunction which is not true for 
> consecutive merges. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (GEARPUMP-23) Add DSL window (time series) support

2016-09-05 Thread Manu Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/GEARPUMP-23?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Manu Zhang updated GEARPUMP-23:
---
Issue Type: Sub-task  (was: New Feature)
Parent: GEARPUMP-202

> Add DSL window (time series) support 
> -
>
> Key: GEARPUMP-23
> URL: https://issues.apache.org/jira/browse/GEARPUMP-23
> Project: Apache Gearpump
>  Issue Type: Sub-task
>  Components: streaming
>Affects Versions: 0.8.0
>Reporter: Kam Kasravi
>Assignee: Manu Zhang
>
> Time series support is need for both GEARPUMP-21 and GEARPUMP-22. This was 
> originally github issue  
> [1917|https://github.com/gearpump/gearpump/issues/1917]. Other realtime 
> streaming engines support time windows such as 
> [Flink|https://flink.apache.org/news/2015/12/04/Introducing-windows.html], 
> [Beam|https://www.oreilly.com/ideas/the-world-beyond-batch-streaming-101] and 
> a future release of 
> [Spark|https://issues.apache.org/jira/secure/attachment/12793410/StructuredStreamingProgrammingAbstractionSemanticsandAPIs-ApacheJIRA.pdf].
>  A comparison matrix is found 
> [here|https://docs.google.com/spreadsheets/d/1OM077lZBARrtUi6g0X0O0PHaIbFKCD6v0djRefQRE1I/edit#gid=995660187]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (GEARPUMP-48) Improve Java interoperability

2016-09-05 Thread Manu Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/GEARPUMP-48?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Manu Zhang resolved GEARPUMP-48.

   Resolution: Fixed
Fix Version/s: 0.8.2

> Improve Java interoperability
> -
>
> Key: GEARPUMP-48
> URL: https://issues.apache.org/jira/browse/GEARPUMP-48
> Project: Apache Gearpump
>  Issue Type: Improvement
>  Components: streaming
>Reporter: Manu Zhang
> Fix For: 0.8.2
>
>
> migrated from [https://github.com/gearpump/gearpump/issues/1967] and 
> [https://github.com/gearpump/gearpump/issues/1938]. 
> The current user / developer interface is not friendly to Java users / 
> developers. For example,
> * private[package] in Scala is public in Java
> * List in Scala is constructed like "$colon$colon$.MODULE$.apply"
> * constants of companion objects  in Scala is accessed like 
> "Foo$MODULE$.constant()"
> We should improve the codebase, and probably add some tests to ensure the 
> interoperability for all public interfaces and a guide to follow.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (GEARPUMP-201) integration test failure

2016-09-05 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/GEARPUMP-201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15464298#comment-15464298
 ] 

ASF GitHub Bot commented on GEARPUMP-201:
-

Github user huafengw commented on the issue:

https://github.com/apache/incubator-gearpump/pull/79
  
+1


> integration test failure 
> -
>
> Key: GEARPUMP-201
> URL: https://issues.apache.org/jira/browse/GEARPUMP-201
> Project: Apache Gearpump
>  Issue Type: Bug
>  Components: integrationtest
>Affects Versions: 0.8.1
>Reporter: Manu Zhang
>Assignee: Manu Zhang
>
> caused by 
> https://github.com/apache/incubator-gearpump/commit/a743a9ca6e9bd074c35097cd9602e606a351f46a



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)