Re: [Discuss] Organizing Documentation for Configuration Options

2017-02-07 Thread Ufuk Celebi
I fully agree with you Greg. Since this is doomed to get out of sync again very shortly after clean up, I vote to automate this. Stephan introduced the ConfigOption type, which makes it easy to define the options. It's already planned to migrate all configuration options from ConfigConstants to

[jira] [Created] (FLINK-5729) add hostname option in SocketWindowWordCount example to be more convenient

2017-02-07 Thread Tao Wang (JIRA)
Tao Wang created FLINK-5729: --- Summary: add hostname option in SocketWindowWordCount example to be more convenient Key: FLINK-5729 URL: https://issues.apache.org/jira/browse/FLINK-5729 Project: Flink

RE: [jira] [Created] (FLINK-5656) Add processing time OVER ROWS BETWEEN UNBOUNDED PRECEDING aggregation to SQL

2017-02-07 Thread Stefano Bortoli
Thanks for confirming this. After the email I started working on it and things became more clear already. I will go ahead this way. Dr. Stefano Bortoli Senior Research Engineer - Big Data and Semantic Technology Expert IT R&D Division -Original Message- From: Fabian Hueske [mailto:fhue

[jira] [Created] (FLINK-5730) User can concurrently modify state metadata of RocksDB asynchronous snapshots

2017-02-07 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5730: - Summary: User can concurrently modify state metadata of RocksDB asynchronous snapshots Key: FLINK-5730 URL: https://issues.apache.org/jira/browse/FLINK-5730 Project

Re: [Discuss] Organizing Documentation for Configuration Options

2017-02-07 Thread Robert Metzger
+1 to automate this and describe the config parameters in the code. That's exactly the approach Apache Kafka is taking as well for their config. On Tue, Feb 7, 2017 at 9:04 AM, Ufuk Celebi wrote: > I fully agree with you Greg. > > Since this is doomed to get out of sync again very shortly after

[jira] [Created] (FLINK-5731) Split up CI builds

2017-02-07 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-5731: -- Summary: Split up CI builds Key: FLINK-5731 URL: https://issues.apache.org/jira/browse/FLINK-5731 Project: Flink Issue Type: Improvement Components: Bu

Re: New Flink team member - Kate Eri.

2017-02-07 Thread Katherin Eri
Thank you Theodore, for your reply. 1)Regarding GPU, your point is clear and I agree with it, ND4J looks appropriate. But, my current understanding is that, we also need to cover some resource management questions -> when we need to provide GPU support we also need to manage it like resource.

Re: [Discuss] Organizing Documentation for Configuration Options

2017-02-07 Thread Till Rohrmann
+1 for automating. The more automation the fewer mistakes we can make :-) On Tue, Feb 7, 2017 at 11:13 AM, Robert Metzger wrote: > +1 to automate this and describe the config parameters in the code. > > That's exactly the approach Apache Kafka is taking as well for their > config. > > On Tue, Fe

[jira] [Created] (FLINK-5732) Java quick start mvn command line is incorrect

2017-02-07 Thread Colin Breame (JIRA)
Colin Breame created FLINK-5732: --- Summary: Java quick start mvn command line is incorrect Key: FLINK-5732 URL: https://issues.apache.org/jira/browse/FLINK-5732 Project: Flink Issue Type: Bug

Re: New Flink team member - Kate Eri.

2017-02-07 Thread Till Rohrmann
Thanks for initiating this discussion Katherin. I think you're right that in general it does not make sense to reinvent the wheel over and over again. Especially if you only have limited resources at hand. So if we could integrate Flink with some existing library that would be great. In the past,

[jira] [Created] (FLINK-5733) Link to Bahir connectors

2017-02-07 Thread Greg Hogan (JIRA)
Greg Hogan created FLINK-5733: - Summary: Link to Bahir connectors Key: FLINK-5733 URL: https://issues.apache.org/jira/browse/FLINK-5733 Project: Flink Issue Type: Improvement Components

Re: [Discuss] Organizing Documentation for Configuration Options

2017-02-07 Thread Greg Hogan
+1 and thanks for volunteering for an initial implementation. Looking forward to auto-scaling of network buffers. On Tue, Feb 7, 2017 at 3:04 AM, Ufuk Celebi wrote: > I fully agree with you Greg. > > Since this is doomed to get out of sync again very shortly after clean up, > I vote to automate

[jira] [Created] (FLINK-5734) Implement code generation for NormalizedKeySorter

2017-02-07 Thread Pattarawat Chormai (JIRA)
Pattarawat Chormai created FLINK-5734: - Summary: Implement code generation for NormalizedKeySorter Key: FLINK-5734 URL: https://issues.apache.org/jira/browse/FLINK-5734 Project: Flink Iss

Re: ecosystem proposal, Temporal graph analytics on Flink with Gelly

2017-02-07 Thread Wouter Ligtenberg
I forgot to attach the github page of the project: https://github.com/otherwise777/Temporal_Graph_library Best regards, Wouter Ligtenberg Game designer at Onzichtbaar Developers On Tue, Feb 7, 2017 at 3:41 PM, Wouter Ligtenberg wrote: > Hello, > > For my master thesis i have created Tink, abr

ecosystem proposal, Temporal graph analytics on Flink with Gelly

2017-02-07 Thread Wouter Ligtenberg
Hello, For my master thesis i have created Tink, abrevated for temporal Flink, It's a library that's supposed to work on top of Flink in relation with Gelly to do temporal graph analytics. I've worked on this project for the past 6 months as part of my master thesis at the university of Eindhoven.

Re: New Flink team member - Kate Eri.

2017-02-07 Thread Katherin Eri
Thank you, Till. 1) Regarding ND4J, I didn’t know about such a pity and critical restriction of it -> lack of sparsity optimizations, and you are right: this issue is still actual for them. I saw that Flink uses Breeze, but I thought its usage caused by some historical reasons. 2) Regar

Re: New Flink team member - Kate Eri.

2017-02-07 Thread Felix Neutatz
Hi Katherin, we are also working in a similar direction. We implemented a prototype to integrate with SystemML: https://github.com/apache/incubator-systemml/pull/119 SystemML provides many different matrix formats, operations, GPU support and a couple of DL algorithms. Unfortunately, we realized t

[jira] [Created] (FLINK-5735) Non-overlapping sliding window is not deterministic

2017-02-07 Thread Timo Walther (JIRA)
Timo Walther created FLINK-5735: --- Summary: Non-overlapping sliding window is not deterministic Key: FLINK-5735 URL: https://issues.apache.org/jira/browse/FLINK-5735 Project: Flink Issue Type: B

[jira] [Created] (FLINK-5736) Fix Javadocs / Scaladocs build (Feb 2017)

2017-02-07 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-5736: - Summary: Fix Javadocs / Scaladocs build (Feb 2017) Key: FLINK-5736 URL: https://issues.apache.org/jira/browse/FLINK-5736 Project: Flink Issue Type: Task

RE: Stream SQL and Dynamic tables

2017-02-07 Thread Radu Tudoran
Hi, I made some comments over the Dynamic table document. Not sure how to ask for feedback for them...therefore my email. Please let me know what do you think https://docs.google.com/document/d/1qVVt_16kdaZQ8RTfA_f4konQPW4tnl8THw6rzGUdaqU/edit#heading=h.3eo2vkvydld6 Dr. Radu Tudoran Senior Res

[ANNOUNCE] Welcome Jark Wu and Kostas Kloudas as committers

2017-02-07 Thread Fabian Hueske
Hi everybody, I'm very happy to announce that Jark Wu and Kostas Kloudas accepted the invitation of the Flink PMC to become committers of the Apache Flink project. Jark and Kostas are longtime members of the Flink community. Both are actively driving Flink's development and contributing to its co

Re: [ANNOUNCE] Welcome Jark Wu and Kostas Kloudas as committers

2017-02-07 Thread Haohui Mai
Congratulations! On Tue, Feb 7, 2017 at 12:17 PM Fabian Hueske wrote: > Hi everybody, > > I'm very happy to announce that Jark Wu and Kostas Kloudas accepted the > invitation of the Flink PMC to become committers of the Apache Flink > project. > > Jark and Kostas are longtime members of the Flin

Re: [ANNOUNCE] Welcome Jark Wu and Kostas Kloudas as committers

2017-02-07 Thread Greg Hogan
Welcome Jark and Kostas! Thank you for your contributions and many more to come. On Tue, Feb 7, 2017 at 3:16 PM, Fabian Hueske wrote: > Hi everybody, > > I'm very happy to announce that Jark Wu and Kostas Kloudas accepted the > invitation of the Flink PMC to become committers of the Apache Flink

Re: [ANNOUNCE] Welcome Jark Wu and Kostas Kloudas as committers

2017-02-07 Thread Matthias J. Sax
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Congrats! On 2/7/17 12:55 PM, Haohui Mai wrote: > Congratulations! > > On Tue, Feb 7, 2017 at 12:17 PM Fabian Hueske > wrote: > >> Hi everybody, >> >> I'm very happy to announce that Jark Wu and Kostas Kloudas >> accepted the invitation of the F

FLINK-5734 : Code Generation for NormalizedKeySorter

2017-02-07 Thread Pattarawat Chormai
Hi all, We’re working on FLINK-5734 : Implement code generation for NormalizedKeySorter. We have just finished a design document that describes how we’re going to proceed this implementation. Because this implement will touch several important parts of Flink, so we would appreciate if you coul

Re: [ANNOUNCE] Welcome Jark Wu and Kostas Kloudas as committers

2017-02-07 Thread Zhuoluo Yang
Congrats! Good job guys! Thanks, Zhuoluo 😀 > 在 2017年2月8日,上午4:59,Greg Hogan 写道: > > Welcome Jark and Kostas! Thank you for your contributions and many more to > come. > > On Tue, Feb 7, 2017 at 3:16 PM, Fabian Hueske wrote: > >> Hi everybody, >> >> I'm very happy to announce that Jark W

Re: [ANNOUNCE] Welcome Jark Wu and Kostas Kloudas as committers

2017-02-07 Thread Jinkui Shi
Congratulations, Jark Wu and Kostas Kloudas. > On Feb 8, 2017, at 09:52, Zhuoluo Yang wrote: > > Congrats! Good job guys! > > Thanks, > > Zhuoluo 😀 > > > > > >> 在 2017年2月8日,上午4:59,Greg Hogan > > 写道: >> >> Welcome Jark and Kostas! Thank you for your contribution

Re: [ANNOUNCE] Welcome Jark Wu and Kostas Kloudas as committers

2017-02-07 Thread Longda Feng
@Jark &  @Kostas, Congratulations, good job.More and more guys join the Community. CheersLongda--From:Greg Hogan Send Time:2017年2月8日(星期三) 04:59To:dev Subject:Re: [ANNOUNCE] Welcome Jark Wu and Kostas Kloudas as committers Welcome

[jira] [Created] (FLINK-5737) Let flink table support byte[] field type

2017-02-07 Thread zhangjing (JIRA)
zhangjing created FLINK-5737: Summary: Let flink table support byte[] field type Key: FLINK-5737 URL: https://issues.apache.org/jira/browse/FLINK-5737 Project: Flink Issue Type: Improvement

Re: [ANNOUNCE] Welcome Jark Wu and Kostas Kloudas as committers

2017-02-07 Thread Chen Qin
Congrats! > On Feb 7, 2017, at 17:52, Zhuoluo Yang wrote: > > Congrats! Good job guys! > > Thanks, > > Zhuoluo 😀 > > > > > >> 在 2017年2月8日,上午4:59,Greg Hogan 写道: >> >> Welcome Jark and Kostas! Thank you for your contributions and many more to >> come. >> >>> On Tue, Feb 7, 2017 at 3:16

[jira] [Created] (FLINK-5738) Destroy created backend when task is canceled

2017-02-07 Thread Xiaogang Shi (JIRA)
Xiaogang Shi created FLINK-5738: --- Summary: Destroy created backend when task is canceled Key: FLINK-5738 URL: https://issues.apache.org/jira/browse/FLINK-5738 Project: Flink Issue Type: Bug

Re: [ANNOUNCE] Welcome Jark Wu and Kostas Kloudas as committers

2017-02-07 Thread Shaoxuan Wang
Congratulations, Jark and Kostas! Let's push "flink" moving "forward" rapidly. -Shaoxuan On Wed, Feb 8, 2017 at 4:16 AM, Fabian Hueske wrote: > Hi everybody, > > I'm very happy to announce that Jark Wu and Kostas Kloudas accepted the > invitation of the Flink PMC to become committers of the A

Re: [ANNOUNCE] Welcome Jark Wu and Kostas Kloudas as committers

2017-02-07 Thread 艾广
Congratulations, Jark and Kostas! 2017-02-08 10:53 GMT+08:00 Shaoxuan Wang : > Congratulations, Jark and Kostas! > Let's push "flink" moving "forward" rapidly. > > -Shaoxuan > > > > On Wed, Feb 8, 2017 at 4:16 AM, Fabian Hueske wrote: > > > Hi everybody, > > > > I'm very happy to announce that J

Re: [ANNOUNCE] Welcome Jark Wu and Kostas Kloudas as committers

2017-02-07 Thread Jark Wu
Thank you very much everyone! Hoping to help out the community as much as I can! - Jark > 在 2017年2月8日,上午11:04,艾广 写道: > > Congratulations, Jark and Kostas! > > 2017-02-08 10:53 GMT+08:00 Shaoxuan Wang : > >> Congratulations, Jark and Kostas! >> Let's push "flink" moving "forward" rapidly. >>

Re: [ANNOUNCE] Welcome Jark Wu and Kostas Kloudas as committers

2017-02-07 Thread Tzu-Li (Gordon) Tai
Great news, congratulations! Thank you Jark and Kostas for all your contribution to the Flink community so far, and really looking forward seeing it grow even more in the future with you being aboard :-D Cheers, Gordon On February 8, 2017 at 11:35:08 AM, Jark Wu (wuchong...@alibaba-inc.com) wr