Re: [VOTE] Release Apache Flink 1.3.0 (RC3)

2017-05-30 Thread Robert Metzger
The vote time is over, but I'll keep it open for a bit longer until we've decided regarding Till's issue. On Tue, May 30, 2017 at 6:10 PM, Robert Metzger <rmetz...@apache.org> wrote: > Hi Till, > good catch! That is definitively a severe issue. Probably it didn't > surfa

Re: [VOTE] Release Apache Flink 1.3.0 (RC3)

2017-05-30 Thread Robert Metzger
erified source and binary signatures > > - verified source and binary checksums > > - verified LICENSEs > > - verified NOTICEs > > - built from source > > > > Greg > > > > > > > On May 26, 2017, at 12:58 PM, Robert Metzger <rmetz

[ANNOUNCE] Flink Forward Berlin (11-13 Sep 2017) Call for Submissions is open now

2017-05-30 Thread Robert Metzger
Dear Flink Community, The Call for Submissions for Flink Forward Berlin 2017 is open now! Since we believe in collaboration, participation and exchange of ideas, we are inviting the Flink community to submit a session. Share your knowledge, applications, use cases and best practices and shape

Re: [VOTE] Release Apache Flink 1.3.0 (RC3)

2017-05-30 Thread Robert Metzger
not sure if this is regarded as a blocker, it depends on our > > assumptions about externalized checkpoints. > > > > What do you think? > > > > Cheers, > > Gyula > > > > Robert Metzger <rmetz...@apache.org> ezt írta (időpont: 2017. máj. 29., >

Re: [VOTE] Release Apache Flink 1.3.0 (RC3)

2017-05-29 Thread Robert Metzger
amp; RocksDB > o canceling with savepoint/resuming from savepoint > o without/with rescaling > * SideOutputs work > * Metrics are properly transmitted & displayed in the webUI > > > On 28.05.2017 20:33, Robert Metzger wrote: > >> @Shaoxuan, I don't think missing do

Re: [VOTE] Release Apache Flink 1.3.0 (RC3)

2017-05-28 Thread Robert Metzger
ase 1.3 has many updates on tableAPI and SQL, and the docs are kind >>> of >>> lagging. We are trying the efforts to update the doc as much as possible >>> before the release is officially published, but I am hoping this is not a >>> blocker for the release.

[CANCELLED][VOTE] Release Apache Flink 1.3.0 (RC2)

2017-05-26 Thread Robert Metzger
On Fri, May 26, 2017 at 3:59 PM, Robert Metzger <rmetz...@apache.org> wrote: > Thanks a lot. > > JIRA also shows me 0 open blockers :) > I'll then kick off the RC3 creation process. > > On Fri, May 26, 2017 at 10:50 AM, Tzu-Li (Gordon) Tai <tzuli...@apache.org >

[VOTE] Release Apache Flink 1.3.0 (RC3)

2017-05-26 Thread Robert Metzger
Hi all, this is the second VOTEing release candidate for Flink 1.3.0 The commit to be voted on: 760eea8a (*http://git-wip-us.apache.org/repos/asf/flink/commit/760eea8a *)

Re: [VOTE] Release Apache Flink 1.3.0 (RC2)

2017-05-26 Thread Robert Metzger
Thanks a lot. JIRA also shows me 0 open blockers :) I'll then kick off the RC3 creation process. On Fri, May 26, 2017 at 10:50 AM, Tzu-Li (Gordon) Tai <tzuli...@apache.org> wrote: > The two blockers FLINK-6646 and FLINK-6714 have been merged. > > > On 26 May 2017 at 1:45:55

Re: [VOTE] Release Apache Flink 1.3.0 (RC2)

2017-05-25 Thread Robert Metzger
ncel this RC and create a new one > containing a fix for the problem. Moreover, this is not only a problem of > the session mode but also for the per job cluster mode. Users simply didn't > run into the problem, because apparently their JM recovery didn't take > longer than 60s. > > Ch

Re: [DISCUSS] Release 1.3.0 RC1 (Non voting, testing release candidate)

2017-05-24 Thread Robert Metzger
a switch to disable the user-jar inclusion in the class path, > which > >> isn't working. > >> > >> PR is open, but i wouldn't consider this a release-blocker. > >> https://github.com/apache/flink/pull/3979 > >> > >> On 24.05.2017 15:45,

[VOTE] Release Apache Flink 1.3.0 (RC2)

2017-05-24 Thread Robert Metzger
Hi all, this is the first VOTEing release candidate for Flink 1.3.0 The commit to be voted on: e0a886e9 (*http://git-wip-us.apache.org/repos/asf/flink/commit/e0a886e9 *)

Re: [DISCUSS] Release 1.3.0 RC1 (Non voting, testing release candidate)

2017-05-24 Thread Robert Metzger
t; > Am 23.05.2017 um 21:05 schrieb Chesnay Schepler <ches...@apache.org>: > > > > It appears that rescaling is broken, I've filed > https://issues.apache.org/jira/browse/FLINK-6690 for that. > > > > needless to say, this is a release blocker. > > > >

Re: [DISCUSS] Release 1.3.0 RC1 (Non voting, testing release candidate)

2017-05-23 Thread Robert Metzger
://issues.apache.org/jira/browse/FLINK-6685 which needs addressing first. Let me know if you want me to publish the new RC2. Otherwise, I'll re-do it with the fix included. On Tue, May 23, 2017 at 10:35 AM, Robert Metzger <rmetz...@apache.org> wrote: > I've started building the RC. &

Re: [DISCUSS] Release 1.3.0 RC1 (Non voting, testing release candidate)

2017-05-23 Thread Robert Metzger
I've started building the RC. On Mon, May 22, 2017 at 6:01 PM, Robert Metzger <rmetz...@apache.org> wrote: > Gordon's PR has been merged. I forgot one blocking issue. Till created a > PR for it: https://issues.apache.org/jira/browse/FLINK-6328 > Once travis has passed, I'll

Re: [DISCUSS] Release 1.3.0 RC1 (Non voting, testing release candidate)

2017-05-22 Thread Robert Metzger
Gordon's PR has been merged. I forgot one blocking issue. Till created a PR for it: https://issues.apache.org/jira/browse/FLINK-6328 Once travis has passed, I'll merge that one and then do the RC. On Mon, May 22, 2017 at 10:36 AM, Robert Metzger <rmetz...@apache.org> wrote: > Tha

Re: [DISCUSS] Release 1.3.0 RC1 (Non voting, testing release candidate)

2017-05-22 Thread Robert Metzger
esnay Schepler <ches...@apache.org> > wrote: > > > Whoops, this is the PR for enabling the test: > > https://github.com/apache/flink/pull/3844 > > > > > > On 19.05.2017 12:14, Robert Metzger wrote: > > > >> Thank you for all your input. >

[jira] [Created] (FLINK-6646) YARN session doesn't work with HA

2017-05-19 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-6646: - Summary: YARN session doesn't work with HA Key: FLINK-6646 URL: https://issues.apache.org/jira/browse/FLINK-6646 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-6643) Flink restarts job in HA even if NoRestartStrategy is set

2017-05-19 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-6643: - Summary: Flink restarts job in HA even if NoRestartStrategy is set Key: FLINK-6643 URL: https://issues.apache.org/jira/browse/FLINK-6643 Project: Flink

[jira] [Created] (FLINK-6641) HA recovery on YARN fails due to missing files in HDFS

2017-05-19 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-6641: - Summary: HA recovery on YARN fails due to missing files in HDFS Key: FLINK-6641 URL: https://issues.apache.org/jira/browse/FLINK-6641 Project: Flink Issue

Re: [DISCUSS] Release 1.3.0 RC1 (Non voting, testing release candidate)

2017-05-19 Thread Robert Metzger
art > >>>>>>> Flink's recovery capabilities. > >>>>>>> > >>>>>>> On Thu, May 18, 2017 at 11:13 AM, Chesnay Schepler < > >>>>>>> ches...@apache.org> > >>>>>>> wrote: > &g

Re: [DISCUSS] Reorganize Table API / SQL documentation

2017-05-18 Thread Robert Metzger
Thank you Fabian for working on the proposal. On Thu, May 18, 2017 at 3:51 PM, Fabian Hueske wrote: > Thanks for starting this discussion Robert. > > I think with the next release the Table API / SQL should be moved up in the > Application Development menu. > I also though

[DISCUSS] Reorganize Table API / SQL documentation

2017-05-18 Thread Robert Metzger
Hi, I'm wondering whether we should make the Table API a bit more prominent in our documentation by upgrading it from below "Libraries" to the same level as "DataSet" and "DataStream". This would also allow us to split it from one large page into smaller sub-pages. I think it would be nice to

Re: [DISCUSS] Release 1.3.0 RC1 (Non voting, testing release candidate)

2017-05-18 Thread Robert Metzger
? Otherwise, I would soon create the first voting RC. On Wed, May 17, 2017 at 8:49 PM, Eron Wright <eronwri...@gmail.com> wrote: > Robert, please add FLINK-6606 to the list of JIRAs that you're tracking, > thanks. > > On Tue, May 16, 2017 at 8:30 AM, Robert Metzger <rmetz..

Re: Official Flink Docker images

2017-05-16 Thread Robert Metzger
> On Sun, May 7, 2017 at 3:51 PM, Ismaël Mejía <ieme...@gmail.com> wrote: > > > Sure we would do it. I will sync with Patrick to do this quickly. > > > > > > On May 5, 2017 3:45 PM, "Robert Metzger" <rmetz...@apache.org> wrote: > > >>

Re: [DISCUSS] Release 1.3.0 RC1 (Non voting, testing release candidate)

2017-05-16 Thread Robert Metzger
write a dedicated email to user@ and dev@ :) On Tue, May 16, 2017 at 9:26 AM, Robert Metzger <rmetz...@apache.org> wrote: > Thanks for the pointer. I'll keep an eye on the JIRA. > > I've gone through the JIRAs tagged with 1.3.0 yesterday to create a list > of new features in 1.3

Re: [DISCUSS] Release 1.3.0 RC1 (Non voting, testing release candidate)

2017-05-16 Thread Robert Metzger
ttps://issues.apache.org/jira/browse/FLINK-6537 > > Gyula > > Robert Metzger <rmetz...@apache.org> ezt írta (időpont: 2017. máj. 15., H, > 19:41): > > > Hi Devs, > > > > This is the second non-voting RC. The last RC had some big issues, making > >

[DISCUSS] Release 1.3.0 RC1 (Non voting, testing release candidate)

2017-05-15 Thread Robert Metzger
Hi Devs, This is the second non-voting RC. The last RC had some big issues, making it hard to start Flink locally. I hope this RC proves to be more stable. I hope to create the first voting RC by end of this week. - The

Re: [DISCUSS] Release 1.3.0 RC0 (Non voting, testing release candidate)

2017-05-15 Thread Robert Metzger
obert said), RC0's shading issues make it virtually > unusable... > > On Fri, May 12, 2017 at 3:45 PM, Robert Metzger <rmetz...@apache.org> > wrote: > > > I'm considering to do another non voting RC1 on Monday with the > incremental > > checkpointing and maven fixes

[jira] [Created] (FLINK-6580) Flink on YARN doesnt start with default parameters

2017-05-15 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-6580: - Summary: Flink on YARN doesnt start with default parameters Key: FLINK-6580 URL: https://issues.apache.org/jira/browse/FLINK-6580 Project: Flink Issue

[jira] [Created] (FLINK-6570) QueryableStateClient constructor in documentation doesn't match actual signature

2017-05-12 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-6570: - Summary: QueryableStateClient constructor in documentation doesn't match actual signature Key: FLINK-6570 URL: https://issues.apache.org/jira/browse/FLINK-6570

[jira] [Created] (FLINK-6569) flink-table KafkaJsonTableSource example doesn't work

2017-05-12 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-6569: - Summary: flink-table KafkaJsonTableSource example doesn't work Key: FLINK-6569 URL: https://issues.apache.org/jira/browse/FLINK-6569 Project: Flink Issue

Re: [DISCUSS] Release 1.3.0 RC0 (Non voting, testing release candidate)

2017-05-12 Thread Robert Metzger
ng to give time for additional bug fixes. > > > > On May 11, 2017, at 10:19 AM, Robert Metzger <rmetz...@apache.org> > wrote: > > > > It seems that we found quite a large number of critical issues in the > first > > RC. > > > > - FLINK-6537 Umbrella

[jira] [Created] (FLINK-6568) flink-table doesn't work without flink-streaming-scala dependency

2017-05-12 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-6568: - Summary: flink-table doesn't work without flink-streaming-scala dependency Key: FLINK-6568 URL: https://issues.apache.org/jira/browse/FLINK-6568 Project: Flink

Re: [DISCUSS] Release 1.3.0 RC0 (Non voting, testing release candidate)

2017-05-11 Thread Robert Metzger
> >> following > > > > >>>>> error: > > > > >>>>>> java.lang.NoClassDefFoundError: Could not initialize class > > > > >>>>>> org.apache.hadoop.security.UserGroupInformation > > > > >>>>>&

Re: [DISCUSS] Release 1.3.0 RC0 (Non voting, testing release candidate)

2017-05-09 Thread Robert Metzger
gt;> notice files of the dependencies we include in the shaded jars. > >>>>> => Not a problem for Guava (Apache Licensed) > >>>>> => I think is a problem for ASM (redistribution in binary form, > >>>>> hence needs a notice

[DISCUSS] Release 1.3.0 RC0 (Non voting, testing release candidate)

2017-05-08 Thread Robert Metzger
Hi Devs, I've created a first non-voting release candidate for Flink 1.3.0. Please use this RC to test as much as you can and provide feedback to the Flink community. The more we find and fix now, the better Flink 1.3.0 wil be :) I've CC'ed the user@ mailing list to get more people to test it.

Re: [DISCUSS] Feature Freeze

2017-05-08 Thread Robert Metzger
. On Mon, May 8, 2017 at 9:56 AM, Kostas Kloudas <k.klou...@data-artisans.com> wrote: > Hi Robert, > > Thanks for starting the process! > > My only remark is that given that the master is unstable, does it make > sense to create an RC0? > > Kostas > > > On May 8,

Re: [DISCUSS] Feature Freeze

2017-05-08 Thread Robert Metzger
Great! It also looks like the other big features made it also into master this weekend. I'll now create the feature branch and create the testing RC0. On Sat, May 6, 2017 at 12:04 PM, Fabian Hueske wrote: > I merged the last to major features for the Table API / SQL (time >

Re: Official Flink Docker images

2017-05-05 Thread Robert Metzger
Thanks a lot for your efforts! Maybe we can even put a small blog post on the Flink post once its available on docker hub. On Fri, Apr 28, 2017 at 11:00 AM, Ismaël Mejía wrote: > Hello, > > I am absolutely happy to see that this is finally happening! > We have a really neat

Re: [DISCUSS] Feature Freeze

2017-05-05 Thread Robert Metzger
) > > Best regards, > > -Original Message- > From: Robert Metzger [mailto:rmetz...@apache.org] > Sent: Friday, May 05, 2017 10:43 AM > To: dev@flink.apache.org > Subject: Re: [DISCUSS] Feature Freeze > > I've checked the release status again, and it seems th

Re: [DISCUSS] Feature Freeze

2017-05-05 Thread Robert Metzger
hat I want to add in the features to be added for 1.3 > >> is the NOT pattern for the CEP library. > >> > >> There is an open PR here: https://github.com/apache/flink/pull/3798 < > >> https://github.com/apache/flink/pull/3798> > >> which is not far

Re: [DISCUSS] What is a "Blocker" in our JIRA?

2017-05-05 Thread Robert Metzger
nly to motivate devs to take care of them. > >> > >> There are important parts of Flink which are not (sufficiently or at > all) > >> documented > >> and this can result in confusion / load in the mailing list / wrong user > >> assumptions. > &g

[DISCUSS] What is a "Blocker" in our JIRA?

2017-05-04 Thread Robert Metzger
Hi Flink Devs, while checking our JIRA for the 1.3 release, I found that some issues of type "New Feature" have the priority "Blocker". With the time-based release model, I don't think its possible to mark a new feature as a blocker. Only a bug that leads to wrong results, system failure or

Re: [DISCUSS] Feature Freeze

2017-05-02 Thread Robert Metzger
FLINK-6335, > > >>>> FLINK-6373 > > >>>>>>>> * StreamTableSink for JDBC and Cassandra: FLINK-6281, FLINK-6225 > > >>>>>>>> * Decoupling Flink and Hadoop: FLINK-5998 > > >>>>>>>> > > >>

Re: [RESULT] [VOTE] Release Apache Flink 1.2.1 (RC2)

2017-04-25 Thread Robert Metzger
Good point. I've included it into the pull request. On Tue, Apr 25, 2017 at 11:16 AM, Ted Yu <yuzhih...@gmail.com> wrote: > Should FLINK-6353 <https://issues.apache.org/jira/browse/FLINK-6353> be > mentioned in the announcement ? > > Cheers > > On Tue, Apr 25, 2

Re: [RESULT] [VOTE] Release Apache Flink 1.2.1 (RC2)

2017-04-25 Thread Robert Metzger
I've uploaded the artifacts to the apache mirrors and released the maven stuff to central. While the artifacts are syncing, please review the release announcement: https://github.com/apache/flink-web/pull/54 On Tue, Apr 25, 2017 at 10:29 AM, Robert Metzger <rmetz...@apache.org> wrote:

[RESULT] [VOTE] Release Apache Flink 1.2.1 (RC2)

2017-04-25 Thread Robert Metzger
>> > >> On Mon, Apr 24, 2017 at 8:12 AM, Aljoscha Krettek <aljos...@apache.org> > >> wrote: > >> > >>> It means that users cannot restore from 1.2.0 to 1.2.0, 1.2.0 to > 1.2.1, or > >>> 1.2.1 to 1.2.1. However, this only happens wh

Re: [VOTE] Release Apache Flink 1.2.1 (RC2)

2017-04-23 Thread Robert Metzger
good > > Signature files look good > > Hash files look good > > No 3rd party exes in source artifact > > Source compiled and pass tests > > Local run work > > Run simple job on YARN > > > > +1 > > > > - Henry > > > > On Wed, Apr

Re: [DISCUSS] Planning Release 1.3

2017-04-21 Thread Robert Metzger
Quick reminder: *The feature freeze is 1 week from now (May 1)* On Mon, Mar 6, 2017 at 1:03 PM, Stephan Ewen <se...@apache.org> wrote: > Looks good to me! > > > On Mon, Mar 6, 2017 at 10:55 AM, Robert Metzger <rmetz...@apache.org> > wrote: > > > That's the

[VOTE] Release Apache Flink 1.2.1 (RC2)

2017-04-12 Thread Robert Metzger
Dear Flink community, Please vote on releasing the following candidate as Apache Flink version 1.2 .1. The commit to be voted on: 76eba4e0 (*http://git-wip-us.apache.org/repos/asf/flink/commit/76eba4e0

Re: [VOTE] Release Apache Flink 1.2.1 (RC1)

2017-04-10 Thread Robert Metzger
I've now started building the next release candidate. On Sun, Apr 9, 2017 at 12:37 PM, Robert Metzger <rmetz...@apache.org> wrote: > Hi Gyula, > > I'm trying to push Stefan R. to get the RocksDB fixes in asap. > > On Sat, Apr 8, 2017 at 5:17 PM, Gyula Fóra <gyula.f...@g

Re: [VOTE] Release Apache Flink 1.2.1 (RC1)

2017-04-09 Thread Robert Metzger
cant > > >>> > > >>> performance problem with append operations. I think this should > > >>> definitely > > >>> be part of the 1.2.1 release because this is already blocking some > > users. > > >>> What is missing is uploading th

Re: [VOTE] Release Apache Flink 1.2.1 (RC1)

2017-04-04 Thread Robert Metzger
gt; bugs: > >>>>>> - https://issues.apache.org/jira/browse/FLINK-6188: Some > >>>>>> setParallelism() methods can't cope with default parallelism > >>>>>> - https://issues.apache.org/jira/browse/FLINK-6209: > >>>>>>

Re: [VOTE] Release Apache Flink 1.2.1 (RC1)

2017-03-31 Thread Robert Metzger
2]https://issues.apache.org/jira/browse/FLINK-6188 > > On Fri, Mar 31, 2017, at 19:10, Robert Metzger wrote: > > I think reverting FLINK-6188 for the 1.2 branch might be a good idea. > > FLINK-6188 introduced two new bugs, so undoing the FLINK-6188 fix will > > lead > >

Re: [DISCUSS] Project build time and possible restructuring

2017-03-31 Thread Robert Metzger
; Greg > > > > On Mar 31, 2017, at 9:12 AM, Robert Metzger <rmetz...@apache.org> wrote: > > > > Good news :) > > A few weeks ago, I got an email from travis asking for feedback. I filled > > out the form and said, that the 50 minutes build time limit is a &g

Re: [VOTE] Release Apache Flink 1.2.1 (RC1)

2017-03-31 Thread Robert Metzger
e: > >> > > A user reported that all tumbling and slinding window assigners > >> contain > >> > > a pretty obvious bug about offsets. > >> > > > >> > > https://issues.apache.org/jira/browse/FLINK-6214 > >> > > >

Re: [DISCUSS] Project build time and possible restructuring

2017-03-31 Thread Robert Metzger
ot; to 120 minutes. Also, we can set the settings to use the "sudo enabled infrastructure", with 7.5 Gb of main memory guaranteed. I'll do a push to a separate branch to see how well it works :) On Tue, Mar 28, 2017 at 4:36 PM, Robert Metzger <rmetz...@apache.org> wrote: > I th

Re: [VOTE] Release Apache Flink 1.2.1 (RC1)

2017-03-29 Thread Robert Metzger
> > https://issues.apache.org/jira/browse/FLINK-6188 > > >>> > > >>> I think that’s blocking for 1.2.1. > > >>> > > >>>> On 24 Mar 2017, at 18:57, Ufuk Celebi <u...@apache.org> wrote: > > >>>> > > >>

Re: [DISCUSS] Project build time and possible restructuring

2017-03-28 Thread Robert Metzger
ghogan/f38a8efe6b6dd5a162a6b43335ac4897 < >>>> https://gist.github.com/greghogan/f38a8efe6b6dd5a162a6b43335ac4897> >>>> >>>> Accounting for the merging of the batch and streaming connector modules, >>>> and assuming that the project structu

[CANCEL][VOTE] Release Apache Flink 1.2.1 (RC1)

2017-03-27 Thread Robert Metzger
7, at 18:57, Ufuk Celebi <u...@apache.org> wrote: >>>>> >>>>> RC1 doesn't contain Stefan's backport for the Asynchronous snapshots >>>>> for heap-based keyed state that has been merged. Should we create RC2 >>>>> with that fix si

[ANNOUNCE] Flink Forward San Francisco 10-11 Apr 2017 community discount codes

2017-03-24 Thread Robert Metzger
Dear Flink community, I would like to bring Flink Forward San Francisco to your attention. After hosting Flink Forward for two years in Berlin, Germany, we decided to bring it to the US west coast as well. Check out this very nice video summary from last year's conference in Berlin:

[VOTE] Release Apache Flink 1.2.1 (RC1)

2017-03-24 Thread Robert Metzger
Dear Flink community, Please vote on releasing the following candidate as Apache Flink version 1.2 .1. The commit to be voted on: *732e55bd* (*http://git-wip-us.apache.org/repos/asf/flink/commit/732e55bd *) Branch: release-1.2.1-rc1

Re: [DISCUSS] Release Flink 1.1.5 / Flink 1.2.1

2017-03-24 Thread Robert Metzger
n > start voting for 1.2.1 tomorrow. > > Also, we’re still lacking a release manager for 1.2.1. Is anyone > interested in volunteering for this release? > If nobody steps up for it before tomorrow, I can also do it. > > Cheers, > Gordon > > On March 18, 2017 at 12:52:4

[jira] [Created] (FLINK-6181) Zookeeper scripts use invalid regex

2017-03-24 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-6181: - Summary: Zookeeper scripts use invalid regex Key: FLINK-6181 URL: https://issues.apache.org/jira/browse/FLINK-6181 Project: Flink Issue Type: Bug

Re: Flink AUR package is available

2017-03-23 Thread Robert Metzger
Amazing, thanks a lot! On Thu, Mar 23, 2017 at 10:36 AM, Tao Meng wrote: > Hi all, > > For arch linux users, I have created flink AUR package. > We can use the package manager to install flink and use the systemd > manager flink as service. > If you have any questions or

Re: [POLL] Who still uses Java 7 with Flink ?

2017-03-23 Thread Robert Metzger
intain and patch current, old-tech > compatible version at a reasonably limited scope. Building backward > compatibility is too much for an open sourced project > > > > On Wed, Mar 15, 2017 at 7:10 AM, Robert Metzger <rmetz...@apache.org> > wrote: > >> I'v

Re: [VOTE] Release Apache Flink 1.1.5 (RC1)

2017-03-21 Thread Robert Metzger
+1 - start-local.sh + some example jobs work (logs are fine, web interface works, scripts are fine) - files in the staging repo look good (quickstart is correct) (except java8 module is missing, but see comment below) Side note: The flink-java8 module is not in the staging repository. I first

[ANNOUNCE] New committer: Theodore Vasiloudis

2017-03-21 Thread Robert Metzger
Hi everybody, On behalf of the PMC I am delighted to announce Theodore Vasiloudis as a new Flink committer! Theo has been a community member for a very long time and he is one of the main drivers of the currently ongoing ML discussions in Flink. Welcome Theo and congratulations again for

Re: [DISCUSS] Project build time and possible restructuring

2017-03-20 Thread Robert Metzger
ck anymore. Of course this would not solve > all problems but many of it. > > What do you think about this? > > > > Am 20/03/17 um 14:02 schrieb Robert Metzger: > > Aljoscha, do you know how to configure jenkins? >> Is Apache INFRA doing that, or are the beam peopl

Re: [DISCUSS] Project build time and possible restructuring

2017-03-20 Thread Robert Metzger
tUnstableBuild/ <https://builds.apache.org/job >> /beam_PostCommit_Java_RunnableOnService_Flink/lastUnstableBuild/>. There >> you can see which tests failed and you can easily drill down. >> >> Best, >> Aljoscha >> >> On 20 Mar 2017, at 11:46, Robert Metzge

Re: [DISCUSS] Project build time and possible restructuring

2017-03-20 Thread Robert Metzger
> > 155 of 1607 commits were mixed > > > > since "2016-01-01" > > 272 of 2561 commits were mixed > > > > Greg > > > > > > > On Mar 15, 2017, at 1:13 PM, Stephan Ewen <se...@apache.org> wrote: > > > > > > @Ro

[jira] [Created] (FLINK-6125) Commons httpclient is not shaded anymore in Flink 1.2

2017-03-20 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-6125: - Summary: Commons httpclient is not shaded anymore in Flink 1.2 Key: FLINK-6125 URL: https://issues.apache.org/jira/browse/FLINK-6125 Project: Flink Issue

Re: Bumping API stability check version

2017-03-17 Thread Robert Metzger
rridden > > Do you think these configuration changes can be scripted as part of the > release process? > > Greg > > > > On Mar 16, 2017, at 12:29 PM, Robert Metzger <rmetz...@apache.org> > wrote: > > > > Hi Greg, > > > > I was not able to

Re: [DISCUSS] Could we Improve tests time and stability?

2017-03-17 Thread Robert Metzger
-- > Total 26187 sec |23726 sec > -- > Acceleration|9.40% > > I think almost 10% is good enough. > > -Original Message- > From: Robert Metzger [mailto:rmetz...@apache.org] &

Re: [DISCUSS] Release Flink 1.1.5 / Flink 1.2.1

2017-03-16 Thread Robert Metzger
The cassandra connector is probably not usable in Flink 1.2.0. I would like to include a fix in 1.2.1: https://issues.apache.org/jira/browse/FLINK-6084 Please let me know if this fix becomes a blocker for the 1.2.1 release. If so, I can validate the fix myself to speed up things. On Thu, Mar 16,

[jira] [Created] (FLINK-6084) Cassandra connector does not declare all dependencies

2017-03-16 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-6084: - Summary: Cassandra connector does not declare all dependencies Key: FLINK-6084 URL: https://issues.apache.org/jira/browse/FLINK-6084 Project: Flink Issue

Re: Bumping API stability check version

2017-03-16 Thread Robert Metzger
Hi Greg, I was not able to update the version to 1.2.0 when updating to 1.3-SNAPSHOT, because 1.2.0 was not released at that point in time :) But I agree that we should update that version once the release is out. I forgot to do it. I'm not sure if I completely understand

Re: [DISCUSS] Could we Improve tests time and stability?

2017-03-16 Thread Robert Metzger
Hi Dmytro, I'm happy to hear that you are trying to help us improving the test time situation :) We have another discussion here on the dev@ list to split the project into two git repositories to resolve the problem. I agree that your proposed changes could improve the build times, but I'm not

[jira] [Created] (FLINK-6065) Make TransportClient for ES5 pluggable

2017-03-15 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-6065: - Summary: Make TransportClient for ES5 pluggable Key: FLINK-6065 URL: https://issues.apache.org/jira/browse/FLINK-6065 Project: Flink Issue Type

Re: [DISCUSS] Project build time and possible restructuring

2017-03-15 Thread Robert Metzger
uild flink-core twice after having > it built as a dependency for flink-libraries? This seems wrong to me. > > Cheers, > Till > > On Wed, Mar 15, 2017 at 4:23 PM, Robert Metzger <rmetz...@apache.org> > wrote: > > > Thank you. Running on AWS is a good idea! >

Re: [DISCUSS] Project build time and possible restructuring

2017-03-15 Thread Robert Metzger
on Travis. > > Should we maintain separate repos for flink-contrib and flink-libraries? > Are you intending that we move flink-table out of flink-libraries (and > perhaps flink-statebackend-rocksdb out of flink-contrib)? > > Greg > > > > On Mar 15, 2017, at 9:55 AM,

Re: [POLL] Who still uses Java 7 with Flink ?

2017-03-15 Thread Robert Metzger
I've put it also on our Twitter account: https://twitter.com/ApacheFlink/status/842015062667755521 On Wed, Mar 15, 2017 at 2:19 PM, Martin Neumann wrote: > I think this easier done in a straw poll than in an email conversation. > I created one at:

Re: [DISCUSS] Project build time and possible restructuring

2017-03-15 Thread Robert Metzger
ally easier for libraries to get actively developed. The main > > > concern is setting up the build infrastructure to aggregate docs from > > > multiple repositories and making them publicly available. > > > > > > Since I started this thread and I would really

Re: [DISCUSS] Official policy for release maintenance

2017-03-14 Thread Robert Metzger
d it to the FAQ > and link from the downloads page or the other way around? I don't know > what's better. > > > On Tue, Mar 14, 2017 at 2:52 PM, Robert Metzger <rmetz...@apache.org> > wrote: > > I'll update the Wikipedia article and include the details into our wiki.

Re: [DISCUSS] Official policy for release maintenance

2017-03-14 Thread Robert Metzger
I'll update the Wikipedia article and include the details into our wiki. In addition, what do you think about adding the "update guarantees" on the download or FAQ page? On Tue, Mar 14, 2017 at 1:18 PM, Ufuk Celebi wrote: > Hey Ismael, > > thanks for bringing this up. I think

Re: Frontend classpath issue

2017-03-13 Thread Robert Metzger
t as a default, otherwise I am in favor of reverting to the 1.1 > default. (My logic is that the user will only observe a difference in > behavior when the new setup actually causes problems) > > Gyula > > On Fri, Feb 24, 2017, 17:53 Robert Metzger <rmetz...@apache.org> wrote

[jira] [Created] (FLINK-6031) Add parameter for per job yarn clusters to control whether the user code jar is included into the system classloader.

2017-03-13 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-6031: - Summary: Add parameter for per job yarn clusters to control whether the user code jar is included into the system classloader. Key: FLINK-6031 URL: https://issues.apache.org

[jira] [Created] (FLINK-6022) Improve support for Avro GenericRecord

2017-03-10 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-6022: - Summary: Improve support for Avro GenericRecord Key: FLINK-6022 URL: https://issues.apache.org/jira/browse/FLINK-6022 Project: Flink Issue Type

[jira] [Created] (FLINK-5998) Un-fat Hadoop from Flink fat jar

2017-03-08 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-5998: - Summary: Un-fat Hadoop from Flink fat jar Key: FLINK-5998 URL: https://issues.apache.org/jira/browse/FLINK-5998 Project: Flink Issue Type: Improvement

Re: [DISCUSS] Planning Release 1.3

2017-03-06 Thread Robert Metzger
*Release date*: 26 May 2017 On Mon, Feb 13, 2017 at 6:03 PM, Aljoscha Krettek <aljos...@apache.org> wrote: > +1, we can do it this time! :-) > > On Mon, 6 Feb 2017 at 20:19 Robert Metzger <rmetz...@apache.org> wrote: > > > Hi, > > according to our recent time-

Re: [DISCUSS] Side Outputs and Split/Select

2017-03-02 Thread Robert Metzger
WindowedStream.java > > > > We would need this for the "lateStream()" API without the explicit > > OutputTag. > > > > It seems the backwards compatibility checker doesn't like this and > > complains about breaking binary backwards compatibilit

Re: Frontend classpath issue

2017-02-24 Thread Robert Metzger
d add a flag for adding the user jar to all > the classpaths. > > On Fri, 24 Feb 2017 at 14:50 Robert Metzger <rmetz...@apache.org> wrote: > >> I agree with you Gyula, this change is dangerous. I have seen another case >> from a user with Hadoop dependencies that crashed in F

Re: [DISCUSS] Project build time and possible restructuring

2017-02-24 Thread Robert Metzger
@Jin Mingjian: You can not use the paid travis version for open source projects. It only works for private repositories (at least back then when we've asked them about that). @Stephan: I don't think that incremental builds will be available with Maven anytime soon. I agree that we need to fix

Re: Frontend classpath issue

2017-02-24 Thread Robert Metzger
I agree with you Gyula, this change is dangerous. I have seen another case from a user with Hadoop dependencies that crashed in Flink 1.2.0 that didn't in 1.1.x I wonder if we should introduce a config flag for Flink 1.2.1 to disable the behavior if needed. On Fri, Feb 24, 2017 at 2:27 PM, Ufuk

Re: Redis sink in Flink 2.0

2017-02-24 Thread Robert Metzger
We'll link to the Bahir-flink connectors once Bahir has done a release and published documentation for the connectors there. On Fri, Feb 24, 2017 at 1:28 PM, Stephan Ewen wrote: > I think the main difference is that Bahir Releases go against stable Flink > releases, which

[jira] [Created] (FLINK-5875) Use TypeComparator.hash instead of Object.hashCode() for keying in DataStream API

2017-02-21 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-5875: - Summary: Use TypeComparator.hash instead of Object.hashCode() for keying in DataStream API Key: FLINK-5875 URL: https://issues.apache.org/jira/browse/FLINK-5875

[jira] [Created] (FLINK-5874) Reject arrays as keys in DataStream API to avoid inconsistent hashing

2017-02-21 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-5874: - Summary: Reject arrays as keys in DataStream API to avoid inconsistent hashing Key: FLINK-5874 URL: https://issues.apache.org/jira/browse/FLINK-5874 Project: Flink

Re: [ANNOUNCE] Welcome Jark Wu and Kostas Kloudas as committers

2017-02-08 Thread Robert Metzger
Welcome on board guys! If you want to try our your new privileges, you can add yourself here: http://flink.apache.org/community.html#people (through the apache/flink-web repo) On Wed, Feb 8, 2017 at 10:52 AM, Till Rohrmann wrote: > Congratulations Jark and Kostas :-) > >

[jira] [Created] (FLINK-5736) Fix Javadocs / Scaladocs build (Feb 2017)

2017-02-07 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-5736: - Summary: Fix Javadocs / Scaladocs build (Feb 2017) Key: FLINK-5736 URL: https://issues.apache.org/jira/browse/FLINK-5736 Project: Flink Issue Type: Task

<    5   6   7   8   9   10   11   12   13   14   >