[jira] [Created] (FLINK-16373) EmbeddedLeaderService: IllegalStateException: The RPC connection is already closed

2020-03-02 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-16373: -- Summary: EmbeddedLeaderService: IllegalStateException: The RPC connection is already closed Key: FLINK-16373 URL: https://issues.apache.org/jira/browse/FLINK-16373

[jira] [Created] (FLINK-16370) YARNHighAvailabilityITCase fails on JDK11 nightly test: NoSuchMethodError: org.apache.flink.shaded.zookeeper3.org.apache.zookeeper.server.quorum.flexible.QuorumMaj

2020-03-02 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-16370: -- Summary: YARNHighAvailabilityITCase fails on JDK11 nightly test: NoSuchMethodError: org.apache.flink.shaded.zookeeper3.org.apache.zookeeper.server.quorum.flexible.QuorumMaj Key: FLINK-16370

Re: [DISCUSS] Migrate build infrastructure from Travis CI to Azure Pipelines

2020-02-28 Thread Robert Metzger
3D+%22Build+System+%2F+Azure+Pipelines%22> " component. On Mon, Feb 17, 2020 at 12:23 PM Robert Metzger wrote: > @Leonard: On Azure, I'm not splitting the execution of the end to end > tests anymore. We won't have the overhead of compiling the same profile > multiple times

[jira] [Created] (FLINK-16330) Set up environment variables for the S3 tests in Azure

2020-02-28 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-16330: -- Summary: Set up environment variables for the S3 tests in Azure Key: FLINK-16330 URL: https://issues.apache.org/jira/browse/FLINK-16330 Project: Flink

[jira] [Created] (FLINK-16329) Set up build notifications from AZP to builds@f.a.o

2020-02-28 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-16329: -- Summary: Set up build notifications from AZP to builds@f.a.o Key: FLINK-16329 URL: https://issues.apache.org/jira/browse/FLINK-16329 Project: Flink

[jira] [Created] (FLINK-16313) flink-state-processor-api: surefire execution unstable on Azure

2020-02-27 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-16313: -- Summary: flink-state-processor-api: surefire execution unstable on Azure Key: FLINK-16313 URL: https://issues.apache.org/jira/browse/FLINK-16313 Project: Flink

[jira] [Created] (FLINK-16292) Execute all end to end tests on AZP

2020-02-26 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-16292: -- Summary: Execute all end to end tests on AZP Key: FLINK-16292 URL: https://issues.apache.org/jira/browse/FLINK-16292 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-16283) NullPointerException in GroupAggProcessFunction

2020-02-25 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-16283: -- Summary: NullPointerException in GroupAggProcessFunction Key: FLINK-16283 URL: https://issues.apache.org/jira/browse/FLINK-16283 Project: Flink Issue

[jira] [Created] (FLINK-16265) TPC-H end-to-end test (Blink Planner): Encodings that differ from the schema are not supported yet for CsvTableSources.

2020-02-24 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-16265: -- Summary: TPC-H end-to-end test (Blink Planner): Encodings that differ from the schema are not supported yet for CsvTableSources. Key: FLINK-16265 URL: https

[jira] [Created] (FLINK-16264) SQLClientKafkaITCase fails with: Could not map the schema field 'rowtime' to a field from source.

2020-02-24 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-16264: -- Summary: SQLClientKafkaITCase fails with: Could not map the schema field 'rowtime' to a field from source. Key: FLINK-16264 URL: https://issues.apache.org/jira/browse/FLINK

[jira] [Created] (FLINK-16263) BaseRowArrowReaderWriterTest/RowArrowReaderWriterTest sun.misc.Unsafe or java.nio.DirectByteBuffer.(long, int) not available

2020-02-24 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-16263: -- Summary: BaseRowArrowReaderWriterTest/RowArrowReaderWriterTest sun.misc.Unsafe or java.nio.DirectByteBuffer.(long, int) not available Key: FLINK-16263 URL: https

[jira] [Created] (FLINK-16256) HiveTableSourceTest / TableEnvHiveConnectorTest are failing on optimizer plan validation

2020-02-24 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-16256: -- Summary: HiveTableSourceTest / TableEnvHiveConnectorTest are failing on optimizer plan validation Key: FLINK-16256 URL: https://issues.apache.org/jira/browse/FLINK-16256

[jira] [Created] (FLINK-16228) test_mesos_wordcount.sh fails

2020-02-21 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-16228: -- Summary: test_mesos_wordcount.sh fails Key: FLINK-16228 URL: https://issues.apache.org/jira/browse/FLINK-16228 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-16227) Streaming bucketing end-to-end test / test_streaming_bucketing.sh unstable

2020-02-21 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-16227: -- Summary: Streaming bucketing end-to-end test / test_streaming_bucketing.sh unstable Key: FLINK-16227 URL: https://issues.apache.org/jira/browse/FLINK-16227

Re: [DISCUSS] Drop connectors for Elasticsearch 2.x and 5.x

2020-02-20 Thread Robert Metzger
; > > > On 18/02/2020 13:03, Aljoscha Krettek wrote: > > > Wouldn't removing the ES 2.x connector be enough because we can then > > > update the ES 5.x connector? It seems there are some users that still > > > want to use that one. > > > > > > Best

Re: Hotfixes on the master

2020-02-19 Thread Robert Metzger
ts use > parts of the hotfix commits, then it makes the cherry-picking more tricky > and the commits should have the JIRA issue tag. But I would be fine with > trying it out. > > Cheers, > Till > > On Mon, Feb 17, 2020 at 3:56 PM Robert Metzger > wrote: > > > Hi a

[jira] [Created] (FLINK-16136) YarnPrioritySchedulingITCase.yarnApplication_submissionWithPriority_shouldRespectPriority() fails

2020-02-18 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-16136: -- Summary: YarnPrioritySchedulingITCase.yarnApplication_submissionWithPriority_shouldRespectPriority() fails Key: FLINK-16136 URL: https://issues.apache.org/jira/browse/FLINK

Re: [DISCUSS] Drop connectors for Elasticsearch 2.x and 5.x

2020-02-18 Thread Robert Metzger
The ES5 connector is causing some problems on the CI system. It would be nice if we could make a decision here soon. I don't want to invest time into fixing it, if we are going to remove it. I'm still in favor of removing it. If we see that there's demand for the 5.x connector after the 1.11

Re: [DISCUSS] Remove transfer.sh from CI setup

2020-02-17 Thread Robert Metzger
Tracking this here: https://issues.apache.org/jira/browse/FLINK-16122 On Sat, Feb 15, 2020 at 8:12 PM Robert Metzger wrote: > I agree that we need to fix this. > > We could either misuse the "build artifact" feature of azure pipelines to > publish the logs, or we s

[jira] [Created] (FLINK-16122) build system: transfer.sh uploads are unstable (February 2020)

2020-02-17 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-16122: -- Summary: build system: transfer.sh uploads are unstable (February 2020) Key: FLINK-16122 URL: https://issues.apache.org/jira/browse/FLINK-16122 Project: Flink

Re: Hotfixes on the master

2020-02-17 Thread Robert Metzger
provided in the commit > > message? > > > > Counting hotfixes by contributor, the top of the list looks as I would > > expect. > > > > Greg > > > > Note: this summary is rather naive and includes non-squashed hotfix > commits > > included in a

Re: [DISCUSS] Migrate build infrastructure from Travis CI to Azure Pipelines

2020-02-17 Thread Robert Metzger
bring up this topic. The 2 ARM machines(16cores) which I > >> donated is just for POC test. We(Huawei) can donate more once moving to > >> official Azure pipeline. :) > >> > >> Robert Metzger 于2019年12月6日周五 上午3:25写道: > >> > >>> Thanks for your

Re: [DISCUSS] Remove transfer.sh from CI setup

2020-02-15 Thread Robert Metzger
I agree that we need to fix this. We could either misuse the "build artifact" feature of azure pipelines to publish the logs, or we set up something simple for Flink (like running an instance of https://github.com/lachs0r/0x0 or https://github.com/dutchcoders/transfer.sh :) ) On Fri, Feb 14,

Re: [VOTE] Release flink-shaded 10.0, release candidate #3

2020-02-14 Thread Robert Metzger
+1 (binding) - Checked some artifacts in the staging repo - checked license documentation - source release is binary free On Fri, Feb 14, 2020 at 8:01 AM Dian Fu wrote: > +1 (non-binding) > > - Verified the signature and checksum > - Checked the release note that all the tickets included in

[jira] [Created] (FLINK-16018) Improve error reporting when submitting batch job (instead of AskTimeoutException)

2020-02-12 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-16018: -- Summary: Improve error reporting when submitting batch job (instead of AskTimeoutException) Key: FLINK-16018 URL: https://issues.apache.org/jira/browse/FLINK-16018

Re: [DISCUSS] Drop connectors for Elasticsearch 2.x and 5.x

2020-02-10 Thread Robert Metzger
Thanks for starting this discussion! +1 to drop both On Mon, Feb 10, 2020 at 2:45 PM Dawid Wysakowicz wrote: > Hi all, > > As described in this https://issues.apache.org/jira/browse/FLINK-11720 > ticket our elasticsearch 5.x connector does not work out of the box on > some systems and requires

[jira] [Created] (FLINK-15903) Make REST port configurable in end to end test scripts

2020-02-04 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-15903: -- Summary: Make REST port configurable in end to end test scripts Key: FLINK-15903 URL: https://issues.apache.org/jira/browse/FLINK-15903 Project: Flink

[jira] [Created] (FLINK-15834) Set up nightly cron jobs on Azure Pipelines build

2020-01-31 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-15834: -- Summary: Set up nightly cron jobs on Azure Pipelines build Key: FLINK-15834 URL: https://issues.apache.org/jira/browse/FLINK-15834 Project: Flink Issue

[jira] [Created] (FLINK-15833) Fix 'Kerberized YARN on Docker' e2e test on Azure Pipelines

2020-01-31 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-15833: -- Summary: Fix 'Kerberized YARN on Docker' e2e test on Azure Pipelines Key: FLINK-15833 URL: https://issues.apache.org/jira/browse/FLINK-15833 Project: Flink

Re: [DISCUSS] FLIP-75: Flink Web UI Improvement Proposal

2020-01-30 Thread Robert Metzger
Thanks a lot for this work! I believe the web UI is very important, in particular to new users. I'm very happy to see that you are putting effort into improving the visibility into Flink through the proposed changes. I can not judge if all the changes make total sense, but the discussion has been

Re: [DISCUSS] Drop vendor specific repositories from pom.xml

2019-12-20 Thread Robert Metzger
ed, Dec 18, 2019 at 5:35 PM Robert Metzger > wrote: > >> I guess we are talking about this profile [1] in the pom.xml? >> >> +1 to remove. >> >> I'm not sure if we need to rush this for the 1.10 release. The profile is >> not doing us any harm at the momen

Re: [DISCUSS] Flink docs vendor table

2019-12-20 Thread Robert Metzger
d a ticket if a commiter could please assign it to my > Jira: > > sjwiesman > > > > https://issues.apache.org/jira/browse/FLINK-15337 > > > > On Wed, Dec 18, 2019 at 10:29 AM Robert Metzger > > wrote: > > > > > I was actually referring to

[jira] [Created] (FLINK-15330) org.apache.flink.fs.s3hadoop.HadoopS3RecoverableWriterITCase.testCallingDeleteObjectTwiceDoesNotThroughException() fails with AssertionError

2019-12-19 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-15330: -- Summary: org.apache.flink.fs.s3hadoop.HadoopS3RecoverableWriterITCase.testCallingDeleteObjectTwiceDoesNotThroughException() fails with AssertionError Key: FLINK-15330 URL

[jira] [Created] (FLINK-15327) 'Walkthrough DataStream Scala nightly' sometimes fails with InterruptedException

2019-12-19 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-15327: -- Summary: 'Walkthrough DataStream Scala nightly' sometimes fails with InterruptedException Key: FLINK-15327 URL: https://issues.apache.org/jira/browse/FLINK-15327

Re: [DISCUSS] Drop vendor specific repositories from pom.xml

2019-12-18 Thread Robert Metzger
I guess we are talking about this profile [1] in the pom.xml? +1 to remove. I'm not sure if we need to rush this for the 1.10 release. The profile is not doing us any harm at the moment. [1]https://github.com/apache/flink/blob/master/pom.xml#L1035 On Wed, Dec 18, 2019 at 4:51 PM Till Rohrmann

Re: [DISCUSS] Flink docs vendor table

2019-12-18 Thread Robert Metzger
rt, can you elaborate on what you mean by "deployment model"? > > > > Seth > > > > On Tue, Dec 17, 2019 at 12:19 PM Robert Metzger > > wrote: > > > > > +1 to the general idea > > > > > > Maybe we could add "Deployment Mo

Re: [DISCUSS] Flink docs vendor table

2019-12-17 Thread Robert Metzger
+1 to the general idea Maybe we could add "Deployment Model" in addition to "Supported Environments" as properties for the vendors. I'd say Cloudera, Eventador and Huawei [1] are missing from this page [1]https://www.huaweicloud.com/en-us/product/cs.html On Tue, Dec 17, 2019 at 5:05 PM Stephan

Re: [DISCUSS] Improve documentation / tooling around security of Flink

2019-12-17 Thread Robert Metzger
>> generating an SSL certificate with the distribution. >> >> On 12/12/2019 17:45, Robert Metzger wrote: >> > Hi all, >> > >> > There was recently a private report to the Flink PMC, as well as >> publicly >> > [1] about Flink's ability to

Re: [DISCUSS] Need feedback on Azure-based build system

2019-12-13 Thread Robert Metzger
gt; As for the current split setup we have (as in by modules), it isn't >> just about faster feedback times; they can also be used to isolate >> components from each other. >> > I know that quite a few people appreciate the kafka/python module >> being in it's own split for exa

Re: [DISCUSS] have separate Flink distributions with built-in Hive dependencies

2019-12-13 Thread Robert Metzger
I'm generally not opposed to convenience binaries, if a huge number of people would benefit from them, and the overhead for the Flink project is low. I did not see a huge demand for such binaries yet (neither for the Flink + Hive integration). Looking at Apache Spark, they are also only offering

Re: [DISCUSS] Drop vendor specific deployment documentation.

2019-12-13 Thread Robert Metzger
This discussion has resulted in the following PR: https://github.com/apache/flink/pull/10559 On Tue, Dec 10, 2019 at 10:14 PM Bowen Li wrote: > +1 to drop vendor related docs. Links to vendors’ webpages should be enough > > On Tue, Dec 10, 2019 at 08:15 Seth Wiesman wrote: > > > @uce Agreed.

[DISCUSS] Improve documentation / tooling around security of Flink

2019-12-12 Thread Robert Metzger
Hi all, There was recently a private report to the Flink PMC, as well as publicly [1] about Flink's ability to execute arbitrary code. In scenarios where Flink is accessible by somebody unauthorized, this can lead to issues. The PMC received a similar report in November 2018. I believe it would

Re: [DISCUSS] Need feedback on Azure-based build system

2019-12-11 Thread Robert Metzger
cution > > in Maven, such that fast projects are executed first. E2E tests should be > > executed last, which they are somewhat, because of the project > dependencies. > > > > Of course, I'm very interested to improve the overall build experience by > > explo

[DISCUSS] Need feedback on Azure-based build system

2019-12-11 Thread Robert Metzger
Hey devs, I need your opinion on something: As part of our migration from Travis to Azure, I'm revisiting the build system of Flink. I currently see two different ways of proceeding, and I would like to know your opinion on the two options. A) We build and test Flink in one "mvn clean verify"

Re: [DISCUSS] Flink Docs Style Guide Review

2019-12-10 Thread Robert Metzger
Thanks a lot Seth! I propose to merge this PR if there's no more feedback within the next 24 hours. On Mon, Dec 9, 2019 at 6:41 PM Seth Wiesman wrote: > Hi All! > > A while back, Marta opened a PR to create a documentation style guide as > part of FLIP-42[1][2]. Unfortunately, the review

[jira] [Created] (FLINK-15156) Warn user if System.exit() is called in user code

2019-12-09 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-15156: -- Summary: Warn user if System.exit() is called in user code Key: FLINK-15156 URL: https://issues.apache.org/jira/browse/FLINK-15156 Project: Flink Issue

Re: [DISCUSS] Migrate build infrastructure from Travis CI to Azure Pipelines

2019-12-05 Thread Robert Metzger
ransfer.sh previously. > I think this feature is also easy to implement in AZP, right? > > Best > Yun Tang > > On 12/6/19, 12:19 AM, "Robert Metzger" wrote: > > I've created a first draft of my plans in the wiki: > > https://cwiki.apache.org/confluen

Re: [DISCUSS] Drop vendor specific deployment documentation.

2019-12-05 Thread Robert Metzger
On Thu, Dec 5, 2019 at 8:46 AM Chesnay Schepler > wrote: > > > Question now is whether the numbers are so low because the docs aren't > > required or because they are so bad. > > > > On 05/12/2019 14:26, Robert Metzger wrote: > > > I just checked GA: >

Re: [DISCUSS] Migrate build infrastructure from Travis CI to Azure Pipelines

2019-12-05 Thread Robert Metzger
I've created a first draft of my plans in the wiki: https://cwiki.apache.org/confluence/display/FLINK/%5Bpreview%5D+Azure+Pipelines. I'm looking forward to your comments. On Thu, Dec 5, 2019 at 12:37 PM Robert Metzger wrote: > Thank you all for the positive feedback. I will start putt

Re: [DISCUSS] Drop vendor specific deployment documentation.

2019-12-05 Thread Robert Metzger
I just checked GA: All numbers are for the last month, independent of the Flink version: aws.html: 918 pageviews mapr_setup.html: 108 pageviews gce_setup.html: 256 pageviews Some other deployment-related pages for reference: yarn_setup: 4687 cluster: 4284 kubernetes: 3428 On Thu, Dec 5,

Re: [DISCUSS] Migrate build infrastructure from Travis CI to Azure Pipelines

2019-12-05 Thread Robert Metzger
; > > >>>>>> Just one comment, it's close to 1.10 feature freeze and we will > > >> spend > > >>>>>> some > > >>>>>> time > > >>>>>> to make tests stable before release. I wish this replacement can &g

[jira] [Created] (FLINK-15056) Python test: ExecutionEnvironmentCompletenessTests.test_completeness failed

2019-12-04 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-15056: -- Summary: Python test: ExecutionEnvironmentCompletenessTests.test_completeness failed Key: FLINK-15056 URL: https://issues.apache.org/jira/browse/FLINK-15056

[DISCUSS] Migrate build infrastructure from Travis CI to Azure Pipelines

2019-12-04 Thread Robert Metzger
Hi all, as a follow up from our discussion on reducing the build time [1], I would like to propose migrating our build infrastructure to Azure Pipelines (away from Travis). I believe that we have reached the limits of what Travis can provide the Flink community, and I don't want the build system

Re: [DISCUSS] Stateful Functions - Contribution Details

2019-12-03 Thread Robert Metzger
ote: > > > > > Hi Robert, > > > Your proposal skipping FLIP and the vote sounds reasonable to me. > > > > > > The project is currently built (with tests, shading, spotbugs etc') in > > > around 2-3 minutes, but since it will reside in its ow

Re: [DISCUSS] Drop RequiredParameters and OptionType

2019-12-03 Thread Robert Metzger
+1 on removing it. On Tue, Dec 3, 2019 at 12:31 PM Stephan Ewen wrote: > I just stumbled across these classes recently and was looking for sample > uses. > No examples and other tests in the code base seem to > use RequiredParameters and OptionType. > > They also seem quite redundant with how

Re: [VOTE] Setup a secur...@flink.apache.org mailing list

2019-11-25 Thread Robert Metzger
I agree that we are only counting PMC votes (because this decision goes beyond the codebase) I'm undecided what to vote :) I'm not against setting up a new mailing list, but I also don't think the benefit (having a private list with PMC + committers) is enough to justify the work involved. As far

Re: [DISCUSS] Stateful Functions - Contribution Details

2019-11-19 Thread Robert Metzger
+1 on what has been decided so far in this thread (including using the same ML, and sticking to the statefun name). I'm not 100% sure if we need a FLIP for this, as we have VOTEd already with a 2/3 majority on accepting this contribution, and there are no changes to the Flink codebase, or

[jira] [Created] (FLINK-14856) Allow setting "state.checkpoints.num-retained" for individual jobs

2019-11-19 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-14856: -- Summary: Allow setting "state.checkpoints.num-retained" for individual jobs Key: FLINK-14856 URL: https://issues.apache.org/jira/browse/FLINK-14856

Re: [ANNOUNCE] Launch of flink-packages.org: A website to foster the Flink Ecosystem

2019-11-19 Thread Robert Metzger
gt;> oy...@motaword.com >> >> <https://www.motaword.com/blog> >> >> >> On Mon, Nov 18, 2019 at 11:07 AM Robert Metzger >> wrote: >> >>> Hi all, >>> >>> I would like to announce that Ververica, with the permission

[ANNOUNCE] Launch of flink-packages.org: A website to foster the Flink Ecosystem

2019-11-18 Thread Robert Metzger
Hi all, I would like to announce that Ververica, with the permission of the Flink PMC, is launching a website called flink-packages.org. This goes back to an effort proposed earlier in 2019 [1] The idea of the site is to help developers building extensions / connectors / API etc. for Flink to get

Re: [DISCUSS] Reducing build times

2019-11-01 Thread Robert Metzger
have the full > access to the ARM resources as well. > > Thanks. > > [1 ] > > https://docs.microsoft.com/zh-cn/azure/devops/pipelines/agents/v2-linux?view=azure-devops > > Robert Metzger 于2019年9月5日周四 下午8:54写道: > > > I do have a working Azure setup, yes. E2E test

Re: [ARM support] Travis ARM CI is now in Alpha Release

2019-10-22 Thread Robert Metzger
Hey Xiyuan, thanks a lot for checking out Travis ARM-based offering. As part of the "Reducing build times" discussion, we have considered moving away from Travis to Azure Pipelines. What I want to say is that Travis might not be important for the Flink community in the long run. I think running

Re: [VOTE] Accept Stateful Functions into Apache Flink

2019-10-21 Thread Robert Metzger
+1 (binding) On Mon, Oct 21, 2019 at 12:06 PM Stephan Ewen wrote: > This is the official vote whether to accept the Stateful Functions code > contribution to Apache Flink. > > The current Stateful Functions code, documentation, and website can be > found here: > https://statefun.io/ >

Re: [DISCUSS] Stateful Functions - in which form to contribute? (same or different repository)

2019-10-16 Thread Robert Metzger
+1 for separate repositories. This is also good for the community to collect some experience for a potential repository split effort at some later point. On Wed, Oct 16, 2019 at 12:01 PM vino yang wrote: > Hi, > > Fast release cycles seems a good viewpoint to support keeping it in a > separate

[jira] [Created] (FLINK-13978) Evaluate Azure Pipelines as a CI tool for Flink

2019-09-05 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-13978: -- Summary: Evaluate Azure Pipelines as a CI tool for Flink Key: FLINK-13978 URL: https://issues.apache.org/jira/browse/FLINK-13978 Project: Flink Issue

Re: [DISCUSS] Reducing build times

2019-09-05 Thread Robert Metzger
ts here; > I would prefer if we only activate it once things are confirmed to be > working. > > For observation purposes, we could also add it to flink-ci with > notifications to people who are interested in this experiment. > This wouldn't impact CiBot. > > On 03/09/2019 1

Re: [DISCUSS] Reducing build times

2019-09-04 Thread Robert Metzger
ensure that contributor builds are still running in a reasonable time? > > As an example of this happening on Travis, contributors currently cannot > run all e2e tests since they timeout, but on apache we have a larger > timeout. > > On 03/09/2019 18:57, Robert Metzger wrote: >

Re: [DISCUSS] Reducing build times

2019-09-03 Thread Robert Metzger
.), nice docker support, plenty of free build resources for open source projects, ...) Best, Robert On Mon, Aug 19, 2019 at 5:12 PM Robert Metzger wrote: > Hi all, > > I have summarized all arguments mentioned so far + some additional > research into a Wiki page here: > https://c

Re: [DISCUSS] Repository split

2019-09-03 Thread Robert Metzger
Thanks a lot for your summary Chesnay. I agree with you that we have no consensus in the community for splitting up the repository immediately, and I agree with you that we should have a separate discussion about reducing the build time (which is already making good progress). Also, I will keep

Re: [DISCUSS] Flink project bylaws

2019-08-28 Thread Robert Metzger
t; Jiangjie (Becket) Qin > > On Thu, Aug 22, 2019 at 12:11 PM Robert Metzger > wrote: > > > I have started a Wiki page (editable by all) for collecting ideas for > > Bylaws changes, so that we can batch changes together and then vote on > > them: > > > https:/

Re: Watermarks not propagated to WebUI?

2019-08-26 Thread Robert Metzger
Jan, will you be able to test this issue on the now-released Flink 1.9 with the new UI? What parallelism is needed to reproduce the issue? On Thu, Aug 15, 2019 at 1:59 PM Chesnay Schepler wrote: > I remember an issue regarding the watermark fetch request from the WebUI > exceeding some HTTP

Re: [DISCUSS] Flink project bylaws

2019-08-22 Thread Robert Metzger
) Qin > > On Tue, Aug 13, 2019 at 1:29 PM Robert Metzger > wrote: > > > Hi Becket, > > I've applied the proposed change to the document: > > > > > https://cwiki.apache.org/confluence/pages/diffpagesbyversion.action?pageId=120731026=20=19 > > > > I wou

Re: [DISCUSS] Reducing build times

2019-08-19 Thread Robert Metzger
he end-to-end tests use the shade plugin to package the jars for testing. > > Aljoscha > > > On 18. Aug 2019, at 19:52, Robert Metzger wrote: > > > > Hi all, > > > > I wanted to understand the impact of the hardware we are using for > running > >

Re: [DISCUSS] Update our Roadmap

2019-08-19 Thread Robert Metzger
provide support, if needed. > > Marta > > On Sun, Aug 18, 2019 at 4:46 PM Stephan Ewen wrote: > > > I could help with that. > > > > On Fri, Aug 16, 2019 at 2:36 PM Robert Metzger > > wrote: > > > > > Flink 1.9 is feature freezed and almost releas

Re: [DISCUSS] Reducing build times

2019-08-18 Thread Robert Metzger
Hi all, I wanted to understand the impact of the hardware we are using for running our tests. Each travis worker has 2 virtual cores, and 7.5 gb memory [1]. They are using Google Cloud Compute Engine *n1-standard-2* instances. Running a full "mvn clean verify" takes *03:32 h* on such a machine

Re: [DISCUSS] Update our Roadmap

2019-08-16 Thread Robert Metzger
Flink 1.9 is feature freezed and almost released. I guess it makes sense to update the roadmap on the website again. Who feels like having a good overview of what's coming up? On Tue, May 7, 2019 at 4:33 PM Fabian Hueske wrote: > Yes, that's a very good proposal Jark. > +1 > > Best, Fabian > >

[jira] [Created] (FLINK-13739) BinaryRowTest.testWriteString() fails in some environments

2019-08-15 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-13739: -- Summary: BinaryRowTest.testWriteString() fails in some environments Key: FLINK-13739 URL: https://issues.apache.org/jira/browse/FLINK-13739 Project: Flink

[jira] [Created] (FLINK-13738) NegativeArraySizeException in LongHybridHashTable

2019-08-15 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-13738: -- Summary: NegativeArraySizeException in LongHybridHashTable Key: FLINK-13738 URL: https://issues.apache.org/jira/browse/FLINK-13738 Project: Flink Issue

Re: [VOTE] Apache Flink Release 1.9.0, release candidate #2

2019-08-14 Thread Robert Metzger
Has anybody verified the inclusion of all bundled dependencies into the NOTICE files? I'm asking because we had some issues with that in the last release(s). On Wed, Aug 14, 2019 at 5:31 PM Aljoscha Krettek wrote: > +1 > > I did some testing on a Google Cloud Dataproc cluster (it gives you a >

Re: [ANNOUNCE] Andrey Zagrebin becomes a Flink committer

2019-08-14 Thread Robert Metzger
Congratulations! Very happy to have you onboard :) On Wed, Aug 14, 2019 at 4:06 PM Kostas Kloudas wrote: > Congratulations Andrey! > Well deserved! > > Kostas > > On Wed, Aug 14, 2019 at 4:04 PM Yun Tang wrote: > > > > Congratulations Andrey. > > > > Best > > Yun Tang > >

Re: [DISCUSS] FLIP-39: Flink ML pipeline and ML libs

2019-08-14 Thread Robert Metzger
It seems that this FLIP doesn't have a Wiki page yet [1], even though it is already partially implemented [2] We should try to stick more to the FLIP process to manage the project more efficiently. [1] https://cwiki.apache.org/confluence/display/FLINK/Flink+Improvement+Proposals [2]

Re: [ANNOUNCE] Progress updates for Apache Flink 1.9.0 release

2019-08-13 Thread Robert Metzger
Hi all, I've opened a pull request for the release announcement. I'm looking forward to your review & feedback: https://github.com/apache/flink-web/pull/244 On Fri, Aug 9, 2019 at 6:27 PM Tzu-Li (Gordon) Tai wrote: > Hi, > > Update: voting on RC2 for Apache Flink 1.9.0 has started: > >

Re: [DISCUSS] Flink project bylaws

2019-08-13 Thread Robert Metzger
es > >>>>>>> (like > >>>>>>>>> the > >>>>>>>>>>>>> DataSet API for instance or the legacy DataSet/DataStream > >>>>>> Python > >>>>>>>>>> APIs)? > >>>>>>>>>&g

Re: [VOTE] Flink Project Bylaws

2019-08-12 Thread Robert Metzger
> > > That's a good suggestion. Will you help to change the permission on that > > page? > > > > Thanks, > > > > Jiangjie (Becket) Qin > > > > On Mon, Aug 12, 2019 at 2:41 PM Robert Metzger > > wrote: > > > > > Thanks for starting the

Re: [DISCUSS] Repository split

2019-08-12 Thread Robert Metzger
Thanks a lot for starting the discussion Chesnay! I would like to throw in another aspect into the discussion: What if we consider this repo split as a first step towards making connectors, machine learning, gelly, table/SQL? independent projects within the ASF, with their own mailing lists,

Re: [VOTE] Flink Project Bylaws

2019-08-12 Thread Robert Metzger
Thanks for starting the vote. How about putting a specific version in the wiki up for voting, or restricting edit access to the page to the PMC? There were already two changes (very minor) to the page since the vote has started:

Re: [ANNOUNCE] Hequn becomes a Flink committer

2019-08-07 Thread Robert Metzger
Congratulations! On Wed, Aug 7, 2019 at 1:09 PM highfei2...@126.com wrote: > Congrats Hequn! > > Best, > Jeff Yang > > > Original Message > Subject: Re: [ANNOUNCE] Hequn becomes a Flink committer > From: Piotr Nowojski > To: JingsongLee > CC: Biao Liu ,Zhu Zhu ,Zili Chen ,Jeff

Re: [DISCUSS] Adopting a Code Style and Quality Guide

2019-08-07 Thread Robert Metzger
> > > > > >> It is super easy to use for contributors as they don't need to > keep > > > any > > > > >> particular coding style in mind and they can only focus on > > > functionality > > > > >> they want to fix, and it's also grea

Re: [REMINDER] Please add entries for newly added dependencies to NOTICE file

2019-08-06 Thread Robert Metzger
The bot now warns if a pull request has been linked to an unassigned Jira ticket. (It also puts a warning if no docs, no zh-docs have been touched, or if a pom.xml file has been touched) On Mon, Apr 15, 2019 at 3:11 PM Robert Metzger wrote: > I will add such a feature to the bot! > &g

Re: [DISCUSS] Setup a bui...@flink.apache.org mailing list for travis builds

2019-07-25 Thread Robert Metzger
The mailing list has been created, you can now subscribe to it. On Wed, Jul 24, 2019 at 1:43 PM Jark Wu wrote: > Thanks Robert for helping out that. > > Best, > Jark > > On Wed, 24 Jul 2019 at 19:16, Robert Metzger wrote: > > > I've requested the creation of the l

Re: [DISCUSS] Setup a bui...@flink.apache.org mailing list for travis builds

2019-07-24 Thread Robert Metzger
I've requested the creation of the list, and made Jark, Chesnay and me moderators of it. On Wed, Jul 24, 2019 at 1:12 PM Robert Metzger wrote: > @Jark: Yes, I will request the creation of a mailing list! > > On Tue, Jul 23, 2019 at 4:48 PM Hugo Louro wrote: > >> +1 >&

Re: [DISCUSS] Setup a bui...@flink.apache.org mailing list for travis builds

2019-07-24 Thread Robert Metzger
> >> On Tue, Jul 23, 2019 at 1:59 PM Hequn Cheng > wrote: > >> > >> Hi Jark, > >> > >> Good idea. +1! > >> > >>> On Tue, Jul 23, 2019 at 6:23 PM Jark Wu wrote: > >>> > >>> Thank you all for your posit

[ANNOUNCE] Kete Young is now part of the Flink PMC

2019-07-23 Thread Robert Metzger
Hi all, On behalf of the Flink PMC, I'm happy to announce that Kete Young is now part of the Apache Flink Project Management Committee (PMC). Kete has been a committer since February 2017, working a lot on Table API / SQL. He's currently co-managing the 1.9 release! Thanks a lot for your work

Re: [DISCUSS] Create a Flink ecosystem website

2019-07-23 Thread Robert Metzger
l — this turned out amazing! >>> >>> Marta >>> >>> On Thu, Jul 18, 2019 at 10:57 AM Congxian Qiu >>> wrote: >>> >>> > Robert and Daryl, thanks for the great work, I tried the website and >>> filed >>> > s

Re: [DISCUSS] Setup a bui...@flink.apache.org mailing list for travis builds

2019-07-23 Thread Robert Metzger
+1 On Mon, Jul 22, 2019 at 10:27 AM Biao Liu wrote: > +1, make sense to me. > Mailing list seems to be a more "community" way. > > Timo Walther 于2019年7月22日周一 下午4:06写道: > > > +1 sounds good to inform people about instabilities or other issues > > > > Regards, > > Timo > > > > > > Am 22.07.19 um

[ANNOUNCE] Zhijiang Wang has been added as a committer to the Flink project

2019-07-22 Thread Robert Metzger
Hey all, We've added another committer to the Flink project: Zhijiang Wang. Congratulations Zhijiang! Best, Robert (on behalf of the Flink PMC)

Re: [DISCUSS] Flink project bylaws

2019-07-19 Thread Robert Metzger
t; > > >>>>>> - > > >>>>>> Re: Chesnay > > >>>>>> > > >>>>>> The emeritus stuff seems like unnecessary noise. > > >>>>>> As Till mentioned, this is

Re: [DISCUSS] A more restrictive JIRA workflow

2019-07-19 Thread Robert Metzger
times in a row :) >>> > > >>> > > On 18/07/2019 12:32, Zili Chen wrote: >>> > > > Robert, >>> > > > >>> > > > Thanks for your effort. Rejecting contributor permission request >>> > > > with a nice message and pointing them to the anno

Re: [ANNOUNCE] JIRA permissions changed: Only committers can assign somebody to a ticket

2019-07-19 Thread Robert Metzger
the email to the user@ list. It is okay for me if you do that :) On Thu, Jul 18, 2019 at 9:47 PM Bowen Li wrote: > shall we announce in user ML too? Users who are used to assign tickets to > themselves should also be aware of this change > > On Thu, Jul 18, 2019 at 3:06 AM Robert Metz

Re: [DISCUSS] A more restrictive JIRA workflow

2019-07-18 Thread Robert Metzger
them to my announcement. What do you think? [1] https://lists.apache.org/thread.html/4ed570c7110b7b55b5c3bd52bb61ff35d5bda88f47939d8e7f1844c4@%3Cdev.flink.apache.org%3E On Thu, Jul 4, 2019 at 1:21 PM Robert Metzger wrote: > This is the Jira ticket I opened > https://issues.apache.org/jira/br

<    2   3   4   5   6   7   8   9   10   11   >