Re: Not able to run beam appliction on Flink cluster environment

2017-08-22 Thread P. Ramanjaneya Reddy
Hi Till, I'm not sure as i'm following correct steps...there is no log file generated on flink cluster. 1. followed the steps mentinoned in below link to setup flink cluster (Standalone) https://ci.apache.org/projects/flink/flink-docs-release-1.2/setup/cluster_setup.html Then 2.run beam word

[jira] [Created] (FLINK-7493) Create Pinot Connector

2017-08-22 Thread Zhenqiu Huang (JIRA)
Zhenqiu Huang created FLINK-7493: Summary: Create Pinot Connector Key: FLINK-7493 URL: https://issues.apache.org/jira/browse/FLINK-7493 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-7492) Memsql Connector

2017-08-22 Thread Zhenqiu Huang (JIRA)
Zhenqiu Huang created FLINK-7492: Summary: Memsql Connector Key: FLINK-7492 URL: https://issues.apache.org/jira/browse/FLINK-7492 Project: Flink Issue Type: New Feature Reporter:

[jira] [Created] (FLINK-7491) Support COLLECT Aggregate function in Flink SQL

2017-08-22 Thread Shuyi Chen (JIRA)
Shuyi Chen created FLINK-7491: - Summary: Support COLLECT Aggregate function in Flink SQL Key: FLINK-7491 URL: https://issues.apache.org/jira/browse/FLINK-7491 Project: Flink Issue Type: New

Re: [DISCUSS] Flink 1.4 and time based release

2017-08-22 Thread Chen Qin
I would be great to avoid immediate 1.x1 bug fixing release. It cause confusion and raise quality concerns. Also, is there already way to communicate with Amazon EMR for latest release speedy available? I may try to find someone work there is needed. Thanks Chen > On Aug 22, 2017, at 9:32 AM,

Re: [DISCUSS] Stop serving docs for Flink version prior to 1.0

2017-08-22 Thread Till Rohrmann
+1 On Tue, Aug 22, 2017 at 6:16 PM, Stefan Richter wrote: > +1 > > > Am 22.08.2017 um 18:07 schrieb Robert Metzger : > > > > Please go ahead +1 > > > > Thank you for taking care! > > > > On Tue, Aug 22, 2017 at 6:02 PM, Aljoscha Krettek

[jira] [Created] (FLINK-7490) UDF Agg throws Exception when flink-table is loaded with AppClassLoader

2017-08-22 Thread Miguel Rui Pereira Marques (JIRA)
Miguel Rui Pereira Marques created FLINK-7490: - Summary: UDF Agg throws Exception when flink-table is loaded with AppClassLoader Key: FLINK-7490 URL: https://issues.apache.org/jira/browse/FLINK-7490

[DISCUSS] Flink 1.4 and time based release

2017-08-22 Thread Stephan Ewen
Hi all! I want to bring up this discussion because we are approaching the date when there would be a feature freeze following the time based release schedule. To make it short, I would suggest to not follow the time-based schedule for that release. There are a bunch of reasons bringing me to

Re: [DISCUSS] Stop serving docs for Flink version prior to 1.0

2017-08-22 Thread Stefan Richter
+1 > Am 22.08.2017 um 18:07 schrieb Robert Metzger : > > Please go ahead +1 > > Thank you for taking care! > > On Tue, Aug 22, 2017 at 6:02 PM, Aljoscha Krettek > wrote: > >> +1 >>> On 22. Aug 2017, at 18:01, Stephan Ewen wrote:

Re: [DISCUSS] Stop serving docs for Flink version prior to 1.0

2017-08-22 Thread Robert Metzger
Please go ahead +1 Thank you for taking care! On Tue, Aug 22, 2017 at 6:02 PM, Aljoscha Krettek wrote: > +1 > > On 22. Aug 2017, at 18:01, Stephan Ewen wrote: > > > > +1 > > > > On Tue, Aug 22, 2017 at 5:58 PM, Ufuk Celebi wrote: > > >

Re: [DISCUSS] Stop serving docs for Flink version prior to 1.0

2017-08-22 Thread Stephan Ewen
+1 On Tue, Aug 22, 2017 at 5:58 PM, Ufuk Celebi wrote: > Quick update: If there are no objections, I will start looking into > how to stop serving the docs for Flink < 1.0 after tomorrow. > > > On Wed, Aug 16, 2017 at 10:45 PM, Ufuk Celebi wrote: > > Thanks

Re: [DISCUSS] Stop serving docs for Flink version prior to 1.0

2017-08-22 Thread Ufuk Celebi
Quick update: If there are no objections, I will start looking into how to stop serving the docs for Flink < 1.0 after tomorrow. On Wed, Aug 16, 2017 at 10:45 PM, Ufuk Celebi wrote: > Thanks for your early feedback Kostas and Ted. > > @Kostas: I have a proposal for a more

[jira] [Created] (FLINK-7489) Remove job lifecycle methods from public JobMasterGateway interface

2017-08-22 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-7489: Summary: Remove job lifecycle methods from public JobMasterGateway interface Key: FLINK-7489 URL: https://issues.apache.org/jira/browse/FLINK-7489 Project: Flink

Re: mvn checkstyle error vs IDE based stylecheck

2017-08-22 Thread Michael Fong
Hi, Thanks for pointing that out! It seems I must have misconfigured that step earlier. Now it works flawlessly. Thanks again! Regards, On Tue, Aug 22, 2017 at 9:37 PM, Chesnay Schepler wrote: > Did you do step 4 "Select /6.19/ in the “Checkstyle Version” dropdown and >

Re: mvn checkstyle error vs IDE based stylecheck

2017-08-22 Thread Chesnay Schepler
Did you do step 4 "Select /6.19/ in the “Checkstyle Version” dropdown and click apply.*"? * On 22.08.2017 14:53, Michael Fong wrote: Hi, Thanks to your swift reply. IntelliJ complains about checkstyle rules with the following exception:

Re: Not able to run beam appliction on Flink cluster environment

2017-08-22 Thread Till Rohrmann
Hi Ramanji, do you have the logs of the Flink master running at 192.168.56.1:6123? Cheers, Till On Tue, Aug 22, 2017 at 2:43 PM, P. Ramanjaneya Reddy wrote: > Hi All, > > We followed the steps mentinoned in below link to setup flink cluster > (Standalone) >

Re: mvn checkstyle error vs IDE based stylecheck

2017-08-22 Thread Michael Fong
Hi, Thanks to your swift reply. IntelliJ complains about checkstyle rules with the following exception: org.infernus.idea.checkstyle.exception.CheckStylePluginException: The Checkstyle rules file could not be parsed.SuppressionCommentFilter is not allowed as a child in CheckerThe file has been

Not able to run beam appliction on Flink cluster environment

2017-08-22 Thread P. Ramanjaneya Reddy
Hi All, We followed the steps mentinoned in below link to setup flink cluster (Standalone) *https://ci.apache.org/projects/flink/flink-docs-release-1.2/setup/cluster_setup.html * In the same cluster we are

Re: mvn checkstyle error vs IDE based stylecheck

2017-08-22 Thread Chesnay Schepler
The IDE setup guide you tried is what most people i know are using. Can you tell us how these didn't work for you? On 22.08.2017 14:30, Michael Fong wrote: Hi, all, I am new to this community and would like to make some contributions to this awesome project. While I was exploring the source

mvn checkstyle error vs IDE based stylecheck

2017-08-22 Thread Michael Fong
Hi, all, I am new to this community and would like to make some contributions to this awesome project. While I was exploring the source code, I noticed there is a maven tests that verify the checkstyle of java codes. Something like the following would pop up after executing `mvn clean install`

Re: Changing parallelism on BucketingSink

2017-08-22 Thread Till Rohrmann
Hi Felix, when calling dataStream.addSink(new BucketingSink()) it returns a DataStreamSink object. On this object you can set the parallelism via setParallelism. Cheers, Till ​ On Mon, Aug 21, 2017 at 7:04 PM, Felix Cheung wrote: > Hi, > > I'm implementing a custom