Apply for contribution permission

2018-04-03 Thread jianhua xiao
Hi! I'm very intrested in Flink and has applied Flink in production, I'm willing to contribute to it, could anybody give me the contribution permission please, my jira uername is " xiaojianhua ". Thanks~

Re: Adding a part suffix setter to the BucketingSink

2018-04-03 Thread Aljoscha Krettek
So you want to be able to set a "global" suffix that should be appended to all different kinds of files that the sink writes, including intermediate files? Aljoscha > On 29. Mar 2018, at 16:59, l...@lyft.com wrote: > > Sorry, I meant "I don't see a way of doing this apart from setting a part >

Re: Apply for contribution permission

2018-04-03 Thread Chesnay Schepler
I've given you contributor permissions, looking forward to your contributions. On 03.04.2018 03:59, jianhua xiao wrote: Hi! I'm very intrested in Flink and has applied Flink in production, I'm willing to contribute to it, could anybody give me the contribution permission please, my jira uernam

Re: [VOTE] Release 1.5.0, release candidate #1

2018-04-03 Thread Flavio Pompermaier
Just one note. There are 2 suggested ways of compiling Flink: 1. From github Readme: mvn clean package -DskipTests ( https://github.com/apache/flink ) 2. From site documentation: mvn clean install -DskipTests ( https://ci.apache.org/projects/flink/flink

Re: [VOTE] Release 1.5.0, release candidate #1

2018-04-03 Thread Till Rohrmann
Hi Sihua, Stefan will look into FLINK-8699 and then we will decide whether it should be part of 1.5.0 or not. The issue should, however, not block others from testing the RC. @Flavio, what exactly is the problem with maven 3.0.x when running `mvn clean package -DskipTests`? Cheers, Till On Tue,

Re: [Proposal] CEP library changes - review request

2018-04-03 Thread Shailesh Jain
Bump. On Thu, Mar 22, 2018 at 7:54 PM, Shailesh Jain wrote: > To trigger the computations for each batch, I'll have to use the > processing time timer in the abstract keyed cep operator, right? > > The reason why I'm avoiding the watermarks is that it is not possible to > generate watermarks per

Re: [Proposal] CEP library changes - review request

2018-04-03 Thread Kostas Kloudas
Hi Shailesh, Your solution may fit your use case, but as Dawid mentioned earlier, it makes a lot of assumptions about the input. From a look at your PoC: 1) You assume no late data (you do not drop anything) and no out-of-orderness. 2) You mix the two notions of time (event and processing). 3)

Re: [VOTE] Release 1.5.0, release candidate #1

2018-04-03 Thread Flavio Pompermaier
Sorry Till but we had an error the first time we've tried to build Flink using mvn clean package...now we're trying to replicate the error but no luck.. :) So for the moment don't consider my note... On Tue, Apr 3, 2018 at 10:56 AM, Till Rohrmann wrote: > Hi Sihua, > > Stefan will look into FLIN

Re: Using Slack for online discussions

2018-04-03 Thread Chesnay Schepler
-1 1. According to INFRA-14292 the ASF Slack isn't run by the ASF. This alone puts this service into rather questionable territory as it /looks/ like an official ASF service. If anyone can provide information to the contrary, please

[jira] [Created] (FLINK-9125) MiniClusterResource should set CoreOptions.TMP_DIRS

2018-04-03 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-9125: --- Summary: MiniClusterResource should set CoreOptions.TMP_DIRS Key: FLINK-9125 URL: https://issues.apache.org/jira/browse/FLINK-9125 Project: Flink Issue

Re: Using Slack for online discussions

2018-04-03 Thread Ted Yu
Thanks for the background information.  I withdraw previous +1 Original message From: Chesnay Schepler Date: 4/3/18 4:50 AM (GMT-08:00) To: dev@flink.apache.org Subject: Re: Using Slack for online discussions -1 1. According to INFRA-14292    

Re: Using Slack for online discussions

2018-04-03 Thread Till Rohrmann
I'm a bit torn here. On the one hand I think Slack would be nice because it allows a more direct interaction. Similar to the IRC channel we once had. On the other hand, I fear that some information/discussions might get lost in the depths of Slack and at least after the 1 message limit has bee

[ANNOUNCE] Weekly community update #14

2018-04-03 Thread Till Rohrmann
Dear community, here is the weekly community update thread #14. Please post any news and updates you want to share with the community to this thread. # Release 1.5 The community could cut down the number of release blockers significantly. A first release candidate has been created in order to fa

Re: Using Slack for online discussions

2018-04-03 Thread Ted Yu
It is the lack of searchable public record (of Slack) that we should be concerned with. Also, requiring invitation would be bottleneck for the growth of participants. Cheers On Tue, Apr 3, 2018 at 6:11 AM, Till Rohrmann wrote: > I'm a bit torn here. On the one hand I think Slack would be nice

Re: Using Slack for online discussions

2018-04-03 Thread Thomas Weise
The invite link is self service. Everyone can signup. As for the searchable record, it may be possible to archive what's posted on the slack channel by subscribing the mailing list. I think a communication platform like Slack or IRC complements email, the type of messages there would typically be

Re: Using Slack for online discussions

2018-04-03 Thread TechnoMage
We use Slack in many contexts, company, community, etc. It has many advantages over email. For one being a separate channel from general email it stands out when there are new messages. Notifications can be configured separately for each channel, and can arrive on multiple mobile devices with

Re: Using Slack for online discussions

2018-04-03 Thread Ted Yu
bq. A bot could archive the messages to a web site, or forward to the email list I think some formatting / condensing may be needed if communication on Slack is forwarded to mailing list - since the sentences on Slack may not be as polished as on the emails. There is also the mapping between a per

[jira] [Created] (FLINK-9126) Ability for CassandraInputFormat to output data into a Custom Cassandra Annotated Pojo

2018-04-03 Thread Jeffrey Carter (JIRA)
Jeffrey Carter created FLINK-9126: - Summary: Ability for CassandraInputFormat to output data into a Custom Cassandra Annotated Pojo Key: FLINK-9126 URL: https://issues.apache.org/jira/browse/FLINK-9126

Re: Using Slack for online discussions

2018-04-03 Thread Suneel Marthi
*As one of the admins for ASF slack*, let me clarify a few things: 1. ASF slack is open to everyone regardless of apache,org or not - u need to make a request on dev@ to be added to ASF slack if you don't have an apache.org 2. There is an archive bot in place on ASF slack for archiving older mess

Re: [VOTE] Release 1.5.0, release candidate #1

2018-04-03 Thread simone
On 03/04/2018 17:40, simone wrote: I tried to run a simple batch job (it tooks about 5 minutes with flink 1.3.1 on single machine), but it seems to run forever with flink 1.5-SNAPSHOT (I stopped it after about 2-3 hours multiple times). If you want to try to replicate this, here are the java

Re: [VOTE] Release 1.5.0, release candidate #1

2018-04-03 Thread simone
I tried to run a simple batch job (it tooks about 5 minutes with flink 1.3.1 on single machine), but it seems to run forever with flink 1.5-SNAPSHOT (I stopped it after about 2-3 hours multiple times). If you want to try to replicate this, here are the java classes: https://github.com/xseris/Fl

[jira] [Created] (FLINK-9127) Filesystem State Backend logged incorrectly

2018-04-03 Thread Scott Kidder (JIRA)
Scott Kidder created FLINK-9127: --- Summary: Filesystem State Backend logged incorrectly Key: FLINK-9127 URL: https://issues.apache.org/jira/browse/FLINK-9127 Project: Flink Issue Type: Bug

Re: [Proposal] CEP library changes - review request

2018-04-03 Thread Shailesh Jain
Thank you, Kostas, for reviewing this. Although points 1 and 3 are something which I was planning to address in the actual implementation, #2 would still be a show stopper. I'll spend some more time on this and maybe come up with a better way to achieve the same use case without mixing the two no

Trying to restart Flink jobs from savepoint with Avro Schema change

2018-04-03 Thread Dhvanan Shah
Hello! I have a Flink job that reads an Event Json stream and converts it to Avro format, and another job that reads this Event Avro stream does some processing and converts it to a Session Avro object. I have a change in schema in the Event and Session Avro object, and I want to restart both the

TaskManager deadlock on NetworkBufferPool

2018-04-03 Thread Amit Jain
Hi, We are hitting TaskManager deadlock on NetworkBufferPool bug in Flink 1.3.2. We have set of ETL's merge jobs for a number of tables and stuck with above issue randomly daily. I'm attaching the thread dump of JobManager and one of the Task Man