Re: [DISCUSS] Start a user...@flink.apache.org mailing list for the Chinese-speaking community?

2019-06-21 Thread vino yang
Hi Hequn, Thanks for reporting this case. The reason replied by QQ mail team is also caused by *bounce attack*. So this mail address has been intercepted and it's an IP level interception. Today, the QQ mail team has unblocked this email address. So it can receive the follow-up email from Apach

[jira] [Created] (FLINK-12923) Introduce a Task termination future

2019-06-21 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-12923: Summary: Introduce a Task termination future Key: FLINK-12923 URL: https://issues.apache.org/jira/browse/FLINK-12923 Project: Flink Issue Type: Impro

[jira] [Created] (FLINK-12924) Introduce basic type inference interfaces

2019-06-21 Thread Timo Walther (JIRA)
Timo Walther created FLINK-12924: Summary: Introduce basic type inference interfaces Key: FLINK-12924 URL: https://issues.apache.org/jira/browse/FLINK-12924 Project: Flink Issue Type: Sub-tas

[jira] [Created] (FLINK-12925) Docker embedded job end-to-end test fails

2019-06-21 Thread Alex (JIRA)
Alex created FLINK-12925: Summary: Docker embedded job end-to-end test fails Key: FLINK-12925 URL: https://issues.apache.org/jira/browse/FLINK-12925 Project: Flink Issue Type: Bug Component

Re: [DISCUSS] Releasing Flink 1.8.1

2019-06-21 Thread jincheng sun
Hi All, The last blocker(FLINK-12863) of 1.8.1 release have been fixed! But also welcome report any issues you think is a blocker! I will also do the final check, if no new problems are found, I will prepare RC1 as soon as possible! :) Cheers, Jincheng jincheng sun 于2019年6月17日周一 上午9:24写道: > Hi

Flink Elasticsearch Sink Issue

2019-06-21 Thread Ramya Ramamurthy
Hi, We use Kafka->Flink->Elasticsearch in our project. The data to the elasticsearch is not getting flushed, till the next batch arrives. E.g.: If the first batch contains 1000 packets, this gets pushed to the Elastic, only after the next batch arrives [irrespective of reaching the batch time limi

Re: Flink Elasticsearch Sink Issue

2019-06-21 Thread miki haiat
Did you set some checkpoints configuration? On Fri, Jun 21, 2019, 13:17 Ramya Ramamurthy wrote: > Hi, > > We use Kafka->Flink->Elasticsearch in our project. > The data to the elasticsearch is not getting flushed, till the next batch > arrives. > E.g.: If the first batch contains 1000 packets, t

[jira] [Created] (FLINK-12926) Main thread checking in some tests fails

2019-06-21 Thread Zhu Zhu (JIRA)
Zhu Zhu created FLINK-12926: --- Summary: Main thread checking in some tests fails Key: FLINK-12926 URL: https://issues.apache.org/jira/browse/FLINK-12926 Project: Flink Issue Type: Bug Comp

Re: [DISCUSS] Start a user...@flink.apache.org mailing list for the Chinese-speaking community?

2019-06-21 Thread Hequn Cheng
Hi vino, Thanks a lot for unblocking the email address. I have told the user about this. Hope things can get better. Best, Hequn On Fri, Jun 21, 2019 at 3:14 PM vino yang wrote: > Hi Hequn, > > Thanks for reporting this case. > > The reason replied by QQ mail team is also caused by *bounce att

Re: Flink Elasticsearch Sink Issue

2019-06-21 Thread Ramya Ramamurthy
Yes, we do maintain checkpoints env.enableCheckpointing(30); But we assumed it is for Kafka consumer offsets. Not sure how this is useful in this case? Can you pls. elaborate on this. ~Ramya. On Fri, Jun 21, 2019 at 4:33 PM miki haiat wrote: > Did you set some checkpoints configuration?

[jira] [Created] (FLINK-12927) YARNSessionCapacitySchedulerITCase failed due to non prohibited exception

2019-06-21 Thread Yun Tang (JIRA)
Yun Tang created FLINK-12927: Summary: YARNSessionCapacitySchedulerITCase failed due to non prohibited exception Key: FLINK-12927 URL: https://issues.apache.org/jira/browse/FLINK-12927 Project: Flink

Re: Flink Elasticsearch Sink Issue

2019-06-21 Thread Ramya Ramamurthy
By default, flushOnCheckpoint is set to True. So ideally, based on env.enableCheckpointing(30); the flush to ES must be triggered every 30seconds, though our ES Flush timeout is 60 seconds. If the above assumption is correct, then still we do not see packets getting flushed till the next p

Re: [DISCUSS] Adopting a Code Style and Quality Guide

2019-06-21 Thread Robert Metzger
It seems that the discussion around this topic has settled. I'm going to turn the Google Doc into a markdown file (maybe also multiple, I'll try out different things) and then open a pull request for the Flink website. I'll post a link to the PR here once I'm done. On Fri, Jun 14, 2019 at 9:36 AM

Re: [DISCUSS] Adopting a Code Style and Quality Guide

2019-06-21 Thread Stephan Ewen
Thanks, everyone, for the positive feedback :-) @Robert - It probably makes sense to break this down into various pages, like PR, general code style guide, Java, component specific guides, formats, etc. Best, Stephan On Fri, Jun 21, 2019 at 4:29 PM Robert Metzger wrote: > It seems that the di

[jira] [Created] (FLINK-12928) Remove old Flink ML docs

2019-06-21 Thread Seth Wiesman (JIRA)
Seth Wiesman created FLINK-12928: Summary: Remove old Flink ML docs Key: FLINK-12928 URL: https://issues.apache.org/jira/browse/FLINK-12928 Project: Flink Issue Type: Improvement Co

[jira] [Created] (FLINK-12929) scala.StreamExecutionEnvironment.addSource does not propagate TypeInformation

2019-06-21 Thread Fabio Lombardelli (JIRA)
Fabio Lombardelli created FLINK-12929: - Summary: scala.StreamExecutionEnvironment.addSource does not propagate TypeInformation Key: FLINK-12929 URL: https://issues.apache.org/jira/browse/FLINK-12929

[jira] [Created] (FLINK-12930) Update Chinese "how to contribute" pages

2019-06-21 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-12930: -- Summary: Update Chinese "how to contribute" pages Key: FLINK-12930 URL: https://issues.apache.org/jira/browse/FLINK-12930 Project: Flink Issue Type: Task

Re: [DISCUSS] Connectors and NULL handling

2019-06-21 Thread Rong Rong
Hi Aljoscha, Sorry for the late reply, I think the solution makes sense. Using the NULL return value to mark a message is corrupted is not a valid way since NULL value has semantic meaning in not just Kafka but also in a lot of other contexts. I was wondering if we can have a more meaningful inte

Re: [ANNOUNCEMENT] June 2019 Bay Area Apache Flink Meetup

2019-06-21 Thread Xuefu Zhang
Hi all, As the event is around the corner. If you haven't responded, please RSVP at meetup.com. Otherwise, I will see you next Wednesday, June 26. Regards, Xuefu On Mon, Jun 10, 2019 at 7:50 PM Xuefu Zhang wrote: > Hi all, > > As promised, we planned to have quarterly Flink meetup and now it's

Join in Apache Flink community

2019-06-21 Thread Chance Li
Hi Guys, I want to contribute to Apache Flink. Would you please give me contributor permission? My JIRA ID: Chance Li, email: chanc...@gmail.com Regards, Chance

[jira] [Created] (FLINK-12931) lint-python.sh cannot find flake8

2019-06-21 Thread Bowen Li (JIRA)
Bowen Li created FLINK-12931: Summary: lint-python.sh cannot find flake8 Key: FLINK-12931 URL: https://issues.apache.org/jira/browse/FLINK-12931 Project: Flink Issue Type: Bug Component

[jira] [Created] (FLINK-12932) support show catalogs and show databases in SQL CLI

2019-06-21 Thread Bowen Li (JIRA)
Bowen Li created FLINK-12932: Summary: support show catalogs and show databases in SQL CLI Key: FLINK-12932 URL: https://issues.apache.org/jira/browse/FLINK-12932 Project: Flink Issue Type: Sub-t

[jira] [Created] (FLINK-12933) support "use catalog" and "use database" in SQL CLI

2019-06-21 Thread Bowen Li (JIRA)
Bowen Li created FLINK-12933: Summary: support "use catalog" and "use database" in SQL CLI Key: FLINK-12933 URL: https://issues.apache.org/jira/browse/FLINK-12933 Project: Flink Issue Type: Sub-t

[jira] [Created] (FLINK-12934) add additional dependencies for flink-connector-hive to connect to standalone hive metastore

2019-06-21 Thread Bowen Li (JIRA)
Bowen Li created FLINK-12934: Summary: add additional dependencies for flink-connector-hive to connect to standalone hive metastore Key: FLINK-12934 URL: https://issues.apache.org/jira/browse/FLINK-12934

[jira] [Created] (FLINK-12935) package flink-connector-hive and some flink dependencies into /opt of flink distribution

2019-06-21 Thread Bowen Li (JIRA)
Bowen Li created FLINK-12935: Summary: package flink-connector-hive and some flink dependencies into /opt of flink distribution Key: FLINK-12935 URL: https://issues.apache.org/jira/browse/FLINK-12935 Proj

Specifying parallelism on join operation

2019-06-21 Thread Roshan Naik
I cant find any place to specify the parallelism for the join here.  stream1.join( stream2 )                      .where( .. )                     .equalTo( .. )                     .window( .. )                     .apply( .. ); How can we specify that ?  -roshan

[jira] [Created] (FLINK-12936) Support intersect all and minus all to blink planner

2019-06-21 Thread Jingsong Lee (JIRA)
Jingsong Lee created FLINK-12936: Summary: Support intersect all and minus all to blink planner Key: FLINK-12936 URL: https://issues.apache.org/jira/browse/FLINK-12936 Project: Flink Issue Ty

[jira] [Created] (FLINK-12937) Introduce join reorder planner rules in blink planner

2019-06-21 Thread godfrey he (JIRA)
godfrey he created FLINK-12937: -- Summary: Introduce join reorder planner rules in blink planner Key: FLINK-12937 URL: https://issues.apache.org/jira/browse/FLINK-12937 Project: Flink Issue Type:

[jira] [Created] (FLINK-12938) Translate "Streaming Connectors" page into Chinese

2019-06-21 Thread Jark Wu (JIRA)
Jark Wu created FLINK-12938: --- Summary: Translate "Streaming Connectors" page into Chinese Key: FLINK-12938 URL: https://issues.apache.org/jira/browse/FLINK-12938 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-12939) Translate "Apache Kafka Connector" page into Chinese

2019-06-21 Thread Jark Wu (JIRA)
Jark Wu created FLINK-12939: --- Summary: Translate "Apache Kafka Connector" page into Chinese Key: FLINK-12939 URL: https://issues.apache.org/jira/browse/FLINK-12939 Project: Flink Issue Type: Sub-ta

[jira] [Created] (FLINK-12940) Translate "Apache Cassandra Connector" page into Chinese

2019-06-21 Thread Jark Wu (JIRA)
Jark Wu created FLINK-12940: --- Summary: Translate "Apache Cassandra Connector" page into Chinese Key: FLINK-12940 URL: https://issues.apache.org/jira/browse/FLINK-12940 Project: Flink Issue Type: Su

[jira] [Created] (FLINK-12941) Translate "Amazon AWS Kinesis Streams Connector" page into Chinese

2019-06-21 Thread Jark Wu (JIRA)
Jark Wu created FLINK-12941: --- Summary: Translate "Amazon AWS Kinesis Streams Connector" page into Chinese Key: FLINK-12941 URL: https://issues.apache.org/jira/browse/FLINK-12941 Project: Flink Iss

[jira] [Created] (FLINK-12942) Translate "Elasticsearch Connector" page into Chinese

2019-06-21 Thread Jark Wu (JIRA)
Jark Wu created FLINK-12942: --- Summary: Translate "Elasticsearch Connector" page into Chinese Key: FLINK-12942 URL: https://issues.apache.org/jira/browse/FLINK-12942 Project: Flink Issue Type: Sub-t

[jira] [Created] (FLINK-12943) Translate "HDFS Connector" page into Chinese

2019-06-21 Thread Jark Wu (JIRA)
Jark Wu created FLINK-12943: --- Summary: Translate "HDFS Connector" page into Chinese Key: FLINK-12943 URL: https://issues.apache.org/jira/browse/FLINK-12943 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-12946) Translate "Apache NiFi Connector" page into Chinese

2019-06-21 Thread Jark Wu (JIRA)
Jark Wu created FLINK-12946: --- Summary: Translate "Apache NiFi Connector" page into Chinese Key: FLINK-12946 URL: https://issues.apache.org/jira/browse/FLINK-12946 Project: Flink Issue Type: Sub-tas

[jira] [Created] (FLINK-12944) Translate "Streaming File Sink" page into Chinese

2019-06-21 Thread Jark Wu (JIRA)
Jark Wu created FLINK-12944: --- Summary: Translate "Streaming File Sink" page into Chinese Key: FLINK-12944 URL: https://issues.apache.org/jira/browse/FLINK-12944 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-12945) Translate "RabbitMQ Connector" page into Chinese

2019-06-21 Thread Jark Wu (JIRA)
Jark Wu created FLINK-12945: --- Summary: Translate "RabbitMQ Connector" page into Chinese Key: FLINK-12945 URL: https://issues.apache.org/jira/browse/FLINK-12945 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-12947) Translate "Twitter Connector" page into Chinese

2019-06-21 Thread Jark Wu (JIRA)
Jark Wu created FLINK-12947: --- Summary: Translate "Twitter Connector" page into Chinese Key: FLINK-12947 URL: https://issues.apache.org/jira/browse/FLINK-12947 Project: Flink Issue Type: Sub-task