[jira] [Created] (FLINK-13090) Test Hive connector with hive runner

Rui Li created FLINK-13090: -- Summary: Test Hive connector with hive runner Key: FLINK-13090 URL: https://issues.apache.org/jira/browse/FLINK-13090 Project: Flink Issue Type: Sub-task

Re: Flink 1.6.4 Issue on RocksDB incremental checkpoints and fs.default-scheme

Dear Yun, thank you for your support then. We will update as soon as we can. Cheers, On Thu, 4 Jul 2019, 04:57 Yun Tang, wrote: > Hi Andrea > > This should be a bug already fixed by > https://issues.apache.org/jira/browse/FLINK-12042 , you could upgrade to > at least 1.7.3 version to avoid

Re: [DISCUSS] solve unstable build capacity problem on TravisCI

Re: > Are they using their own Travis CI pool, or did the switch to an entirely different CI service? I reached out to Wes and Krisztián from Apache Arrow PMC. They are currently moving away from ASF's Travis to their own in-house metal machines at [1] with custom CI application at [2]. They've

[jira] [Created] (FLINK-13089) Implement batch nested loop join in blink

Jingsong Lee created FLINK-13089: Summary: Implement batch nested loop join in blink Key: FLINK-13089 URL: https://issues.apache.org/jira/browse/FLINK-13089 Project: Flink Issue Type: New

[DISCUSS] Make window state queryable

Hi folks, Currently, the queryable state is not widely used in production. IMO, there are two key reasons caused this result. 1) the client of the queryable state is hard to use. Because it requires users to know the address of TaskManager and the port of the proxy. Actually, most business users

Request for contributor permission

Hi , I want to contribute to Apache Flink, and my JIRA ID is xuchao. Would you please give me the contributor permission? Thanks, xuchao

Re: Flink 1.6.4 Issue on RocksDB incremental checkpoints and fs.default-scheme

Hi Andrea This should be a bug already fixed by https://issues.apache.org/jira/browse/FLINK-12042 , you could upgrade to at least 1.7.3 version to avoid this bug. Best Yun Tang From: Andrea Spina Sent: Wednesday, July 3, 2019 15:46 To: dev@flink.apache.org

答复: Application for contributor permission

Yes,it's mine. -邮件原件- 发件人: jincheng sun [mailto:sunjincheng...@gmail.com] 发送时间: 2019年7月4日 10:26 收件人: dev 主题: Re: Application for contributor permission Hi wudi， Thank you for your willingness to contribute to the Flink community，just confirm, does the follows page is your profile?

Re: Application for contributor permission

Hi wudi， Thank you for your willingness to contribute to the Flink community，just confirm, does the follows page is your profile? https://issues.apache.org/jira/secure/ViewProfile.jspa?name=wuyanzu Best, Jincheng 吴迪 于2019年7月4日周四 上午9:52写道： > Hi , > > I want to contribute to Apache Flink, and

[jira] [Created] (FLINK-13088) Supports execute DAG plan

godfrey he created FLINK-13088: -- Summary: Supports execute DAG plan Key: FLINK-13088 URL: https://issues.apache.org/jira/browse/FLINK-13088 Project: Flink Issue Type: New Feature

Re: [DISCUSS] FLIP-44: Support Local Aggregation in Flink

Hi Kurt, Sorry for the late statement. Yes, your statement basically reflects our communication conclusions. Yesterday, I am busy with another proposal and some other things. Some part of the FLIP documentation has not been fully updated. Let's listen to the further opinion after many

Re: [DISCUSS] FLIP-44: Support Local Aggregation in Flink

Hi all, I have talked to vino offline try to have a better understanding about the motivation and functionality this FLIP he wanted to have. Seems there indeed exists some misunderstandings for the previous discussions. I will try to summarize the original scenario and requirements from vino and

Application for contributor permission

Hi , I want to contribute to Apache Flink, and my JIRA ID is wuyanzu. Would you please give me the contributor permission? Thx.

[jira] [Created] (FLINK-13087) Add group window Aggregate operator to Table API

Hequn Cheng created FLINK-13087: --- Summary: Add group window Aggregate operator to Table API Key: FLINK-13087 URL: https://issues.apache.org/jira/browse/FLINK-13087 Project: Flink Issue Type:

[jira] [Created] (FLINK-13086) add Chinese documentation for catalogs

Bowen Li created FLINK-13086: Summary: add Chinese documentation for catalogs Key: FLINK-13086 URL: https://issues.apache.org/jira/browse/FLINK-13086 Project: Flink Issue Type: Sub-task

Re: Source Kafka and Sink Hive managed tables via Flink Job

BTW, I'm adding user@ mailing list since this is a user question and should be asked there. dev@ mailing list is only for discussions of Flink development. Please see https://flink.apache.org/community.html#mailing-lists On Wed, Jul 3, 2019 at 12:34 PM Bowen Li wrote: > Hi Youssef, > > You

Re: Source Kafka and Sink Hive managed tables via Flink Job

Hi Youssef, You need to provide more background context: - Which Hive sink are you using? We are working on the official Hive sink for community and will be released in 1.9. So did you develop yours in house? - What do you mean by 1st, 2nd, 3rd window? You mean the parallel instances of the same

[jira] [Created] (FLINK-13085) unable to run python test locally

Bowen Li created FLINK-13085: Summary: unable to run python test locally Key: FLINK-13085 URL: https://issues.apache.org/jira/browse/FLINK-13085 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-13084) Improve Queryable State Documentation

Matt Lloyd created FLINK-13084: -- Summary: Improve Queryable State Documentation Key: FLINK-13084 URL: https://issues.apache.org/jira/browse/FLINK-13084 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-13083) Various improvements PubSub Connector

Richard Deurwaarder created FLINK-13083: --- Summary: Various improvements PubSub Connector Key: FLINK-13083 URL: https://issues.apache.org/jira/browse/FLINK-13083 Project: Flink Issue

Re: Rolling policy when using StreamingFileSink for bulk-encoded output

Thanks Ying! Looking forward to your contribution. Kostas On Wed, Jul 3, 2019 at 6:48 PM Ying Xu wrote: > Hi Kostas: > > For simplicity FLINK-13027 > has been assigned to > my > current user ID. I will contribute using that ID. > > Will

Re: Rolling policy when using StreamingFileSink for bulk-encoded output

Hi Kostas: For simplicity FLINK-13027 has been assigned to my current user ID. I will contribute using that ID. Will circulate with the community once we have initial success with this new rolling policy ! Thank you again. - Ying On Fri,

[jira] [Created] (FLINK-13082) Support MatchRecognize in blink planner

Jark Wu created FLINK-13082: --- Summary: Support MatchRecognize in blink planner Key: FLINK-13082 URL: https://issues.apache.org/jira/browse/FLINK-13082 Project: Flink Issue Type: New Feature

[DISCUSS] FLIP-45: Reinforce Job Stop Semantic

Hi Flink devs, Through recent discussion on job stop processing, we found its semantic is incomplete, mainly reflected in two aspects: 1. In our released versions [1], the stop process is as follows: - A “stop” call is a graceful way of stopping a running streaming job. When the user

[jira] [Created] (FLINK-13081) Supports explain and execute DAG plan

godfrey he created FLINK-13081: -- Summary: Supports explain and execute DAG plan Key: FLINK-13081 URL: https://issues.apache.org/jira/browse/FLINK-13081 Project: Flink Issue Type: New Feature

Re: [DISCUSS] Publish the PyFlink into PyPI

So this would not be a source release then, but a full-blown binary release. Maybe it is just me, but I find it a bit suspect to ship an entire java application via PyPI, just because there's a Python API for it. We definitely need input from more people here. On 03/07/2019 14:09, Dian Fu

Re: [DISCUSS] Publish the PyFlink into PyPI

Hi Chesnay, Thanks a lot for the suggestions. Regarding “distributing java/scala code to PyPI”: The Python Table API is just a wrapper of the Java Table API and without the java/scala code, two steps will be needed to set up an environment to execute a Python Table API program: 1) Install

I want to contribute to Apache Flink

Hi, I want to contribute to Apache Flink. Would you please give me the contributor permission? My JIRA ID is lucas_hust

Re: [DISCUSS] Publish the PyFlink into PyPI

The existing artifact in the pyflink project was neither released by the Flink project / anyone affiliated with it nor approved by the Flink PMC. As such, if we were to use this account I believe we should delete it to not mislead users that this is in any way an apache-provided distribution.

[jira] [Created] (FLINK-13080) Implement Sparrow Scheduler for Flink

Mridul Verma created FLINK-13080: Summary: Implement Sparrow Scheduler for Flink Key: FLINK-13080 URL: https://issues.apache.org/jira/browse/FLINK-13080 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-13079) Make window state queryable

vinoyang created FLINK-13079: Summary: Make window state queryable Key: FLINK-13079 URL: https://issues.apache.org/jira/browse/FLINK-13079 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-13078) Add a type parser utility

Timo Walther created FLINK-13078: Summary: Add a type parser utility Key: FLINK-13078 URL: https://issues.apache.org/jira/browse/FLINK-13078 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-13077) CatalogPartitionAPICompletenessTests in pyflink failed because of lacking "getComment" method

Wei Zhong created FLINK-13077: - Summary: CatalogPartitionAPICompletenessTests in pyflink failed because of lacking "getComment" method Key: FLINK-13077 URL: https://issues.apache.org/jira/browse/FLINK-13077

Re: Contributing Code Guide - Clarification

My personal take is the following: - These improvements are welcome in general. Improving code quality is a good idea. - At the same time, these refactorings can easily introduce new bugs - I would focus on issues where there is clearly duplication without need, but the code and refactoring

Re: [DISCUSS] Proposal for Flink job execution/availability metrics impovement

Hi, I am sharing the last doc, which is about progress monitor (a little deferred sharing by my vacation): https://docs.google.com/document/d/1Ov9A7V2tMs4uVimcSeHL5eftRJ3MCJBiVSFNdz8rmjU/edit?usp=sharing This last one seems like pretty independent from the first two (execution tracking and

Re: [DISCUSS] Proposal for Flink job execution/availability metrics impovement

Hi Becket, Sorry for the late response since I might have missed this during my vacation. Thanks for the feedback! Please find inlined below. 2019년 6월 16일 (일) 오후 6:46, Becket Qin 님이 작성: > Hi Hwanju, > > Thanks for the proposal. The enhancement will improve the operability of > Flink and make it

Source Kafka and Sink Hive managed tables via Flink Job

Dear all, I'm working for a big project and one of the challenge is to read Kafka topics and copy them via Hive command into Hive managed tables in order to enable ACID HIVE properties. I try it but I have a issue with back pressure: - The first window read 20.000 events and wrote them in Hive

[jira] [Created] (FLINK-13076) Bump Calcite dependency to 1.20.0 in blink planner

godfrey he created FLINK-13076: -- Summary: Bump Calcite dependency to 1.20.0 in blink planner Key: FLINK-13076 URL: https://issues.apache.org/jira/browse/FLINK-13076 Project: Flink Issue Type:

Re: Flink 1.6.4 Issue on RocksDB incremental checkpoints and fs.default-scheme

Hi, I attached also the JM log. Thereby you can appreciate the exception. I hope that can help. As I said previously, disabling *fs.default-scheme *property solved my issue. cheers, Il giorno lun 1 lug 2019 alle ore 18:17 Yun Tang ha scritto: > Hi Andrea > > Unfortunately, the tm log provided

[jira] [Created] (FLINK-13075) Project pushdown rule shouldn't require the TableSource return a modified schema in blink planner

Jark Wu created FLINK-13075: --- Summary: Project pushdown rule shouldn't require the TableSource return a modified schema in blink planner Key: FLINK-13075 URL: https://issues.apache.org/jira/browse/FLINK-13075

[jira] [Created] (FLINK-13074) Add PartitionableTableSink bridge logic to blink planner

Danny Chan created FLINK-13074: -- Summary: Add PartitionableTableSink bridge logic to blink planner Key: FLINK-13074 URL: https://issues.apache.org/jira/browse/FLINK-13074 Project: Flink Issue

Re: [DISCUSS] solve unstable build capacity problem on TravisCI

Are they using their own Travis CI pool, or did the switch to an entirely different CI service? If we can just switch to our own Travis pool, just for our project, then this might be something we can do fairly quickly? On 03/07/2019 05:55, Bowen Li wrote: I responded in the INFRA ticket [1]

Re: RE: [DISCUSS] Improve Queryable State and introduce aQueryServerProxy component

Hi vino, Big +1 for this. Glad to see new progress on this topic! I’ve left some comments on it. Best Regards, Jiayi Liao Original Message Sender:vino yangyanghua1...@gmail.com Recipient:Georgi stoyanovgstoya...@live.com Cc:dev...@flink.apache.org; useru...@flink.apache.org; Stefan

Re: [ANNOUNCE] Apache Flink 1.8.1 released

Thanks jincheng for your great job. Best, JingsongLee -- From:Congxian Qiu Send Time:2019年7月3日(星期三) 14:35 To:dev@flink.apache.org Cc:Dian Fu ; jincheng sun ; Hequn Cheng ; user ; announce Subject:Re: [ANNOUNCE] Apache Flink

[jira] [Created] (FLINK-13073) BinaryRow in Blink runtime has wrong FIRST_BYTE_ZERO mask

Louis Xu created FLINK-13073: Summary: BinaryRow in Blink runtime has wrong FIRST_BYTE_ZERO mask Key: FLINK-13073 URL: https://issues.apache.org/jira/browse/FLINK-13073 Project: Flink Issue

Re: [ANNOUNCE] Apache Flink 1.8.1 released

Thanks for being the release manager and the great job Best, Congxian Jark Wu 于2019年7月3日周三 上午10:23写道： > Thanks for being the release manager and the great job! > > Cheers, > Jark > > On Wed, 3 Jul 2019 at 10:16, Dian Fu wrote: > > > Awesome! Thanks a lot for being the release manager. Great