Re: [DISCUSS] FLIP-36 - Support Interactive Programming in Flink Table API

2020-05-19 Thread Xuannan Su
Hi folks, As the feature freeze of Flink 1.11 has passed and the release branch is cut, I'd like to revive this discussion thread of FLIP-36[1]. A quick summary of FLIP-36: The FLIP proposes to add support for interactive programming in Flink Table API. Specifically, it let users cache the interm

[jira] [Created] (FLINK-17805) InputProcessorUtil doesn't handle indexes for multiple inputs operators correctly

2020-05-19 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-17805: -- Summary: InputProcessorUtil doesn't handle indexes for multiple inputs operators correctly Key: FLINK-17805 URL: https://issues.apache.org/jira/browse/FLINK-17805

[jira] [Created] (FLINK-17806) CollectSinkFunctionTest.testCheckpointedFunction fails with expected:<50> but was:<0>

2020-05-19 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-17806: -- Summary: CollectSinkFunctionTest.testCheckpointedFunction fails with expected:<50> but was:<0> Key: FLINK-17806 URL: https://issues.apache.org/jira/browse/FLINK-17806

[jira] [Created] (FLINK-17807) Fix the broken link "/zh/ops/memory/mem_detail.html" in documentation

2020-05-19 Thread Jark Wu (Jira)
Jark Wu created FLINK-17807: --- Summary: Fix the broken link "/zh/ops/memory/mem_detail.html" in documentation Key: FLINK-17807 URL: https://issues.apache.org/jira/browse/FLINK-17807 Project: Flink

[jira] [Created] (FLINK-17808) Rename checkpoint meta file to "_metadata" until it has completed writing

2020-05-19 Thread Yun Tang (Jira)
Yun Tang created FLINK-17808: Summary: Rename checkpoint meta file to "_metadata" until it has completed writing Key: FLINK-17808 URL: https://issues.apache.org/jira/browse/FLINK-17808 Project: Flink

[jira] [Created] (FLINK-17809) BashJavaUtil script logic does not work for paths with spaces

2020-05-19 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-17809: Summary: BashJavaUtil script logic does not work for paths with spaces Key: FLINK-17809 URL: https://issues.apache.org/jira/browse/FLINK-17809 Project: Flink

Need Help on Flink suitability to our usecase

2020-05-19 Thread Prasanna kumar
Hi, I have the following usecase to implement in my organization. Say there is huge relational database(1000 tables for each of our 30k customers) in our monolith setup We want to reduce the load on the DB and prevent the applications from hitting it for latest events. So an extract is done from

[jira] [Created] (FLINK-17810) Add document for K8s application mode

2020-05-19 Thread Yang Wang (Jira)
Yang Wang created FLINK-17810: - Summary: Add document for K8s application mode Key: FLINK-17810 URL: https://issues.apache.org/jira/browse/FLINK-17810 Project: Flink Issue Type: Sub-task

Google Season of Document

2020-05-19 Thread Hossam Elsafty
Dear aljoscha and sjwiesman, I am Hossam Elsafty a graduated from the Faculty of Engineering Computer and System Department. As one of my academic courses, I have finished Technical Reports Writing. Regarding my previous experience, I have done two internships as a Software Engineer including

Discussion on Project Idea for Session Of docs 2020

2020-05-19 Thread Divya Sanghi
Hello Aljoscha , Sjwiesman I am working on Big Data technologies and have hands-on experience on Flink, Spark, Kafka. These are some tasks done by me: 1. I did POC where I created a Docker image of Fink job and ran it on the K8S cluster on the local machine. Attaching my POC project: https://gith

Re: [NOTICE] Azure Pipelines Status

2020-05-19 Thread Robert Metzger
Microsoft has not increased our capacity yet (even though it was promised to me yesterday again). I have now merged a hotfix disabling the e2e test execution on pull requests to have enough capacity on master. Please run e2e tests using your private Azure accounts. Thanks for your understanding!

[jira] [Created] (FLINK-17811) Update docker hub Flink page

2020-05-19 Thread Andrey Zagrebin (Jira)
Andrey Zagrebin created FLINK-17811: --- Summary: Update docker hub Flink page Key: FLINK-17811 URL: https://issues.apache.org/jira/browse/FLINK-17811 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-17812) Bundled reporters in plugins/ directory

2020-05-19 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-17812: Summary: Bundled reporters in plugins/ directory Key: FLINK-17812 URL: https://issues.apache.org/jira/browse/FLINK-17812 Project: Flink Issue Type: I

[jira] [Created] (FLINK-17813) Manually test unaligned checkpoints on a cluster

2020-05-19 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-17813: -- Summary: Manually test unaligned checkpoints on a cluster Key: FLINK-17813 URL: https://issues.apache.org/jira/browse/FLINK-17813 Project: Flink Issue Ty

Re: Google Season of Document

2020-05-19 Thread Seth Wiesman
Hi Hossam, Please apply! We look forward to reviewing your application. Let us know if you have any questions. Seth On Tue, May 19, 2020 at 8:09 AM Hossam Elsafty wrote: > Dear aljoscha and sjwiesman, > > I am Hossam Elsafty a graduated from the Faculty of Engineering Computer > and System Dep

Re: Discussion on Project Idea for Session Of docs 2020

2020-05-19 Thread Seth Wiesman
Hi Divya, Thrilled to see your interest in the project. We are looking to work with someone to expand Flink SQL's reach. What we proposed on the blog is our initial idea's but we are open to any suggestions or modifications on the proposal if you have ideas about how it could be improved. I am hap

Re: Interested In Google Season of Docs!

2020-05-19 Thread Seth Wiesman
Hi Roopal, *Restructure the Table API & SQL Documentation* Right now the Table / SQL documentation is very technical and dry to read. It is more like a technical specification than documentation that a new user could read. This project is to take the existing content and rewrite/reorganize it to

[jira] [Created] (FLINK-17814) Translate native kubernetes document to Chinese

2020-05-19 Thread Yang Wang (Jira)
Yang Wang created FLINK-17814: - Summary: Translate native kubernetes document to Chinese Key: FLINK-17814 URL: https://issues.apache.org/jira/browse/FLINK-17814 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-17815) Change KafkaConnector to give per-partition metric group to WatermarkGenerator

2020-05-19 Thread Aljoscha Krettek (Jira)
Aljoscha Krettek created FLINK-17815: Summary: Change KafkaConnector to give per-partition metric group to WatermarkGenerator Key: FLINK-17815 URL: https://issues.apache.org/jira/browse/FLINK-17815

[jira] [Created] (FLINK-17816) Change Latency Marker to work with "scheduleAtFixedDelay" instead of "scheduleAtFixedRate"

2020-05-19 Thread Stephan Ewen (Jira)
Stephan Ewen created FLINK-17816: Summary: Change Latency Marker to work with "scheduleAtFixedDelay" instead of "scheduleAtFixedRate" Key: FLINK-17816 URL: https://issues.apache.org/jira/browse/FLINK-17816

[jira] [Created] (FLINK-17817) CollectResultFetcher fails with EOFException in AggregateReduceGroupingITCase

2020-05-19 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-17817: -- Summary: CollectResultFetcher fails with EOFException in AggregateReduceGroupingITCase Key: FLINK-17817 URL: https://issues.apache.org/jira/browse/FLINK-17817 Pro

Re: [NOTICE] Azure Pipelines Status

2020-05-19 Thread Robert Metzger
Microsoft has now doubled our CI capacity (to 20 concurrent VMs for executing e2e tests). If the e2e test execution is normalized tomorrow, I will revert the hotfix, enabling e2e tests on PRs again. Sorry for the back and forth. On Tue, May 19, 2020 at 3:11 PM Robert Metzger wrote: > Microsoft

[jira] [Created] (FLINK-17818) CSV Reader with Pojo Type and no field names fails

2020-05-19 Thread Danish Amjad (Jira)
Danish Amjad created FLINK-17818: Summary: CSV Reader with Pojo Type and no field names fails Key: FLINK-17818 URL: https://issues.apache.org/jira/browse/FLINK-17818 Project: Flink Issue Type

[jira] [Created] (FLINK-17819) Yarn error unhelpful when forgetting HADOOP_CLASSPATH

2020-05-19 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-17819: --- Summary: Yarn error unhelpful when forgetting HADOOP_CLASSPATH Key: FLINK-17819 URL: https://issues.apache.org/jira/browse/FLINK-17819 Project: Flink Issue Typ

[jira] [Created] (FLINK-17820) Memory threshold is ignored for channel state

2020-05-19 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-17820: - Summary: Memory threshold is ignored for channel state Key: FLINK-17820 URL: https://issues.apache.org/jira/browse/FLINK-17820 Project: Flink Issue

[jira] [Created] (FLINK-17821) Kafka010TableITCase>KafkaTableTestBase.testKafkaSourceSink failed on AZP

2020-05-19 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-17821: --- Summary: Kafka010TableITCase>KafkaTableTestBase.testKafkaSourceSink failed on AZP Key: FLINK-17821 URL: https://issues.apache.org/jira/browse/FLINK-17821 Project: Flink

[jira] [Created] (FLINK-17822) Flink CLI end-to-end test failed with "JavaGcCleanerWrapper$PendingCleanersRunner cannot access class jdk.internal.misc.SharedSecrets" in JDK 11

2020-05-19 Thread Dian Fu (Jira)
Dian Fu created FLINK-17822: --- Summary: Flink CLI end-to-end test failed with "JavaGcCleanerWrapper$PendingCleanersRunner cannot access class jdk.internal.misc.SharedSecrets" in JDK 11 Key: FLINK-17822 URL: https://iss

[jira] [Created] (FLINK-17823) Resolve the race condition while releasing RemoteInputChannel

2020-05-19 Thread Zhijiang (Jira)
Zhijiang created FLINK-17823: Summary: Resolve the race condition while releasing RemoteInputChannel Key: FLINK-17823 URL: https://issues.apache.org/jira/browse/FLINK-17823 Project: Flink Issue

[jira] [Created] (FLINK-17824) "Resuming Savepoint" e2e stalls indefinitely

2020-05-19 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-17824: -- Summary: "Resuming Savepoint" e2e stalls indefinitely Key: FLINK-17824 URL: https://issues.apache.org/jira/browse/FLINK-17824 Project: Flink Issue Type:

Re: MODERATE for dev@flink.apache.org

2020-05-19 Thread Henry Saputra
Hi, Looks like you are trying to send email to Apache Flink dev@ mailing list without subscribing yet. Please subscribe to the dev mailing list [1] to be able to see the reply and follow up with your question. Thanks, Henry On behalf of Apache Flink PMC [1] https://flink.apache.org/community.h

[jira] [Created] (FLINK-17825) HA end-to-end gets killed due to timeout

2020-05-19 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-17825: -- Summary: HA end-to-end gets killed due to timeout Key: FLINK-17825 URL: https://issues.apache.org/jira/browse/FLINK-17825 Project: Flink Issue Type: Bug