[jira] [Created] (FLINK-14264) Expose CheckpointBackend in checkpoint config RestAPI

Congxian Qiu(klion26) created FLINK-14264: - Summary: Expose CheckpointBackend in checkpoint config RestAPI Key: FLINK-14264 URL: https://issues.apache.org/jira/browse/FLINK-14264 Project:

[jira] [Created] (FLINK-14263) Extract static method from ClusterClient to ClientUtils

Zili Chen created FLINK-14263: - Summary: Extract static method from ClusterClient to ClientUtils Key: FLINK-14263 URL: https://issues.apache.org/jira/browse/FLINK-14263 Project: Flink Issue

Re: [VOTE] FLIP-57: Rework FunctionCatalog

@Dawid, do you have any other concerns? If not, I hope we can close the voting. On Thu, Sep 26, 2019 at 8:14 PM Rui Li wrote: > I'm not sure how much benefit #1 can bring us. If users just want to try > out temporary functions, they can create temporary system functions which > don't require a

Re: [COMMITTER] repo locked due to synchronization issues

+1 for recommendation to use the github repo Thanks, Thomas On Fri, Sep 27, 2019 at 9:29 AM Rong Rong wrote: > +1 on to state with one recommendation method in the wiki. > I haven't encountered this often, so I do not have a preference regarding > which way to go (Gitbox or Github). However,

[jira] [Created] (FLINK-14262) support referencing function with fully/partially qualified names in SQL

Bowen Li created FLINK-14262: Summary: support referencing function with fully/partially qualified names in SQL Key: FLINK-14262 URL: https://issues.apache.org/jira/browse/FLINK-14262 Project: Flink

Re: [COMMITTER] repo locked due to synchronization issues

+1 on to state with one recommendation method in the wiki. I haven't encountered this often, so I do not have a preference regarding which way to go (Gitbox or Github). However, I've experienced some different issues on both Github and Gitbox when setting up new committer credentials. If

[jira] [Created] (FLINK-14261) Add support for permanently fenced RpcEndpoints

Till Rohrmann created FLINK-14261: - Summary: Add support for permanently fenced RpcEndpoints Key: FLINK-14261 URL: https://issues.apache.org/jira/browse/FLINK-14261 Project: Flink Issue

[jira] [Created] (FLINK-14260) Remove Mockito usage from TestingJobManagerRunnerFactory

Till Rohrmann created FLINK-14260: - Summary: Remove Mockito usage from TestingJobManagerRunnerFactory Key: FLINK-14260 URL: https://issues.apache.org/jira/browse/FLINK-14260 Project: Flink

[jira] [Created] (FLINK-14259) Extract JobManagerRunner interface for improved testability

Till Rohrmann created FLINK-14259: - Summary: Extract JobManagerRunner interface for improved testability Key: FLINK-14259 URL: https://issues.apache.org/jira/browse/FLINK-14259 Project: Flink

[jira] [Created] (FLINK-14258) Integrate hive to FileSystemTableFactory

Jingsong Lee created FLINK-14258: Summary: Integrate hive to FileSystemTableFactory Key: FLINK-14258 URL: https://issues.apache.org/jira/browse/FLINK-14258 Project: Flink Issue Type:

[jira] [Created] (FLINK-14257) Integrate csv to FileSystemTableFactory

Jingsong Lee created FLINK-14257: Summary: Integrate csv to FileSystemTableFactory Key: FLINK-14257 URL: https://issues.apache.org/jira/browse/FLINK-14257 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-14256) Introduce FileSystemTableFactory

Jingsong Lee created FLINK-14256: Summary: Introduce FileSystemTableFactory Key: FLINK-14256 URL: https://issues.apache.org/jira/browse/FLINK-14256 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-14255) Introduce StreamingFileSystemSink

Jingsong Lee created FLINK-14255: Summary: Introduce StreamingFileSystemSink Key: FLINK-14255 URL: https://issues.apache.org/jira/browse/FLINK-14255 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-14254) Introduce FileSystemOutputFormat

Jingsong Lee created FLINK-14254: Summary: Introduce FileSystemOutputFormat Key: FLINK-14254 URL: https://issues.apache.org/jira/browse/FLINK-14254 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-14253) Add hash distribution and sort grouping only when dynamic partition insert

Jingsong Lee created FLINK-14253: Summary: Add hash distribution and sort grouping only when dynamic partition insert Key: FLINK-14253 URL: https://issues.apache.org/jira/browse/FLINK-14253 Project:

[jira] [Created] (FLINK-14252) Encapsulate Dispatcher services in DispatcherServices container

Till Rohrmann created FLINK-14252: - Summary: Encapsulate Dispatcher services in DispatcherServices container Key: FLINK-14252 URL: https://issues.apache.org/jira/browse/FLINK-14252 Project: Flink

[jira] [Created] (FLINK-14251) Add FutureUtils#forward utility

Till Rohrmann created FLINK-14251: - Summary: Add FutureUtils#forward utility Key: FLINK-14251 URL: https://issues.apache.org/jira/browse/FLINK-14251 Project: Flink Issue Type: Improvement

[ANNOUNCE] Progress of Apache Flink 1.10 #1

Hi community, Since we are now more than one month into the Flink 1.10 release cycle, we thought it would be adequate to give a progress update. Below we have included a list of the ongoing efforts that we are aware of, together with a brief summary of their state. As always, the list is not

[jira] [Created] (FLINK-14250) Introduce separate "bin/flink runpy" and remove python support from "bin/flink run"

Aljoscha Krettek created FLINK-14250: Summary: Introduce separate "bin/flink runpy" and remove python support from "bin/flink run" Key: FLINK-14250 URL: https://issues.apache.org/jira/browse/FLINK-14250

[jira] [Created] (FLINK-14249) Rework table partition support

Jingsong Lee created FLINK-14249: Summary: Rework table partition support Key: FLINK-14249 URL: https://issues.apache.org/jira/browse/FLINK-14249 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-14248) LazyFromSourcesSchedulingStrategy should support to tasks in terminal state

Zhu Zhu created FLINK-14248: --- Summary: LazyFromSourcesSchedulingStrategy should support to tasks in terminal state Key: FLINK-14248 URL: https://issues.apache.org/jira/browse/FLINK-14248 Project: Flink

Re: [VOTE] FLIP-63: Rework table partition support

Thanks for the votes! We have 3 binding +1's from Kurt, Jark, Bowen. Have 3 non-binding +1's from xuefu, terry, rui. Thank you for the vote. Since there are no disapproving votes and the voting time has passed, I will see this FLIP as approved to be adopted into Apache Flink. Best, Jingsong Lee

Re: [DISCUSS] FLIP-73: Introducing Executors for job submission

Hi Zili, I think we are more or less on the same page with most of the stuff you mentioned. The only slight difference, at least in my opinion, is that I do not see the Executors as being a "Client". As you mentioned, I can see having the following: 1). ClusterClientFactory: responsible for

[jira] [Created] (FLINK-14247) Use NoResourceAvailableException to wrap TimeoutException on slot allocation (Scheduler NG)

Zhu Zhu created FLINK-14247: --- Summary: Use NoResourceAvailableException to wrap TimeoutException on slot allocation (Scheduler NG) Key: FLINK-14247 URL: https://issues.apache.org/jira/browse/FLINK-14247

[jira] [Created] (FLINK-14246) Annotate all MiniCluster tests in flink-runtime with AlsoRunWithSchedulerNG

Zhu Zhu created FLINK-14246: --- Summary: Annotate all MiniCluster tests in flink-runtime with AlsoRunWithSchedulerNG Key: FLINK-14246 URL: https://issues.apache.org/jira/browse/FLINK-14246 Project: Flink

Re: [DISCUSS] FLIP-74: Flink JobClient API

Hi Flavio, I agree that this would be good to have. But I also think that this is outside the scope of FLIP-74, I think it is an orthogonal feature. Best, Aljoscha > On 27. Sep 2019, at 10:31, Flavio Pompermaier wrote: > > Hi all, > just a remark about the Flink REST APIs (and its client as

Re: REST API / JarRunHandler: More flexibility for launching jobs

Hi Thomas, Ok, I agree with the necessity of running a job without a Java Client. FLIP-73 aims at introducing a Pipeline (or FlinkPipeline) interface that is the common interface of StreamGraph and Plan. Maybe we could reintroduce something like Program that returns a Pipeline for this

[jira] [Created] (FLINK-14245) Kafka010ProducerITCase>KafkaProducerTestBase.testOneToOneAtLeastOnceRegularSink fails on Travis

Till Rohrmann created FLINK-14245: - Summary: Kafka010ProducerITCase>KafkaProducerTestBase.testOneToOneAtLeastOnceRegularSink fails on Travis Key: FLINK-14245 URL:

Re: [DISCUSS] FLIP-73: Introducing Executors for job submission

Thanks for your reply Kostas. As mentioned in FLIP-74 thread[1] there are two questions on Executor design (1) Where Executor is in a multi-layered clients view. (2) A bit more details about PerJobExecutor implementation. For (1) Where Executor is in a multi-layered clients view, As described

[jira] [Created] (FLINK-14244) Use correct RestartBackoffTimetrategy in new DefaultScheduler

Gary Yao created FLINK-14244: Summary: Use correct RestartBackoffTimetrategy in new DefaultScheduler Key: FLINK-14244 URL: https://issues.apache.org/jira/browse/FLINK-14244 Project: Flink Issue

Re: [DISCUSS] FLIP-74: Flink JobClient API

Hi all, just a remark about the Flink REST APIs (and its client as well): almost all the times we need a way to dynamically know which jobs are contained in a jar file, and this could be exposed by the REST endpoint under /jars/:jarid/entry-points (a simple way to implement this would be to check

[jira] [Created] (FLINK-14243) flink hiveudf need some check whether it is using cache

jackylau created FLINK-14243: Summary: flink hiveudf need some check whether it is using cache Key: FLINK-14243 URL: https://issues.apache.org/jira/browse/FLINK-14243 Project: Flink Issue Type:

Re: [DISCUSS] FLIP-75: Flink Web UI Improvement Proposal

Filed a jira to track this[1]. Thanks a lot. [1] https://issues.apache.org/jira/browse/FLINK-14242 Best, Paul Lam > 在 2019年9月27日，14:34，Yadong Xie 写道： > > Hi Paul > Thanks for your suggestion. > I think it is easy to implement, could you

[jira] [Created] (FLINK-14242) Collapse task names in job graph visualization if too long

Paul Lin created FLINK-14242: Summary: Collapse task names in job graph visualization if too long Key: FLINK-14242 URL: https://issues.apache.org/jira/browse/FLINK-14242 Project: Flink Issue

Re: [DISCUSS] FLIP-74: Flink JobClient API

modify /we just shutdown the cluster on the exit of client that running inside cluster/ to we just shutdown the cluster on both the exit of client that running inside cluster and the finish of job. Since client is running inside cluster we can easily wait for the end of two both in

Re: [DISCUSS] FLIP-74: Flink JobClient API

About JobCluster Actually I am not quite sure what we gains from DETACHED configuration on cluster side. We don't have a NON-DETACHED JobCluster in fact in our codebase, right? It comes to me one major questions we have to answer first. *What JobCluster conceptually is exactly* Related

Re: [DISCUSS] FLIP-75: Flink Web UI Improvement Proposal

Hi Paul Thanks for your suggestion. I think it is easy to implement, could you create a JIRA for me? Paul Lam 于2019年9月27日周五 上午11:11写道： > Hi Yadong, > > Thanks a lot for summing up the Web UI efforts. > > I have a minor suggestion: can we provide a collapse button for the task > names in job

Re: [DISCUSS] FLIP-74: Flink JobClient API

Thanks for your replies Kostas & Aljoscha! Below are replies point by point. 1. For DETACHED mode, what I said there is about the DETACHED mode in client side. There are two configurations overload the item DETACHED[1]. In client side, it means whether or not client.submitJob is blocking to job