[
https://issues.apache.org/jira/browse/FLINK-17392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17092930#comment-17092930
]
Jingsong Lee commented on FLINK-17392:
--------------------------------------
I don't fully understand the problem,
> users cannot run even a little bit more complicated job since they cannot
>configure task slots of minicluster thru Flink SQL, e.g. single parallelism
>job requires shuffle. This incapability has been very frustrating to new users.
Why need configure slots? IIUC, Minicluster slot number is depends on
maximumParallelism of job. So it can run every jobs.
I don't quite understand what the user's problem is.
> enable configuring minicluster resources in Flink SQL in IDE
> ------------------------------------------------------------
>
> Key: FLINK-17392
> URL: https://issues.apache.org/jira/browse/FLINK-17392
> Project: Flink
> Issue Type: Improvement
> Components: Table SQL / API
> Affects Versions: 1.11.0
> Reporter: Bowen Li
> Assignee: Kurt Young
> Priority: Major
> Fix For: 1.11.0
>
>
> It's very common case that users who want to learn and test Flink SQL will
> try to run a SQL job in IDE like Intellij, with Flink minicluster. Currently
> it's fine to do so with a simple job requiring only one task slot, which is
> the default resource config of minicluster.
> However, users cannot run even a little bit more complicated job since they
> cannot configure task slots of minicluster thru Flink SQL, e.g. single
> parallelism job requires shuffle. This incapability has been very frustrating
> to new users.
> There are two solutions to this problem:
> - in minicluster, if it is single parallelism job, then chain all operators
> together
> - enable configuring minicluster in Flink SQL in IDE.
> The latter feels more proper.
> Expected: users can configure minicluster resources via either SQL ("set
> ...=...") or TableEnvironment ("tEnv.setMiniclusterResources(..., ...)").
> [~jark] [~lzljs3620320]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
