[jira] [Created] (FLINK-32027) Batch jobs could hang at shuffle phase when max parallelism is really large

2023-05-07 Thread Yun Tang (Jira)
Yun Tang created FLINK-32027:


 Summary: Batch jobs could hang at shuffle phase when max 
parallelism is really large
 Key: FLINK-32027
 URL: https://issues.apache.org/jira/browse/FLINK-32027
 Project: Flink
  Issue Type: Bug
  Components: Runtime / Network
Affects Versions: 1.17.0
Reporter: Yun Tang
 Fix For: 1.17.1
 Attachments: image-2023-05-08-11-12-58-361.png

In batch stream mode with adaptive batch schedule mode, If we set the max 
parallelism large as 32768 (pipeline.max-parallelism), the job could hang at 
the shuffle phase:

It would hang for a long time and show "No bytes sent":
 !image-2023-05-08-11-12-58-361.png! 

After some time to debug, we can see the downstream operator did not receive 
the end-of-partition event.




--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (FLINK-32026) jdbc-3.1.0-1.16 left join conversion error

2023-05-07 Thread xueyongyang (Jira)
xueyongyang created FLINK-32026:
---

 Summary: jdbc-3.1.0-1.16 left join conversion error
 Key: FLINK-32026
 URL: https://issues.apache.org/jira/browse/FLINK-32026
 Project: Flink
  Issue Type: Improvement
  Components: Connectors / JDBC
Affects Versions: jdbc-3.1.0
 Environment: flink1.16.1

mysql8.0.33

jdbc-3.1.0-1.16 
Reporter: xueyongyang


I have a sql,


insert into test_flink_res2(id,name,address) 
select a.id,a.name,a.address from test_flink_res1 a left join test_flink_res2 b 
on a.id=b.id where a.name='abc0.11317691217472489' and b.id is null;

*Why does flinksql convert this statement into the following statement?*

SELECT `address` FROM `test_flink_res1` WHERE ((`name` = 
'abc0.11317691217472489')) AND ((`id` IS NULL))

*As a result, there is no data in test_flink_res2,why?*



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (FLINK-32025) Make job cancellation button on UI configurable

2023-05-07 Thread Ted Yu (Jira)
Ted Yu created FLINK-32025:
--

 Summary: Make job cancellation button on UI configurable
 Key: FLINK-32025
 URL: https://issues.apache.org/jira/browse/FLINK-32025
 Project: Flink
  Issue Type: Improvement
Reporter: Ted Yu


On the flink job UI, there is `Cancel Job` button.

When the job UI is shown to users, it is desirable to hide the button so that 
normal user doesn't mistakenly cancel a long running flink job.

This issue adds configuration for hiding the `Cancel Job` button.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


Re: flink documents Korean translation suggestions

2023-05-07 Thread Jing Ge
Hi Tan,

Thanks for raising the suggestion. Proposals are always welcome. Flink is
very well documented which turns out the translation effort is big. Afaiu,
there are limited contributors in the community who could review content in
Korean. I am wondering how you will continuously move forward and
keep contributing translated (old and new) content.

Best regards,
Jing

On Sat, May 6, 2023 at 10:34 AM Tan Kim  wrote:

> Hello, I'm Kim Tan, a software engineer from South Korea.
> I would like to contribute to the translation of flink documents into
> Korean, but it seems that only Chinese translation is being done at the
> moment, so I'm writing to make a proposal.
> I would appreciate your positive review.
>
> Regards,
> Tan Kim
>


[jira] [Created] (FLINK-32024) Short code related to external connector retrieve version from its own data yaml

2023-05-07 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-32024:
--

 Summary: Short code related to external connector retrieve version 
from its own data yaml
 Key: FLINK-32024
 URL: https://issues.apache.org/jira/browse/FLINK-32024
 Project: Flink
  Issue Type: Improvement
  Components: Connectors / Common
Affects Versions: 1.18.0
Reporter: Weijie Guo
Assignee: Weijie Guo


Currently, we have some shortcodes specifically designed for external 
connector, such as {{connectors_artifact}}, {{sql_connector_download_table}}, 
etc.

When using them, we need to pass in a version number, such as 
{{sql_connector_download_table "pulsar" 3.0.0}}.  It's easy for us to forget to 
modify the corresponding version in the document when releasing a new version.

Of course, we can hard code these into the release process. But perhaps we can 
introduce a version field to {{docs/data/connector_name.yml}}, where flink 
directly reads the corresponding version when rendering shortcode.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)