[
https://issues.apache.org/jira/browse/FLINK-24641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hadiiiiiiiii updated FLINK-24641:
---------------------------------
Description:
Hello, big bro.
when I use the Flink SQL to read HDFS Files like this:
{code:java}
CREATE TABLE `cfg_city`(
`provincecode` int, `city_id` int, `city_name` string)
WITH (
'connector'='filesystem',
'path'='viewfs://path1/path2/path3/cfg_city',
'format' = 'csv',
'csv.field-delimiter' = ',',
'csv.ignore-parse-errors' = 'true'
)
;
{code}
if the task failed and retry, this will throw a exception:
!screenshot-1.png!
I found , because the path 'viewfs://path1/path2/path3/cfg_city' file name
changed. but it not get new FileList.
was:
Hello, big bro.
when I use the Flink SQL to read HDFS Files like this:
{code:java}
CREATE TABLE `cfg_city`(
`provincecode` int, `city_id` int, `city_name` string)
WITH (
'connector'='filesystem',
'path'='viewfs://path1/path2/path3/cfg_city',
'format' = 'csv',
'csv.field-delimiter' = ',',
'csv.ignore-parse-errors' = 'true'
)
;
{code}
> Flink SQL FileSystem read hdfs Path, when Path's file name change, the sql
> will not find the file.
> --------------------------------------------------------------------------------------------------
>
> Key: FLINK-24641
> URL: https://issues.apache.org/jira/browse/FLINK-24641
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Client
> Affects Versions: 1.13.2
> Reporter: Hadiiiiiiiii
> Priority: Minor
> Attachments: screenshot-1.png
>
>
> Hello, big bro.
> when I use the Flink SQL to read HDFS Files like this:
> {code:java}
> CREATE TABLE `cfg_city`(
> `provincecode` int, `city_id` int, `city_name` string)
> WITH (
> 'connector'='filesystem',
> 'path'='viewfs://path1/path2/path3/cfg_city',
> 'format' = 'csv',
> 'csv.field-delimiter' = ',',
> 'csv.ignore-parse-errors' = 'true'
> )
> ;
> {code}
> if the task failed and retry, this will throw a exception:
> !screenshot-1.png!
> I found , because the path 'viewfs://path1/path2/path3/cfg_city' file name
> changed. but it not get new FileList.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
