Artiom Darie created FLINK-6417: ----------------------------------- Summary: Wildcard support for read text file Key: FLINK-6417 URL: https://issues.apache.org/jira/browse/FLINK-6417 Project: Flink Issue Type: New Feature Components: Core Reporter: Artiom Darie Priority: Minor
Add wildcard support while reading from s3://, hdfs://, file://, etc. h6. Examples: # {code} s3://bucket-name/*.gz {code} # {code} hdfs://path/*file-name*.csv {code} # {code} file://tmp/**/*.* {code} h6. Proposal # Use the existing method: {code}environment.readFile(...){code} # List all the files in the directories # Read files using existing: {code}ContinuousFileReaderOperator{code} h6. Concerns (Open for discussions) # Have multiple DataSource(s) created for each each file and then to join them into a single DataSource # Have all the files into the same DataSource -- This message was sent by Atlassian JIRA (v6.3.15#6346)