Re: flink not able to get scheme for S3

2021-08-17 Thread tarun joshi
Thanks Chesnay ! that helped me resolve the issue On Fri, 6 Aug 2021 at 04:31, Chesnay Schepler wrote: > The reason this doesn't work is that your application works directly > against Hadoop. > The filesystems in the plugins directory are only loaded via specific > code-paths, specifically when

Re: flink not able to get scheme for S3

2021-08-06 Thread Chesnay Schepler
The reason this doesn't work is that your application works directly against Hadoop. The filesystems in the plugins directory are only loaded via specific code-paths, specifically when the Flink FileSystem class is used. Since you are using Hadoop directly you are side-stepping the plugin mechan

flink not able to get scheme for S3

2021-08-05 Thread tarun joshi
Hey All, I am running flink in docker containers (image Tag :flink:scala_2.11-java11) on EC2 and getting exception as I am trying to submit a job through the local ./opt/flink/bin *org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: No FileSystem for schem