Hi,
Currently i am working with flink HA cluster with 3 job managers and 3
zookeeper nodes. Also i am persisting my checkpoints to s3 and hence already
configured required flink-s3 jars during flink job manager and task manager
process startup. Now i have configured a variable
web.upload.dir: s3p://d11-flink-job-manager-load/jars
<s3p://d11-flink-job-manager-load/jars>
Expectation is that jar upload via rest apis will be uploaded to this location
and hence is accessible to all 3 job managers (which eventually will help in
job submission as all 3 job managers will have record of uploaded jar to this
location). But while uploading the jar, I am facing following Illegal Argument
Exception which i am not sure why. Also above provided s3 location was created
before job manager process was even started.
2022-01-09 18:12:46,790 WARN org.apache.flink.runtime.rest.FileUploadHandler
[] - File upload failed.
java.lang.IllegalArgumentException: UploadDirectory is not absolute.
at
org.apache.flink.util.Preconditions.checkArgument(Preconditions.java:138)
~[flink-dist_2.12-1.13.1.jar:1.13.1]
at
org.apache.flink.runtime.rest.handler.FileUploads.<init>(FileUploads.java:59)
~[flink-dist_2.12-1.13.1.jar:1.13.1]
at
org.apache.flink.runtime.rest.FileUploadHandler.channelRead0(FileUploadHandler.java:186)
~[flink-dist_2.12-1.13.1.jar:1.13.1]
at
org.apache.flink.runtime.rest.FileUploadHandler.channelRead0(FileUploadHandler.java:69)
~[flink-dist_2.12-1.13.1.jar:1.13.1]
at
org.apache.flink.shaded.netty4.io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
~[flink-dist_2.12-1.13.1.jar:1.13.1]
at
org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
~[flink-dist_2.12-1.13.1.jar:1.13.1]
at
org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
~[flink-dist_2.12-1.13.1.jar:1.13.1]
at
org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
~[flink-dist_2.12-1.13.1.jar:1.13.1]
at
org.apache.flink.shaded.netty4.io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:436)
~[flink-dist_2.12-1.13.1.jar:1.13.1]
