Good afternoon,
I have started work on BEAM-2500, "Add support for S3 as a Apache Beam
FileSystem". The work-in-progress: https://github.com/Kochava/beam-s3
Feel free to critique anything there, I hope to submit a PR eventually. The
code is heavily inspired by the GCS FileSystem implementation, and does not
have Hadoop dependencies.
This error is foreign to me, can someone comment on what I have likely
missed so far?
java.lang.IllegalAccessError: tried to access class
com.kochava.beam.s3.S3Util from class com.sun.proxy.$Proxy35
at com.sun.proxy.$Proxy35.getS3Util(Unknown Source)
at
com.kochava.beam.s3.S3FileSystem.matchNonGlobs(S3FileSystem.java:191)
at com.kochava.beam.s3.S3FileSystem.match(S3FileSystem.java:72)
at org.apache.beam.sdk.io.FileSystems.match(FileSystems.java:111)
at
org.apache.beam.sdk.io.FileBasedSource.getEstimatedSizeBytes(FileBasedSource.java:207)
at
org.apache.beam.runners.direct.BoundedReadEvaluatorFactory$InputProvider.getInitialInputs(BoundedReadEvaluatorFactory.java:207)
Thanks!
--
Jacob
