Abacn commented on issue #30512:
URL: https://github.com/apache/beam/issues/30512#issuecomment-2402923733
Taking a closer look, tests are failing on initializing TestPipeline:
```
Caused by: java.io.InvalidClassException:
org.apache.beam.sdk.transforms.ParDoTest$LifecycleTests; unable to create
instance
Caused by: java.lang.reflect.InvocationTargetException
Caused by: java.util.ServiceConfigurationError:
org.apache.beam.sdk.io.FileSystemRegistrar: Error reading configuration file
...
at
org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.collect.Lists.newArrayList(Lists.java:132)
at
org.apache.beam.sdk.io.FileSystems.setDefaultPipelineOptions(FileSystems.java:587)
at
org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:518)
at
org.apache.beam.sdk.testing.TestPipeline.create(TestPipeline.java:273)
...
Caused by: java.io.FileNotFoundException:
/tmp/spark-f76d7a05-d782-41a9-9926-089251e24bdd/userFiles-7506344e-2e1b-43ea-8ccb-5bbc936d955f/beam-runners-direct-java-2.60.0-SNAPSHOT.jar
(No such file or directory)
at java.util.zip.ZipFile.open(Native Method)
at java.net.URL.openStream(URL.java:1093)
at java.util.ServiceLoader.parse(ServiceLoader.java:304)
```
the failing call is "setDefaultPipelineOptions", which loads filesystem
registrar that are autoService. It sounds similar to
https://github.com/google/auto/issues/718
Another observation is that the test trying to read from `/tmp/spark-***`
which looks like the staged jars for Spark runner pipeline. However the
invocation is inside junit code, and it looks like the staged jar paths leaked
into the host test.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
