I'm trying to use the loopback via the environment_type option:

options = PipelineOptions(["--runner=PortableRunner",
                                           
"--environment_config=-apachebeam/python3.7_sdk ",
                                           "--environment_type=LOOPBACK",
                                           "--job_endpoint=dnnserver2:8099"])

Previouly, I've done:

./gradlew -p sdks/python/container buildAll

And ran the Spark job server:

./gradlew :runners:spark:job-server:runShadow 
-PsparkMasterUrl=spark://dnnserver2:7077

However, I get a pretty cryptic error message:

org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.UncheckedExecutionException:
 org.apache.beam.vendor.grpc.v1p21p0.io.grpc.StatusRuntimeException: 
UNIMPLEMENTED: Method not found!

Any ideas?


Reply via email to