Re: Expansion service for SqlTranform fails with a local flink cluster using Python SDK

2024-03-13 Thread Chamikara Jayalath via user
> When I check the expansion service docker container, normally it downloads a JAR file and starts SDK Fn Harness To clarify the terminology here, I think you meant the Java SDK harness container not the expansion service. Expansion service is only needed during job submission and your failure is

Re: Expansion service for SqlTranform fails with a local flink cluster using Python SDK

2024-03-12 Thread Jaehyeon Kim
Hello, Attached includes more logging details. WARNING:root:Waiting for grpc channel to be ready at localhost:45371. INFO:root:Building pipeline ... INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at localhost:36959 INFO:apache_beam.runners.portability.fn_api_runner.transla

Expansion service for SqlTranform fails with a local flink cluster using Python SDK

2024-03-11 Thread Jaehyeon Kim
Hello, ✔️ I have a simple pipeline that transforms data with *SqlTransform*. I use the *FlinkRunner *and, when I don't specify the *flink_master *option and use an embedded flink cluster, it works fine. However, if I use a local flink cluster and specify the *flink_master *option to *localhost:808