state broadcasting in flink

2023-05-17 Thread Zheng Ni
Hi There, Does beam support flink's state broadcasting feature mentioned in the link below? if yes, is there any beam doc/example available? https://flink.apache.org/2019/06/26/a-practical-guide-to-broadcast-state-in-apache-flink/ Thanks, Zheng

Re: [Question] Beam SQL failed with NPE

2022-08-30 Thread Zheng Ni
"java.net.URLClassLoader$3$1" Code extract: org.apache.beam.vendor.calcite.v1_28_0.org.codehaus.janino.IClassLoader public final IClass loadIClass(String fieldDescriptor) throws ClassNotFoundException { result = this.findIClass(fieldDescriptor); } On Tue, Aug 30, 2022 at 3:55

Re: [Question] Beam SQL failed with NPE

2022-08-30 Thread Zheng Ni
On Tue, Aug 30, 2022 at 11:40 AM P Singh wrote: > Hi, > > Use apache-beam==2.37.0 > > On Wed, 31 Aug 2022 at 00:02, Brian Hulette via user > wrote: > >> Hi Zheng, >> Could you share a minimal example that reproduces the issue? >> Also, have you tried usi

[Question] Beam SQL failed with NPE

2022-08-30 Thread Zheng Ni
Hi There, I am using beam 2.35.0 to build a simple sql based pipeline but got below error. I am trying to debug into the code and could not found this class: org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.rel.metadata.BuiltInMetadata.ExplainVisibility.Handler. Not sure if any lib missin

Compatibility of Spark portable runner

2022-01-04 Thread Zheng Ni
Hi Beam Community, Greetings. I am interested in submitting a spark job through portable runner. I have a question about the compatibility between spark_job_server and spark cluster. Let’s say I am going to use beam_spark_job_server of version 2.35.0. How could I know which spark cluster v