Compatibility of Spark portable runner

2022-01-04 Thread Zheng Ni
Hi Beam Community, Greetings. I am interested in submitting a spark job through portable runner. I have a question about the compatibility between spark_job_server and spark cluster. Let’s say I am going to use beam_spark_job_server of version 2.35.0. How could I know which spark cluster

Re: Regarding contribution to Apache-Beam

2022-01-04 Thread Bitfox
Hello Maybe begin from this content? https://beam.apache.org/contribute/ Thanks On Wed, Jan 5, 2022 at 1:43 PM Devangi Das wrote: > Hello! > I want to contribute to Apache Beam .I have a fair knowledge of java and > python but I'm new to Go language.kindly guide me how to start contributing >

Regarding contribution to Apache-Beam

2022-01-04 Thread Devangi Das
Hello! I want to contribute to Apache Beam .I have a fair knowledge of java and python but I'm new to Go language.kindly guide me how to start contributing to the project. Thank you; Devangi

Beam [python] - docker run in ParDo?

2022-01-04 Thread Mahesh Vangala
Hello Beam community - Is it possible to run docker image as part of a transformation step? Could you point me to any examples with using "docker run" as a step in the pipeline? Let me know. Thank you, Mahesh