Re: Proposal: Beam to use GCP Libraries BOM

2020-03-20 Thread Luke Cwik
My concern would be to validate how the GCP BOM impacts the release process and the pom files that are produced otherwise the next person running a release may run into trouble. On Fri, Mar 20, 2020 at 3:00 PM Pablo Estrada wrote: > +1 > > On Fri, Mar 20, 2020 at 2:41 PM Ismaël Mejía wrote: > >

Re: Proposal: Beam to use GCP Libraries BOM

2020-03-20 Thread Pablo Estrada
+1 On Fri, Mar 20, 2020 at 2:41 PM Ismaël Mejía wrote: > Well why we just don't merge it? I am unfamiliar with GCP deps to be > confident to LGTM it. but given that 22 checks pass and given that > Tomo addressed most comments and he has already a consistent track of > good work on dependency imp

Re: Proposal: Beam to use GCP Libraries BOM

2020-03-20 Thread Ismaël Mejía
Well why we just don't merge it? I am unfamiliar with GCP deps to be confident to LGTM it. but given that 22 checks pass and given that Tomo addressed most comments and he has already a consistent track of good work on dependency improvements I think it is worth to merge it as it is. We still have

Re: Issue in testing doing DirectRunner Apache Beam Local Machine

2020-03-20 Thread Tomo Suzuki
Yi Yogesh, It seems you have incompatible dependencies. Would you share your pom.xml? I'm interested in "dependencies" and "dependencyManagement" sections. Regards, Tomo On Fri, Mar 20, 2020 at 12:43 PM Austin Bennett wrote: > Hi Yogesh, > > Many of the examples, use the direct runner: > > htt

java_mobile_gaming_topic deleted (and re-created)

2020-03-20 Thread Brian Hulette
Hi all, I was going through and cleaning up old topics in the apache-beam-testing project now that the source of most of the leaked topics has been addressed (see [1] for details). I tried to filter out and delete just topics that are clearly generated for a single-use in tests, but I got a little

Re: Issue in testing doing DirectRunner Apache Beam Local Machine

2020-03-20 Thread Austin Bennett
Hi Yogesh, Many of the examples, use the direct runner: https://github.com/apache/beam/tree/master/examples/java/src/main/java/org/apache/beam/examples As does the word count example: https://beam.apache.org/get-started/quickstart-java/#get-the-wordcount-code I'm not well versed enough with our

Issue in testing doing DirectRunner Apache Beam Local Machine

2020-03-20 Thread Kumbhare, Yogesh
Hi Team , I am facing issue to run the simple project on Direct Runner Apache beam , to test the example locally in our machine . I added in pom.xml dependency , org.apache.beam beam-runners-direct-java 2.19.0 runtime Please find the below error , let me know any update . Exc

Re: Issue in testing doing DirectRunner Apache Beam Local Machine

2020-03-20 Thread Kumbhare, Yogesh
Hi Team, Please find the below command to build . mvn compile exec:java -Dexec.mainClass=com.intuit.dedupe.beam.poc.StreamingDedupe -Pdirect-runner is there any DirectRunner example you have please do share with us. Thanks , Yogesh K 8050397434 From: "Kumbhare, Yogesh" Date: Fr

Re: Jenkins jobs not running for my PR 10438

2020-03-20 Thread Jan Lukavský
Hi, done. On 3/20/20 3:59 PM, Tomo Suzuki wrote: HI Beam committers, (Thanks Ahmet) Would you re-run the presubmit checks for https://github.com/apache/beam/pull/11168 with the followings? Run Java PostCommit Run Java HadoopFormatIO Performance Test Run BigQueryIO Streaming Performance Test J

Re: Jenkins jobs not running for my PR 10438

2020-03-20 Thread Tomo Suzuki
HI Beam committers, (Thanks Ahmet) Would you re-run the presubmit checks for https://github.com/apache/beam/pull/11168 with the followings? Run Java PostCommit Run Java HadoopFormatIO Performance Test Run BigQueryIO Streaming Performance Test Java Run Dataflow ValidatesRunner Run Spark ValidatesRu