Re: [QUESTION] Dockerized Integration Tests with Java/Gradle

2021-04-22 Thread Evan Galpin
Thanks all for the warm welcome and documentation. I'll peruse the links sent and ask follow-ups once I've digested the info. Thanks again, Evan On Thu, Apr 22, 2021 at 12:11 PM Brian Hulette wrote: > Welcome Evan! > > Note we do have some examples in Beam of running IO integration tests > agai

Re: [QUESTION] Dockerized Integration Tests with Java/Gradle

2021-04-22 Thread Brian Hulette
Welcome Evan! Note we do have some examples in Beam of running IO integration tests against testcontainers [1] that startup "fakes". We do this for Kafka [2], Kinesis [3], and there's a test that does this for both Kafka and Pubsub [4]. Is that the kind of thing you had in mind? It looks like the

Re: [QUESTION] Dockerized Integration Tests with Java/Gradle

2021-04-22 Thread Alexey Romanenko
Hi Evan, Great to hear that you are going to contribute to Beam. Welcome! For integration tests we mostly use k8s. Did you take a look on current implementation of ITs for ElasticsearchIO (e.g. [1]) and how it runs on Jenkins [2]? Also, perhaps worth to mention our very good guide about writing

[QUESTION] Dockerized Integration Tests with Java/Gradle

2021-04-22 Thread Evan Galpin
Hi folks! I'm Evan, and I'm fairly new to developing the Beam SDK. I've been a user for a number of years and have done some private SDK customizations along the way for my day job, but have recently been given the green light to contribute back to the OSS repo 🙌 In particular, I've worked with El