Re: [JmsIO] => Pull Request to fix message acknowledgement issue

2022-08-29 Thread Jean-Baptiste Onofré
Hi Vincent, thanks, I will take a look (as original JmsIO author ;)). Regards JB On Mon, Aug 29, 2022 at 6:43 PM BALLADA Vincent wrote: > > Hi all, > > > > Here is a PR related to the following issue (Runner acknowledges messages on > closed session): > > https://github.com/apache/beam/issues/

RE: [idea] A new IO connector named DataLakeIO, which support to connect Beam and data lake, such as Delta Lake, Apache Hudi, Apache iceberg.

2022-08-29 Thread Neil Kolban via dev
Howdy, I have a client who would be interested to use this. Is there a link to a GitHub repo or other place I can read more? Neil (kol...@google.com) On 2022/08/05 07:23:31 张涛 wrote: > > Hi, we developed a new IO connector named DataLakeIO, to connect Beam and data lake, such as Delta Lake, Apa

Re: Java compatibility checking library

2022-08-29 Thread Kenneth Knowles
I think this is still worth considering. We would need to see how well it does at avoiding false alarms. It was brought up by Andrew a while back at https://lists.apache.org/thread/kq2w6rw0oorcj037ygjvfsqw1l9l55jj and I know we had another discussion of it even further back. I thought also that the

Re: Checkpointing on Google Cloud Dataflow Runner

2022-08-29 Thread Kenneth Knowles
Hi Will, David, I think you'll find the best source of answer for this sort of question on the user@beam list. I've put that in the To: line with a BCC: to the dev@beam list so everyone knows they can find the thread there. If I have misunderstood, and your question has to do with building Beam it

Checkpointing on Google Cloud Dataflow Runner

2022-08-29 Thread Will Baker
Hello! I am wondering about using checkpoints with Beam running on Google Cloud Dataflow. The docs indicate that checkpoints are not supported by Google Cloud Dataflow: https://beam.apache.org/documentation/runners/capability-matrix/additional-common-features-not-yet-part-of-the-beam-model/ Is

Java compatibility checking library

2022-08-29 Thread Pablo Estrada via dev
Hi folks! I learned about this library: https://lvc.github.io/japi-compliance-checker/ It looks like it's able to check API compatibility between versions of libraries. We could instate checks that use this library to be more aware of backwards incompatibilities that we may introduce accidentally,

[JmsIO] => Pull Request to fix message acknowledgement issue

2022-08-29 Thread BALLADA Vincent
Hi all, Here is a PR related to the following issue (Runner acknowledges messages on closed session): https://github.com/apache/beam/issues/20814 And here is a documentation explaining the fix: https://docs.google.com/document/d/19HiNPoJeIlzCFyWGdlw7WEFutceL2AmN_5Z0Vmi1s-I/edit?usp=sharing And

Re: [Question] Progress on BEAM-9923 and how can I help?

2022-08-29 Thread Danny McCormick via dev
Hey Ronoaldo, I believe some investigation has been done on adding a Go expansion service (written up here ), but no concrete work has been done yet. I don't know of any general guidelines

Beam High Priority Issue Report (70)

2022-08-29 Thread beamactions
This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/22913 [Bug]: beam_PostCo

Re: SingleStore IO

2022-08-29 Thread Adalbert Makarovych
Thanks for the answer! It would be great to have a call with you. Here is a meeting invitation. SingleStore Beam connector discussion Wednesday, August 31 · 7:00 – 8:00pm Google Meet joining info Video call link: https://meet.google.com/uiq-btvt-tpw Or dial: ‪(GB) +44 20 3956 6918‬ PIN: ‪226 926