Re: [Question] Beam Schema, fields order

2022-04-05 Thread gaurav mishra
There was an annotation introduced in 2.37 to make sure we get the same order of fields in schema inferred from a POJO. https://javadoc.io/doc/org.apache.beam/beam-sdks-java-core/latest/org/apache/beam/sdk/schemas/annotations/SchemaFieldNumber.html with that annotation

Re: [Question] Beam Schema, fields order

2022-04-05 Thread Alexey Romanenko
Thanks for answers, Reuven. Please see the additional questions inline. > On 5 Apr 2022, at 20:07, Reuven Lax wrote: > > On Tue, Apr 5, 2022 at 9:55 AM Alexey Romanenko > wrote: > > So, the different fields order matters. > > Additionally, since

Beam Metrics Report (2022-04-05)

2022-04-05 Thread Apache Jenkins Server
ERROR: File 'src/.test-infra/jenkins/metrics_report/beam-metrics_report.html' does not exist

Beam Metrics Report (2022-04-05)

2022-04-05 Thread Apache Jenkins Server
ERROR: File 'src/.test-infra/jenkins/metrics_report/beam-metrics_report.html' does not exist

Re: Updating output watermark on bundle boundaries

2022-04-05 Thread Kenneth Knowles
Coming to this a bit late, but to remind that we switched to a whole-window definition of lateness/droppability. Elements in front of / behind a watermark or other elements should hardly matter for lateness. Anything output within a window should be fine as long as the window itself is treated

Re: Re: RE: Re: unvendoring bytebuddy

2022-04-05 Thread Kenneth Knowles
Hmm. Too bad the information on the jira is inadequate to explain or justify the change. TBH if faced with a conflict between bytebuddy and mockito, working to use mocks less, or in more straightforward ways, would have been my preference. This isn't actually a diamond dep problem that impacts

P1 issues report (75)

2022-04-05 Thread Beam Jira Bot
This is your daily summary of Beam's current P1 issues, not including flaky tests (https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20priority%20%3D%20P1%20AND%20(labels%20is%20EMPTY%20OR%20labels%20!%3D%20flake). See

Flaky test issue report (51)

2022-04-05 Thread Beam Jira Bot
This is your daily summary of Beam's current flaky tests (https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20labels%20%3D%20flake) These are P1 issues because they have a major negative impact on the community and make it hard to

[Question] Beam Schema, fields order

2022-04-05 Thread Alexey Romanenko
Hi everyone, I have several Beam Schema-related questions since I didn’t find an exact answer for that. Let me give some brief intro before. The order of fields in Schema - this is what users have to pay attention on, iiuc. In other words, two schemas with the same set of fields but with a

[Question] Connect Cloud SQL postgres instance for load test.

2022-04-05 Thread Andoni Guzman Becerra
Hi All, I have a question related to Cloud SQL. I'm adding a new load test , this test will work with debezium, checking that the readFromDebezium works well. For this I need to create a CloudSQL postgres instance to do some queries and check that Debezium catches the changes correctly. The

Re: Beam Metrics Report (2022-04-05)

2022-04-05 Thread Manu Zhang
Is this still working? Apache Jenkins Server 于2022年4月5日 周二19:56写道: > ERROR: File > 'src/.test-infra/jenkins/metrics_report/beam-metrics_report.html' does not > exist

Beam Metrics Report (2022-04-05)

2022-04-05 Thread Apache Jenkins Server
ERROR: File 'src/.test-infra/jenkins/metrics_report/beam-metrics_report.html' does not exist

Re: [DISCUSS] Deprecation of AWS SDK v1 IO connectors

2022-04-05 Thread Moritz Mack
Thank you, David! Fan Out Reads are certainly on my mind, though probably nothing I’ll be able to tackle soon. I agree, that would be a great feature to get attention for v2. Best, Moritz From: David Hollands Date: Monday, 21. March 2022 at 18:53 To: dev@beam.apache.org Subject: Re: [DISCUSS]