Re: [ANNOUNCE] New Committer: Svetak Sundhar

2024-02-13 Thread Priyans Desai via dev
Congratulations Svetak!!

On Tue, Feb 13, 2024 at 8:09 PM Chamikara Jayalath via dev <
dev@beam.apache.org> wrote:

> Congrats Svetak!
>
> On Tue, Feb 13, 2024 at 4:39 PM Svetak Sundhar via dev <
> dev@beam.apache.org> wrote:
>
>> Thanks everyone!! Looking forward to the continued collaboration :)
>>
>>
>> Svetak Sundhar
>>
>>   Data Engineer
>> s vetaksund...@google.com
>>
>>
>>
>> On Mon, Feb 12, 2024 at 9:58 PM Byron Ellis via dev 
>> wrote:
>>
>>> Congrats Svetak!
>>>
>>> On Mon, Feb 12, 2024 at 6:57 PM Shunping Huang via dev <
>>> dev@beam.apache.org> wrote:
>>>
 Congratulations, Svetak!

 On Mon, Feb 12, 2024 at 9:50 PM XQ Hu via dev 
 wrote:

> Great job, Svetak! Thanks for all your contributions to Beam!!!
>
> On Mon, Feb 12, 2024 at 4:44 PM Valentyn Tymofieiev via dev <
> dev@beam.apache.org> wrote:
>
>> Congrats, Svetak!
>>
>> On Mon, Feb 12, 2024 at 11:20 AM Kenneth Knowles 
>> wrote:
>>
>>> Hi all,
>>>
>>> Please join me and the rest of the Beam PMC in welcoming a new
>>> committer: Svetak Sundhar (sve...@apache.org).
>>>
>>> Svetak has been with Beam since 2021. Svetak has contributed code to
>>> many areas of Beam, including notebooks, Beam Quest, dataframes, and 
>>> IOs.
>>> We also want to especially highlight the effort Svetak has put into
>>> improving Beam's documentation, participating in release validation, and
>>> evangelizing Beam.
>>>
>>> Considering his contributions to the project over this timeframe,
>>> the Beam PMC trusts Svetak with the responsibilities of a Beam 
>>> committer.
>>> [1]
>>>
>>> Thank you Svetak! And we are looking to see more of your
>>> contributions!
>>>
>>> Kenn, on behalf of the Apache Beam PMC
>>>
>>> [1]
>>>
>>> https://beam.apache.org/contribute/become-a-committer/#an-apache-beam-committer
>>>
>>


Re: [ANNOUNCE] New Committer: Svetak Sundhar

2024-02-13 Thread Chamikara Jayalath via dev
Congrats Svetak!

On Tue, Feb 13, 2024 at 4:39 PM Svetak Sundhar via dev 
wrote:

> Thanks everyone!! Looking forward to the continued collaboration :)
>
>
> Svetak Sundhar
>
>   Data Engineer
> s vetaksund...@google.com
>
>
>
> On Mon, Feb 12, 2024 at 9:58 PM Byron Ellis via dev 
> wrote:
>
>> Congrats Svetak!
>>
>> On Mon, Feb 12, 2024 at 6:57 PM Shunping Huang via dev <
>> dev@beam.apache.org> wrote:
>>
>>> Congratulations, Svetak!
>>>
>>> On Mon, Feb 12, 2024 at 9:50 PM XQ Hu via dev 
>>> wrote:
>>>
 Great job, Svetak! Thanks for all your contributions to Beam!!!

 On Mon, Feb 12, 2024 at 4:44 PM Valentyn Tymofieiev via dev <
 dev@beam.apache.org> wrote:

> Congrats, Svetak!
>
> On Mon, Feb 12, 2024 at 11:20 AM Kenneth Knowles 
> wrote:
>
>> Hi all,
>>
>> Please join me and the rest of the Beam PMC in welcoming a new
>> committer: Svetak Sundhar (sve...@apache.org).
>>
>> Svetak has been with Beam since 2021. Svetak has contributed code to
>> many areas of Beam, including notebooks, Beam Quest, dataframes, and IOs.
>> We also want to especially highlight the effort Svetak has put into
>> improving Beam's documentation, participating in release validation, and
>> evangelizing Beam.
>>
>> Considering his contributions to the project over this timeframe, the
>> Beam PMC trusts Svetak with the responsibilities of a Beam committer. [1]
>>
>> Thank you Svetak! And we are looking to see more of your
>> contributions!
>>
>> Kenn, on behalf of the Apache Beam PMC
>>
>> [1]
>>
>> https://beam.apache.org/contribute/become-a-committer/#an-apache-beam-committer
>>
>


Re: [ANNOUNCE] New Committer: Svetak Sundhar

2024-02-13 Thread Svetak Sundhar via dev
Thanks everyone!! Looking forward to the continued collaboration :)


Svetak Sundhar

  Data Engineer
s vetaksund...@google.com



On Mon, Feb 12, 2024 at 9:58 PM Byron Ellis via dev 
wrote:

> Congrats Svetak!
>
> On Mon, Feb 12, 2024 at 6:57 PM Shunping Huang via dev <
> dev@beam.apache.org> wrote:
>
>> Congratulations, Svetak!
>>
>> On Mon, Feb 12, 2024 at 9:50 PM XQ Hu via dev 
>> wrote:
>>
>>> Great job, Svetak! Thanks for all your contributions to Beam!!!
>>>
>>> On Mon, Feb 12, 2024 at 4:44 PM Valentyn Tymofieiev via dev <
>>> dev@beam.apache.org> wrote:
>>>
 Congrats, Svetak!

 On Mon, Feb 12, 2024 at 11:20 AM Kenneth Knowles 
 wrote:

> Hi all,
>
> Please join me and the rest of the Beam PMC in welcoming a new
> committer: Svetak Sundhar (sve...@apache.org).
>
> Svetak has been with Beam since 2021. Svetak has contributed code to
> many areas of Beam, including notebooks, Beam Quest, dataframes, and IOs.
> We also want to especially highlight the effort Svetak has put into
> improving Beam's documentation, participating in release validation, and
> evangelizing Beam.
>
> Considering his contributions to the project over this timeframe, the
> Beam PMC trusts Svetak with the responsibilities of a Beam committer. [1]
>
> Thank you Svetak! And we are looking to see more of your contributions!
>
> Kenn, on behalf of the Apache Beam PMC
>
> [1]
>
> https://beam.apache.org/contribute/become-a-committer/#an-apache-beam-committer
>



Beam High Priority Issue Report (37)

2024-02-13 Thread beamactions
This is your daily summary of Beam's current high priority issues that may need 
attention.

See https://beam.apache.org/contribute/issue-priorities for the meaning and 
expectations around issue priorities.

Unassigned P1 Issues:

https://github.com/apache/beam/issues/30266 [Bug]: Cannot read from ssl-enabled 
cassandra cluster
https://github.com/apache/beam/issues/29971 [Bug]: FixedWindows not working for 
large Kafka topic
https://github.com/apache/beam/issues/29926 [Bug]: FileIO: lack of timeouts may 
cause the pipeline to get stuck indefinitely
https://github.com/apache/beam/issues/29902 [Bug]: Messages are not ACK on 
Pubsub starting Beam 2.52.0 on Flink Runner in detached mode
https://github.com/apache/beam/issues/29099 [Bug]: FnAPI Java SDK Harness 
doesn't update user counters in OnTimer callback functions
https://github.com/apache/beam/issues/28760 [Bug]: EFO Kinesis IO reader 
provided by apache beam does not pick the event time for watermarking
https://github.com/apache/beam/issues/28383 [Failing Test]: 
org.apache.beam.runners.dataflow.worker.StreamingDataflowWorkerTest.testMaxThreadMetric
https://github.com/apache/beam/issues/28326 Bug: 
apache_beam.io.gcp.pubsublite.ReadFromPubSubLite not working
https://github.com/apache/beam/issues/27892 [Bug]: ignoreUnknownValues not 
working when using CreateDisposition.CREATE_IF_NEEDED 
https://github.com/apache/beam/issues/27616 [Bug]: Unable to use 
applyRowMutations() in bigquery IO apache beam java
https://github.com/apache/beam/issues/27486 [Bug]: Read from datastore with 
inequality filters
https://github.com/apache/beam/issues/27314 [Failing Test]: 
bigquery.StorageApiSinkCreateIfNeededIT.testCreateManyTables[1]
https://github.com/apache/beam/issues/27238 [Bug]: Window trigger has lag when 
using Kafka and GroupByKey on Dataflow Runner
https://github.com/apache/beam/issues/26911 [Bug]: UNNEST ARRAY with a nested 
ROW (described below)
https://github.com/apache/beam/issues/26343 [Bug]: 
apache_beam.io.gcp.bigquery_read_it_test.ReadAllBQTests.test_read_queries is 
flaky
https://github.com/apache/beam/issues/26329 [Bug]: BigQuerySourceBase does not 
propagate a Coder to AvroSource
https://github.com/apache/beam/issues/26041 [Bug]: Unable to create 
exactly-once Flink pipeline with stream source and file sink
https://github.com/apache/beam/issues/24776 [Bug]: Race condition in Python SDK 
Harness ProcessBundleProgress
https://github.com/apache/beam/issues/24313 [Flaky]: 
apache_beam/runners/portability/portable_runner_test.py::PortableRunnerTestWithSubprocesses::test_pardo_state_with_custom_key_coder
https://github.com/apache/beam/issues/23709 [Flake]: Spark batch flakes in 
ParDoLifecycleTest.testTeardownCalledAfterExceptionInProcessElement and 
ParDoLifecycleTest.testTeardownCalledAfterExceptionInStartBundle
https://github.com/apache/beam/issues/23525 [Bug]: Default PubsubMessage coder 
will drop message id and orderingKey
https://github.com/apache/beam/issues/22913 [Bug]: 
beam_PostCommit_Java_ValidatesRunner_Flink is flakes in 
org.apache.beam.sdk.transforms.GroupByKeyTest$BasicTests.testAfterProcessingTimeContinuationTriggerUsingState
https://github.com/apache/beam/issues/22605 [Bug]: Beam Python failure for 
dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest.test_metrics_it
https://github.com/apache/beam/issues/21706 Flaky timeout in github Python unit 
test action 
StatefulDoFnOnDirectRunnerTest.test_dynamic_timer_clear_then_set_timer
https://github.com/apache/beam/issues/21643 FnRunnerTest with non-trivial 
(order 1000 elements) numpy input flakes in non-cython environment
https://github.com/apache/beam/issues/21476 WriteToBigQuery Dynamic table 
destinations returns wrong tableId
https://github.com/apache/beam/issues/21260 Python DirectRunner does not emit 
data at GC time
https://github.com/apache/beam/issues/21121 
apache_beam.examples.streaming_wordcount_it_test.StreamingWordCountIT.test_streaming_wordcount_it
 flakey
https://github.com/apache/beam/issues/21104 Flaky: 
apache_beam.runners.portability.fn_api_runner.fn_runner_test.FnApiRunnerTestWithGrpcAndMultiWorkers
https://github.com/apache/beam/issues/20976 
apache_beam.runners.portability.flink_runner_test.FlinkRunnerTestOptimized.test_flink_metrics
 is flaky
https://github.com/apache/beam/issues/20108 Python direct runner doesn't emit 
empty pane when it should
https://github.com/apache/beam/issues/19814 Flink streaming flakes in 
ParDoLifecycleTest.testTeardownCalledAfterExceptionInStartBundleStateful and 
ParDoLifecycleTest.testTeardownCalledAfterExceptionInProcessElementStateful


P1 Issues with no update in the last week:

https://github.com/apache/beam/issues/29515 [Bug]: WriteToFiles in python leave 
few records in temp directory when writing to large number (100+) of files
https://github.com/apache/beam/issues/28219 [Bug]: BigQuery IO Batch load using 
File_load causing the same job id ignoring inserts as the job_id is already 
completed

Re: [VOTE] Vendored Dependencies Release

2024-02-13 Thread Sam Whittle via dev
Hi,
Sorry I missed that close step. Done!
Sam

On Mon, Feb 12, 2024 at 8:32 PM Yi Hu via dev  wrote:

> Hi,
>
> I am trying to open "
> https://repository.apache.org/content/repositories/orgapachebeam-1369/;
> but get "[id=orgapachebeam-1369] exists but is not exposed." It seems the
> staging repository needs to be closed to have it available to public: [1]
>
> [1]
> https://docs.google.com/document/d/1ztEoyGkqq9ie5riQxRtMuBu3vb6BUO91mSMn1PU0pDA/edit?disco=vHX80XE
>
> On Mon, Feb 12, 2024 at 1:44 PM Chamikara Jayalath via dev <
> dev@beam.apache.org> wrote:
>
>> +1 (binding)
>>
>> Thanks,
>> Cham
>>
>> On Fri, Feb 9, 2024 at 5:25 AM Sam Whittle  wrote:
>>
>>> Please review the release of the following artifacts that we vendor,
>>> following the process [5]:
>>>
>>>  * beam-vendor-grpc-1-60-1:0.2
>>>
>>> Hi everyone,
>>>
>>> Please review and vote on the release candidate #1 for the version
>>> beam-vendor-grpc-1-60-1:0.2 as follows:
>>>
>>> [ ] +1, Approve the release
>>>
>>> [ ] -1, Do not approve the release (please provide specific comments)
>>>
>>>
>>> The complete staging area is available for your review, which includes:
>>>
>>> * the official Apache source release to be deployed to dist.apache.org
>>> [1], which is signed with the key with fingerprint FCFD152811BF1578 [2],
>>>
>>> * all artifacts to be deployed to the Maven Central Repository [3],
>>>
>>> * commit hash "2d08b32e674a1046ba7be0ae5f1e4b7b05b73488" [4].
>>>
>>> The vote will be open for at least 72 hours. It is adopted by majority
>>> approval, with at least 3 PMC affirmative votes.
>>>
>>> Thanks,
>>>
>>> Sam
>>>
>>> [1] https://dist.apache.org/repos/dist/dev/beam/vendor/
>>>
>>> [2] https://dist.apache.org/repos/dist/release/beam/KEYS
>>>
>>> [3]
>>> https://repository.apache.org/content/repositories/orgapachebeam-1369/
>>>
>>> [4]
>>> https://github.com/apache/beam/commit/2d08b32e674a1046ba7be0ae5f1e4b7b05b73488
>>>
>>> [5] https://s.apache.org/beam-release-vendored-artifacts
>>>
>>