[GitHub] [beam-site] johnjcasey merged pull request #640: Update beam-site for release 2.45.0.
johnjcasey merged PR #640: URL: https://github.com/apache/beam-site/pull/640 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@beam.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [VOTE] Release 2.45.0, Release Candidate #1
With 7 approving votes, of which 5 are binding, 2.45.0 RC1 has been approved. Binding votes are: Luke Cwik Chamikara Jayalath Ahmet Altay Alexey Romanenko Robert Bradshaw There are no disapproving votes. Thanks for your validations everyone, John On Mon, Feb 13, 2023 at 5:19 PM Ritesh Ghorse via dev wrote: > +1 (non-binding) > Validated: > 1. Go SDK Quickstart on Direct & Dataflow runner. > 2. Dataframe wrapper > 3. RunInference Wrapper for Sklearn > > On Mon, Feb 13, 2023 at 2:56 PM Robert Bradshaw via dev < > dev@beam.apache.org> wrote: > >> +1 (binding) >> >> Validated release artifacts and signatures and tested a couple of >> Python pipelines. >> >> On Mon, Feb 13, 2023 at 8:57 AM Alexey Romanenko >> wrote: >> > >> > +1 (binding) >> > >> > Tested with https://github.com/Talend/beam-samples/ >> > (Java SDK v8/v11/v17, Spark 3.x runner). >> > >> > --- >> > Alexey >> > >> > On 13 Feb 2023, at 17:54, Ahmet Altay via dev >> wrote: >> > >> > +1 (binding) - I validated python quick starts on direct runner and >> python streaming quickstart on dataflow. >> > >> > Thank you! >> > >> > On Mon, Feb 13, 2023 at 5:17 AM Bruno Volpato via dev < >> dev@beam.apache.org> wrote: >> >> >> >> +1 (non-binding) >> >> >> >> Tested with https://github.com/GoogleCloudPlatform/DataflowTemplates >> (Java SDK 11, Dataflow runner). >> >> >> >> >> >> Thanks! >> >> >> >> On Mon, Feb 13, 2023 at 1:13 AM Chamikara Jayalath via dev < >> dev@beam.apache.org> wrote: >> >>> >> >>> +1 (binding) >> >>> >> >>> Tried several Java and Python multi-language pipelines. >> >>> >> >>> Thanks, >> >>> Cham >> >>> >> >>> On Fri, Feb 10, 2023 at 1:52 PM Luke Cwik via dev < >> dev@beam.apache.org> wrote: >> >> +1 >> >> Validated release artifact signatures and verified the Java Flink >> and Spark quickstarts. >> >> On Fri, Feb 10, 2023 at 9:27 AM John Casey via dev < >> dev@beam.apache.org> wrote: >> > >> > Addendum to above email. >> > >> > Java artifacts were built with Gradle 7.5.1 and OpenJDK 1.8.0_362 >> > >> > On Fri, Feb 10, 2023 at 11:14 AM John Casey < >> theotherj...@google.com> wrote: >> >> >> >> Hi everyone, >> >> Please review and vote on the release candidate #3 for the version >> 2.45.0, as follows: >> >> [ ] +1, Approve the release >> >> [ ] -1, Do not approve the release (please provide specific >> comments) >> >> >> >> >> >> Reviewers are encouraged to test their own use cases with the >> release candidate, and vote +1 if no issues are found. >> >> >> >> The complete staging area is available for your review, which >> includes: >> >> * GitHub Release notes [1], >> >> * the official Apache source release to be deployed to >> dist.apache.org [2], which is signed with the key with fingerprint >> 921F35F5EC5F5DDE [3], >> >> * all artifacts to be deployed to the Maven Central Repository [4], >> >> * source code tag "v2.45.0-RC1" [5], >> >> * website pull request listing the release [6], the blog post [6], >> and publishing the API reference manual [7]. >> >> * Java artifacts were built with Gradle GRADLE_VERSION and >> OpenJDK/Oracle JDK JDK_VERSION. >> >> * Python artifacts are deployed along with the source release to >> the dist.apache.org [2] and PyPI[8]. >> >> * Go artifacts and documentation are available at pkg.go.dev [9] >> >> * Validation sheet with a tab for 2.45.0release to help with >> validation [10]. >> >> * Docker images published to Docker Hub [11]. >> >> >> >> The vote will be open for at least 72 hours. It is adopted by >> majority approval, with at least 3 PMC affirmative votes. >> >> >> >> For guidelines on how to try the release in your projects, check >> out our blog post at /blog/validate-beam-release/. >> >> >> >> Thanks, >> >> John Casey >> >> >> >> [1] https://github.com/apache/beam/milestone/8 >> >> [2] https://dist.apache.org/repos/dist/dev/beam/2.45.0/ >> >> [3] https://dist.apache.org/repos/dist/release/beam/KEYS >> >> [4] >> https://repository.apache.org/content/repositories/orgapachebeam-1293/ >> >> [5] https://github.com/apache/beam/tree/v2.45.0-RC1 >> >> [6] https://github.com/apache/beam/pull/25407 >> >> [7] https://github.com/apache/beam-site/pull/640 >> >> [8] https://pypi.org/project/apache-beam/2.45.0rc1/ >> >> [9] >> https://pkg.go.dev/github.com/apache/beam/sdks/v2@v2.45.0-RC1/go/pkg/beam >> >> [10] >> https://docs.google.com/spreadsheets/d/1qk-N5vjXvbcEk68GjbkSZTR8AGqyNUM-oLFo_ZXBpJw/edit#gid=2030665842 >> >> [11] https://hub.docker.com/search?q=apache%2Fbeam&type=image >> > >> > >> >
Re: Beam Release 2.46
> Do you mind if I shadow you while you do this? Sure! On Tue, Feb 14, 2023 at 12:32 PM Damon Douglas wrote: > Hello Danny, > > Do you mind if I shadow you while you do this? > > Best, > > Damon > > On Thu, Feb 9, 2023 at 3:17 PM Kenneth Knowles wrote: > >> Excellent! Keep that release train rolling. >> >> On Thu, Feb 9, 2023 at 9:28 AM Ahmet Altay via dev >> wrote: >> >>> Thank you Danny! >>> >>> On Wed, Feb 8, 2023 at 6:46 AM Danny McCormick via dev < >>> dev@beam.apache.org> wrote: >>> Hey everyone, I would like to volunteer myself to do the 2.46.0 release. I will cut the branch Feb 22 [1], and cherrypick any blocking fixes afterwards. Please review the current release blockers [2] and remove the 2.46 milestone if they don't meet the criteria at [3]. Thanks, Danny [1] https://calendar.google.com/calendar/embed?src=0p73sl034k80oob7seouanigd0%40group.calendar.google.com [2] https://github.com/apache/beam/milestone/9 [3] https://beam.apache.org/contribute/release-blocking/ >>>
Re: Launch Dataflow Flex Templates from Go
Hello,
The most similar to the mentioned Python APIs is through
https://github.com/googleapis/google-api-go-client.
There are some docs that include Go examples:
- Flex Templates:
https://cloud.google.com/dataflow/docs/samples/dataflow-v1beta3-generated-FlexTemplatesService-LaunchFlexTemplate-sync
- Classic Templates:
https://cloud.google.com/dataflow/docs/samples/dataflow-v1beta3-generated-TemplatesService-LaunchTemplate-sync
Best,
Bruno
On Wed, Feb 15, 2023 at 9:29 AM Jack McCluskey via user <
u...@beam.apache.org> wrote:
> As far as I know, Shivam's solution is the correct one for launching a
> template from Go. You're just routing your calls through a
> Dataflow-specific API library rather than going through the API discovery
> service.
>
> On Wed, Feb 15, 2023 at 9:16 AM Kerry Donny-Clark
> wrote:
>
>> Jack added the Go templates capabilities, he should be able to help you
>> out.
>>
>> On Wed, Feb 15, 2023, 12:37 AM Ashok KS wrote:
>>
>>> Hi Shivam,
>>>
>>> Thanks a lot for your response. I did check the http request. But I
>>> wanted to see if I can use the Google API client Library.
>>> The docs show a Python example for it shown below. I wanted to know if
>>> there is something similar with Go.
>>>
>>> from googleapiclient.discovery import build
>>>
>>> # project = 'your-gcp-project'
>>> # job = 'unique-job-name'
>>> # template = 'gs://dataflow-templates/latest/Word_Count'
>>> # parameters = {
>>> # 'inputFile': 'gs://dataflow-samples/shakespeare/kinglear.txt',
>>> # 'output': 'gs:///wordcount/outputs',
>>> # }
>>>
>>> dataflow = build('dataflow', 'v1b3')
>>> request = dataflow.projects().templates().launch(
>>> projectId=project,
>>> gcsPath=template,
>>> body={
>>> 'jobName': job,
>>> 'parameters': parameters,
>>> }
>>> )
>>>
>>> response
>>>
>>>
Re: Launch Dataflow Flex Templates from Go
As far as I know, Shivam's solution is the correct one for launching a
template from Go. You're just routing your calls through a
Dataflow-specific API library rather than going through the API discovery
service.
On Wed, Feb 15, 2023 at 9:16 AM Kerry Donny-Clark
wrote:
> Jack added the Go templates capabilities, he should be able to help you
> out.
>
> On Wed, Feb 15, 2023, 12:37 AM Ashok KS wrote:
>
>> Hi Shivam,
>>
>> Thanks a lot for your response. I did check the http request. But I
>> wanted to see if I can use the Google API client Library.
>> The docs show a Python example for it shown below. I wanted to know if
>> there is something similar with Go.
>>
>> from googleapiclient.discovery import build
>>
>> # project = 'your-gcp-project'
>> # job = 'unique-job-name'
>> # template = 'gs://dataflow-templates/latest/Word_Count'
>> # parameters = {
>> # 'inputFile': 'gs://dataflow-samples/shakespeare/kinglear.txt',
>> # 'output': 'gs:///wordcount/outputs',
>> # }
>>
>> dataflow = build('dataflow', 'v1b3')
>> request = dataflow.projects().templates().launch(
>> projectId=project,
>> gcsPath=template,
>> body={
>> 'jobName': job,
>> 'parameters': parameters,
>> }
>> )
>>
>> response
>>
>>
Re: Launch Dataflow Flex Templates from Go
Jack added the Go templates capabilities, he should be able to help you
out.
On Wed, Feb 15, 2023, 12:37 AM Ashok KS wrote:
> Hi Shivam,
>
> Thanks a lot for your response. I did check the http request. But I wanted
> to see if I can use the Google API client Library.
> The docs show a Python example for it shown below. I wanted to know if
> there is something similar with Go.
>
> from googleapiclient.discovery import build
>
> # project = 'your-gcp-project'
> # job = 'unique-job-name'
> # template = 'gs://dataflow-templates/latest/Word_Count'
> # parameters = {
> # 'inputFile': 'gs://dataflow-samples/shakespeare/kinglear.txt',
> # 'output': 'gs:///wordcount/outputs',
> # }
>
> dataflow = build('dataflow', 'v1b3')
> request = dataflow.projects().templates().launch(
> projectId=project,
> gcsPath=template,
> body={
> 'jobName': job,
> 'parameters': parameters,
> }
> )
>
> response
>
>
