Nvm, I was running the Kafka cluster and the job in two different projects.
It's working as expected.

+1 (binding) for the release.

Thanks,
Cham


On Tue, May 30, 2023 at 6:09 PM Chamikara Jayalath <chamik...@google.com>
wrote:

> I'm seeing a potential regression when running Python x-lang Kafka jobs on
> Datafllow.
>
>
> https://pantheon.corp.google.com/dataflow/jobs/us-central1/2023-05-30_16_31_32-1219154560944228293;step=;mainTab=JOB_GRAPH;bottomTab=JOB_LOGS;logsSeverity=INFO;graphView=0?project=google.com:clouddfe&pageState=(%22dfTime%22:(%22l%22:%22dfJobMaxTime%22))
>
> "Topic kafka_taxirides_realtime not present in metadata after 60000 ms"
>
> Currently not sure if this is due to my Kafka cluster setup or not.
>
> Thanks,
> Cham
>
>
>
>
>
> On Tue, May 30, 2023 at 5:52 PM Robert Bradshaw via dev <
> dev@beam.apache.org> wrote:
>
>> +1 (binding)
>>
>> On Tue, May 30, 2023 at 5:42 PM Robert Bradshaw <rober...@google.com>
>> wrote:
>>
>>> On Tue, May 30, 2023 at 2:01 PM Ritesh Ghorse via dev <
>>> dev@beam.apache.org> wrote:
>>>
>>>> Thanks Danny and Jack! Dataflow containers are up!
>>>>
>>>> Only PMC votes count but feel free to test your use cases and vote on
>>>> this thread!
>>>>
>>>
>>> While we need at least 3 affirmative PMC votes to formally do a release,
>>> it is definitely the case that all votes are valuable input and are taken
>>> into consideration when deciding to do so.
>>>
>>>
>>>> On Tue, May 30, 2023 at 11:26 AM Alexey Romanenko <
>>>> aromanenko....@gmail.com> wrote:
>>>>
>>>>> +1 (binding)
>>>>>
>>>>> Tested with  https://github.com/Talend/beam-samples/
>>>>> (Java SDK v8/v11/v17, Spark 3.x runner).
>>>>>
>>>>> On 27 May 2023, at 19:38, Bruno Volpato via dev <dev@beam.apache.org>
>>>>> wrote:
>>>>>
>>>>> I was able to check that containers are all there and complete
>>>>> my validation.
>>>>>
>>>>> +1 (non-binding).
>>>>>
>>>>> Tested with https://github.com/GoogleCloudPlatform/DataflowTemplates (Java
>>>>> SDK 11, Dataflow runner).
>>>>>
>>>>>
>>>>> Thanks Ritesh and Danny!
>>>>>
>>>>> On Fri, May 26, 2023 at 10:09 AM Danny McCormick via dev <
>>>>> dev@beam.apache.org> wrote:
>>>>>
>>>>>> It looks like some Dataflow containers didn't get published, so some
>>>>>> jobs using the legacy runner (runner v2 disabled) will fail. I kicked off
>>>>>> the container release, so that should hopefully be available later today.
>>>>>>
>>>>>> Thanks,
>>>>>> Danny
>>>>>>
>>>>>> On Thu, May 25, 2023 at 11:19 PM Ritesh Ghorse via dev <
>>>>>> dev@beam.apache.org> wrote:
>>>>>>
>>>>>>> Hi everyone,
>>>>>>> Please review and vote on the release candidate #2 for the version
>>>>>>> 2.48.0, as follows:
>>>>>>> [ ] +1, Approve the release
>>>>>>> [ ] -1, Do not approve the release (please provide specific comments)
>>>>>>>
>>>>>>>
>>>>>>> Reviewers are encouraged to test their own use cases with the
>>>>>>> release candidate, and vote +1 if no issues are found. Only PMC member
>>>>>>> votes will count towards the final vote, but votes from all community
>>>>>>> members are encouraged and helpful for finding regressions; you can 
>>>>>>> either
>>>>>>> test your own use cases or use cases from the validation sheet [10].
>>>>>>>
>>>>>>> The complete staging area is available for your review, which
>>>>>>> includes:
>>>>>>> * GitHub Release notes [1],
>>>>>>> * the official Apache source release to be deployed to
>>>>>>> dist.apache.org [2], which is signed with the key with fingerprint
>>>>>>> E4C74BEC861570F5A3E44E46280A0AC32DBAE62B [3],
>>>>>>> * all artifacts to be deployed to the Maven Central Repository [4],
>>>>>>> * source code tag "v2.48.0-RC2" [5],
>>>>>>> * website pull request listing the release [6], the blog post [6],
>>>>>>> and publishing the API reference manual [7] (to be generated).
>>>>>>> * Java artifacts were built with Gradle 7.5.1 and OpenJDK/Oracle JDK
>>>>>>> 8.0.322.
>>>>>>> * Python artifacts are deployed along with the source release to the
>>>>>>> dist.apache.org [2] and PyPI[8].
>>>>>>> * Go artifacts and documentation are available at pkg.go.dev [9]
>>>>>>> * Validation sheet with a tab for 2.48.0 release to help with
>>>>>>> validation [10].
>>>>>>> * Docker images published to Docker Hub [11].
>>>>>>> * PR to run tests against release branch [12].
>>>>>>>
>>>>>>> The vote will be open for at least 72 hours. It is adopted by
>>>>>>> majority approval, with at least 3 PMC affirmative votes.
>>>>>>>
>>>>>>> For guidelines on how to try the release in your projects, check out
>>>>>>> our blog post at /blog/validate-beam-release/.
>>>>>>>
>>>>>>> *NOTE: Dataflow containers for Python are not finalized yet (likely
>>>>>>> to happen on tuesday). I will follow up on this thread once that is 
>>>>>>> done.
>>>>>>> Feel free to test it on other runners until then. *
>>>>>>>
>>>>>>> Thanks,
>>>>>>> Ritesh Ghorse
>>>>>>>
>>>>>>> [1] https://github.com/apache/beam/milestone/12
>>>>>>> [2] https://dist.apache.org/repos/dist/dev/beam/2.48.0/
>>>>>>> [3] https://dist.apache.org/repos/dist/release/beam/KEYS
>>>>>>> [4]
>>>>>>> https://repository.apache.org/content/repositories/orgapachebeam-1346/
>>>>>>> [5] https://github.com/apache/beam/tree/v2.48.0-RC2
>>>>>>> [6] https://github.com/apache/beam/pull/26903
>>>>>>> [7] https://github.com/apache/beam-site/pull/645
>>>>>>> [8] https://pypi.org/project/apache-beam/2.48.0rc2/
>>>>>>> [9]
>>>>>>> https://pkg.go.dev/github.com/apache/beam/sdks/v2@v2.48.0-RC2/go/pkg/beam
>>>>>>> <https://pkg.go.dev/github.com/apache/beam/sdks/v2@v2.48.0-RC1/go/pkg/beam>
>>>>>>> [10]
>>>>>>> https://docs.google.com/spreadsheets/d/1qk-N5vjXvbcEk68GjbkSZTR8AGqyNUM-oLFo_ZXBpJw/edit#gid=458120434
>>>>>>> [11] https://hub.docker.com/search?q=apache%2Fbeam&type=image
>>>>>>> [12] https://github.com/apache/beam/pull/26811
>>>>>>>
>>>>>>>
>>>>>

Reply via email to