Re: [ANNOUNCE] Apache Beam 2.9.0 released!

Excellent thank you Chamikara and all who contributed to this release!!! On Thu, Dec 13, 2018 at 7:42 PM Chamikara Jayalath wrote: > The Apache Beam team is pleased to announce the release of version 2.9.0! > > Apache Beam is an open source unified programming model to define and > execute data

[ANNOUNCE] Apache Beam 2.9.0 released!

The Apache Beam team is pleased to announce the release of version 2.9.0! Apache Beam is an open source unified programming model to define and execute data processing pipelines, including ETL, batch and stream (continuous) processing. See https://beam.apache.org You can download the release

Re: [ANNOUNCEMENT] [SQL] [BEAM-6133] Support for user defined table functions (UDTF)

Sorry for the slow reply & review. Having UDTF support in Beam SQL is extremely useful. Are both table functions and table macros part of "standard" SQL or is this a distinction between different Calcite concepts? Kenn On Wed, Nov 28, 2018 at 10:36 AM Gleb Kanterov wrote: > At the moment we

Re: SplittableDoFn for zipWithIndex for a large file

I previously responded to your post on user@: https://lists.apache.org/thread.html/5c10b7edf982ef63d1d1d70545e3fe2716d00628ff5c2a7854383413@%3Cuser.beam.apache.org%3E I've also mirrored my response on StackOverflow: https://stackoverflow.com/a/53771980/33791 On Thu, Dec 13, 2018 at 4:21 PM

SplittableDoFn for zipWithIndex for a large file

Hello everyone! I asked the following question and think I might get some suggestions whether what I want is doable or not. https://stackoverflow.com/questions/53746046/how-can-i-implement-zipwithindex-like-spark-in-apache-beam/53747612#53747612 If I can get `PCollection` id and the number of

Apache Beam Newsletter - December 2018

[image: Beam.png] December 2018 | Newsletter What’s been done -- KafkaIO (by: Alexey Romanenko, Raghu Angadi) - Added writing support with ProducerRecord - See BEAM-6063 for more details

Re: [VOTE] Release 2.9.0, release candidate #1

Thanks all for voting. This vote has passed with 9 +1 votes (4 binding) and no -1 votes. I'll complete the remaining work and finalize the release. Thanks, Cham On Thu, Dec 13, 2018 at 11:12 AM Jean-Baptiste Onofré wrote: > +1 (binding) > > Regards > JB > Le 13 déc. 2018, à 20:11, Reuven Lax

Re: [VOTE] Release 2.9.0, release candidate #1

+1 (binding) Regards JB Le 13 déc. 2018 à 20:11, à 20:11, Reuven Lax a écrit: >+1 (binding) > >On Thu, Dec 13, 2018 at 8:39 AM Kenneth Knowles >wrote: > >> +1 (binding) >> >> A new feature request >(https://issues.apache.org/jira/browse/BEAM-6212) >> had been filed against 2.9.0 release ( >>

Re: [VOTE] Release 2.9.0, release candidate #1

+1 (binding) On Thu, Dec 13, 2018 at 8:39 AM Kenneth Knowles wrote: > +1 (binding) > > A new feature request (https://issues.apache.org/jira/browse/BEAM-6212) > had been filed against 2.9.0 release ( > https://issues.apache.org/jira/projects/BEAM/versions/12344258). I moved > it to 2.10.0. > >

Re: Contributor for Beam Jira tickets

Done. Welcome! Kenn On Thu, Dec 13, 2018 at 10:54 AM ter...@teresato.com wrote: > Hi, I've been using Beam and Dataflow for one of my work projects, and > would like to be granted contributor status for Beam JIRA tickets. My user > id is teresato. > > Thanks, > Teresa >

Contributor for Beam Jira tickets

Hi, I've been using Beam and Dataflow for one of my work projects, and would like to be granted contributor status for Beam JIRA tickets. My user id is teresato. Thanks, Teresa

Re: [VOTE] Release 2.9.0, release candidate #1

I've opened BEAM-6228 for the website build issue-- thanks for noting it Kenn. On Thu, Dec 13, 2018 at 8:39 AM Kenneth Knowles wrote: > +1 (binding) > > A new feature request (https://issues.apache.org/jira/browse/BEAM-6212) > had been filed against 2.9.0 release ( >

Re: [VOTE] Release 2.9.0, release candidate #1

+1 (binding) A new feature request (https://issues.apache.org/jira/browse/BEAM-6212) had been filed against 2.9.0 release ( https://issues.apache.org/jira/projects/BEAM/versions/12344258). I moved it to 2.10.0. I additionally built [some targets in] the source release. The website build does not

Re: Issue with publishing maven artefacts locally

Scott and Garret, thank you for a fix, it works fine for me now. Ismael, this is very good question. I think we still don’t have a determinate way of installing custom artifacts and using them for testing with custom pipelines. I’d very appreciate if someone could share their experience with

Re: Java performance tests dashboard

śr., 12 gru 2018 o 19:24 Udi Meiri napisał(a): > Hi Lukasz, > I was looking for statistics on I/O performance for writes of many files > (~10k) on GCS. > > I found this dashboard > > and > I have some questions. > 1.

Re: 2019 Beam Events

Great work ! Thanks for sharing Gris ! Etienne Le mercredi 05 décembre 2018 à 07:47 +, Matthias Baetens a écrit : > Great stuff, Gris! Looking forward to what 2019 will bring! > The Beam meetup in London will have a new get together early next year as > well :-) >

Re: Beam snapshots broken

Looks like the recent failure (like this job ) is related to ':beam-sdks-python:test' change introduced in this PR . `./gradlew