Re: March 2021, Beam Community Update

[Griselda Cuevas]

Very cool update :)

On Fri, 5 Mar 2021 at 13:44, Brittany Hermann  wrote:

> Hi folks,
>
> Attached is the March 2021 Beam Community Update. Be sure to check out all
> the upcoming exciting Beam events! The purpose of this newsletter is purely
> community focused, giving folks the visibility to the insights of the
> health and growth of the community. This newsletter does not cover project
> releases or feature updates. Please let me know if you have any questions,
> and as always, all feedback is welcome.
>
>
> https://docs.google.com/document/d/1sA06m_spqgHwI3yGiQ_Z06LXfYqRcgIO1_N8y_a2O6o/edit?usp=sharing
>
> Thanks!
> -Brittany Hermann
>
>
>

Re: New Apache Beam Online Mini-Course

[Griselda Cuevas]

This is amazing, thank you Alexandra, I will promote :)

On Wed, 7 Oct 2020 at 04:01, Alexandra Abbas  wrote:

> Hey everyone,
>
> In the last couple of weeks I worked on an introductory mini-course about
> Apache Beam. I just launched it this week!
>
> Batch Processing with Apache Beam in Python
>  is an hour long
> mini-course that aims to help you get started with Apache Beam. It covers
> the following topics:
>
>- How to install Apache Beam on your machine
>- Basic and advanced Apache Beam concepts
>- How to develop a real-world batch processing pipeline
>- How to define custom transformation steps
>- How to deploy your pipeline on Cloud Dataflow
>
> Hope you'll enjoy it and please share it with your network!
>
> If you have any questions don't hesitate to contact me.
>
> Cheers,
> Alexandra
>

Re: 2019 Beam Events

[Griselda Cuevas]

Where are you going to present them Matt?



On Wed, 5 Dec 2018 at 02:24, Matt Casters  wrote:

> It has been be a lot of fun to see Kettle transformations run on Beam.  I
> think it will blow a lot of people's minds to actually see it in action
> when I'll be presenting the results in February.
> ---
> Matt Casters attcast...@gmail.com>
> Senior Solution Architect, Kettle Project Founder
>
>
>
>
> Op di 4 dec. 2018 om 14:24 schreef Dan :
>
>> The next Pentaho London meetup has a presentation on using Kettle with
>> Beam:
>>
>> https://www.meetup.com/Pentaho-London-User-Group/events/256773962/
>>
>> Thanks,
>> Dan
>>
>> On Tue, 4 Dec 2018 at 13:20, Maximilian Michels  wrote:
>>
>>> Thanks for sharing, Gris! This list will likely never be complete, as
>>> there are endless conferences :)
>>>
>>> Nevertheless, it's a great idea to coordinate the attendance for the
>>> major ones.
>>>
>>> Cheers,
>>> Max
>>>
>>> On 03.12.18 23:33, Griselda Cuevas wrote:
>>> > Hi Beam Community,
>>> >
>>> > I started curating industry conferences, meetups and events that are
>>> > relevant for Beam, this initial list I came up with
>>> > <
>>> https://docs.google.com/spreadsheets/d/1CloF63FOKSPM6YIuu8eExjhX6xrIiOp5j4zPbSg3Apo/edit#gid=0>.
>>>
>>> > *I'd love your help adding others that I might have overlooked.* Once
>>> > we're satisfied with the list, let's re-share so we can coordinate
>>> > proposal submissions, attendance and community meetups there.
>>> >
>>> >
>>> > Cheers,
>>> >
>>> > G
>>> >
>>> >
>>> >
>>>
>>

Re: 2019 Beam Events

[Griselda Cuevas]

+1 to Pablo's suggestion, if there's interest in "Founding a Meetup group
in a particular city, let's create the Meetup page and start getting sign
ups. Joana will be reaching out with a comprenhexive list of how to get
started and we're hoping to compile a high level calendar of
launches/announcements to feed into your meetup.

G

On Tue, 4 Dec 2018 at 12:04, Daniel Salerno  wrote:

> =)
> What good news!
> Okay, I'll set up the group and try to get interested.
> Thank you
>
>
> Em ter, 4 de dez de 2018 às 17:19, Pablo Estrada 
> escreveu:
>
>> FWIW, for some of these places that have interest (e.g. Brazil, Israel),
>> it's possible to create a group in meetup.com, and start gauging
>> interest, and looking for organizers.
>> Once a group of people with interest exists, it's easier to get interest
>> / sponsorship to bring speakers.
>> So if you are willing to create the group in meetup, Daniel, we can
>> monitor it and try to plan something as it grows : )
>> Best
>> -P.
>>
>> On Tue, Dec 4, 2018 at 10:55 AM Daniel Salerno 
>> wrote:
>>
>>>
>>> It's a shame that there are no events in Brazil ...
>>>
>>> =(
>>>
>>> Em ter, 4 de dez de 2018 às 13:12, OrielResearch Eila Arich-Landkof <
>>> e...@orielresearch.org> escreveu:
>>>
>>>> agree 👍
>>>>
>>>> On Tue, Dec 4, 2018 at 5:41 AM Chaim Turkel  wrote:
>>>>
>>>>> Israel would be nice to have one
>>>>> chaim
>>>>> On Tue, Dec 4, 2018 at 12:33 AM Griselda Cuevas 
>>>>> wrote:
>>>>> >
>>>>> > Hi Beam Community,
>>>>> >
>>>>> > I started curating industry conferences, meetups and events that are
>>>>> relevant for Beam, this initial list I came up with. I'd love your help
>>>>> adding others that I might have overlooked. Once we're satisfied with the
>>>>> list, let's re-share so we can coordinate proposal submissions, attendance
>>>>> and community meetups there.
>>>>> >
>>>>> >
>>>>> > Cheers,
>>>>> >
>>>>> > G
>>>>> >
>>>>> >
>>>>> >
>>>>>
>>>>> --
>>>>>
>>>>>
>>>>> Loans are funded by
>>>>> FinWise Bank, a Utah-chartered bank located in Sandy,
>>>>> Utah, member FDIC, Equal
>>>>> Opportunity Lender. Merchant Cash Advances are
>>>>> made by Behalf. For more
>>>>> information on ECOA, click here
>>>>> <https://www.behalf.com/legal/ecoa/>. For important information about
>>>>> opening a new
>>>>> account, review Patriot Act procedures here
>>>>> <https://www.behalf.com/legal/patriot/>.
>>>>> Visit Legal
>>>>> <https://www.behalf.com/legal/> to
>>>>> review our comprehensive program terms,
>>>>> conditions, and disclosures.
>>>>>
>>>>
>>>>
>>>> --
>>>> Eila
>>>> www.orielresearch.org
>>>> https://www.meetu <https://www.meetup.com/Deep-Learning-In-Production/>
>>>> p.co <https://www.meetup.com/Deep-Learning-In-Production/>
>>>> m/Deep-Learning-In-Production/
>>>> <https://www.meetup.com/Deep-Learning-In-Production/>
>>>>
>>>>
>>>>

2019 Beam Events

[Griselda Cuevas]

Hi Beam Community,

I started curating industry conferences, meetups and events that are
relevant for Beam, this initial list I came up with
.
*I'd love your help adding others that I might have overlooked.* Once we're
satisfied with the list, let's re-share so we can coordinate proposal
submissions, attendance and community meetups there.


Cheers,

G

Agenda for the Beam Summit London 2018

[Griselda Cuevas]

Hi Beam Community,

We have finalized the agenda for the Beam Summit London 2018, it's here:
https://www.linkedin.com/feed/update/urn:li:activity:6450125487321735168/


We had a great amount of talk proposals, thank you so much to everyone who
submitted one! We also sold out the event, so we're very excited to see the
community growing.


See you around,

Gris on behalf of the Organizing Committee

[Events] Fwd: Deadline for speaker proposals is Sept 18!

[Griselda Cuevas]

Hi Beam Community!


Is anyone presenting at Strata Data in San Francisco next year?


Deadline for proposals is September 18th, it'd be great to know who is
coming and speaking to organize a Beam get together.


G

-- Forwarded message -
From: Strata Data Conference 
Date: Fri, 14 Sep 2018 at 08:09
Subject: Deadline for speaker proposals is Sept 18!
To: 


If you'd like to speak at Strata, send us your best ideas ASAP
[image: O'Reilly Media Logo]

Learning Platform  •
Conferences  • Ideas

[image: Strata Logo] 
March 25–28 •
San Francisco, CA
Proposals are due September 18
Hi Griselda,
Thousands of top data scientists, engineers, and executives will converge
in San Francisco, the world's innovation and technology hub, for Strata
Data Conference  in 2019.
It's a great opportunity to share your success stories or technical
expertise, build your profile in the community, and establish connections
with colleagues in the data industry.
If you're interested in speaking at Strata, the deadline to submit your
proposal is *Tuesday, September 18.*
Submit a proposal 
See you in San Francisco,
Ben Lorica, Doug Cutting, and Alistair Croll
Program Chairs
*P.S. Stumped on how to start your proposal? Take a look at the topics we
are most interested in, get additional helpful resources, and see our tips
for submitting a great proposal
.*
Looking to increase your visibility as a vendor in the big data landscape? *Ask
us about sponsorship and exhibitor opportunities.*
*Be a sponsor* 
Presented by
[image: Cloudera]  [image:
O'Reilly Media]  Thank you
to our sponsorsContributing Sponsors
[image: Kyligence]  [image:
MemSQL]  Exabyte Sponsors
[image: Amazon Web Services]
 [image: SAS]

[image: Talend]  Impact
Sponsors
[image: Impetus]  [image:
Kyvos Insights] 
[image: Striim]  [image:
Syncsort] 
[image: O'Reilly Media Logo]
 [image: Twitter Logo]
 [image: Facebook Logo]
 [image: LinkedIn Logo]


This message was sent to g...@google.com. You are receiving this because
you're a customer of O'Reilly Media, or you've signed up to receive email
from us. We hope you found this message to be useful. However, if you'd
rather not receive future emails of this type from O'Reilly, please manage
your preferences or unsubscribe here
.

Please read our Privacy Policy
.

O'Reilly Media, Inc. 1005 Gravenstein Highway North, Sebastopol, CA 95472
(707) 827-7000

Re: Apache Beam Newsletter - September 2018

[Griselda Cuevas]

Thank you so much for helping us put this together Rose!

And thanks everyone who contributed, is so good to see how our
contributions grow and how much more events we're representing Beam at!




On Mon, 10 Sep 2018 at 19:56, Rose Nguyen  wrote:

>
> [image: Beam.png]
>
> September 2018 | Newsletter
>
>
> What’s been done
>
>
> CI improvement (by: Etienne Chauchot)
>
>-
>
>For each new commit on master Nexmark suite is run in both batch and
>streaming mode in Spark, Flink, Cloud Dataflow (thanks to Andrew) and
>dashboards graphs are produced to track functional and performance
>regressions.
>
>
> Elasticsearch IO Supports Version 6 (by: Dat Tran)
>
>-
>
>Elasticsearch IO now supports version 6.x in addition to version 2.x
>and 5.x.
>-
>
>See the merged PR
>
>for more details.
>
>
> KuduIO Added (by: Tim Robertson)
>
>-
>
>Apache Beam master now has KuduIO that will be released with Beam
>2.7.0.
>-
>
>See BEAM-2661  for
>more details.
>
>
>
> What we’re working on...
>
>
> Flink Portable Runner (by: Ankur Goenka, Maximilian Michels, Thomas
> Weise, Ryan Williams)
>
>-
>
>Support for streaming side inputs merged
>
>-
>
>Portable Compatibility Matrix tests pass in streaming mode
>
>-
>
>Many more ValidatesRunner tests pass (ValidatesRunner is a
>comprehensive suite for Beam test pipelines)
>-
>
>Python Pipelines can be tested without bringing up a JobServer first
>(it is started in a container)
>-
>
>Experimental support for executing the SDK harnesses in a process
>instead of a Docker container
>-
>
>Bug fixes to Beam discovered during working on the portability
>
> State and Timer Support in Python SDK (by: Charles Chen, Robert Bradshaw)
>
>-
>
>This change adds the reference DirectRunner implementation of the
>Python User State and Timers API. With this change, a user can execute
>DoFns with state and timers on the DirectRunner.
>-
>
>See the design doc
> and PR
> for more details..
>
>
> New IO - HadoopOutputFormatIO (by: Alexey Romanenko)
>
>-
>
>Adding support of MapReduce OutputFormat.
>-
>
>See BEAM-5310  for
>more details.
>
>
> High-level Java 8 DSL (by: David Moravek, Vaclav Plajt, Marek Simunek)
>
>-
>
>Adding high-level Java 8 DSL based on Euphoria API
> project
>-
>
>See BEAM-3900  for
>more details.
>
> Performance improvements for HDFS file writing operations (by: Tim
> Robertson)
>
>-
>
>Autocreate directories when doing an HDFS rename
>-
>
>See PR  for more details
>
>
> Recognition of non-code contributions (by: Gris Cuevas)
>
>-
>
>Got consensus about recognizing non-code contributions
>-
>
>See
>
> 
>discussion for more details
>-
>
>Planned launch date: Beam Summit London (October 2nd)
>
>
> Weekly Community Updates (by: Gris Cuevas)
>
>-
>
>Some of the project’s subcomponents run weekly updates in the mailing
>list, we’ll be consolidating best practices to share a weekly community
>update with all project related must knows in a shell
>
>
>
> What’s planned
>
>
> Beam Cookbook (by: Austin Bennett, David Cavazos, Gris Cuevas, Andrea
> Foegler, Rose Nguyen, Connell O'Callaghan, and you!)
>
>-
>
>We are creating a cookbook for common data science tasks in Beam and
>have started brainstorming
>-
>
>We want to have a hackathon after the London Summit to generate
>content from the community
>-
>
>There will be a session at the summit to gather more ideas and input.
>Watch the dev and users mailing list for a call for contributions soon!.
>
>
> Beam 2.7.0 release (by: Charles Chen)
>
> Beam Mascot (by: Gris Cuevas & Community!)
>
>-
>
>We got approval to launch a contest to create a new Apache Beam mascot
>-
>
>See
>
>discussion for more details, if you’re interested in driving this, reach
>out in the thread!
>-
>
>Planned launch date: Last week of September
>
>
>
> New Members
>
>
> New Contributors
>
>-
>
>Đạt Trần, Ho Chi Minh City, Vietnam
>-
>
>   See BEAM-5107
>   
>   for more details on “Support ES-6.x for ElasticsearchIO”
>   -
>
>Ravi Pathak, Copenhagen, Denmark
>-
>
>   Using Beam for indexing o

Re: [ANNOUNCE] Apache Beam 2.6.0 released!

[Griselda Cuevas]

Thanks Pablo!





On Thu, 9 Aug 2018 at 15:24, Ismaël Mejía  wrote:

> Two really interesting features in 2.6.0 not mentioned in the announcement
> email:
>
>
> - Bounded SplittableDoFn support is available now in all runners (SDF is
> the new IO connector API).
>
> - HBaseIO was updated to be the first IO supporting Bounded SDF (using
> readAll).
>
>
>
>
> On Fri, Aug 10, 2018 at 12:14 AM Connell O'Callaghan 
> wrote:
>
>> Pablo and all involved thank you for working to get this release
>> completed!!!
>>
>> On Thu, Aug 9, 2018 at 3:06 PM Pablo Estrada  wrote:
>>
>>> Of course, I messed that link up again. The release notes should be here:
>>>
>>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527&version=12343392
>>>
>>> On Thu, Aug 9, 2018 at 10:11 AM Pablo Estrada 
>>> wrote:
>>>
 As was pointed out to me by Ryan Williams, the link I posted with the
 release notes is not right. Here is a link with Beam 2.6.0 release notes
 for those interested:

 https://issues.apache.org/jira/projects/BEAM/versions/12343392

 On Thu, Aug 9, 2018 at 9:41 AM Alexey Romanenko <
 aromanenko@gmail.com> wrote:

> Great news!
> Thanks to Pablo for driving this and to all contributors of this
> release!
>
>
> On 9 Aug 2018, at 00:48, Pablo Estrada  wrote:
>
> The Apache Beam team is pleased to announce the release of 2.6.0
> version!
>
> Apache Beam is an open source unified programming model to define and
> execute data processing pipelines, including ETL, batch and stream
> (continuous) processing. See https://beam.apache.org
>
> You can download the release here:
>
> https://beam.apache.org/get-started/downloads/
>
> This release includes the following major new features & improvements,
> among others:
> - Improvements for internal Context Management in Python SDK
> - A number of improvements to the Portability Framework
> - A Universal Local Runner has been added to Beam. This runner runs in
> a single machine using portability, and containerized SDK harnesses.
> - Increased the coverage of ErrorProne analysis of the codebase.
> - Updates to various dependency versions
> - Updates to stability, performance, and documentation.
> - SQL - improvements: support exists operator, implemented sum()
> aggregations, fixes to CASE expression, support for date comparison,
> support LIMIT on Unbounded Data
> - Provide automatic schema registration for POJOs
>
> You can take a look at the Release Notes for more details:
>
> *https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12343392&projectId=12319527
> *
>
> Thanks to everyone who participated in this release, and we hope
> you'll have a good time using Beam 2.6.0.
> --
> Pablo Estrada, on behalf of The Apache Beam team
> --
> Got feedback? go/pabloem-feedback
> 
>
>
> --
 Got feedback? go/pabloem-feedback
 

>>> --
>>> Got feedback? go/pabloem-feedback
>>> 
>>>
>>

Re: Beam Summit London 2018

[Griselda Cuevas]

Hi there,

We'll have 20min talks with 10min for Q&A, so 30min total.

G




On Tue, 21 Aug 2018 at 11:45, javier ramirez <
javier.ramirez.gom...@gmail.com> wrote:

> Hi,
>
> What'd be the duration of the talks? So I can scope the contents of my
> proposal.
>
> Looking forward to the summit!
>
> J
>
> On Tue, 21 Aug 2018, 14:47 Pascal Gula,  wrote:
>
>> Hi Matthias,
>> we (Peat / Plantix) might be interested by submitting a talk and I would
>> like to know if we can get access to the list of already submitted "Title"
>> to avoid submitting on similar topic!
>> Cheers,
>> Pascal
>>
>> On Tue, Aug 21, 2018 at 1:59 PM, Matthias Baetens <
>> baetensmatth...@gmail.com> wrote:
>>
>>> Hi everyone,
>>>
>>> We are happy to invite you to the first Beam Summit in London.
>>>
>>> The summit will be held in London at Level39
>>>  on *October 1 and 2.*
>>> You can register to attend for free on the Eventbrite page
>>> 
>>> .
>>>
>>> If you are interested in talking, please check our CfP form
>>>  and submit a talk!
>>>
>>> If you or your company is interested in helping out or sponsoring the
>>> summit (to keep it free), you can check out the sponsor booklet
>>> 
>>> .
>>>
>>> We will soon launch a blogpost with more details and announce the agenda
>>> closer to date.
>>>
>>> Thanks to everyone who helped make this happen, looking forward to
>>> welcoming you all in London!
>>>
>>> The Events & Meetups Group
>>>
>>> --
>>>
>>>
>>
>>
>>
>> --
>>
>> Pascal Gula
>> Senior Data Engineer / Scientist
>> +49 (0)176 34232684www.plantix.net 
>>  PEAT GmbH
>> Kastanienallee 4
>> 10435 Berlin // Germany
>>  Download 
>> the App! 
>>
>>

Re: Live coding & reviewing adventures

[Griselda Cuevas]

Exciting! :D




On Tue, 17 Jul 2018 at 14:27, Holden Karau  wrote:

> And I've got an hour to kill @ SFO today so at some of the suggestions
> from folks I'm going to do a more user focused one trying getting the TFT
> demo to work with the portable flink runner (hopefully) -
> https://www.youtube.com/watch?v=wL9mvQeN36E
>
> On Fri, Jul 13, 2018 at 11:54 AM, Holden Karau 
> wrote:
>
>> Hi folks! I've been doing some live coding in my other projects and I
>> figured I'd do some with Apache Beam as well.
>>
>> Today @ 3pm pacific I'm going be doing some impromptu exploration better
>> review tooling possibilities (looking at forking spark-pr-dashboard for
>> other projects like beam and setting up mentionbot to work with ASF infra)
>> - https://www.youtube.com/watch?v=ff8_jbzC8JI
>>
>> Next week (Thursday the 19th at 2pm pacific) I'm going to be working on
>> trying to get easier dependency management for the Python portable runner
>> in place - https://www.youtube.com/watch?v=Sv0XhS2pYqA
>>
>> If your interested in seeing more of the development process I hope you
>> will join me :)
>>
>> P.S.
>>
>> You can also follow on twitch which does a better job of notifications
>> https://www.twitch.tv/holdenkarau
>>
>> Also one of the other thing I do is "live reviews" of PRs but they are
>> generally opt-in and I don't have enough opt-ins from the Beam community to
>> do live reviews in Beam, if you work on Beam and would be OK with me doing
>> a live streamed review of your PRs let me know (if your curious to what
>> they look like you can see some of them here in Spark land
>> 
>> ).
>>
>> --
>> Twitter: https://twitter.com/holdenkarau
>>
>
>
>
> --
> Twitter: https://twitter.com/holdenkarau
>

[Call for Volunteers] Apache Beam Summit Europe 2018

[Griselda Cuevas]

*Hi Beam Community: If you’d like to sponsor/help organize the Europe
Apache Beam Summit Europe 2018, please reach out to gris [at] apache [dot]
org with your contact info and what areas would you like to help with.
We’ll be hosting a kick-off meeting with the organizing committee the last
week of July. Cheers, G*

[Events] Save the Date, Apache Beam Summit Europe 2018

[Griselda Cuevas]

*Hi Beam Community, We are happy to announce that the Apache Beam Summit
Europe will be hosted in London on October 1st & 2nd. Please mark your
calendars and keep an eye open for the call for speakers and the
registration announcement.If you have questions or suggestions, please let
us know. Gris on behalf of the Summit Organizers*

Re: [Events] Big Data in Production Boston Meetup, Today!

[Griselda Cuevas]

Thanks Everyone!




On Sat, 30 Jun 2018 at 08:00, Matthias Baetens 
wrote:

> The video can be found on the Beam YouTube channel as well:
> https://youtu.be/pPnY2y-zfaI
>
> On Thu, 28 Jun 2018 at 20:55 Eila Arich-Landkof 
> wrote:
>
>> I can download it and share it. You might be able to import it / add it
>> directly from Oriel research channel.
>> Let me know if this doesn’t work and I will download it
>>
>> Thanks,
>>
>> ———
>> Eila
>> www.orielresearch.org
>> www.meetup.com/deep-learning-in-production
>>
>> On Jun 28, 2018, at 12:22 PM, Matthias Baetens 
>> wrote:
>>
>> Hey Eila,
>>
>> Do you have the original file and could you share that with me? Is
>> everyone in the video and the venue fine with sharing it?
>>
>> Thanks!
>> Matthias
>>
>> On Thu, 28 Jun 2018 at 14:27 OrielResearch Eila Arich-Landkof <
>> e...@orielresearch.org> wrote:
>>
>>> Sure. great great!
>>>
>>> On Thu, Jun 28, 2018 at 5:52 AM, Matthias Baetens <
>>> baetensmatth...@gmail.com> wrote:
>>>
>>>> Looks awesome! Shall I add the talk to the Beam YouTube channel as
>>>> well?
>>>>
>>>> On Tue, 26 Jun 2018 at 23:40 Griselda Cuevas  wrote:
>>>>
>>>>> In case you'd like to follow the talk live, here is the livestream
>>>>> link:
>>>>>
>>>>> https://www.youtube.com/watch?v=aSU9y0E-WMA
>>>>>
>>>>>
>>>>>
>>>>> On Tue, 26 Jun 2018 at 16:11, Griselda Cuevas  wrote:
>>>>>
>>>>>> Hi Beam Community,
>>>>>>
>>>>>> Robert Bradshaw (Google) and Eila Arich-Landkof (Oriel Research) will
>>>>>> be speaking about Apache Beam at the Big Data in Production Boston
>>>>>> Meetup
>>>>>> <https://www.meetup.com/Deep-Learning-In-Production/events/250589154/> 
>>>>>> today
>>>>>> in the Google office in Cambridge, MA. We'll share the video and slides
>>>>>> with the mailing list afterwards.
>>>>>>
>>>>>> Regards,
>>>>>> G
>>>>>>
>>>>>> *P.S. If you'd like to organize a Meetup/Conference about Apache
>>>>>> Beam, don't forget to join our beam-events-meetups Slack channel to join
>>>>>> the convo!*
>>>>>>
>>>>> --
>>>>
>>>>
>>>
>>>
>>>
>>> --
>>> Eila
>>> www.orielresearch.org
>>> https://www.meetu <https://www.meetup.com/Deep-Learning-In-Production/>
>>> p.co <https://www.meetup.com/Deep-Learning-In-Production/>
>>> m/Deep-Learning-In-Production/
>>> <https://www.meetup.com/Deep-Learning-In-Production/>
>>>
>>>
>>> --
>>
>>
>> --
>
>

Re: FYI on Slack Channels

[Griselda Cuevas]

This is awesome, thanks Rafael!




On Tue, 26 Jun 2018 at 13:46, Scott Wegner  wrote:

> This is great, thanks Rafael!
>
> On Tue, Jun 26, 2018 at 6:45 AM Rafael Fernandez 
> wrote:
>
>> Ah! Didn't know -- thanks Romain!
>>
>> Done for all channels I could find. Also, here is a list of channels:
>>
>> #beam
>> #beam-events-meetups
>> #beam-go
>> #beam-java
>> #beam-portability
>> #beam-python
>> #beam-sql
>> #beam-testing
>>
>>
>> On Tue, Jun 26, 2018 at 1:18 AM Romain Manni-Bucau 
>> wrote:
>>
>>> +1 sounds very good
>>>
>>> side note: any channel must invite @asfarchivebot, I did it for the ones
>>> before "etc" but if you add others please ensure it is done
>>>
>>> Romain Manni-Bucau
>>> @rmannibucau  |  Blog
>>>  | Old Blog
>>>  | Github
>>>  | LinkedIn
>>>  | Book
>>> 
>>>
>>>
>>> Le mar. 26 juin 2018 à 01:05, Lukasz Cwik  a écrit :
>>>
 +user@beam.apache.org 

 On Mon, Jun 25, 2018 at 4:04 PM Rafael Fernandez 
 wrote:

> Hello!
>
> I took the liberty to create area-specific channels (such as
> #beam-java, #beam-python, #beam-go, etc.) As our project and community
> grows, I am seeing more and more "organic" interest groups forming -- this
> may help us chat more online. If they don't, we can delete later.
>
> Any thoughts? (I am having second thoughts... #beam-go should probably
> be #beam-burrow ;p )
>
> Cheers,
> r
>

Re: [Events] Big Data in Production Boston Meetup, Today!

[Griselda Cuevas]

In case you'd like to follow the talk live, here is the livestream link:

https://www.youtube.com/watch?v=aSU9y0E-WMA



On Tue, 26 Jun 2018 at 16:11, Griselda Cuevas  wrote:

> Hi Beam Community,
>
> Robert Bradshaw (Google) and Eila Arich-Landkof (Oriel Research) will be
> speaking about Apache Beam at the Big Data in Production Boston Meetup
> <https://www.meetup.com/Deep-Learning-In-Production/events/250589154/> today
> in the Google office in Cambridge, MA. We'll share the video and slides
> with the mailing list afterwards.
>
> Regards,
> G
>
> *P.S. If you'd like to organize a Meetup/Conference about Apache Beam,
> don't forget to join our beam-events-meetups Slack channel to join the
> convo!*
>

[Events] Big Data in Production Boston Meetup, Today!

[Griselda Cuevas]

Hi Beam Community,

Robert Bradshaw (Google) and Eila Arich-Landkof (Oriel Research) will be
speaking about Apache Beam at the Big Data in Production Boston Meetup
 today
in the Google office in Cambridge, MA. We'll share the video and slides
with the mailing list afterwards.

Regards,
G

*P.S. If you'd like to organize a Meetup/Conference about Apache Beam,
don't forget to join our beam-events-meetups Slack channel to join the
convo!*

Celebrating Pride... in the Apache Beam Logo

[Griselda Cuevas]

Someone in my team edited some Open-Source-Projects' logos to celebrate
pride and Apache Beam was included!


I'm attaching what she did... sprinkling some fun in the mailing list,
because it's Friday!

Apache Beam June Newsletter

[Griselda Cuevas]

Hi Beam Community!

Here

[1]
is the June Edition of our Apache Beam Newsletter. This edition was curated
by our community of contributors, committers and PMCs. Generally, it
contains the work done in the previous month (May in this case) and what's
planned for the future.

We hope to provide visibility to what's going on in the community, so if
you have questions, feel free to ask in this thread.

Cheers,
Gris

[1]
https://docs.google.com/document/d/1BwRhOu-uDd3SLB_Om_Beke5RoGKos4hj7Ljh7zM2YIo/edit?ts=5b17fb92#

[Call for Speakers] Deep Learning in Production Meetup, Boston Area on June 26th

[Griselda Cuevas]

Hi Beam Community,


Eila Arich-Landkof (from OrielResearch) and I are co-hosting the next
edition of the Deep Learning in Production Meetup
 on June 26th at the
Google Office in Cambridge, Massachusetts.


*We are looking for speakers who would like to share their Beam use case.*


We are expecting an audience of 150 people, so this is a great visibility
opportunity and also a fantastic way to network and get to meet people from
the Beam community.


If you are in the Area, come join us!


Cheers,

Eila & Gris

[FYI] New Apache Beam Swag Store!

[Griselda Cuevas]

Hi Beam Community,

I just want to share with you the exciting news about our brand new Apache
Beam Swag Store!

You can find it here: https://store-beam.myshopify.com/

*How does it work?*

   - You can just select the items you want and check-out. Our Vendor ships
   to anywhere in the world and normally can have swag to be delivered within
   1 week. Each company or user will need to pay for their own swag.
   - If you are hosting an event or representing Beam at one, reach out to
   me or the beam-events-meetups slack channel, I'll be happy to review your
   event and see if we can sponsor the swag. We'll have codes for this
   occasions thanks to Google, who has sponsored an initial inventory.

If you have feedback, ideas on new swag, questions or suggestions, reach
out to me and/or Matthias Baetens.

Happy Friday!
G

Re: [Call for items] Beam June Newsletter

[Griselda Cuevas]

Great question Scott!

Yes, this is a monthly Newsletter and the June Edition should cover the
things that happened in May.

On Wed, 6 Jun 2018 at 08:05, Scott Wegner  wrote:

> Thanks for putting this together, Gris. I'm not familiar with the format:
> what time period this newsletter should cover? Is this a monthly newsletter
> and the June edition covers news from May?
>
> On Tue, Jun 5, 2018 at 4:47 PM Griselda Cuevas  wrote:
>
>> Hi Everyone,
>>
>> Just a reminder to add items to the June Newsletter, the idea behind it
>> is to summarize community efforts in the project to get others identify
>> similar actions, opportunities to collaborate and ask questions. Folks in
>> the mailing list have found these newsletters useful in the past, so let's
>> keep the tradition going :)
>>
>> I'll extend the deadline until 6/7 11:59 p.m. PST. If you have questions
>> let me know.
>>
>> Thanks!
>> G
>>
>> On Fri, 1 Jun 2018 at 12:19, Griselda Cuevas  wrote:
>>
>>> Hi Everyone,
>>>
>>> Here's
>>> <https://docs.google.com/document/d/1BwRhOu-uDd3SLB_Om_Beke5RoGKos4hj7Ljh7zM2YIo/edit>
>>> [1] the template for the June Beam Newsletter.
>>>
>>> *Add the updates you want to share with the community by 6/5 11:59 p.m.*
>>> *Pacific Time.*
>>>
>>> I'll edit and send the final version through the users mailing list on
>>> 6/7.
>>>
>>> Thank you!
>>> Gris
>>>
>>> [1]
>>> https://docs.google.com/document/d/1BwRhOu-uDd3SLB_Om_Beke5RoGKos4hj7Ljh7zM2YIo/edit
>>>
>>

Re: [Call for items] Beam June Newsletter

[Griselda Cuevas]

Hi Everyone,

Just a reminder to add items to the June Newsletter, the idea behind it is
to summarize community efforts in the project to get others identify
similar actions, opportunities to collaborate and ask questions. Folks in
the mailing list have found these newsletters useful in the past, so let's
keep the tradition going :)

I'll extend the deadline until 6/7 11:59 p.m. PST. If you have questions
let me know.

Thanks!
G

On Fri, 1 Jun 2018 at 12:19, Griselda Cuevas  wrote:

> Hi Everyone,
>
> Here's
> <https://docs.google.com/document/d/1BwRhOu-uDd3SLB_Om_Beke5RoGKos4hj7Ljh7zM2YIo/edit>
> [1] the template for the June Beam Newsletter.
>
> *Add the updates you want to share with the community by 6/5 11:59 p.m.*
> *Pacific Time.*
>
> I'll edit and send the final version through the users mailing list on 6/7.
>
> Thank you!
> Gris
>
> [1]
> https://docs.google.com/document/d/1BwRhOu-uDd3SLB_Om_Beke5RoGKos4hj7Ljh7zM2YIo/edit
>

Re: Initial contributor experience

[Griselda Cuevas]

+user@ in case someone has had similar experiences.

Thanks for documenting this Austin & Pablo!

If any other folks would like to participate in improving the "First
contribution experience" for Beam let us know in this thread.

On Tue, 5 Jun 2018 at 13:40, Austin Bennett 
wrote:

> Had been meaning to get setup to contribute for a bit - so walked through
> with Pablo, to try to point out assumptions, lacking docs, etc.
>
> Write-up found-->
>
>
> https://docs.google.com/document/d/1hq-s3L676LkMTftvhv0eCkdwrRnZmCRiLdaQBWLHWWA/edit
>

[Call for items] Beam June Newsletter

[Griselda Cuevas]

Hi Everyone,

Here's

[1] the template for the June Beam Newsletter.

*Add the updates you want to share with the community by 6/5 11:59 p.m.*
*Pacific Time.*

I'll edit and send the final version through the users mailing list on 6/7.

Thank you!
Gris

[1]
https://docs.google.com/document/d/1BwRhOu-uDd3SLB_Om_Beke5RoGKos4hj7Ljh7zM2YIo/edit

Getting Ready for the Apache Community Summit @ San Francisco, CA

[Griselda Cuevas]

Hi Everyone,

As you might remember from this thread [1] we're hosting the first Apache
Beam Community Summit in San Francisco tomorrow.

I've prepared a notes document [2] so that people can read after the
sessions. Additionally, folks who cannot attend can add questions starting
now so we can address them during or after the summit.

I'll report back with a summary after the event. Thanks to everyone who is
coming!

Gris Cuevas

[1] https://lists.apache.org/list.html?user@beam.apache.org:lte=2M:summit
[2]
https://docs.google.com/document/d/1B4EU8jjZy9TnlRiZWW9hSCqegbmOh8boIgjkAyOfnCk/edit#

Re: Strata Conference this March 6-8

[Griselda Cuevas]

I'll be there too :)


Gris Cuevas Zambrano

g...@google.com

Open Source Strategist

345 Spear Street, San Francisco, 94105



On 7 March 2018 at 10:57, Tyler Akidau  wrote:

> I may be a few minutes late but I'll be there. Looking forward to seeing
> everyone who can make it!
>
> -Tyler
>
>
> On Wed, Mar 7, 2018, 10:45 Holden Karau  wrote:
>
>> Just a reminder folks this is today!
>> 3:30 pm at Philz Coffee. If any folks want to walk over together we'll
>> meet in front around 3:15pm and I'll be wearing my black/white code dress
>> with pink/blue hair. Looking forward to chatting with y'all.
>>
>> On Mon, Jan 22, 2018 at 12:12 PM, Griselda Cuevas 
>> wrote:
>>
>>> Hi Everyone,
>>>
>>> +1 to the BoF. I'd suggest meeting at 3:30 p.m. on 3/7/2018 at the Philz
>>> Coffee Holden suggested. It takes about 10min
>>> <https://www.google.com/maps/dir/San+Jose+McEnery+Convention+Center,+150+W+San+Carlos+St,+San+Jose,+CA+95113/Philz+Coffee,+Paseo+De+San+Antonio+Walk,+San+Jose,+CA/@37.3315262,-121.8894574,17z/data=!3m1!4b1!4m14!4m13!1m5!1m1!1s0x808fccb0748b2f73:0x1615f1acacf4449a!2m2!1d-121.8875475!2d37.3293048!1m5!1m1!1s0x808fccbbd516f8b7:0xa48a49dfd03f76e9!2m2!1d-121.8848985!2d37.3336067!3e2>
>>> to walk from the convention center there.
>>>
>>> re:Organizing a Meetup near the dates of Strata SJ. I can organize
>>> something for Wednesday night @ Google's campus. Would anyone have a use
>>> case or talk they'd like to share with the community?
>>>
>>> re:Strata London -- @Matthias & Victor, happy to help on that as well.
>>>
>>> Cheers,
>>> G
>>>
>>>
>>>
>>> On 19 January 2018 at 11:00, Tyler Akidau  wrote:
>>>
>>>> I'll be talking about streaming SQL at Strata SJC. It's related to the
>>>> SQL work happening in Beam that Mingmin, James, and Anton are working on,
>>>> but the talk itself is relatively conceptual, hence no Beam in the title.
>>>> Is the BoF thing happening? If so, is Wed 3:20pm the confirmed time? I'll
>>>> be flying back from QCon London that week, so will try to book flights that
>>>> get me back in time for the BoF if I can.
>>>>
>>>> -Tyler
>>>>
>>>>
>>>> On Thu, Jan 18, 2018 at 9:39 AM Jean-Baptiste Onofré 
>>>> wrote:
>>>>
>>>>> I think Matthias has already some plan for London meetup later this
>>>>> year (it's
>>>>> what he said to me).
>>>>>
>>>>> Stay tuned !
>>>>>
>>>>> Regards
>>>>> JB
>>>>>
>>>>> On 01/18/2018 06:29 PM, Ismaël Mejía wrote:
>>>>> > My excuses I somehow misread the dates and thought you referred to
>>>>> the
>>>>> > London conference, but well in the end this becomes two good ideas :)
>>>>> >
>>>>> > - A meetup in London for the week of May 21
>>>>> > - A meetup in San Jose if someone can organize it for the March
>>>>> dates.
>>>>> >
>>>>> >
>>>>> > On Thu, Jan 18, 2018 at 12:00 AM, Holden Karau 
>>>>> wrote:
>>>>> >> So doing a streaming BoF join in would probably require meeting
>>>>> somewhere
>>>>> >> other than a coffee shop so as not to be jerks in the coffee shop.
>>>>> >>
>>>>> >> On Wed, Jan 17, 2018 at 2:53 PM, Matthias Baetens
>>>>> >>  wrote:
>>>>> >>>
>>>>> >>> Sure, I'd be very happy to organise something. This is about
>>>>> Strata San
>>>>> >>> Jose though right? Maybe we can organise a remote session in which
>>>>> we can
>>>>> >>> join (depending on when you would organise the BoF) or have a
>>>>> channel set-up
>>>>> >>> if the talks would be broadcasted?
>>>>> >>>
>>>>> >>> Also: will there be any Beam talks on Strata London or is this not
>>>>> known
>>>>> >>> yet? Keen to get involved and set things up around that date as
>>>>> well.
>>>>> >>>
>>>>> >>> On Wed, Jan 17, 2018 at 8:37 AM, Jean-Baptiste Onofré <
>>>>> j...@nanthrax.net>
>>>>> >>> wrote:
>>>>&

Re: Third Apache Beam meet up in London

[Griselda Cuevas]

Great and thanks for organizing guys!




On 27 February 2018 at 03:22, Matthias Baetens  wrote:

> Hi all,
>
> We are very excited to announce the third Apache Beam meetup in London *the
> 5th of March*.
>
> Tyler Akidau (Google) will be talking about Streaming SQL, while Victor
> Kotai (Qubit) will talk about putting a Beam pipeline in production and how
> to monitor it, while I (Datatonic) will do a talk on how to leverage Beam
> for a Machine Learning use case.
>
> More info and RSVP: http://bit.ly/3rdApacheBeamMeetupLondon
>
> We'll do our best to record and share the session again as well.
>
> Best regards,
> Matthias
>

[Events] Apache Beam Summit 2018 in California on 3/14

[Griselda Cuevas]

Hi Everyone,

I know that some folks from the community are attending a few events in
California in March, one of them is the Google Cloud Community Conference
on March 15th.

Taking advantage of these events happening in California, some of us have
been putting together the first Apache Beam Community Summit on March 14th

[1].
The location will be Wingtip Club in San Francisco, CA.

The objective of this summit, is to open a space for the members of this
community to spend some time working face-to-face, focusing specially on
2018 plans.

I'd like to invite any Apache Beam developer and/or user interested in
joining to register using this form

[2]
by 3/10.

I realize the invitation comes with a short notice so apologies for that. We
needed to take advantage of the opportunity of having folks traveling to
California. We'll make sure to report back all important outcomes here to
the mailing list.

If you can't join but would like to organize a second version this year
(maybe in Europe or another location), let me know. I'll be happy to help
coordinate this as well.

Have a great weekend!
G

[1] https://docs.google.com/document/d/1fY-O2IdN0IrWYvPhxs6EvgwSaaLAd74aR
ws2_mogkNQ/edit#heading=h.mls7w0yyv8wc

[2] https://docs.google.com/forms/d/1kZKakoxesFJvNa37RjHRr9WWK8ojQ
gUBBARqjQkNBVg/edit?usp=drive_web

Re: Presentations about Apche Beam

[Griselda Cuevas]

Ciao Davide,

Just checking if you'd like to share the presentations with the community?

Have a great weekend!

>
> On Wed, Feb 14, 2018, 10:26 PM Davide Russo 
> wrote:
>
>> Dear Beam Community,
>>
>>
>>
>> My name is David and i’m a studet of University of Molise, Italy. I’m
>> studing “Security of Software System” and during this degree I’m attending
>> the course of “Complex Software Architecture and Styes”; for the exam I
>> have to analyse an Apache complex system. I selected to analyse Apache Beam
>> for many reason. I’m writing you because for this project I produced 3
>> presentations about Beam that I would to submit you to add them on Beam
>> website as presentation material. They derived in part form the existing
>> presentation so if you think that these presentations are good and well
>> done it could be cool if you add them on the Beam website. If you are
>> interested let me know that I’ll send you as soon as possible my work.
>>
>>
>>
>> Best Regards.
>>
>> DR
>>
>

[Community] Second User Empathy Workshop tomorrow 2/10 in Mexico City

[Griselda Cuevas]

Hi Folks,

Tomorrow February 10th, Pablo Estrada, Thomas Grogh, Hector Paredes and
Mariann Nagy will deliver a second Apache Beam user empathy workshop[1],
this time in Mexico City. This workshop will be also sponsored by Wizeline
Academy & Google.

As you might remember, we ran a first edition[2] back on December 2nd in
Guadalajara. The purpose of these workshops is to let us study and
understand the adoption barriers of Apache Beam. We'll be consolidating
findings from both workshops and sharing insights with the mailing list
after this session.

If you're in Mexico and want to say hi to our team, feel free to stop by.
If you're interested in running similar efforts reach out to me and I'll be
happy to share resources and connect with you.

Happy Friday!
G

[1] https://academy.wizeline.com/apache-beam/
[2] https://lists.apache.org/list.html?*@beam.apache.org:lte=1y:workshop

[Event] OSCON Call For Proposals Deadline is 1/30

[Griselda Cuevas]

Hi Beam Community,

I just wanted to send a reminder that OSCON's CFP deadline is this 1/30. I
have added a reminder in our brand new events calendar.

You can find more information about the event in their website
. To submit a proposal you
can use this link.


If you're submitting something related to Beam, let us know in this thread.

Enjoy the weekend!
G

Re: Strata Conference this March 6-8

[Griselda Cuevas]

Hi Everyone,

+1 to the BoF. I'd suggest meeting at 3:30 p.m. on 3/7/2018 at the Philz
Coffee Holden suggested. It takes about 10min

to walk from the convention center there.

re:Organizing a Meetup near the dates of Strata SJ. I can organize
something for Wednesday night @ Google's campus. Would anyone have a use
case or talk they'd like to share with the community?

re:Strata London -- @Matthias & Victor, happy to help on that as well.

Cheers,
G



On 19 January 2018 at 11:00, Tyler Akidau  wrote:

> I'll be talking about streaming SQL at Strata SJC. It's related to the SQL
> work happening in Beam that Mingmin, James, and Anton are working on, but
> the talk itself is relatively conceptual, hence no Beam in the title. Is
> the BoF thing happening? If so, is Wed 3:20pm the confirmed time? I'll be
> flying back from QCon London that week, so will try to book flights that
> get me back in time for the BoF if I can.
>
> -Tyler
>
>
> On Thu, Jan 18, 2018 at 9:39 AM Jean-Baptiste Onofré 
> wrote:
>
>> I think Matthias has already some plan for London meetup later this year
>> (it's
>> what he said to me).
>>
>> Stay tuned !
>>
>> Regards
>> JB
>>
>> On 01/18/2018 06:29 PM, Ismaël Mejía wrote:
>> > My excuses I somehow misread the dates and thought you referred to the
>> > London conference, but well in the end this becomes two good ideas :)
>> >
>> > - A meetup in London for the week of May 21
>> > - A meetup in San Jose if someone can organize it for the March dates.
>> >
>> >
>> > On Thu, Jan 18, 2018 at 12:00 AM, Holden Karau 
>> wrote:
>> >> So doing a streaming BoF join in would probably require meeting
>> somewhere
>> >> other than a coffee shop so as not to be jerks in the coffee shop.
>> >>
>> >> On Wed, Jan 17, 2018 at 2:53 PM, Matthias Baetens
>> >>  wrote:
>> >>>
>> >>> Sure, I'd be very happy to organise something. This is about Strata
>> San
>> >>> Jose though right? Maybe we can organise a remote session in which we
>> can
>> >>> join (depending on when you would organise the BoF) or have a channel
>> set-up
>> >>> if the talks would be broadcasted?
>> >>>
>> >>> Also: will there be any Beam talks on Strata London or is this not
>> known
>> >>> yet? Keen to get involved and set things up around that date as well.
>> >>>
>> >>> On Wed, Jan 17, 2018 at 8:37 AM, Jean-Baptiste Onofré <
>> j...@nanthrax.net>
>> >>> wrote:
>> 
>>  That's a great idea ! I'm sure that Matthias (organizer of the Beam
>>  London Meetup) can help us to plan something.
>> 
>>  Regards
>>  JB
>> 
>> 
>>  On 01/17/2018 08:57 AM, Ismaël Mejía wrote:
>> >
>> > Maybe a good idea to try to organize a Beam meetup in london in the
>> > same dates in case some of the people around can jump in and talk
>> too.
>> >
>> > On Wed, Jan 17, 2018 at 2:51 AM, Ron Gonzalez > >
>> > wrote:
>> >>
>> >> Works for me...
>> >>
>> >> On Tuesday, January 16, 2018, 5:45:33 PM PST, Holden Karau
>> >>  wrote:
>> >>
>> >>
>> >> How would folks feel about during the afternoon break (3:20-4:20)
>> on
>> >> the
>> >> Wednesday (same day as Eugene's talk)? We could do the Philz which
>> is a
>> >> bit
>> >> of a walk but gets us away from the big crowd and also lets folks
>> not
>> >> attending the conference but in the area join us.
>> >>
>> >> On Tue, Jan 16, 2018 at 5:29 PM, Ron Gonzalez <
>> zlgonza...@yahoo.com>
>> >> wrote:
>> >>
>> >> Cool, let me know if you guys finally schedule it. I will
>> definitely
>> >> try to
>> >> make it to Eugene's talk but having an informal BoF in the area
>> would
>> >> be
>> >> nice...
>> >>
>> >> Thanks,
>> >> Ron
>> >>
>> >> On Tuesday, January 16, 2018, 5:06:53 PM PST, Boris Lublinsky
>> >>  wrote:
>> >>
>> >>
>> >> All for it
>> >>
>> >> Boris Lublinsky
>> >> FDP Architect
>> >> boris.lublin...@lightbend.com
>> >> https://www.lightbend.com/
>> >>
>> >> On Jan 16, 2018, at 7:01 PM, Ted Yu  wrote:
>> >>
>> >> +1 to BoF
>> >>
>> >> On Tue, Jan 16, 2018 at 5:00 PM, Dmitry Demeshchuk
>> >> 
>> >> wrote:
>> >>
>> >> Probably won't be attending the conference, but totally down for a
>> BoF.
>> >>
>> >> On Tue, Jan 16, 2018 at 4:58 PM, Holden Karau <
>> hol...@pigscanfly.ca>
>> >> wrote:
>> >>
>> >> Do interested folks have any timing constraints around a BoF?
>> >>
>> >> On Tue, Jan 16, 2018 at 4:30 PM, Jesse Anderson
>> >> 
>> >> wrote:
>> >>
>> >> +1 to BoF. I 

Apache Beam Workshop in Guadalajara Mexico

[Griselda Cuevas]

Hi Everyone,

I wanted to share with you that on December 2nd, Wizeline Academy [1] will
host an Apache Beam workshop in Guadalajara Mexico. The objective of this
workshop is to identify adoption barriers and improvement opportunities for
the project through the observation and documentation of the experience of
new Beam users. We hope that the findings of this workshop can provide
supportive information to shape the direction of our project, specially now
that we have started conversation about next releases.

If you are in the area and are interested in joining us, please sign up
[2]. If you're interested in running similar efforts reach out to me and
I'll be happy to share resources and connect with you. I'll report back
with findings after the workshop.

Cheers,
Gris

[1] https://academy.wizeline.com/about/
[2] https://academy.wizeline.com/apache-beam/

Re: [Call for items] Beam Nov/Dec Newsletter

[Griselda Cuevas]

Hi everyone - just a reminder to add any updates you want to share with the
community before EOD today.

Cheers,
G


On 17 November 2017 at 16:05, Griselda Cuevas  wrote:

> Hi Everyone,
>
> Here's
> <https://docs.google.com/document/d/1L67ICt44Yo02onxOUsHeoiolE3GdMz_6q1Lk94CPRxM/edit#>
>  the
> template for the Nov/Dec Beam Newsletter.
>
> *Add the updates you want to share with the community by 11/27 11:59 p.m.
> Pacific Time.*
>
> I'll edit and send the final version through the users mailing list on
> 12/1.
>
> Thank you!
> Gris
>

[Call for items] Beam Nov/Dec Newsletter

[Griselda Cuevas]

Hi Everyone,

Here's

the
template for the Nov/Dec Beam Newsletter.

*Add the updates you want to share with the community by 11/27 11:59 p.m.
Pacific Time.*

I'll edit and send the final version through the users mailing list on
12/1.

Thank you!
Gris

Re: London Apache Beam meetup 2: call for speakers

[Griselda Cuevas]

Question for the PMCs and Committers - do we have a YT channel already or
do we need to create one? If we need to create one, do we need to ask
someone in press@ or marketing@?


Gris Cuevas Zambrano

g...@google.com

Open Source Strategy

345 Spear Street, San Francisco, 94105



On 9 November 2017 at 14:07, AndrasNagy  wrote:

> Thx.
> Great pls post the links here too ;)
>
> On 9 Nov 2017 10:05 pm, "Griselda Cuevas"  wrote:
>
>> Great suggestion (about the Youtube channel). I have the recording of the
>> talks we gave here in SF this past 11/1 but I need to get it from our tech
>> team and upload it somewhere, will look into a youtube channel :)
>>
>>
>> Gris Cuevas Zambrano
>>
>> g...@google.com
>>
>> Open Source Strategy
>>
>> 345 Spear Street, San Francisco, 94105
>> <https://maps.google.com/?q=345+Spear+Street,+San+Francisco,+94105&entry=gmail&source=g>
>>
>>
>>
>> On 9 November 2017 at 14:01, AndrasNagy  wrote:
>>
>>> Hey.
>>> Please make sure all talks are going to be recorded and later uploaded
>>> to youtube or ustream.
>>>
>>> We are all really interested but many people (include myself) do not
>>> have the opportunity to attend.
>>>
>>> Thx
>>>
>>> On 9 Nov 2017 21:55, "Griselda Cuevas"  wrote:
>>>
>>>> Maybe send a call for speakers and see if we have anyone from the
>>>> community visiting London who could be a speaker?
>>>>
>>>> It'd be great to have one London Meetup on 12/5 because we're hosting
>>>> one in SF and one in NY so it'd be awesome to have three on the same day!
>>>>
>>>>
>>>> Gris Cuevas Zambrano
>>>>
>>>> g...@google.com
>>>>
>>>> Open Source Strategy
>>>>
>>>> 345 Spear Street, San Francisco, 94105
>>>> <https://maps.google.com/?q=345+Spear+Street,+San+Francisco,+94105&entry=gmail&source=g>
>>>>
>>>>
>>>>
>>>> On 8 November 2017 at 15:09, Matthias Baetens <
>>>> baetensmatth...@gmail.com> wrote:
>>>>
>>>>> No worries JB, I'll send you a message on how we can plan around this
>>>>> (reschedule the meetup or postpone your session).
>>>>> Thanks for the heads-up, have fun in Singapore!
>>>>>
>>>>> Best,
>>>>> Matthias
>>>>>
>>>>> Op di 7 nov. 2017 om 04:52 schreef Jean-Baptiste Onofré <
>>>>> j...@nanthrax.net>:
>>>>>
>>>>>> Hi,
>>>>>>
>>>>>> unfortunately, I have to decline the invite as I will be at Strata
>>>>>> Singapore in
>>>>>> the same time :(
>>>>>>
>>>>>> I'm very sorry about that. You can count on me for the 3rd edition !
>>>>>>
>>>>>> Regards
>>>>>> JB
>>>>>>
>>>>>> On 11/07/2017 01:41 AM, Matthias Baetens wrote:
>>>>>> > Hi all!
>>>>>> >
>>>>>> > Hope you are well.
>>>>>> > We are back for a second edition of the London Apache Beam meetup,
>>>>>> aiming for
>>>>>> > the 5th of December.
>>>>>> >
>>>>>> > We are pretty excited to announce that our first speaker will be
>>>>>> > Jean-Baptiste Onofré <https://github.com/jbonofre> himself!
>>>>>> >
>>>>>> > If you have an interesting *use-case* to share and are in London on
>>>>>> the *5th of
>>>>>> > December*, don't hesitate to reach out to me :)
>>>>>> > Else: keep track of the meetup page
>>>>>> > <https://www.meetup.com/London-Apache-Beam-Meetup/> to be updated
>>>>>> on our
>>>>>> > activity in the space.
>>>>>> >
>>>>>> > Best,
>>>>>> > Matthias
>>>>>> > --
>>>>>>
>>>>>> --
>>>>>> Jean-Baptiste Onofré
>>>>>> jbono...@apache.org
>>>>>> http://blog.nanthrax.net
>>>>>> Talend - http://www.talend.com
>>>>>>
>>>>> --
>>>>>
>>>>>
>>>>
>>>>
>>

Re: London Apache Beam meetup 2: call for speakers

[Griselda Cuevas]

Great suggestion (about the Youtube channel). I have the recording of the
talks we gave here in SF this past 11/1 but I need to get it from our tech
team and upload it somewhere, will look into a youtube channel :)


Gris Cuevas Zambrano

g...@google.com

Open Source Strategy

345 Spear Street, San Francisco, 94105



On 9 November 2017 at 14:01, AndrasNagy  wrote:

> Hey.
> Please make sure all talks are going to be recorded and later uploaded to
> youtube or ustream.
>
> We are all really interested but many people (include myself) do not have
> the opportunity to attend.
>
> Thx
>
> On 9 Nov 2017 21:55, "Griselda Cuevas"  wrote:
>
>> Maybe send a call for speakers and see if we have anyone from the
>> community visiting London who could be a speaker?
>>
>> It'd be great to have one London Meetup on 12/5 because we're hosting one
>> in SF and one in NY so it'd be awesome to have three on the same day!
>>
>>
>> Gris Cuevas Zambrano
>>
>> g...@google.com
>>
>> Open Source Strategy
>>
>> 345 Spear Street, San Francisco, 94105
>> <https://maps.google.com/?q=345+Spear+Street,+San+Francisco,+94105&entry=gmail&source=g>
>>
>>
>>
>> On 8 November 2017 at 15:09, Matthias Baetens 
>> wrote:
>>
>>> No worries JB, I'll send you a message on how we can plan around this
>>> (reschedule the meetup or postpone your session).
>>> Thanks for the heads-up, have fun in Singapore!
>>>
>>> Best,
>>> Matthias
>>>
>>> Op di 7 nov. 2017 om 04:52 schreef Jean-Baptiste Onofré >> >:
>>>
>>>> Hi,
>>>>
>>>> unfortunately, I have to decline the invite as I will be at Strata
>>>> Singapore in
>>>> the same time :(
>>>>
>>>> I'm very sorry about that. You can count on me for the 3rd edition !
>>>>
>>>> Regards
>>>> JB
>>>>
>>>> On 11/07/2017 01:41 AM, Matthias Baetens wrote:
>>>> > Hi all!
>>>> >
>>>> > Hope you are well.
>>>> > We are back for a second edition of the London Apache Beam meetup,
>>>> aiming for
>>>> > the 5th of December.
>>>> >
>>>> > We are pretty excited to announce that our first speaker will be
>>>> > Jean-Baptiste Onofré <https://github.com/jbonofre> himself!
>>>> >
>>>> > If you have an interesting *use-case* to share and are in London on
>>>> the *5th of
>>>> > December*, don't hesitate to reach out to me :)
>>>> > Else: keep track of the meetup page
>>>> > <https://www.meetup.com/London-Apache-Beam-Meetup/> to be updated on
>>>> our
>>>> > activity in the space.
>>>> >
>>>> > Best,
>>>> > Matthias
>>>> > --
>>>>
>>>> --
>>>> Jean-Baptiste Onofré
>>>> jbono...@apache.org
>>>> http://blog.nanthrax.net
>>>> Talend - http://www.talend.com
>>>>
>>> --
>>>
>>>
>>
>>

Re: London Apache Beam meetup 2: call for speakers

[Griselda Cuevas]

Maybe send a call for speakers and see if we have anyone from the community
visiting London who could be a speaker?

It'd be great to have one London Meetup on 12/5 because we're hosting one
in SF and one in NY so it'd be awesome to have three on the same day!


Gris Cuevas Zambrano

g...@google.com

Open Source Strategy

345 Spear Street, San Francisco, 94105



On 8 November 2017 at 15:09, Matthias Baetens 
wrote:

> No worries JB, I'll send you a message on how we can plan around this
> (reschedule the meetup or postpone your session).
> Thanks for the heads-up, have fun in Singapore!
>
> Best,
> Matthias
>
> Op di 7 nov. 2017 om 04:52 schreef Jean-Baptiste Onofré :
>
>> Hi,
>>
>> unfortunately, I have to decline the invite as I will be at Strata
>> Singapore in
>> the same time :(
>>
>> I'm very sorry about that. You can count on me for the 3rd edition !
>>
>> Regards
>> JB
>>
>> On 11/07/2017 01:41 AM, Matthias Baetens wrote:
>> > Hi all!
>> >
>> > Hope you are well.
>> > We are back for a second edition of the London Apache Beam meetup,
>> aiming for
>> > the 5th of December.
>> >
>> > We are pretty excited to announce that our first speaker will be
>> > Jean-Baptiste Onofré  himself!
>> >
>> > If you have an interesting *use-case* to share and are in London on the
>> *5th of
>> > December*, don't hesitate to reach out to me :)
>> > Else: keep track of the meetup page
>> >  to be updated on
>> our
>> > activity in the space.
>> >
>> > Best,
>> > Matthias
>> > --
>>
>> --
>> Jean-Baptiste Onofré
>> jbono...@apache.org
>> http://blog.nanthrax.net
>> Talend - http://www.talend.com
>>
> --
>
>

Re: Infinite retry in streaming - is there a workaround?

[Griselda Cuevas]

Hi Derek, yes you can use that mailing list and also the SO channel.

Cheers,
G


> BTW, do you know if there's a Dataflow mailing list for questions like
> this? Would dataflow-feedback be the appropriate mailing list?
>
> Thanks,
>
> Derek
>
> On Wed, Oct 25, 2017 at 10:58 AM, Griselda Cuevas  wrote:
>
>> Hi Derek - It sounds like this is a Dataflow specific questions so I'd
>> recommend you also reach out through the Dataflow's Stack Overflow
>> <https://stackoverflow.com/questions/tagged/google-cloud-dataflow>
>> channel. I'm also cc'ing Thomas Groh who might be able to help.
>>
>>
>>
>> On 20 October 2017 at 11:35, Derek Hao Hu  wrote:
>>
>>> ​Kindly ping as I'm really curious about this. :p
>>>
>>> Derek​
>>>
>>> On Thu, Oct 19, 2017 at 2:15 PM, Derek Hao Hu 
>>> wrote:
>>>
>>>> Hi,
>>>>
>>>> ​We are trying to use Dataflow in Prod and right now one of our main
>>>> concerns is this "infinite retry" behavior which might stall the whole
>>>> pipeline.
>>>>
>>>> Right now for all the DoFns we've implemented ourselves we've added
>>>> some error handling or exception swallowing mechanism to make sure some
>>>> bundles can just fail and we log the exceptions. But we are a bit concerned
>>>> about the other Beam native transforms which we can not easily wrap, e.g.
>>>> PubSubIO transforms and DatastoreV1 transforms.
>>>>
>>>> A few days ago I asked a specific question in this group about how one
>>>> can catch exception in DatastoreV1 transforms and the recommended approach
>>>> is to 1) either duplicate the code in the current DatastoreV1
>>>> implementation and swallow the exception instead of throwing or 2) Follow
>>>> the implementation of BigQueryIO to add the ability to support custom retry
>>>> policy. Both are feasible options but I'm a bit concerned in that doesn't
>>>> that mean eventually all Beam native transforms need to implement something
>>>> like 2) if we want to use them in Prod?
>>>>
>>>> So in short, I want to know right now what is the recommended approach
>>>> or workaround to say, hey, just let this bundle fail and we can process the
>>>> rest of the elements instead of just stall the pipeline?
>>>>
>>>> Thanks!
>>>> --
>>>> Derek Hao Hu
>>>>
>>>> Software Engineer | Snapchat
>>>> Snap Inc.
>>>>
>>>
>>>
>>>
>>> --
>>> Derek Hao Hu
>>>
>>> Software Engineer | Snapchat
>>> Snap Inc.
>>>
>>
>>
>
>
> --
> Derek Hao Hu
>
> Software Engineer | Snapchat
> Snap Inc.
>

Re: Infinite retry in streaming - is there a workaround?

[Griselda Cuevas]

Hi Derek - It sounds like this is a Dataflow specific questions so I'd
recommend you also reach out through the Dataflow's Stack Overflow
 channel.
I'm also cc'ing Thomas Groh who might be able to help.



On 20 October 2017 at 11:35, Derek Hao Hu  wrote:

> ​Kindly ping as I'm really curious about this. :p
>
> Derek​
>
> On Thu, Oct 19, 2017 at 2:15 PM, Derek Hao Hu 
> wrote:
>
>> Hi,
>>
>> ​We are trying to use Dataflow in Prod and right now one of our main
>> concerns is this "infinite retry" behavior which might stall the whole
>> pipeline.
>>
>> Right now for all the DoFns we've implemented ourselves we've added some
>> error handling or exception swallowing mechanism to make sure some bundles
>> can just fail and we log the exceptions. But we are a bit concerned about
>> the other Beam native transforms which we can not easily wrap, e.g.
>> PubSubIO transforms and DatastoreV1 transforms.
>>
>> A few days ago I asked a specific question in this group about how one
>> can catch exception in DatastoreV1 transforms and the recommended approach
>> is to 1) either duplicate the code in the current DatastoreV1
>> implementation and swallow the exception instead of throwing or 2) Follow
>> the implementation of BigQueryIO to add the ability to support custom retry
>> policy. Both are feasible options but I'm a bit concerned in that doesn't
>> that mean eventually all Beam native transforms need to implement something
>> like 2) if we want to use them in Prod?
>>
>> So in short, I want to know right now what is the recommended approach or
>> workaround to say, hey, just let this bundle fail and we can process the
>> rest of the elements instead of just stall the pipeline?
>>
>> Thanks!
>> --
>> Derek Hao Hu
>>
>> Software Engineer | Snapchat
>> Snap Inc.
>>
>
>
>
> --
> Derek Hao Hu
>
> Software Engineer | Snapchat
> Snap Inc.
>

[Events] Call for speakers for a NY Meetup on 12/5 or 12/6, can be remote

[Griselda Cuevas]

Hi folks - I'm looking for 2 speakers for the Big Data Warehousing Meetup
 [1] in New York on December
5th or 6th, if you don't live in NY but would love to share your project
you can give your talk via Hangout.

Any topic related to Apache Beam or how you use it is good - you can see
suggested topics in our Meetup Knowledge Base

 [2].

This is a great opportunity to tell the world about how you're using Beam ;)

Happy Weekend everyone!
G

[1] https://www.meetup.com/Big-Data-Warehousing/
[2]
https://docs.google.com/spreadsheets/d/1CloF63FOKSPM6YIuu8eExjhX6xrIiOp5j4zPbSg3Apo/edit#gid=466829885

Re: [VOTE] [DISCUSSION] Remove support for Java 7

[Griselda Cuevas]

+1

On 17 October 2017 at 16:36, Robert Bradshaw  wrote:

> +1 to removing Java 7 support, pending no major user outcry to the
> contrary.
>
> In terms of versioning, I fall into the camp that this isn't
> sufficiently incompatible to warrant a major version increase.
> Semantic versioning is all about messaging, and upgrading the major
> version so soon after GA for such a minor change would IMHO cause more
> confusion that clarity. Hitting 3.0 should signal a major improvement
> to Beam itself.
>
> On Tue, Oct 17, 2017 at 3:52 PM, Eugene Kirpichov 
> wrote:
> > +1 to removing Java 7 support.
> >
> > In terms of release 3.0, we can handle this two ways:
> > - Wait until enough other potentially incompatible changes accumulate, do
> > all of them, and call it a "3.0" release, so that 3.0 will truly differ
> in a
> > lot of incompatible and hopefully nice ways from 2.x. This might well
> take a
> > year or so.
> > - Make a release in which Java 7 support is removed, and call it a "3.0"
> > release just to signal the incompatibility, and other potentially
> > incompatible changes will wait until "4.0" etc.
> >
> > I suppose the decision depends on whether we have a lot of other
> > incompatible changes we would like to do, and whether we have any other
> > truly great features enabled by those changes, or at least truly great
> > features justifying increasing the major version number. If we go with
> #1,
> > I'd say, among the current work happening in Beam, portability comes to
> mind
> > as a sufficiently huge milestone, so maybe drop Java 7 in the same
> release
> > that offers a sufficient chunk of the portability work?
> >
> > (There's also a third path: declare that dropping Java7 support is not
> > sufficiently "incompatible" to warrant a major version increase, because
> > people don't have to rewrite their code but only switch their compiler
> > version, and people who already use a Java8 compiler won't even notice.
> This
> > path could perhaps be considered if we had evidence that switching to a
> Beam
> > release without Java7 support would require 0 work for an overwhelming
> > majority of users)
> >
> >
> >
> > On Tue, Oct 17, 2017 at 3:34 PM Randal Moore 
> wrote:
> >>
> >> +1
> >>
> >> On Tue, Oct 17, 2017 at 5:21 PM Raghu Angadi 
> wrote:
> >>>
> >>> +1.
> >>>
> >>> On Tue, Oct 17, 2017 at 2:11 PM, David McNeill 
> >>> wrote:
> 
>  The final version of Beam that supports Java 7 should be clearly
> stated
>  in the docs, so those stuck on old production infrastructure for
> other java
>  app dependencies know where to stop upgrading.
> 
>  David McNeill
>  021 721 015
> 
> 
> 
>  On 18 October 2017 at 05:16, Ismaël Mejía  wrote:
> >
> > We have discussed recently in the developer mailing list about the
> > idea of removing support for Java 7 on Beam. There are multiple
> > reasons for this:
> >
> > - Java 7 has not received public updates for almost two years and
> most
> > companies are moving / have already moved to Java 8.
> > - A good amount of the systems Beam users rely on have decided to
> drop
> > Java 7 support, e.g. Spark, Flink, Elasticsearch, even Hadoop plans
> to
> > do it on version 3.
> > - Most Big data distributions and Cloud managed Spark/Hadoop services
> > have already moved to Java 8.
> > - Recent versions of core libraries Beam uses are moving to be Java 8
> > only (or mostly), e.g. Guava, Google Auto, etc.
> > - Java 8 has some nice features that can make Beam code nicer e.g.
> > lambdas, streams.
> >
> > Considering that Beam is a ‘recent’ project we expect users to be
> > already using Java 8. However we wanted first to ask the opinion of
> > the Beam users on this subject. It could be the case that some of the
> > users are still dealing with some old cluster running on Java 7 or
> > have another argument to keep the Java 7 compatibility.
> >
> > So, please vote:
> > +1 Yes, go ahead and move Beam support to Java 8.
> >  0 Do whatever you want. I don’t have a preference.
> > -1 Please keep Java 7 compatibility (if possible add your argument to
> > keep supporting for Java 7).
> 
> 
> >>>
> >
>

[Events] Apache Beam Meetup in San Francisco on 11/1, Join us!

[Griselda Cuevas]

Hi Everyone,

A new Apache Beam Meetup is happening on 11/1!

Ahmet Altay & Anand Iyer from Google are speaking at the Next San Francisco
Cloud Mafia gathering. You can find details here
[1], join us
if you're in the area :)

I'll record the sessions to share later on with the mailing list, so stay
tuned.

*G*

*[1] *https://www.meetup.com/San-Francisco-Cloud-Mafia/?scroll=true

Re: [Call for Speakers] Apache Beam Meetup @ San Francisco, CA on Oct. 24th

[Griselda Cuevas]

Hi Eric - Actually we just rebooked the date and it is now on November 1st.
The time is 6:30 p.m. the place needs to be defined yet.

G



Gris Cuevas Zambrano

g...@google.com

Open Source Strategy

345 Spear Street, San Francisco, 94105



On 11 October 2017 at 10:43, Eric Fang  wrote:

> Hi Griselda,
>
> Not sure if I missed it, but has the time been decided for the meetup on
> the 24th?
>
> Thanks
> Eric
>
> On Tue, Oct 10, 2017 at 12:48 AM Jean-Baptiste Onofré 
> wrote:
>
>> Hi,
>>
>> unfortunately, as said on Slack, I won't be able to be there.
>>
>> Enjoy guys !
>>
>> Regards
>> JB
>>
>> On 10/09/2017 09:25 PM, Griselda Cuevas wrote:
>> > Hi everyone,
>> >
>> > I'm reaching out because I'm organizing a Meetup in San Francisco
>> California on
>> > October 24th. and I'm looking for speakers. This is the agenda:
>> >
>> > *Talk 1: Apache Beam Overview*
>> > *Talk 2: Exactly one processing with Dataflow*
>> > *
>> > *
>> > We will have 30 min for each talk + 15 min of Q&A, the event will be
>> hosted at
>> > Google San Francisco and will be promote on the San Francisco Cloud
>> Mafia Meetup
>> > group.
>> >
>> > *Request: If you're interested in giving any of these two talks, reply
>> to this
>> > message and we can arrange details.* The date is a bit flexible in case
>> someone
>> > is interested but can't make the date.
>> >
>> > Thanks!
>> > G
>> >
>> >
>>
>> --
>> Jean-Baptiste Onofré
>> jbono...@apache.org
>> http://blog.nanthrax.net
>> Talend - http://www.talend.com
>>
> --
>
> Eric Fang
>
> Stack Labs  |  10054 Pasadena Ave, Cupertino, CA 95014
> <https://maps.google.com/?q=10054+Pasadena+Ave,+Cupertino,+CA+95014&entry=gmail&source=g>
>
>
> This electronic mail transmission may contain private, confidential and
> privileged information that is for the sole use of the intended
> recipient.  If you are not the intended recipient, you are hereby
> notified that any review, dissemination, distribution, archiving, or
> copying of this communication is strictly prohibited.  If you received
> this communication in error, please reply to this message immediately and
> delete the original message and the associated reply.
>

[Proposal] Apache Beam Meetup Guide + Slack Channel

[Griselda Cuevas]

Hi Everyone,

I'm working on a Meetup guide for all of us organizing Meetups and/or
speaking about Beam. My idea is to start off this Google Doc

[1] with resources and tips everyone can use when needed. Once we think
it's ready we could push it to the website.

It'd be good also to have a slack room/channel dedicated to events, the K8s
community has one and it's quite helpful.

Thoughts?

P.S. If you want to work on this together ping me.

G

[1]
https://docs.google.com/spreadsheets/d/1CloF63FOKSPM6YIuu8eExjhX6xrIiOp5j4zPbSg3Apo/edit#gid=1630515621



Gris Cuevas Zambrano

g...@google.com

Open Source Strategy

345 Spear Street, San Francisco, 94105

Re: Apache Beam meetup London 1: debrief

[Griselda Cuevas]

Congrats guys! I've heard it was a quite successful meetup!

As Matthias mentioned, I'd be happy to help anyone else running meetups.
I'm working on a Meetup guide for all of us to use with some suggestions on
content roadmaps, talks, tips in how to organize and promote events, etc.
I'll be sharing with the broader list soon.

g

On 10 October 2017 at 06:00, Matthias Baetens 
wrote:

> Hi all!
>
> We had our first Apache Beam meetup last week, and we just released a
> small blogpost
>  
> about
> it!
> Stay tuned for more of these or reach out if you have something
> interesting to share :)
>
> Also: if you are thinking to set up something similar in your city, I am
> happy to join forces and share thoughts and ideas. Don't doubt to reach out
> to Griselda (in cc) as well - she has been a great help for us so far!
>
> Best,
> Matthias
>
>
> --
>
>

Re: [Call for Speakers] Apache Beam Meetup @ San Francisco, CA on Oct. 24th

[Griselda Cuevas]

Got it.

I can def look into recording the talks and share later, in case it's not
possible I'll definitely share the slides.

I can also look into organizing something in Seattle later on :)

On Oct 9, 2017 10:59 PM, "Derek Hao Hu"  wrote:

> It's just that I'm in Seattle (and I guess a lot of us are not in SF). The
> talks seem pretty interesting. :)
>
> Can you help share the slides after the talk then?
>
> Thanks,
>
> Derek
>
> On Mon, Oct 9, 2017 at 10:57 PM, Griselda Cuevas  wrote:
>
>> Hi Derek - I could look into that but so far we're not planning on it.
>> Would you like to watch them later?
>>
>> On 9 October 2017 at 16:36, Derek Hao Hu  wrote:
>>
>>> Hi Griselda,
>>>
>>> Will the talks be recorded?
>>>
>>> Thanks,
>>>
>>> Derek
>>>
>>> On Mon, Oct 9, 2017 at 12:25 PM, Griselda Cuevas 
>>> wrote:
>>>
>>>> Hi everyone,
>>>>
>>>> I'm reaching out because I'm organizing a Meetup in San Francisco
>>>> California on October 24th. and I'm looking for speakers. This is the
>>>> agenda:
>>>>
>>>> *Talk 1: Apache Beam Overview*
>>>> *Talk 2: Exactly one processing with Dataflow*
>>>>
>>>> We will have 30 min for each talk + 15 min of Q&A, the event will be
>>>> hosted at Google San Francisco and will be promote on the San Francisco
>>>> Cloud Mafia Meetup group.
>>>>
>>>> *Request: If you're interested in giving any of these two talks, reply
>>>> to this message and we can arrange details.* The date is a bit
>>>> flexible in case someone is interested but can't make the date.
>>>>
>>>> Thanks!
>>>> G
>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> Derek Hao Hu
>>>
>>> Software Engineer | Snapchat
>>> Snap Inc.
>>>
>>
>>
>
>
> --
> Derek Hao Hu
>
> Software Engineer | Snapchat
> Snap Inc.
>

Re: [Call for Speakers] Apache Beam Meetup @ San Francisco, CA on Oct. 24th

[Griselda Cuevas]

Hi Derek - I could look into that but so far we're not planning on it.
Would you like to watch them later?

On 9 October 2017 at 16:36, Derek Hao Hu  wrote:

> Hi Griselda,
>
> Will the talks be recorded?
>
> Thanks,
>
> Derek
>
> On Mon, Oct 9, 2017 at 12:25 PM, Griselda Cuevas  wrote:
>
>> Hi everyone,
>>
>> I'm reaching out because I'm organizing a Meetup in San Francisco
>> California on October 24th. and I'm looking for speakers. This is the
>> agenda:
>>
>> *Talk 1: Apache Beam Overview*
>> *Talk 2: Exactly one processing with Dataflow*
>>
>> We will have 30 min for each talk + 15 min of Q&A, the event will be
>> hosted at Google San Francisco and will be promote on the San Francisco
>> Cloud Mafia Meetup group.
>>
>> *Request: If you're interested in giving any of these two talks, reply to
>> this message and we can arrange details.* The date is a bit flexible in
>> case someone is interested but can't make the date.
>>
>> Thanks!
>> G
>>
>>
>>
>
>
> --
> Derek Hao Hu
>
> Software Engineer | Snapchat
> Snap Inc.
>

[Call for Speakers] Apache Beam Meetup @ San Francisco, CA on Oct. 24th

[Griselda Cuevas]

Hi everyone,

I'm reaching out because I'm organizing a Meetup in San Francisco
California on October 24th. and I'm looking for speakers. This is the
agenda:

*Talk 1: Apache Beam Overview*
*Talk 2: Exactly one processing with Dataflow*

We will have 30 min for each talk + 15 min of Q&A, the event will be hosted
at Google San Francisco and will be promote on the San Francisco Cloud
Mafia Meetup group.

*Request: If you're interested in giving any of these two talks, reply to
this message and we can arrange details.* The date is a bit flexible in
case someone is interested but can't make the date.

Thanks!
G

October Apache Beam Newsletter

[Griselda Cuevas]

Hi Apache Beam Community,

Our first Apache Beam Newsletter is here!, I'm sharing a table of contents
of what's in this edition, which covers everything that has happened in the
project from June 2017 until October 2017.

You can find the full content in this Google Doc:
https://docs.google.com/document/d/1BbpQne-9ng93G-_-UKH2C4UNafcEQcLALtu38qsXfI8/edit?usp=sharing

Enjoy!

* * * * * October 2017 Newsletter Table of Contents * * * * *

>> What's Been Done
- Beam SQL DSL APIs
- Nexmark
- Splittable DoFn
- Improvements to reading and writing files
- Improvements to BigQueryIO
- New I/O connectors
- Docker development images and reproducible-builds
- Website updates: New Beam Execution Model page & the Mobile Gaming
Walkthrough was updated w/ new sample code for Python

>> What We Are Working On
- Portability
- Splittable DoFn for Python SDK
- Website: Improve CoGroupByKey docs & website navigation/usability

>> What's Planned
- FileIO.write()

>>  New Members (Welcome!)
- Daniel Harper, BBC, London (UK)

>>  Talks & Meetups
- Talks @ YOW Data Sydney and Strata NY
- Meetups @ London & dinner in NY
- Speakers & Meetup Founders group

>>  Resources
- Capability Matrix
- Contribution Guide
- Featured talk & sample intro talk deck

Re: [Call for items] Beam October Newsletter

[Griselda Cuevas]

Hi everyone - just a reminder to add updates to our Newsletter, it needs
some love <3

If you have questions on what to add or just don't have time, ping me on
slack (griscz) and I can help.

G

On 2 October 2017 at 14:29, Griselda Cuevas  wrote:

> Hi Beam community,
>
> Here's
> <https://docs.google.com/document/d/1BbpQne-9ng93G-_-UKH2C4UNafcEQcLALtu38qsXfI8/edit>
> the template for the October Newsletter.
>
> *Add the updates you want to share with the community by 10/6 11:59 p.m.
> Pacific Time - I'm in SF :)*
>
> I'll edit and send the final version through the users mailing list on
> 10/9.
>
> Thank you!
> G
>

Re: [Call for items] Beam October Newsletter

[Griselda Cuevas]

Hi Eugene, thanks for the question, here are my comments:

- Time this newsletter covers: *Let's cover everything done since June*
given that this is the first edition. Moving forward we should focus on
everything that happened since the last newsletter was sent.
- Should this newsletter focus on things only visible to users: No. *let's
not limit input to only things visible to users* for now, if this gets too
long we can add this filter later on.
- Great suggestion on only having the "What" & "Notes" section, this will
keep things slimmer, I removed everything else.

Thanks for asking and giving suggestion to make this better.

G


On 2 October 2017 at 14:49, Eugene Kirpichov  wrote:

> Hi Griselda,
>
> Thanks for organizing this! A few questions:
> - What time period shall this newsletter cover? It will be more clear in
> future newsletters, but currently I'm not sure how far back to go in my
> memory :)
> - Should this focus only on things that are visible to users or will be at
> some point? E.g. should items like "There's a discussion going on about
> changing API $X in important way $Y" go into the newsletter?
> - I'm a bit confused with the "what / how / when / notes" format. Seems
> like a simple "What / notes" would be sufficient (1-sentence title +
> elaboration), and I'm not sure what to say about "how" / "when" for some
> things I'd like to mention.
>
>
> On Mon, Oct 2, 2017 at 2:29 PM Griselda Cuevas  wrote:
>
>> Hi Beam community,
>>
>> Here's
>> <https://docs.google.com/document/d/1BbpQne-9ng93G-_-UKH2C4UNafcEQcLALtu38qsXfI8/edit>
>> the template for the October Newsletter.
>>
>> *Add the updates you want to share with the community by 10/6 11:59 p.m.
>> Pacific Time - I'm in SF :)*
>>
>> I'll edit and send the final version through the users mailing list on
>> 10/9.
>>
>> Thank you!
>> G
>>
>

[Call for items] Beam October Newsletter

[Griselda Cuevas]

Hi Beam community,

Here's

the template for the October Newsletter.

*Add the updates you want to share with the community by 10/6 11:59 p.m.
Pacific Time - I'm in SF :)*

I'll edit and send the final version through the users mailing list on
10/9.

Thank you!
G

Re: [Proposal] Beam Newsletter

[Griselda Cuevas]

Excellent -- I'll do the call for items this week so we have it ready in
time for October.

On 25 September 2017 at 07:36, Tyler Akidau 
wrote:

> +1, would be great to get highlights of what's going on in the community.
> Thank, Gris!
>
> On Fri, Sep 22, 2017 at 4:02 AM Steve Anderson  wrote:
>
> > +1 would love this. Our team (maestro.io, we do livestreams for brands
> > like the Grammys and Playstation and use dataflow to collect massive
> > amounts of data) checks the beam blog and the google bigdata blog daily
> for
> > new features and bug fixes. Would love to see something more regular!
> Some
> > of us on the team would love to contribute case studies as well, so it'd
> be
> > awesome if we could implement some sort of guest editorial.
> >
> > On Thu, Sep 21, 2017 at 11:59 PM, Reza Rokni  wrote:
> >
> >> +1
> >>
> >> On Sep 22, 2017 2:32 AM, "Griselda Cuevas"  wrote:
> >>
> >>> Hi Beam Community,
> >>>
> >>> I have a proposal to start sending *monthly newsletters* to our dev and
> >>> user mailing lists. The idea is to summarize what's happening in the
> >>> project and keep everyone informed of what's happening, specially new
> >>> members, people interested in specific initiatives/efforts and help
> >>> visualize the progress in concrete milestones.
> >>>
> >>> This is what I propose:
> >>>
> >>> 1. I'll send an email to the dev & user mailing list with a "Call for
> >>> updates" with a link to a Google doc like this
> >>> <https://docs.google.com/document/d/1C4L8b1It9Ju1JgJaSvSPlAYMlG0Q4
> v4hbjebkmNsnQ8/edit>
> >>> so people can add their updates.
> >>> 2. I'll edit it to get it ready to share
> >>> 3. I'll send an email with highlights and the link to the finalized
> >>> Google doc
> >>>
> >>> I propose to do this monthly.
> >>>
> >>> What do you guys think?
> >>>
> >>> Gris
> >>>
> >>
> >
> >
> > --
> >
> > [image: photo] Steven Anderson
> > <http://www.linkedin.com/in/stevenandersonla>
> > Software Developer
> > Mobile: 650.455.6530
> > Email: st...@maestro.io
> > Website: http://www.maestro.io
> >
>

[Proposal] Beam Newsletter

[Griselda Cuevas]

Hi Beam Community,

I have a proposal to start sending *monthly newsletters* to our dev and
user mailing lists. The idea is to summarize what's happening in the
project and keep everyone informed of what's happening, specially new
members, people interested in specific initiatives/efforts and help
visualize the progress in concrete milestones.

This is what I propose:

1. I'll send an email to the dev & user mailing list with a "Call for
updates" with a link to a Google doc like this

so people can add their updates.
2. I'll edit it to get it ready to share
3. I'll send an email with highlights and the link to the finalized Google
doc

I propose to do this monthly.

What do you guys think?

Gris

[Event] Strata Data Conference - New York 2017

[Griselda Cuevas]

Hi Beam Community,

Apache Beam will be featured at Strata Data Conference New York next week
[1].

Scheduled events:

** Realizing the promise of portability with Apache Beam*
Speaker: Reuven Lax
11:20am–12:00pm Thursday, September 28, 2017

** Foundations of streaming SQL; or, How I learned to love stream and table
theory*
Speaker: Tyler Akidau
1:15pm–1:55pm Thursday, September 28, 2017

** Apache Beam Dinner @ OBAO Hell's Kitchen*
If you'd like to attend please RSVP[2], space in New York restaurants is
limited and we want to make sure we can acomodate everyone :)

Everyone is welcome to this events - users and contributors, feel free to
use code Google20 to get 20% off any pass for the conference.

I hope to see a good part of our community there!

Gris

[1] https://conferences.oreilly.com/strata/strata-ny
[2] https://www.eventbrite.com/e/beam-dinner-strata-tickets-37851664347

Re: Python support for Spark Runner

[Griselda Cuevas]

Hi Manoj,

As far as I know, today Python only works with DataFlow & direct runners
and there isn't a concrete timeframe for a Spark Runner at the moment.

Could you share a bit more of your use case or why you're interested?

G

On 18 September 2017 at 06:36, Manoj Mohan  wrote:

> Hello,
>
> As per the response posted for this SO question in May, Spark runner
> support would be available in Python relatively soon.
>
> https://stackoverflow.com/questions/43923776/python-support-
> for-sparkrunner-in-apache-beam
>
> Still don't see it here:
> https://beam.apache.org/get-started/wordcount-example/
>
> Can you please let me know if there is a timeframe for adding Spark Runner
> support for the Python SDK?
>
> Thanks,
> Manoj
>

[Proposal] Host office hours to help new Beam users/contributors

[Griselda Cuevas]

Hi Beam Community,

I'd like to propose an idea to host virtual office hours where Committers
and PMCs could help new users like me get onboard into the project.

These office hours could be open videoconferences where people can join if
they have questions or need help reviewing their commits. We could have a
rotation of PMCs/Committers to always have someone who can help a larger
group.

If you guys like the idea I can help organize them.

G

Re: Slack channel

[Griselda Cuevas]

Hi Manu, I'd like to piggy back on shen's request, could you add me to the
channel as well?

On 15 August 2017 at 21:32, Manu Zhang  wrote:

> Invitation sent. Welcome.
>
> On Wed, Aug 16, 2017 at 11:41 AM shen yu  wrote:
>
>> Hi, I'd like to join the Slack channel for Apache Beam. I work at Klook
>> and would like to get involved in the Apache Beam community. My email is
>> you...@klook.com
>>
>