Re: Beam Katas YouTube

[Henry Suryawirawan]

Unfortunately I only have comment only access :(



On Mon, Apr 6, 2020 at 1:48 AM Matthias Baetens 
wrote:

> Hey Henry - I think you can just fill it out rather than comment. The
> people who have access to the Twitter handle monitor the sheet and will
> tweet accordingly afaik :)
>
> On Sun, 5 Apr 2020 at 14:42, Henry Suryawirawan 
> wrote:
>
>> I just added some comments on the sheet.
>> Can someone help me to review and publish the tweet?
>>
>>
>>
>> On Thu, Apr 2, 2020 at 12:32 AM Matthias Baetens <
>> baetensmatth...@gmail.com> wrote:
>>
>>> I see :-) That's a good idea, iirc the best way to do that is through
>>> this
>>> 
>>> sheet!
>>>
>>> On Wed, 1 Apr 2020 at 16:01, Henry Suryawirawan <
>>> hsuryawira...@google.com> wrote:
>>>
 Thanks all!

 Matthias, the raw file is not owned by me and managed by the Level Up
 YouTube channel team.
 Maybe we can do a tweet from @ApacheBeam?




 On Wed, Apr 1, 2020 at 2:27 PM Matthias Baetens <
 baetensmatth...@gmail.com> wrote:

> This is brilliant, Henry! Let me know if you want this posted on the
> Beam YouTube channel as well in case you have access to the raw file.
>
> Cheers,
> Matthias
>
> On Fri, 27 Mar 2020 at 20:02, Pablo Estrada 
> wrote:
>
>> Nice : D
>>
>> On Fri, Mar 27, 2020 at 12:44 AM Alex Van Boxel 
>> wrote:
>>
>>> That's nicely done! Congrats, going to share this immediately.
>>>
>>> And I actually didn't know where the name Beam came from, now I know
>>> :-)
>>>
>>>  _/
>>> _/ Alex Van Boxel
>>>
>>>
>>> On Fri, Mar 27, 2020 at 4:32 AM Henry Suryawirawan <
>>> hsuryawira...@google.com> wrote:
>>>
 Hello,

 Just would like to share that recently the Apache Beam Katas is
 featured in the Google Cloud Level Up YouTube video (
 https://www.youtube.com/watch?v=tzZiC4s_OqE).
 Hope that it can be useful for the community.


 Regards,
 Henry

Re: Beam Katas YouTube

[Matthias Baetens]

Hey Henry - I think you can just fill it out rather than comment. The
people who have access to the Twitter handle monitor the sheet and will
tweet accordingly afaik :)

On Sun, 5 Apr 2020 at 14:42, Henry Suryawirawan 
wrote:

> I just added some comments on the sheet.
> Can someone help me to review and publish the tweet?
>
>
>
> On Thu, Apr 2, 2020 at 12:32 AM Matthias Baetens <
> baetensmatth...@gmail.com> wrote:
>
>> I see :-) That's a good idea, iirc the best way to do that is through
>> this
>> 
>> sheet!
>>
>> On Wed, 1 Apr 2020 at 16:01, Henry Suryawirawan 
>> wrote:
>>
>>> Thanks all!
>>>
>>> Matthias, the raw file is not owned by me and managed by the Level Up
>>> YouTube channel team.
>>> Maybe we can do a tweet from @ApacheBeam?
>>>
>>>
>>>
>>>
>>> On Wed, Apr 1, 2020 at 2:27 PM Matthias Baetens <
>>> baetensmatth...@gmail.com> wrote:
>>>
 This is brilliant, Henry! Let me know if you want this posted on the
 Beam YouTube channel as well in case you have access to the raw file.

 Cheers,
 Matthias

 On Fri, 27 Mar 2020 at 20:02, Pablo Estrada  wrote:

> Nice : D
>
> On Fri, Mar 27, 2020 at 12:44 AM Alex Van Boxel 
> wrote:
>
>> That's nicely done! Congrats, going to share this immediately.
>>
>> And I actually didn't know where the name Beam came from, now I know
>> :-)
>>
>>  _/
>> _/ Alex Van Boxel
>>
>>
>> On Fri, Mar 27, 2020 at 4:32 AM Henry Suryawirawan <
>> hsuryawira...@google.com> wrote:
>>
>>> Hello,
>>>
>>> Just would like to share that recently the Apache Beam Katas is
>>> featured in the Google Cloud Level Up YouTube video (
>>> https://www.youtube.com/watch?v=tzZiC4s_OqE).
>>> Hope that it can be useful for the community.
>>>
>>>
>>> Regards,
>>> Henry
>>>
>>>
>>>

Re: Scheduling dataflow pipelines

[Joshua B. Harrison]

Hi Marco,

I've ended using a VM running Luigi to schedule jobs. I use the data flow
Python API to execute stored templates.

I can give you more details if you’re interested.

Best,
Joshua

On Sun, Apr 5, 2020 at 5:02 AM Marco Mistroni  wrote:

> HI all
>  sorry for this partially OT but has anyone been successful in scheduling
> dataflow job on GCP?
> I have tried the CloudFunction approach (following few eamples on the web)
> but it didnt work out for me - the cloud function keep on giving me an
> INVALID ARGUMENT - which i could not debug
>
> So i was wondering if anyone has  been successful and can provide me an
> example
>
> kind regards
>  Marco
>
> --
Joshua Harrison |  Software Engineer |  joshharri...@gmail.com
 |  404-433-0242

Re: Beam Katas YouTube

[Henry Suryawirawan]

I just added some comments on the sheet.
Can someone help me to review and publish the tweet?



On Thu, Apr 2, 2020 at 12:32 AM Matthias Baetens 
wrote:

> I see :-) That's a good idea, iirc the best way to do that is through this
> 
> sheet!
>
> On Wed, 1 Apr 2020 at 16:01, Henry Suryawirawan 
> wrote:
>
>> Thanks all!
>>
>> Matthias, the raw file is not owned by me and managed by the Level Up
>> YouTube channel team.
>> Maybe we can do a tweet from @ApacheBeam?
>>
>>
>>
>>
>> On Wed, Apr 1, 2020 at 2:27 PM Matthias Baetens <
>> baetensmatth...@gmail.com> wrote:
>>
>>> This is brilliant, Henry! Let me know if you want this posted on the
>>> Beam YouTube channel as well in case you have access to the raw file.
>>>
>>> Cheers,
>>> Matthias
>>>
>>> On Fri, 27 Mar 2020 at 20:02, Pablo Estrada  wrote:
>>>
 Nice : D

 On Fri, Mar 27, 2020 at 12:44 AM Alex Van Boxel 
 wrote:

> That's nicely done! Congrats, going to share this immediately.
>
> And I actually didn't know where the name Beam came from, now I know
> :-)
>
>  _/
> _/ Alex Van Boxel
>
>
> On Fri, Mar 27, 2020 at 4:32 AM Henry Suryawirawan <
> hsuryawira...@google.com> wrote:
>
>> Hello,
>>
>> Just would like to share that recently the Apache Beam Katas is
>> featured in the Google Cloud Level Up YouTube video (
>> https://www.youtube.com/watch?v=tzZiC4s_OqE).
>> Hope that it can be useful for the community.
>>
>>
>> Regards,
>> Henry
>>
>>
>>

Scheduling dataflow pipelines

[Marco Mistroni]

HI all
 sorry for this partially OT but has anyone been successful in scheduling
dataflow job on GCP?
I have tried the CloudFunction approach (following few eamples on the web)
but it didnt work out for me - the cloud function keep on giving me an
INVALID ARGUMENT - which i could not debug

So i was wondering if anyone has  been successful and can provide me an
example

kind regards
 Marco