Re: Looking for a PMC member to help with website development

2020-11-05 Thread Pablo Estrada
For code review / changes / merges, committers are all that's necessary, and I am happy to help with anything that requires extra PMC privileges (also happy to do code reviews). You can mention me in PRs, and I'm happy to try and triage to other active committers. Best -P. On Thu, Nov 5, 2020

Re: Looking for a PMC member to help with website development

2020-11-05 Thread Gris Cuevas
The reason why I was asking a PMC member was to minimize dependencies in permissions needed for code/reviews, commits, etc. I don't have full visibility to confirm that any committer could help here. If that is the case then we can cast a broader net. Even if I am a committer, I can't help

Re: Contributor permissions for Beam Jira

2020-11-05 Thread Ke Wu
Absolutely, my jira username is kw2542 Thanks, Ke > On Nov 5, 2020, at 2:47 AM, Alexey Romanenko wrote: > > Hi, > > Sure. Could you provide your Jira username, please? > >> On 5 Nov 2020, at 00:48, Ke Wu wrote: >> >> Hello, >> >> I am working at Samza team at LinkedIn and I would like to

Re: Beam Dependency Check Report (2020-11-02)

2020-11-05 Thread Kenneth Knowles
I think at a minimum it shouldn't recommend major version upgrades. Almost all projects do breaking changes there. And really a ton of projects break things at minor versions too. I don't have too strong an opinion. I very rarely read the report. Just wanted to tie this together with the

Re: Beam Dependency Check Report (2020-11-02)

2020-11-05 Thread Pablo Estrada
Sorry, I missed Ismael's comment, but - I'd like to understand how this report falls short. Does it flag certain dependency versions as old even though they're still the 'de-facto' standard version? Does it make sense to exclude dependencies that we are aware of (e.g. Avro / Spark / idk) while

Re: Beam Dependency Check Report (2020-11-02)

2020-11-05 Thread Kenneth Knowles
Ismaƫl pointed out that the dependency upgrades recommended by this bot are often not a good idea. Should we disable it? Kenn On Mon, Nov 2, 2020 at 4:31 AM Apache Jenkins Server < jenk...@builds.apache.org> wrote: > High Priority Dependency Updates Of Beam Python SDK: > *Dependency Name*

Re: Bigtable for BeamSQL - question about the schema design

2020-11-05 Thread Piotr Szuberski
Thanks for the resources! I'll try to follow the BQ approach. I'd also add something like flattened schema so the user can use simple types only. It would be limited to BINARY values though. Something like: CREATE EXTERNAL TABLE( key VARCHAR NOT NULL, family VARCHAR NOT NULL, column

[Beam Spark Structured Streaming runner]

2020-11-05 Thread Etienne Chauchot
Hi all, In case anyone wanted some details about the new Beam runner based on Spark Structured Streaming framework, here are 2 talks I gave at the ApacheCon this year and last year about this subject. https://www.youtube.com/watch?v=oEehQwOEFvg https://www.youtube.com/watch?v=_dCmV1ZW3M4

Re: Contributor permissions for Beam Jira

2020-11-05 Thread Alexey Romanenko
Hi, Sure. Could you provide your Jira username, please? > On 5 Nov 2020, at 00:48, Ke Wu wrote: > > Hello, > > I am working at Samza team at LinkedIn and I would like to contribute to > Samza runner in Beam. Could I please have permission to add/assign tickets on > the Beam Jira? > >