Re: [RELEASE VOTE RESULT] Release 2.22.0, candidate #1

: > Hooray! Thanks for shepherding the release Brian :) > > On Mon, Jun 8, 2020 at 11:24 AM Brian Hulette wrote: > >> I'm happy to announce that we have approved the 2.22.0 release. >> >> There are 5 approving votes, 3 of which are binding: >> * Robert Bra

Re: DataflowRunner | Cross-language

On Mon, Jun 8, 2020 at 2:06 PM Chad Dombrova wrote: > Even when running portably, Dataflow still has its own implementation of >> PubSubIO that is switched out for Python's "implementation." (It's actually >> built into the same layer that provides the shuffle/group-by-key >> implementation.) How

Re: [VOTE] Release 2.22.0, release candidate #1

+1, I validated the python quickstarts. On Wed, Jun 3, 2020 at 2:01 PM Brian Hulette wrote: > A few more useful links: I verified the release-2.22.0 branch with jenkins > jobs in a PR [1]. There are some VR test failures that I don't believe > represent regressions, summarized in a comment [2],

Re:

Welcome. I added you as a contributor. On Mon, Jun 1, 2020 at 7:51 PM Prathap Reddy wrote: > Hi All, > > I am Prathap Reddy from Google and would like to contribute to beam. > Please add me (ASF ID: prathapreddy22) as a contributor in the Beam issue > tracker. > > Thanks, > Prathap > > >

Re: Fwd: [DISCUSSION] Use github actions for python wheels ?

> @Ahmet Altay happy to understand the extent of what you had in mind, maybe the extensions are not as important to plan out, as they're straightforwardly bolted on (ex: daily builds). More tactically would be valuable to ensure I understand what all needs to occur. Any other source of

Re: [ANNOUNCE] Beam 2.21.0 Released

Thank you, Kyle! On Fri, May 29, 2020 at 12:52 AM Ismaël Mejía wrote: > Thanks Kyle for all the work and patience as a release manager for this > version. > > On Thu, May 28, 2020, 7:47 PM Udi Meiri wrote: > >> Woohoo! >> >> On Thu, May 28, 2020 at 4:16 AM Kyle Weaver wrote: >> >>> The Apache

Re: Contributor permission for beam jira tickets

Welcome. I added you as a contributor to our JIRA. You were not in the list before. On Wed, May 27, 2020 at 9:04 AM Aaron Tillekeratne < aaron.tillekera...@gmail.com> wrote: > Hi, > > I'm Aaron, I'm a newbie go developer and beam but i'm interested in > getting involved and helping out with the b

Re: Companies using Beam?

On Tue, May 26, 2020 at 6:02 PM Aizhamal Nurmamat kyzy wrote: > > > Aizhamal, what is the plan for your document? Would it be fine if we add >> this powered_by page now, and edit as we go? >> > Yes. The document was created as a plan to add all those sections, but it > would be great to start add

Re: What's the purpose of version=2.20.0-RC2 in gradle.properties?

On Tue, May 26, 2020 at 11:50 AM Maximilian Michels wrote: > Don't think so. Feel free to create one. > I think a related jira would be ( https://issues.apache.org/jira/browse/BEAM-9181). Removing the snapshot form javadoc versions. > > We already have a script which updates the version to a n

Re: Companies using Beam?

Another example is Arrow's powered by page. ( https://arrow.apache.org/powered_by/). I like two aspects of this page. First it is simple to add things, there is a pull request link at the top of the list. Second, it lists products and companies alike. For Beam, we can list TFX as one of these produ

Re: deploy_travis.sh ?

Thank you for updating the readme. This file was removed as part of a change that removed the need to share personal credentials with travis in order to deploy directly to svn. On Tue, May 26, 2020 at 8:03 AM Kyle Weaver wrote: > > If my understanding is correct, I will at least update the > doc

Re: [VOTE] Release 2.21.0, release candidate #1

ovided is proper. If we take FixedBytes logical type with >>>>>> length 10, for example, the proper input value will be a byte array of >>>>>> length 10. But, without this PR, for FixedBytes logical type, the Row >>>>>> will >>>>>> be b

Re: joining Beam JIRA

Done. And welcome! On Thu, May 21, 2020 at 10:32 AM Ted Romer wrote: > Hi, this is Ted Romer at Google ... I'd like to get permission to join the > JIRA project so that I can assign > https://issues.apache.org/jira/browse/BEAM-10055 to myself. > > My JIRA username is "tedromer". > > Thanks! > Te

Re: [VOTE] Release 2.21.0, release candidate #1

+1, I validated python 2 and 3 quickstarts. On Tue, May 19, 2020 at 4:57 PM Hannah Jiang wrote: > I confirmed that licenses/notices/source code are added to Java and Python > docker images as expected. > > > On Tue, May 19, 2020 at 2:36 PM Kyle Weaver wrote: > >> Thanks for bringing that up Ste

[ANNOUNCE] New committer: Robin Qiu

Hi everyone, Please join me and the rest of the Beam PMC in welcoming a new committer: Robin Qiu . Robin has been active in the community for close to 2 years, worked on HyperLogLog++ [1], SQL [2], improved documentation, and helped with releases(*). In consideration of his contributions, the Be

Re: [DISCUSS] New process for proposing ApacheBeam tweets

I think this is a good idea. On Fri, May 15, 2020 at 5:50 PM Robert Bradshaw wrote: > Sounds like a good plan to me, but I haven't been the one monitoring this > spreadsheet (or twitter for that matter). Spam is a concern, but > everything is moderated so I think we try it out and see if the vol

Re: [REVIEW][please pause website changes] Migrated the Beam website to Hugo

After the merge, please try out the live website see if it is working as expected. > > On Wed, May 13, 2020, 5:41 PM Ahmet Altay wrote: > >> Thank you! Let's merge it once tests are done. >> >> On Wed, May 13, 2020 at 5:23 PM Robert Bradshaw >> wrote: >&

Re: [REVIEW][please pause website changes] Migrated the Beam website to Hugo

r question, I just added a section in the documentation >> (CONTRIBUTE.md), which mentions the replaced/removed features of Jekyll in >> terms of writing a new blog post or documentation in Hugo. >> > Got it. The main effect will be any one has a bookmark/link to these pages, th

Re: [REVIEW][please pause website changes] Migrated the Beam website to Hugo

es). I will push >> another commit to fix all that up, hope can be tomorrow. >> >> [1] https://github.com/apache/beam/pull/11554#issuecomment-626792031 >> >> Best regards, >> Nam >> >> >> On Mon, May 11, 2020 at 9:01 AM Nam Bui wrote: >> &

Re: GSoD with Apache Beam

Welcome. There was this list of projects ( https://cwiki.apache.org/confluence/display/BEAM/Google+Season+of+Docs) if that helps. +Aizhamal Nurmamat kyzy could probably point you in the right direction. Ahmet On Tue, May 12, 2020 at 1:30 AM Sylvia Mittal wrote: > Hey, > > I am Sylvia, a final

Re: [DISCUSS] Dealing with @Ignored tests

+1 to generate a report instead of removing these tests. A report like this could help us with prioritization. It is easier to address issues when we can quantify how much of a problem it is. I am curious what we can do to incentivize reducing the number of flaky/ignored tests? A report itself mig

Re: Jenkins jobs not running for my PR 10438

Done for both Yoshiki and Tomo's PRs. On Mon, May 11, 2020 at 6:33 PM Tomo Suzuki wrote: > Hi Beam committers, > > Would you run the basic precommit checks for > https://github.com/apache/beam/pull/11674 ? > > Regards, > Tomo >

Re: [REVIEW][please pause website changes] Migrated the Beam website to Hugo

t;>>>>> something to fix we can fix the live website much more quickly than go >>>>>> through the whole release process and convince people to upgrade. (I >>>>>> recognize accepting this argument is, to some degree at least, saying

Re: Beam 2.21 release update

On Thu, May 7, 2020 at 11:56 AM Thomas Weise wrote: > Thanks Udi! This is the issue. I'm trying to upgrade from 2.18 where > build-requirements.txt didn't exist. > > Is there a reason why this cannot happen automatically when > running python3.6 setup.py sdist bdist_wheel ? > I _believe_ this sh

Re: [REVIEW][please pause website changes] Migrated the Beam website to Hugo

s reasonable to everyone? > This is reasonable to me. I agree with your reasons. What do others think? > > > On Wed, May 6, 2020 at 7:07 PM Ahmet Altay wrote: > >> >> >> On Wed, May 6, 2020 at 2:33 PM Aizhamal Nurmamat kyzy < >> aizha...@apach

Re: Python Precommit significantly flaky

I am aware of the following two that contributes to precommit flakiness. Someone is working on both. https://issues.apache.org/jira/browse/BEAM-9907 - ExternalTransform https://issues.apache.org/jira/browse/BEAM-9767 - test_streaming_wordcount flaky On Thu, May 7, 2020 at 10:54 AM Brian Hulette

Re: [REVIEW][please pause website changes] Migrated the Beam website to Hugo

uot;) — FAILURE >> > Website_Stage_GCS ("Run Website_Stage_GCS PreCommit") — FAILURE >> > >> > 2) Are there any other blockers for merging? @Ahmet/Robert/others >> please share if there are any other blockers. >> > >> > >> > [

Re: [PROPOSAL] Preparing for Beam 2.22.0 release

Thank you, Brian. On Mon, May 4, 2020 at 1:59 PM Luke Cwik wrote: > Thanks Brian. > > On Mon, May 4, 2020 at 10:57 AM Kyle Weaver wrote: > >> Thanks Brian! >> >> I'd also like to remind everyone to update CHANGES.md with any important >> recent changes that might be missing. >> https://github.c

Re: [REVIEW][please pause website changes] Migrated the Beam website to Hugo

t [3] (the earth icon on the right corner is temporarily used for >> switching languages). You can take a look at the translation guide for this >> PoC [4]. >> > >>>>> >> > >>>>> [1] >> https://github.com/apache/beam/pull/11554/commits/b

Re: JIRA priorities explaination

+1 sounds good to me. Oftentimes I confused the relative priorities of critical/blocker/major. On Fri, May 1, 2020 at 3:05 PM Tyson Hamilton wrote: > Proposal sounds good to me! The tool tips will be fantastic. > > On Fri, May 1, 2020 at 3:03 PM Robert Bradshaw > wrote: > >> On Fri, May 1, 2020

Re: [REVIEW][please pause website changes] Migrated the Beam website to Hugo

s start with a date so they >>> naturally sort chronologically. It looks like this hugo PR [1] made it >>> possible to extract date metadata and slug >>> (i.e. dataflow-python-sdk-is-now-public) separately from the filename. >>> >>> [1] ht

Re: Jenkins jobs not running for my PR 10438

gt;>> Hello Beam Committers. >>>>>>>> >>>>>>>> Would you please trigger the pre-commit checks on the PR: >>>>>>>> https://github.com/apache/beam/pull/11210 along with the python >>>>>>>> post

Re: Python 3.7 docker container fails to build

:docker* >> > >> *07:57:03* [91mERROR: Could not install packages due to an >> > EnvironmentError: [Errno 28] No space left on device >> > >> >> > >> >> > >> >> > >> On Wed, Ap

Re: Jira PR links not being generated?

Thank you! On Wed, Apr 29, 2020 at 3:23 PM Kyle Weaver wrote: > Added a comment on https://issues.apache.org/jira/browse/INFRA-19967 > > On Wed, Apr 29, 2020 at 5:57 PM Ahmet Altay wrote: > >> Would it be worth filing this as an infra ticket? >> >> On Mon, Apr 2

Re: [REVIEW][please pause website changes] Migrated the Beam website to Hugo

e development stage and agreed to get rid of >>> this. For now, we keep the old URLs working in terms of redirecting them. >>> However, from now on, we should change the name convention on blog posts to >>> have a fancy URL like "beam.apache.org/blog/myblogpost.md&quo

Re: [REVIEW][please pause website changes] Migrated the Beam website to Hugo

will get back to you with answers. I'm so sorry if I answer >> a little bit due to the timezone. :) >> >> Best regards, >> Nam >> >> >> >> On Tue, Apr 28, 2020 at 8:49 PM Aizhamal Nurmamat kyzy < >> aizha...@apache.org> wrote: >> >

Re: sdks:java:container:generateThirdPartyLicenses effect on build time / stability

On Wed, Apr 29, 2020 at 3:49 PM Valentyn Tymofieiev wrote: > > > On Tue, Apr 28, 2020 at 5:03 PM Robert Bradshaw > wrote: > >> On Tue, Apr 28, 2020 at 4:46 PM Hannah Jiang >> wrote: >> >>> I guess I assumed there was some reason we needed "lightweight images" in our tests (because licenses

Re: Jira PR links not being generated?

Would it be worth filing this as an infra ticket? On Mon, Apr 27, 2020 at 4:29 PM Kyle Weaver wrote: > Slight correction.. Jira to Github links are back. Github to Jira links > (which were only recently added) are not being added. > > On Mon, Apr 27, 2020 at 7:20 PM Kyle Weaver wrote: > >> Well

Re: Greetings from Tyson

Welcome! On Tue, Apr 28, 2020 at 3:06 PM Hannah Jiang wrote: > Welcome to the community! > > > On Tue, Apr 28, 2020 at 2:45 PM Tyson Hamilton wrote: > >> Hello Beam Community, >> >> This is just a simple 'Hello' to introduce myself. I'm a Software >> Engineer at Google and have worked with data

Re: Automation for Jira

+1 for the automations. I agree with concerns related to #4. Auto closing issues is not a good experience. A person goes through the work of reporting an issue. This might very well be their first contribution. Automatically closing these issues with no human comments might make the reporter feel i

Re: Python 3.7 docker container fails to build

+Valentyn Tymofieiev +Hannah Jiang -- in case they have relevant information. On Wed, Apr 29, 2020 at 12:35 PM Maximilian Michels wrote: > Hi, > > has anyone noticed the Python 3.7 Docker container fails to build? I > haven't been able to build the Python 3.7 container, neither locally nor > o

Re: [REVIEW][please pause website changes] Migrated the Beam website to Hugo

I am having trouble reviewing the staged version. What is the best way to review this change? Do we expect any changes to markdown files, beyond some metadata? On Tue, Apr 28, 2020 at 10:45 AM Robert Bradshaw wrote: > Thanks. It'll be great to better support more languages. > > I looked at the

Re: metrics site not available

I will try to restart pods and see if it helps. >> >> --Mikhail >> >> On Fri, Apr 24, 2020 at 4:42 PM Ahmet Altay wrote: >> >>> Hi all, >>> >>> I am not able to access http://metrics.beam.apache.org/, I also >>> tried 104.154.241.2

metrics site not available

Hi all, I am not able to access http://metrics.beam.apache.org/, I also tried 104.154.241.245 and it has the same problem. As of last week both of them were working. Does anyone know what might be the issue? Is there an open JIRA for this? Thank you! Ahmet

Re: Reference to Beam in upcoming Kubeflow Book

Hi Holden, nice to hear from you. Thanks a lot for this email. Adding some TFX folks as well. +Robert Crowe +Irene Giannoumis +Zhitao Li +Anusha Ramesh Would it be possible for TFX folks to review the TFX section of your book? On Fri, Apr 17, 2020 at 12:27 PM Kyle Weaver wrote: > Hi Holden,

Re: New Contributor Intro

Welcome! On Fri, Apr 17, 2020 at 12:41 PM Ismaël Mejía wrote: > Done, assigned BEAM-9502 to you, you can also now self assign tickets too. > Welcome! > > > On Fri, Apr 17, 2020 at 8:15 PM Cameron Morgan > wrote: > > > > Hello everyone, > > > > I would like the permission to contribute to Beam.

Re: Website publish jobs fail recently

Did we end up emailing builds@ or should this be filed as a ticket to infra ? +Rui Wang -- This is preventing Rui from updating the website post 2.20 release. On Tue, Apr 14, 2020 at 9:01 PM Kenneth Knowles wrote: > Indeed, publish jobs have write access to things, which normal builds do > not

Re: [Proposal] Requesting PMC approval to start planning for Beam Summits 2019

Thank you for this proposal and shifting this to a digital event. Kenn, do you know what formal approval is required? On Fri, Apr 10, 2020 at 8:17 PM Kenneth Knowles wrote: > Looks good to me. We'll have to see what ASF is doing with their own > events. We haven't gotten to dates, but I wonder

Re: Jenkins jobs not running for my PR 10438

t; >> > >> >> > >> >> > >> >> > On Mon, Mar 30, 2020 at 8:09 PM Kamil Wasilewski < >> kamil.wasilew...@polidea.com> wrote: >> >> >> >> >> >> Done. >> >> >> >&

Re: [VOTE] Release 2.20.0, release candidate #2

+1 - validated python quickstarts batch/streaming with python 2.7. Thank you Rui! On Thu, Apr 9, 2020 at 12:28 PM Valentyn Tymofieiev wrote: > +1. Checked mobile gaming batch examples, and a streaming quickstart on > Dataflow, on Python 3.7 using Linux wheels. > > On Thu, Apr 9, 2020 at 11:13 A

Re: [VOTE] Accept the Firefly design donation as Beam Mascot - Deadline Mon April 6

+1! On Fri, Apr 3, 2020 at 10:36 AM Kenneth Knowles wrote: > +1 (binding) > > Kenn > > On Fri, Apr 3, 2020 at 10:19 AM Gris Cuevas wrote: > >> +1 >> >> On 2020/04/02 17:18:47, Julian Bruno wrote: >> > Hello Apache Beam Community, >> > >> > Please vote on the acceptance of the final design of t

Re: [VOTE] Release 2.20.0, release candidate #1

+1 - Validated python quickstart examples. Thank you for preparing the RC. On Fri, Apr 3, 2020 at 12:25 PM Ismaël Mejía wrote: > Can somebody with windows please validate this one: > https://issues.apache.org/jira/browse/BEAM-9452 > > We really need to put some windows tests in place in the futu

Re: Golang SDK Katas

Welcome! This will be a great contribution. I hear lots of positive things about existing Katas. On Thu, Apr 2, 2020 at 2:52 PM Pablo Estrada wrote: > Added him as contributor! > > On Thu, Apr 2, 2020 at 2:48 PM Robert Burke wrote: > >> Could someone in the PMC add Damon's username to be assign

Re: Jenkins jobs not running for my PR 10438

s://github.com/apache/beam/pull/11156 with > the following 6 checks? > Run Java PostCommit > Run Java HadoopFormatIO Performance Test > Run BigQueryIO Streaming Performance Test Java > Run Dataflow ValidatesRunner > Run Spark ValidatesRunner > Run SQL Postcommit > > On Tue

Re: Next LTS?

;> in dev or user community who will be willing to maintain that release. >> > > >> > > We can bring this up when we drop Python 2 support. We decided to >> revisit that conversation in a couple of months IIRC. >> > > >> > > On Tue, Mar 24, 2020 a

Re: Jenkins jobs not running for my PR 10438

. > > Thanks in advance! > > Best. > > *Shoaib Zafar* > Software Engineering Lead > Mobile: +92 333 274 6242 > Skype: live:shoaibzafar_1 > > <http://venturedive.com/> > > > On Wed, Mar 25, 2020 at 3:37 AM Ahmet Altay wrote: > >> KInd of done. 11208

Re: Next LTS?

Apache Beam codebase > on behalf of Dataflow customers, but we cannot create hotfixes or official > releases of Apache Beam on demand. > > > > However, the Apache Beam community designates specific releases as long > term support (LTS) releases. LTS releases receive pat

Re: Jenkins jobs not running for my PR 10438

11168 with the followings? >> Run Java PostCommit >> Run Java HadoopFormatIO Performance Test >> Run BigQueryIO Streaming Performance Test Java >> Run Dataflow ValidatesRunner >> Run Spark ValidatesRunner >> Run SQL Postcommit >> >> >> On We

Re: [PROPOSAL] Preparing for Beam 2.20.0 release

And yes this is a release blocker for the open source runners >> > because people >> > tend to package their projects with the respective runners in a >> > jar and this is >> > breaking at the moment. >> > >> > Kenn c

Re: Jenkins jobs not running for my PR 10438

Done. On Wed, Mar 18, 2020 at 5:57 PM Tomo Suzuki wrote: > Hi Beam committers, > (Alexey, thank you!) > > 1. Would you run the 2 failed checks Java PreCommit and Python PreCommit > for https://github.com/apache/beam/pull/11156 > > 2. Would you run the precommit checks for > https://github.com/ap

Re: [Interactive Runner] now available on master

ments >> >> ib.show(counts) >> >> >> >> # We can now visualize the data using standard pandas operations. >> >> df = ib.collect(counts) >> >> print(df.info()) >> >> print(df.describe()) >> >> >> >> # Plot th

Re: Hello Beam Community!

Welcome Brittany! On Thu, Mar 12, 2020 at 6:32 PM Brittany Hermann wrote: > Hello Beam Community! > > My name is Brittany Hermann and I recently joined the Open Source team in > Data Analytics at Google. As a Program Manager, I will be focusing on > community engagement while getting to work on

Re: Request to be added as Jira contributor

Done. Welcome! On Wed, Mar 11, 2020 at 1:51 PM Piotr Szuberski wrote: > *Hi, my name is Piotr. I am interested in contributing java sdk to the > Apache Beam SDK. I'd like to be added **as a Jira contributor so that I > can assign issues to myself. My ASF Jira Username is piotr-szuberski .* >

Re: Jenkins jobs not running for my PR 10438

Done. On Tue, Mar 10, 2020 at 12:21 PM Tomo Suzuki wrote: > Hi Beam committers, > > Would you trigger precomimt checks for > https://github.com/apache/beam/pull/11095 with the following 6 commands ? > Run Java PostCommit > Run Java HadoopFormatIO Performance Test > Run BigQueryIO Streaming Perfo

Re: No space left on device - beam-jenkins 1 and 7

+Alan Myrvold is doing a one time cleanup. I agree that we need to have a solution to automate this task or address the root cause of the buildup. On Thu, Mar 5, 2020 at 2:47 AM Michał Walenia wrote: > Hi there, > it seems we have a problem with Jenkins workers again. Nodes 1 and 7 both > fail

Re: Python Static Typing: Next Steps

On Tue, Mar 3, 2020 at 11:53 AM Chad Dombrova wrote: > >>> +1. Also would not running dmypy would require all contributors to run a >> process all the time? I do not know if this is desired by existing >> contributors, and I am not sure if it will be friendly to new contributors. >> > > Pre-commi

Re: Python Static Typing: Next Steps

On Tue, Mar 3, 2020 at 11:10 AM Robert Bradshaw wrote: > Nice. > > I still think we should enable it in jenkins and get some experience > with it before we add it to the default pre-commit-hook territory. > +1. Also would not running dmypy would require all contributors to run a process all the

Re: [DISCUSSION] Use github actions for python wheels ?

owles wrote: > > > > +1 to exploring this. > > > > On bui...@apache.org there is lots of discussion and general approval > for trying it. It is enabled and used by some projects. Calcite uses it to > build their website, for example. > Great. > > > > Kenn >

[DISCUSSION] Use github actions for python wheels ?

Hi all, I recently had a chance to look at the documentation for github actions. I think we could use github actions instead of travis to for building python wheels during releases. This will have the following advantages: - We will eliminate one repo. (If you don't know, we have https://github.c

Re: Request to be added as contributor

Done. Added you as a contributor. On Mon, Feb 24, 2020 at 2:54 PM Emiliano Capoccia < emiliano.capoc...@gmail.com> wrote: > Hi Luke, > > that is "ecapoccia" > > Thanks, I look forward to hearing from you > > Emiliano > > On 2020/02/24 17:03:53, Luke Cwik wrote: > > Please provide your user id as

Re: [ANNOUNCE] New committer: Chad Dombrova

Congratulations! On Mon, Feb 24, 2020 at 3:25 PM Sam Bourne wrote: > Nice one Chad. Your typing efforts are very welcomed. > > On Tue, Feb 25, 2020 at 10:16 AM Yichi Zhang wrote: > >> Congratulations, Chad! >> >> On Mon, Feb 24, 2020 at 3:10 PM Robert Bradshaw >> wrote: >> >>> Well deserved, C

Re: [ANNOUNCE] New committer: Jincheng Sun

Congratulations! On Mon, Feb 24, 2020 at 6:48 AM Thomas Weise wrote: > Congratulations! > > > On Mon, Feb 24, 2020 at 6:45 AM Ismaël Mejía wrote: > >> Congrats Jincheng! >> >> On Mon, Feb 24, 2020 at 1:39 PM Gleb Kanterov wrote: >> >>> Congratulations! >>> >>> On Mon, Feb 24, 2020 at 1:18 PM H

Re: [VOTE] Vendored Dependencies Release gRPC 1.26.0 v0.2 for BEAM-9252

+1 On Fri, Feb 21, 2020 at 4:39 PM Luke Cwik wrote: > +1 (binding) > I diffed the binary contents of the 0.1 jar and 0.2 jar with no changes to > the contents of the files and can confirm that module-info.class the > offending Main.class and Main$1.class have been removed as well. > > On Fri, Fe

Re: Docker images are migrated to Apache org.

Thank you, Hannah! This is great. On Fri, Feb 21, 2020 at 11:24 AM Hannah Jiang wrote: > Hello team > > Docker SDK images (Python, Java, Go) and Flink job server images are > migrated to Apache org[1]. > I confirmed digests of all the images of the two repos are exactly the > same. > In addition

Re: [PROPOSAL] Preparing for Beam 2.20.0 release

endored gRPC release so better to give it > some priority. > > > On Wed, Feb 12, 2020 at 6:48 PM Ahmet Altay wrote: > >> +1. Thank you. >> >> On Tue, Feb 11, 2020 at 11:01 PM Rui Wang wrote: >> >>> Hi all, >>> >>> Th

Re: Sphinx Docs Command Error (:sdks:python:test-suites:tox:pycommon:docs)

0写道： > >> For me the difference was about 20s longer (40s -> 60s approx). Not >> significant IMO >> >> On Tue, Feb 11, 2020 at 9:59 AM Ahmet Altay wrote: >> >>> Should we remove the "-j 8" option by default? Sphinx docs says this is >>

Re: Beam Postcommit SQL broken RESOURCE_EXHAUSTED pubsub topics

Filed https://issues.apache.org/jira/browse/BEAM-9319 for this. It seems like there are many leaked topics that accumulated over time. On Fri, Feb 14, 2020 at 5:40 AM Michał Walenia wrote: > From what I've seen so far it seems that the topics are created as parts > of multiple tests, both Java a

Re: Contributor permission for Beam Jira tickets

Done. Welcome! On Thu, Feb 13, 2020 at 5:42 PM Wenbing Bai wrote: > Hi there, > > I am Wenbing from Cruise. I would like to make some contributions to > the Python SDK for Beam. Can someone add me as a contributor in the > Beam Jira? My username is wenbing-bai. > > Thank you! > Wenbing > > -- >

Re: [PROPOSAL] Transition released containers to the official ASF dockerhub organization

0, 9:51 AM Robert Bradshaw >> wrote: >> >>> +1, granting permission to individual accounts is preferable to trying >>> to share a single account. >>> >>> On Thu, Feb 13, 2020 at 9:44 AM Ahmet Altay wrote: >>> > >>> > Could

Re: daily dataflow job failing today

here is also a middle ground, where we can pin certain dependencies >>> if we are not confident about their releases. And allow ranges for rest of >>> the dependencies. In general, we are currently following this practice. >>> >>> I see your point, like many things

Re: [PROPOSAL] Transition released containers to the official ASF dockerhub organization

Knowles wrote: > >> +1 very nice explanation >> >> On Wed, Jan 15, 2020 at 1:57 PM Ahmet Altay wrote: >> >>> +1 - Thank you for driving this! >>> >>> On Wed, Jan 15, 2020 at 1:55 PM Thomas Weise wrote: >>> >>&

Re: Python2.7 Beam End-of-Life Date

On Wed, Feb 12, 2020 at 1:29 AM Ismaël Mejía wrote: > I am with Chad on this, we should probably extend it a bit more, even if it > makes us struggle a bit at least we have some workarounds as Robert > suggests, > and as Chad said there are still many people playing the python 3 catchup > game, >

Re: daily dataflow job failing today

rtain dependencies if we are not confident about their releases. And allow ranges for rest of the dependencies. In general, we are currently following this practice. > > > On Wed, Feb 12, 2020 at 9:14 PM Ahmet Altay wrote: > >> Related: we have dependencies on avro, avro-pyth

Re: daily dataflow job failing today

Jayalath , because I vaguely remember him working on this. The reason I am calling for this is the impact of bad dependency releases are high. All previously released Beam versions will be impacted. Reducing the dependency list will reduce the risk. Ahmet On Wed, Feb 12, 2020 at 12:02 PM Ahmet Altay

Re: daily dataflow job failing today

Thank you Valentyn! On Wed, Feb 12, 2020 at 11:32 AM Valentyn Tymofieiev wrote: > Yes, otherwise all Python tests will continue to fail until Avro comes up > with a new release. Sent: https://github.com/apache/beam/pull/10844 > > On Wed, Feb 12, 2020 at 11:08 AM Ahmet Altay wrote:

Re: daily dataflow job failing today

Should we update Beam's setup.py to skip this avro-python3 version? On Wed, Feb 12, 2020 at 10:57 AM Alan Krumholz wrote: > makes sense. I'll add this workaround for now. > Thanks so much for your help! > > On Wed, Feb 12, 2020 at 10:33 AM Valentyn Tymofieiev > wrote: > >> Alan, Dataflow worker

Re: [PROPOSAL] Preparing for Beam 2.20.0 release

+1. Thank you. On Tue, Feb 11, 2020 at 11:01 PM Rui Wang wrote: > Hi all, > > The next (2.20.0) release branch cut is scheduled for 02/26, according to > the calendar > > . > I would like to v

Re: Sphinx Docs Command Error (:sdks:python:test-suites:tox:pycommon:docs)

Should we remove the "-j 8" option by default? Sphinx docs says this is an experimental option [1]. I do not recall docs generation taking a long time, does this increase significantly without this option? [1] http://www.sphinx-doc.org/en/stable/man/sphinx-build.html On Tue, Feb 11, 2020 at 1:16

Re: big data blog

Cool, thank you. Would it make sense to promote Beam related posts on our twitter channel? On Fri, Feb 7, 2020 at 2:47 PM Pablo Estrada wrote: > Very nice. Thanks for sharing Etienne! > > On Fri, Feb 7, 2020 at 2:19 PM Reuven Lax wrote: > >> Cool! >> >> On Fri, Feb 7, 2020 at 7:24 AM Etienne Ch

Re: Updating releases on Github release page.

I do not believe this is intentional. This step might be missing from the release guide. On Fri, Feb 7, 2020 at 5:07 PM Daniel Oliveira wrote: > Hey beam devs, > > I saw a comment on SO that our releases on github ( > https://github.com/apache/beam/releases) are stuck at 2.16.0. It looks > like

Re: [DISCUSS] Autoformat python code with Black

; However, we don't conform to that either--we use 2 spaces for indentation, > but 4 for continuation indentation. (As for the history of this, this goes > back to Google's internal style guide, probably motivated by consistency > with C++, Java, ... and the fact that with an ind

Re: [DISCUSSION] Improve release notes by adding a change list file

On Mon, Feb 3, 2020 at 5:15 PM Ahmet Altay wrote: > Done, updated the PR template checklist as well. > > On Mon, Feb 3, 2020 at 5:05 PM Udi Meiri wrote: > >> +1 to add this to the checklist >> >> On Mon, Feb 3, 2020 at 4:57 PM Robert Bradshaw >> wrote: >>

Re: Python2.7 Beam End-of-Life Date

For reference, this was last discussed in September [1]. I agree, that it is a good time to re-think about this, and I also lean towards deprecating sooner. /cc +Valentyn Tymofieiev +Robert Bradshaw +Chad [1] https://lists.apache.org/thread.html/d098b92cbd5549fdeff88eeb5d5c62c97269244d966082ed2

Re: [DISCUSSION] Improve release notes by adding a change list file

Done, updated the PR template checklist as well. On Mon, Feb 3, 2020 at 5:05 PM Udi Meiri wrote: > +1 to add this to the checklist > > On Mon, Feb 3, 2020 at 4:57 PM Robert Bradshaw > wrote: > >> On Mon, Feb 3, 2020 at 4:49 PM Ahmet Altay wrote: >> > >> >

Re: [DISCUSSION] Improve release notes by adding a change list file

luding ..." > I agree. If there are no objections I will go ahead with the PR I proposed. It adds a single change log file to begin with. We would need all committers to help after that by asking PR authors to update this file whenever it makes sense. > > On Mon, Feb 3, 2020 at 1:55

Re: [RELEASE VOTE RESULT] Release 2.19.0, release candidate #1

this release. >> >> There are 5 approving votes, 4 of which are binging: >> * Ahmet Altay >> * Ismaël Mejía >> * Jean-Baptiste Onofré >> * Robert Bradshaw >> >> There are no disapproving votes. >> >> Thanks for everyone's help! I'm going to finalize the release and send >> out the official release announcement later. >> >

Re: [DISCUSSION] Improve release notes by adding a change list file

crier > [2] https://github.com/python-attrs/attrs > > > On Fri, Jan 31, 2020 at 5:09 PM Ahmet Altay wrote: > >> Thank you for the quick responses. I sent out >> https://github.com/apache/beam/pull/10743 to make this change. Please >> provide feedback or directly edit the

Re: [DISCUSSION] Improve release notes by adding a change list file

gt; >> > >> This is a great idea. Hope it can lead to higher-value view of relevant > changes. > >> > >> I like it being in the root of the repo, so it lives next to the code. > >> > >> Since the website is also markdown, it could be c

Re: [ANNOUNCE] New committer: Hannah Jiang

Congratulations! On Wed, Jan 29, 2020 at 4:50 PM Robert Bradshaw wrote: > Congratulations, Hannah! > > On Wed, Jan 29, 2020 at 3:23 PM Chamikara Jayalath > wrote: > >> Congrats Hannah! >> >> On Wed, Jan 29, 2020 at 9:22 AM Hannah Jiang >> wrote: >> >>> Thanks everyone! >>> It is a very rewardi

Re: [ANNOUNCE] New committer: Michał Walenia

Congratulations! On Tue, Jan 28, 2020 at 9:16 PM Connell O'Callaghan wrote: > Thank you Pablo for sharing!!! > > Well done Michal!!! > > On Tue, Jan 28, 2020 at 21:07 jincheng sun > wrote: > >> Congrats Michał ！ >> >> >> Hannah Jiang 于2020年1月29日 周三01:43写道： >> >>> Congrats you Michal! >>> >>> >>

<    1   2   3   4   5   6   7   8   9   10   >