Re: [REVIEW][please pause website changes] Migrated the Beam website to Hugo

l push >> another commit to fix all that up, hope can be tomorrow. >> >> [1] https://github.com/apache/beam/pull/11554#issuecomment-626792031 >> >> Best regards, >> Nam >> >> >> On Mon, May 11, 2020 at 9:01 AM Nam Bui wrote: >> >>

Re: GSoD with Apache Beam

Welcome. There was this list of projects ( https://cwiki.apache.org/confluence/display/BEAM/Google+Season+of+Docs) if that helps. +Aizhamal Nurmamat kyzy could probably point you in the right direction. Ahmet On Tue, May 12, 2020 at 1:30 AM Sylvia Mittal wrote: > Hey, > > I am Sylvia, a

Re: [DISCUSS] Dealing with @Ignored tests

+1 to generate a report instead of removing these tests. A report like this could help us with prioritization. It is easier to address issues when we can quantify how much of a problem it is. I am curious what we can do to incentivize reducing the number of flaky/ignored tests? A report itself

Re: Jenkins jobs not running for my PR 10438

Done for both Yoshiki and Tomo's PRs. On Mon, May 11, 2020 at 6:33 PM Tomo Suzuki wrote: > Hi Beam committers, > > Would you run the basic precommit checks for > https://github.com/apache/beam/pull/11674 ? > > Regards, > Tomo >

Re: [REVIEW][please pause website changes] Migrated the Beam website to Hugo

>> through the whole release process and convince people to upgrade. (I >>>>>> recognize accepting this argument is, to some degree at least, saying >>>>>> that we don't care about the correctness of docs as much as so-called >>>>

Re: Beam 2.21 release update

On Thu, May 7, 2020 at 11:56 AM Thomas Weise wrote: > Thanks Udi! This is the issue. I'm trying to upgrade from 2.18 where > build-requirements.txt didn't exist. > > Is there a reason why this cannot happen automatically when > running python3.6 setup.py sdist bdist_wheel ? > I _believe_ this

Re: [REVIEW][please pause website changes] Migrated the Beam website to Hugo

yone? > This is reasonable to me. I agree with your reasons. What do others think? > > > On Wed, May 6, 2020 at 7:07 PM Ahmet Altay wrote: > >> >> >> On Wed, May 6, 2020 at 2:33 PM Aizhamal Nurmamat kyzy < >> aizha...@apache.org> wrote: >

Re: Python Precommit significantly flaky

I am aware of the following two that contributes to precommit flakiness. Someone is working on both. https://issues.apache.org/jira/browse/BEAM-9907 - ExternalTransform https://issues.apache.org/jira/browse/BEAM-9767 - test_streaming_wordcount flaky On Thu, May 7, 2020 at 10:54 AM Brian Hulette

Re: [REVIEW][please pause website changes] Migrated the Beam website to Hugo

— FAILURE >> > Website_Stage_GCS ("Run Website_Stage_GCS PreCommit") — FAILURE >> > >> > 2) Are there any other blockers for merging? @Ahmet/Robert/others >> please share if there are any other blockers. >> > >> > >> > [1] ht

Re: [PROPOSAL] Preparing for Beam 2.22.0 release

Thank you, Brian. On Mon, May 4, 2020 at 1:59 PM Luke Cwik wrote: > Thanks Brian. > > On Mon, May 4, 2020 at 10:57 AM Kyle Weaver wrote: > >> Thanks Brian! >> >> I'd also like to remind everyone to update CHANGES.md with any important >> recent changes that might be missing. >>

Re: [REVIEW][please pause website changes] Migrated the Beam website to Hugo

rily used for >> switching languages). You can take a look at the translation guide for this >> PoC [4]. >> > >>>>> >> > >>>>> [1] >> https://github.com/apache/beam/pull/11554/commits/b267bb360866a723ac2536f408f23de648c7cd4d >

Re: JIRA priorities explaination

+1 sounds good to me. Oftentimes I confused the relative priorities of critical/blocker/major. On Fri, May 1, 2020 at 3:05 PM Tyson Hamilton wrote: > Proposal sounds good to me! The tool tips will be fantastic. > > On Fri, May 1, 2020 at 3:03 PM Robert Bradshaw > wrote: > >> On Fri, May 1,

Re: [REVIEW][please pause website changes] Migrated the Beam website to Hugo

th a date so they >>> naturally sort chronologically. It looks like this hugo PR [1] made it >>> possible to extract date metadata and slug >>> (i.e. dataflow-python-sdk-is-now-public) separately from the filename. >>> >>> [1] https://gith

Re: Jenkins jobs not running for my PR 10438

; Hello Beam Committers. >>>>>>>> >>>>>>>> Would you please trigger the pre-commit checks on the PR: >>>>>>>> https://github.com/apache/beam/pull/11210 along with the python >>>>>>>> post-commit ch

Re: Python 3.7 docker container fails to build

t; >> *07:57:03* [91mERROR: Could not install packages due to an >> > EnvironmentError: [Errno 28] No space left on device >> > >> >> > >> >> > >> >> > >> On Wed, Apr 29, 2020 at 5:59 P

Re: Jira PR links not being generated?

Thank you! On Wed, Apr 29, 2020 at 3:23 PM Kyle Weaver wrote: > Added a comment on https://issues.apache.org/jira/browse/INFRA-19967 > > On Wed, Apr 29, 2020 at 5:57 PM Ahmet Altay wrote: > >> Would it be worth filing this as an infra ticket? >> >> On Mon, Apr 2

Re: [REVIEW][please pause website changes] Migrated the Beam website to Hugo

to get rid of >>> this. For now, we keep the old URLs working in terms of redirecting them. >>> However, from now on, we should change the name convention on blog posts to >>> have a fancy URL like "beam.apache.org/blog/myblogpost.md". :) >>>

Re: [REVIEW][please pause website changes] Migrated the Beam website to Hugo

to you with answers. I'm so sorry if I answer >> a little bit due to the timezone. :) >> >> Best regards, >> Nam >> >> >> >> On Tue, Apr 28, 2020 at 8:49 PM Aizhamal Nurmamat kyzy < >> aizha...@apache.org> wrote: >> >>> Adding +Na

Re: sdks:java:container:generateThirdPartyLicenses effect on build time / stability

On Wed, Apr 29, 2020 at 3:49 PM Valentyn Tymofieiev wrote: > > > On Tue, Apr 28, 2020 at 5:03 PM Robert Bradshaw > wrote: > >> On Tue, Apr 28, 2020 at 4:46 PM Hannah Jiang >> wrote: >> >>> I guess I assumed there was some reason we needed "lightweight images" in our tests (because

Re: Jira PR links not being generated?

Would it be worth filing this as an infra ticket? On Mon, Apr 27, 2020 at 4:29 PM Kyle Weaver wrote: > Slight correction.. Jira to Github links are back. Github to Jira links > (which were only recently added) are not being added. > > On Mon, Apr 27, 2020 at 7:20 PM Kyle Weaver wrote: > >>

Re: Automation for Jira

+1 for the automations. I agree with concerns related to #4. Auto closing issues is not a good experience. A person goes through the work of reporting an issue. This might very well be their first contribution. Automatically closing these issues with no human comments might make the reporter feel

Re: Greetings from Tyson

Welcome! On Tue, Apr 28, 2020 at 3:06 PM Hannah Jiang wrote: > Welcome to the community! > > > On Tue, Apr 28, 2020 at 2:45 PM Tyson Hamilton wrote: > >> Hello Beam Community, >> >> This is just a simple 'Hello' to introduce myself. I'm a Software >> Engineer at Google and have worked with

Re: Python 3.7 docker container fails to build

+Valentyn Tymofieiev +Hannah Jiang -- in case they have relevant information. On Wed, Apr 29, 2020 at 12:35 PM Maximilian Michels wrote: > Hi, > > has anyone noticed the Python 3.7 Docker container fails to build? I > haven't been able to build the Python 3.7 container, neither locally nor >

Re: [REVIEW][please pause website changes] Migrated the Beam website to Hugo

I am having trouble reviewing the staged version. What is the best way to review this change? Do we expect any changes to markdown files, beyond some metadata? On Tue, Apr 28, 2020 at 10:45 AM Robert Bradshaw wrote: > Thanks. It'll be great to better support more languages. > > I looked at the

Re: metrics site not available

e. I will try to restart pods and see if it helps. >> >> --Mikhail >> >> On Fri, Apr 24, 2020 at 4:42 PM Ahmet Altay wrote: >> >>> Hi all, >>> >>> I am not able to access http://metrics.beam.apache.org/, I also >>> tried 104.154.241.2

metrics site not available

Hi all, I am not able to access http://metrics.beam.apache.org/, I also tried 104.154.241.245 and it has the same problem. As of last week both of them were working. Does anyone know what might be the issue? Is there an open JIRA for this? Thank you! Ahmet

Re: Reference to Beam in upcoming Kubeflow Book

Hi Holden, nice to hear from you. Thanks a lot for this email. Adding some TFX folks as well. +Robert Crowe +Irene Giannoumis +Zhitao Li +Anusha Ramesh Would it be possible for TFX folks to review the TFX section of your book? On Fri, Apr 17, 2020 at 12:27 PM Kyle Weaver wrote: > Hi

Re: New Contributor Intro

Welcome! On Fri, Apr 17, 2020 at 12:41 PM Ismaël Mejía wrote: > Done, assigned BEAM-9502 to you, you can also now self assign tickets too. > Welcome! > > > On Fri, Apr 17, 2020 at 8:15 PM Cameron Morgan > wrote: > > > > Hello everyone, > > > > I would like the permission to contribute to Beam.

Re: Website publish jobs fail recently

Did we end up emailing builds@ or should this be filed as a ticket to infra ? +Rui Wang -- This is preventing Rui from updating the website post 2.20 release. On Tue, Apr 14, 2020 at 9:01 PM Kenneth Knowles wrote: > Indeed, publish jobs have write access to things, which normal builds do >

Re: [Proposal] Requesting PMC approval to start planning for Beam Summits 2019

Thank you for this proposal and shifting this to a digital event. Kenn, do you know what formal approval is required? On Fri, Apr 10, 2020 at 8:17 PM Kenneth Knowles wrote: > Looks good to me. We'll have to see what ASF is doing with their own > events. We haven't gotten to dates, but I wonder

Re: Jenkins jobs not running for my PR 10438

t; >> > >> >> > >> >> > >> >> > On Mon, Mar 30, 2020 at 8:09 PM Kamil Wasilewski < >> kamil.wasilew...@polidea.com> wrote: >> >> >> >> >> >> Done. >> >> >> >&

Re: [VOTE] Release 2.20.0, release candidate #2

+1 - validated python quickstarts batch/streaming with python 2.7. Thank you Rui! On Thu, Apr 9, 2020 at 12:28 PM Valentyn Tymofieiev wrote: > +1. Checked mobile gaming batch examples, and a streaming quickstart on > Dataflow, on Python 3.7 using Linux wheels. > > On Thu, Apr 9, 2020 at 11:13

Re: [VOTE] Accept the Firefly design donation as Beam Mascot - Deadline Mon April 6

+1! On Fri, Apr 3, 2020 at 10:36 AM Kenneth Knowles wrote: > +1 (binding) > > Kenn > > On Fri, Apr 3, 2020 at 10:19 AM Gris Cuevas wrote: > >> +1 >> >> On 2020/04/02 17:18:47, Julian Bruno wrote: >> > Hello Apache Beam Community, >> > >> > Please vote on the acceptance of the final design of

Re: [VOTE] Release 2.20.0, release candidate #1

+1 - Validated python quickstart examples. Thank you for preparing the RC. On Fri, Apr 3, 2020 at 12:25 PM Ismaël Mejía wrote: > Can somebody with windows please validate this one: > https://issues.apache.org/jira/browse/BEAM-9452 > > We really need to put some windows tests in place in the

Re: Golang SDK Katas

Welcome! This will be a great contribution. I hear lots of positive things about existing Katas. On Thu, Apr 2, 2020 at 2:52 PM Pablo Estrada wrote: > Added him as contributor! > > On Thu, Apr 2, 2020 at 2:48 PM Robert Burke wrote: > >> Could someone in the PMC add Damon's username to be

Re: Jenkins jobs not running for my PR 10438

s://github.com/apache/beam/pull/11156 with > the following 6 checks? > Run Java PostCommit > Run Java HadoopFormatIO Performance Test > Run BigQueryIO Streaming Performance Test Java > Run Dataflow ValidatesRunner > Run Spark ValidatesRunner > Run SQL Postcommit > > On

Re: Next LTS?

in dev or user community who will be willing to maintain that release. >> > > >> > > We can bring this up when we drop Python 2 support. We decided to >> revisit that conversation in a couple of months IIRC. >> > > >> > > On Tue, Mar 24, 2020 at 3:44 PM

Re: Jenkins jobs not running for my PR 10438

; > Thanks in advance! > > Best. > > *Shoaib Zafar* > Software Engineering Lead > Mobile: +92 333 274 6242 > Skype: live:shoaibzafar_1 > > <http://venturedive.com/> > > > On Wed, Mar 25, 2020 at 3:37 AM Ahmet Altay wrote: > >> KInd of done. 11208 is r

Re: Next LTS?

of Dataflow customers, but we cannot create hotfixes or official > releases of Apache Beam on demand. > > > > However, the Apache Beam community designates specific releases as long > term support (LTS) releases. LTS releases receive patches to fix major > issues for a

Re: Jenkins jobs not running for my PR 10438

11168 with the followings? >> Run Java PostCommit >> Run Java HadoopFormatIO Performance Test >> Run BigQueryIO Streaming Performance Test Java >> Run Dataflow ValidatesRunner >> Run Spark ValidatesRunner >> Run SQL Postcommit >> >> >> On We

Re: [PROPOSAL] Preparing for Beam 2.20.0 release

is is a release blocker for the open source runners >> > because people >> > tend to package their projects with the respective runners in a >> > jar and this is >> > breaking at the moment. >> > >> > Kenn changed the p

Re: Jenkins jobs not running for my PR 10438

Done. On Wed, Mar 18, 2020 at 5:57 PM Tomo Suzuki wrote: > Hi Beam committers, > (Alexey, thank you!) > > 1. Would you run the 2 failed checks Java PreCommit and Python PreCommit > for https://github.com/apache/beam/pull/11156 > > 2. Would you run the precommit checks for >

Re: [Interactive Runner] now available on master

;> # We can now visualize the data using standard pandas operations. >> >> df = ib.collect(counts) >> >> print(df.info()) >> >> print(df.describe()) >> >> >> >> # Plot the top-10 counted words >> >> df = df.sort_values(by=1,

Re: Hello Beam Community!

Welcome Brittany! On Thu, Mar 12, 2020 at 6:32 PM Brittany Hermann wrote: > Hello Beam Community! > > My name is Brittany Hermann and I recently joined the Open Source team in > Data Analytics at Google. As a Program Manager, I will be focusing on > community engagement while getting to work on

Re: Request to be added as Jira contributor

Done. Welcome! On Wed, Mar 11, 2020 at 1:51 PM Piotr Szuberski wrote: > *Hi, my name is Piotr. I am interested in contributing java sdk to the > Apache Beam SDK. I'd like to be added **as a Jira contributor so that I > can assign issues to myself. My ASF Jira Username is piotr-szuberski .* >

Re: Jenkins jobs not running for my PR 10438

Done. On Tue, Mar 10, 2020 at 12:21 PM Tomo Suzuki wrote: > Hi Beam committers, > > Would you trigger precomimt checks for > https://github.com/apache/beam/pull/11095 with the following 6 commands ? > Run Java PostCommit > Run Java HadoopFormatIO Performance Test > Run BigQueryIO Streaming

Re: No space left on device - beam-jenkins 1 and 7

+Alan Myrvold is doing a one time cleanup. I agree that we need to have a solution to automate this task or address the root cause of the buildup. On Thu, Mar 5, 2020 at 2:47 AM Michał Walenia wrote: > Hi there, > it seems we have a problem with Jenkins workers again. Nodes 1 and 7 both > fail

Re: Python Static Typing: Next Steps

On Tue, Mar 3, 2020 at 11:53 AM Chad Dombrova wrote: > >>> +1. Also would not running dmypy would require all contributors to run a >> process all the time? I do not know if this is desired by existing >> contributors, and I am not sure if it will be friendly to new contributors. >> > >

Re: Python Static Typing: Next Steps

On Tue, Mar 3, 2020 at 11:10 AM Robert Bradshaw wrote: > Nice. > > I still think we should enable it in jenkins and get some experience > with it before we add it to the default pre-commit-hook territory. > +1. Also would not running dmypy would require all contributors to run a process all the

Re: [DISCUSSION] Use github actions for python wheels ?

gt; > > > +1 to exploring this. > > > > On bui...@apache.org there is lots of discussion and general approval > for trying it. It is enabled and used by some projects. Calcite uses it to > build their website, for example. > Great. > > > > Kenn > > > >

[DISCUSSION] Use github actions for python wheels ?

Hi all, I recently had a chance to look at the documentation for github actions. I think we could use github actions instead of travis to for building python wheels during releases. This will have the following advantages: - We will eliminate one repo. (If you don't know, we have

Re: Request to be added as contributor

Done. Added you as a contributor. On Mon, Feb 24, 2020 at 2:54 PM Emiliano Capoccia < emiliano.capoc...@gmail.com> wrote: > Hi Luke, > > that is "ecapoccia" > > Thanks, I look forward to hearing from you > > Emiliano > > On 2020/02/24 17:03:53, Luke Cwik wrote: > > Please provide your user id

Re: [ANNOUNCE] New committer: Chad Dombrova

Congratulations! On Mon, Feb 24, 2020 at 3:25 PM Sam Bourne wrote: > Nice one Chad. Your typing efforts are very welcomed. > > On Tue, Feb 25, 2020 at 10:16 AM Yichi Zhang wrote: > >> Congratulations, Chad! >> >> On Mon, Feb 24, 2020 at 3:10 PM Robert Bradshaw >> wrote: >> >>> Well deserved,

Re: [ANNOUNCE] New committer: Jincheng Sun

Congratulations! On Mon, Feb 24, 2020 at 6:48 AM Thomas Weise wrote: > Congratulations! > > > On Mon, Feb 24, 2020 at 6:45 AM Ismaël Mejía wrote: > >> Congrats Jincheng! >> >> On Mon, Feb 24, 2020 at 1:39 PM Gleb Kanterov wrote: >> >>> Congratulations! >>> >>> On Mon, Feb 24, 2020 at 1:18 PM

Re: [VOTE] Vendored Dependencies Release gRPC 1.26.0 v0.2 for BEAM-9252

+1 On Fri, Feb 21, 2020 at 4:39 PM Luke Cwik wrote: > +1 (binding) > I diffed the binary contents of the 0.1 jar and 0.2 jar with no changes to > the contents of the files and can confirm that module-info.class the > offending Main.class and Main$1.class have been removed as well. > > On Fri,

Re: Docker images are migrated to Apache org.

Thank you, Hannah! This is great. On Fri, Feb 21, 2020 at 11:24 AM Hannah Jiang wrote: > Hello team > > Docker SDK images (Python, Java, Go) and Flink job server images are > migrated to Apache org[1]. > I confirmed digests of all the images of the two repos are exactly the > same. > In

Re: [PROPOSAL] Preparing for Beam 2.20.0 release

a vendored gRPC release so better to give it > some priority. > > > On Wed, Feb 12, 2020 at 6:48 PM Ahmet Altay wrote: > >> +1. Thank you. >> >> On Tue, Feb 11, 2020 at 11:01 PM Rui Wang wrote: >> >>> Hi all, >>> >>> Th

Re: Sphinx Docs Command Error (:sdks:python:test-suites:tox:pycommon:docs)

gt; >> For me the difference was about 20s longer (40s -> 60s approx). Not >> significant IMO >> >> On Tue, Feb 11, 2020 at 9:59 AM Ahmet Altay wrote: >> >>> Should we remove the "-j 8" option by default? Sphinx docs says this is >>>

Re: Beam Postcommit SQL broken RESOURCE_EXHAUSTED pubsub topics

Filed https://issues.apache.org/jira/browse/BEAM-9319 for this. It seems like there are many leaked topics that accumulated over time. On Fri, Feb 14, 2020 at 5:40 AM Michał Walenia wrote: > From what I've seen so far it seems that the topics are created as parts > of multiple tests, both Java

Re: Contributor permission for Beam Jira tickets

Done. Welcome! On Thu, Feb 13, 2020 at 5:42 PM Wenbing Bai wrote: > Hi there, > > I am Wenbing from Cruise. I would like to make some contributions to > the Python SDK for Beam. Can someone add me as a contributor in the > Beam Jira? My username is wenbing-bai. > > Thank you! > Wenbing > > -- >

Re: [PROPOSAL] Transition released containers to the official ASF dockerhub organization

rt Bradshaw >> wrote: >> >>> +1, granting permission to individual accounts is preferable to trying >>> to share a single account. >>> >>> On Thu, Feb 13, 2020 at 9:44 AM Ahmet Altay wrote: >>> > >>> > Could we ask t

Re: daily dataflow job failing today

so a middle ground, where we can pin certain dependencies >>> if we are not confident about their releases. And allow ranges for rest of >>> the dependencies. In general, we are currently following this practice. >>> >>> I see your point, like

Re: [PROPOSAL] Transition released containers to the official ASF dockerhub organization

wrote: > >> +1 very nice explanation >> >> On Wed, Jan 15, 2020 at 1:57 PM Ahmet Altay wrote: >> >>> +1 - Thank you for driving this! >>> >>> On Wed, Jan 15, 2020 at 1:55 PM Thomas Weise wrote: >>> >>>> +1

Re: Python2.7 Beam End-of-Life Date

On Wed, Feb 12, 2020 at 1:29 AM Ismaël Mejía wrote: > I am with Chad on this, we should probably extend it a bit more, even if it > makes us struggle a bit at least we have some workarounds as Robert > suggests, > and as Chad said there are still many people playing the python 3 catchup > game,

Re: daily dataflow job failing today

ot confident about their releases. And allow ranges for rest of the dependencies. In general, we are currently following this practice. > > > On Wed, Feb 12, 2020 at 9:14 PM Ahmet Altay wrote: > >> Related: we have dependencies on avro, avro-python3, and fastavro. >> fa

Re: daily dataflow job failing today

Jayalath , because I vaguely remember him working on this. The reason I am calling for this is the impact of bad dependency releases are high. All previously released Beam versions will be impacted. Reducing the dependency list will reduce the risk. Ahmet On Wed, Feb 12, 2020 at 12:02 PM Ahmet Altay

Re: daily dataflow job failing today

Thank you Valentyn! On Wed, Feb 12, 2020 at 11:32 AM Valentyn Tymofieiev wrote: > Yes, otherwise all Python tests will continue to fail until Avro comes up > with a new release. Sent: https://github.com/apache/beam/pull/10844 > > On Wed, Feb 12, 2020 at 11:08 AM Ahmet Altay wrote:

Re: daily dataflow job failing today

Should we update Beam's setup.py to skip this avro-python3 version? On Wed, Feb 12, 2020 at 10:57 AM Alan Krumholz wrote: > makes sense. I'll add this workaround for now. > Thanks so much for your help! > > On Wed, Feb 12, 2020 at 10:33 AM Valentyn Tymofieiev > wrote: > >> Alan, Dataflow

Re: [PROPOSAL] Preparing for Beam 2.20.0 release

+1. Thank you. On Tue, Feb 11, 2020 at 11:01 PM Rui Wang wrote: > Hi all, > > The next (2.20.0) release branch cut is scheduled for 02/26, according to > the calendar > > . > I would like to

Re: Sphinx Docs Command Error (:sdks:python:test-suites:tox:pycommon:docs)

Should we remove the "-j 8" option by default? Sphinx docs says this is an experimental option [1]. I do not recall docs generation taking a long time, does this increase significantly without this option? [1] http://www.sphinx-doc.org/en/stable/man/sphinx-build.html On Tue, Feb 11, 2020 at 1:16

Re: big data blog

Cool, thank you. Would it make sense to promote Beam related posts on our twitter channel? On Fri, Feb 7, 2020 at 2:47 PM Pablo Estrada wrote: > Very nice. Thanks for sharing Etienne! > > On Fri, Feb 7, 2020 at 2:19 PM Reuven Lax wrote: > >> Cool! >> >> On Fri, Feb 7, 2020 at 7:24 AM Etienne

Re: Updating releases on Github release page.

I do not believe this is intentional. This step might be missing from the release guide. On Fri, Feb 7, 2020 at 5:07 PM Daniel Oliveira wrote: > Hey beam devs, > > I saw a comment on SO that our releases on github ( > https://github.com/apache/beam/releases) are stuck at 2.16.0. It looks > like

Re: [DISCUSS] Autoformat python code with Black

ry of this, this goes > back to Google's internal style guide, probably motivated by consistency > with C++, Java, ... and the fact that with an indent level of 4 one ends up > wrapping lines quite frequently (it's telling that black's default line > length is 88)). This turns out to be

Re: [DISCUSSION] Improve release notes by adding a change list file

On Mon, Feb 3, 2020 at 5:15 PM Ahmet Altay wrote: > Done, updated the PR template checklist as well. > > On Mon, Feb 3, 2020 at 5:05 PM Udi Meiri wrote: > >> +1 to add this to the checklist >> >> On Mon, Feb 3, 2020 at 4:57 PM Robert Bradshaw >> wrote: >>

Re: Python2.7 Beam End-of-Life Date

For reference, this was last discussed in September [1]. I agree, that it is a good time to re-think about this, and I also lean towards deprecating sooner. /cc +Valentyn Tymofieiev +Robert Bradshaw +Chad [1]

Re: [DISCUSSION] Improve release notes by adding a change list file

Done, updated the PR template checklist as well. On Mon, Feb 3, 2020 at 5:05 PM Udi Meiri wrote: > +1 to add this to the checklist > > On Mon, Feb 3, 2020 at 4:57 PM Robert Bradshaw > wrote: > >> On Mon, Feb 3, 2020 at 4:49 PM Ahmet Altay wrote: >> > >> >

Re: [DISCUSSION] Improve release notes by adding a change list file

gt; including ..." > I agree. If there are no objections I will go ahead with the PR I proposed. It adds a single change log file to begin with. We would need all committers to help after that by asking PR authors to update this file whenever it makes sense. > > On Mon, Feb 3, 2020 at 1:55 PM Ahmet

Re: [RELEASE VOTE RESULT] Release 2.19.0, release candidate #1

approved this release. >> >> There are 5 approving votes, 4 of which are binging: >> * Ahmet Altay >> * Ismaël Mejía >> * Jean-Baptiste Onofré >> * Robert Bradshaw >> >> There are no disapproving votes. >> >> Thanks for everyone's help! I'm going to finalize the release and send >> out the official release announcement later. >> >

Re: [DISCUSSION] Improve release notes by adding a change list file

[2] https://github.com/python-attrs/attrs > > > On Fri, Jan 31, 2020 at 5:09 PM Ahmet Altay wrote: > >> Thank you for the quick responses. I sent out >> https://github.com/apache/beam/pull/10743 to make this change. Please >> provide feedback or directly edit the PR. >&

Re: [DISCUSSION] Improve release notes by adding a change list file

t; >> This is a great idea. Hope it can lead to higher-value view of relevant > changes. > >> > >> I like it being in the root of the repo, so it lives next to the code. > >> > >> Since the website is also markdown, it could be copied over dire

Re: [ANNOUNCE] New committer: Hannah Jiang

Congratulations! On Wed, Jan 29, 2020 at 4:50 PM Robert Bradshaw wrote: > Congratulations, Hannah! > > On Wed, Jan 29, 2020 at 3:23 PM Chamikara Jayalath > wrote: > >> Congrats Hannah! >> >> On Wed, Jan 29, 2020 at 9:22 AM Hannah Jiang >> wrote: >> >>> Thanks everyone! >>> It is a very

Re: [ANNOUNCE] New committer: Michał Walenia

Congratulations! On Tue, Jan 28, 2020 at 9:16 PM Connell O'Callaghan wrote: > Thank you Pablo for sharing!!! > > Well done Michal!!! > > On Tue, Jan 28, 2020 at 21:07 jincheng sun > wrote: > >> Congrats Michał ！ >> >> >> Hannah Jiang 于2020年1月29日 周三01:43写道： >> >>> Congrats you Michal! >>> >>>

Re: New contributor to Beam documentation

Welcome! On Fri, Jan 31, 2020 at 12:03 PM Kyle Weaver wrote: > Hi Dave, > > Welcome to Beam! Looking forward to working with you :) > > Kyle > > On Fri, Jan 31, 2020 at 11:17 AM Dave Wrede wrote: > >> Hi all, >> >> I'm Dave and I recently started working on Dataflow documentation. In >>

[DISCUSSION] Improve release notes by adding a change list file

Hi all, We currently have two major ways to communicate changes in a release: - A blog post, to highlight major changes in the release. (Example for 2.17: [1]) - JIRA release notes pages listing all issues tagged for a specific release. (Example for 2.17 [2]). There are a few issues with this

Re: Release 2.19.0, release candidate #1

+1 -- Verified web page / blog post changes. Thank you for building this RC and pre-validating a large number of tests. On Wed, Jan 29, 2020 at 9:03 PM Boyuan Zhang wrote: > Hi everyone, > Please review and vote on the release candidate #1 for the version > 2.19.0, as follows: > [ ] +1,

Re: [ANNOUNCE] Beam 2.18.0 Released

Thank you Udi! On Tue, Jan 28, 2020 at 2:13 PM kant kodali wrote: > Looks like > https://beam.apache.org/documentation/runners/capability-matrix/ needs to > be updated? since there seems to be support for spark structured streaming? > > On Tue, Jan 28, 2020 at 1:47 PM Connell O'Callaghan >

Re: New contributor

Done. Added xbhuang to the list of contributors. On Mon, Jan 27, 2020 at 10:45 AM Xinbin Huang wrote: > Hi > > This is Xinbin Huang. Can someone add me as a contributor for Beam's Jira > issue tracker? I would like to create/assign tickets for my work. > > My Jira username is xbhuang . > >

Re: New contributor

Welcome. What is your jira user name? On Fri, Jan 24, 2020 at 1:25 PM Xinbin Huang wrote: > Hi > > This is Xinbin Huang. Can someone add me as a contributor for Beam's Jira > issue tracker? I would like to create/assign tickets for my work. > > Thanks > Bin >

Re: Jenkins Master

/cc +Alan Myrvold +Yifan Zou +Dan Gazineu -- cc'ing folks who worked on Jenkins related tasks before. On Thu, Jan 23, 2020 at 10:10 AM Pablo Estrada wrote: > Removing private@, and adding dev@. > > ASF Infra has provisioned a new Jenkins master that we'll be able to use > with more

Re: [DISCUSS] Autoformat python code with Black

t;>>> > > >> >>>>>> > > Reformatted lines don't allow quick access to the Git history. >> This >> >>>>>> > > effect is still visible in the Java SDK. However, I have the >> feeling >

Re: [VOTE] Release 2.18.0, release candidate #1

Tue, Jan 21, 2020 at 11:16 AM Robert Bradshaw > wrote: > >> The source tarball seems to be missing the commit at >> >> https://github.com/apache/beam/commit/a61dfbf4570e3adb30e15315c116751faeda897e >> >> On Tue, Jan 21, 2020 at 9:49 AM Ahmet Altay wrote

Re: [VOTE] Release 2.18.0, release candidate #1

All, could you help with validations and voting? On Wed, Jan 15, 2020 at 6:14 PM Ahmet Altay wrote: > +1, validated the same things, they still work. Thank you. > > On Wed, Jan 15, 2020 at 5:01 PM Udi Meiri wrote: > >> Dataflow containers have been updated. Test away. &g

Re: [VOTE] Release 2.18.0, release candidate #1

ZXBpJw/edit#gid=1178617819 >> [10] https://hub.docker.com/u/apachebeam >> >> >> On Tue, Jan 14, 2020 at 6:34 PM Udi Meiri wrote: >> >>> Please don't do any Dataflow-based verifications yet, because we'll have >>> to redo them once new Dataflow container

Re: [PROPOSAL] Transition released containers to the official ASF dockerhub organization

is >> returned. Users need to use tags to identify which images they should use. >> Since we release images with new tags for each version, it will overwhelm >> the users and give them an impression that the images are not organized >> well. It's al

Re: [DISCUSS] Integrate Google Cloud AI functionalities

On Wed, Jan 15, 2020 at 8:12 AM Kamil Wasilewski < kamil.wasilew...@polidea.com> wrote: > Based on your feedback, I think it'd be fine to deal with the problem as > follows: > * for Python: put the transforms into `sdks/python/apache_beam/io/gcp/ai` > * for Java: create a

Re: [DISCUSS] Python static type checkers

On Mon, Jan 13, 2020 at 6:43 PM Chad Dombrova wrote: > > I agree with focusing one mypy for now, but I would propose soon after, >> or in parallel if it will be different folks, to work on pytype and enable >> it as a first class citizen similar to mypy. If there will be a large delta >> between

Re: Jenkins jobs not running for my PR 10438

Done. +Kenneth Knowles , any updates from INFRA on this? On Tue, Jan 14, 2020 at 6:43 PM Tomo Suzuki wrote: > It hit Dataflow quota error again. Can somebody run > Run Dataflow ValidatesRunner > for https://github.com/apache/beam/pull/10554 ? > > On Tue, Jan 14, 2020 at 12:14 PM Tomo Suzuki

Re: [VOTE] Release 2.18.0, release candidate #1

I verified python 2 quickstarts with batch and streaming pipelines, wheel files, and reviewed changes to the blog/website. Udi, could you send an updated version of the voting text with TODOs, template pieces removed? We can discuss changes to the template separately. My vote is +1 pending an

Re: [DISCUSS] Python static type checkers

> The most important gain would be compatibility with Google internal code. I would like to clarify this. This refers to users of Beam who by default are using pytype as part of the toolchain. Even though they are internal to a one single company and not vocal on Beam, they still represent a large

Re: [PROPOSAL] Transition released containers to the official ASF dockerhub organization

On Fri, Jan 10, 2020 at 3:33 PM Ahmet Altay wrote: > > > On Fri, Jan 10, 2020 at 3:32 PM Ankur Goenka wrote: > >> Also curious to know if apache provide any infra support fro projects >> under Apache umbrella and any quota limits they might have. >> > Maybe Ha

<    1   2   3   4   5   6   7   8   9   10   >