Re: [Numpy-discussion] The http://planet.scipy.org/ site is down.
Unfortunately the machine that was hosting planet.scipy.org has died. The volunteer that was supporting it, Sheila Miguez, had warned the scipy leadership for over a year that it was going down. Over the last six months after the Rackspace open source program has ended she repeatedly reached out for help. I tried to save it but the machine wasn’t backed up or had any instructions on how to operate. The rackspace images couldn’t be transferred to the NumFOCUS account for some reason that was never understood. Sheila informed Rackspace that she couldn’t pay the bill of over $1200 for the machine and we would need to cancel the account. I paid the bill for her, and started the process of copying files over to a different box. Rackspace, despite telling us it would take 3 days to delete the account took less then 3hours. Since then I have been on numerous support calls but it appears the account is gone. — Andy On Mon, Aug 20, 2018 at 6:07 AM Didrik Pinte wrote: > Andy Terrel and I have been in the process of migrating the service out of > Rackspace account. There was an issue when the Rackspace machine and its > snapshots got deleted a little too fast. We're working on recovering the > service asap. > > -- Didrik > > On Sat, 18 Aug 2018 at 16:52, Gael Varoquaux < > gael.varoqu...@normalesup.org> wrote: > >> It used to be enthought. >> >> Sorry, I'm traveling for vacations, and I cannot take care of this right >> now. >> >> Gaël >> >> Sent from my phone. Please forgive typos and briefness. >> On Aug 18, 2018, at 07:44, Charles R Harris >> wrote: >>> >>> Hi All, >>> >>> Anyone know who hosts http://planet.scipy.org/? >>> >>> Chuck >>> >>> > ___ > NumPy-Discussion mailing list > NumPy-Discussion@python.org > https://mail.python.org/mailman/listinfo/numpy-discussion > ___ NumPy-Discussion mailing list NumPy-Discussion@python.org https://mail.python.org/mailman/listinfo/numpy-discussion
Re: [Numpy-discussion] Tidelift
FYI, Donald Fischer will be at the NumFOCUS forum next week if folks want to talk to him about it. It looks like individuals sign up with Tidelift and perform services to be paid this money. Looking at the contract it doesn't seem like something that works with anything but individuals or for profit companies. Thus I don't know that "Numpy is eligible" more that "Numpy developers are eligible". On Tue, Sep 18, 2018 at 2:27 PM Stephan Hoyer wrote: > Tidelift is a startup trying to make open source software more sustainable > by selling an open source subscription that pays maintainers. > > NumPy is eligible for a guaranteed $10,000 over 24 months -- are we > interesting in signing up? > https://blog.tidelift.com/1m-to-pay-open-source-maintainers-on-tidelift > https://tidelift.com/lifter/search/pypi/numpy > > It looks like they've started out focused on web development. NumPy is the > only project I see listed in the scientific computing space. > ___ > NumPy-Discussion mailing list > NumPy-Discussion@python.org > https://mail.python.org/mailman/listinfo/numpy-discussion > ___ NumPy-Discussion mailing list NumPy-Discussion@python.org https://mail.python.org/mailman/listinfo/numpy-discussion
Re: [Numpy-discussion] Tidelift
On Tue, Sep 18, 2018 at 4:55 PM Stephan Hoyer wrote: > On Tue, Sep 18, 2018 at 12:26 PM Stephan Hoyer wrote: > >> Tidelift is a startup trying to make open source software more >> sustainable by selling an open source subscription that pays maintainers. >> >> NumPy is eligible for a guaranteed $10,000 over 24 months -- are we >> interesting in signing up? >> https://blog.tidelift.com/1m-to-pay-open-source-maintainers-on-tidelift >> https://tidelift.com/lifter/search/pypi/numpy >> >> It looks like they've started out focused on web development. NumPy is >> the only project I see listed in the scientific computing space. >> > > It occurs to me that NumFOCUS is probably worth looping into any such > discussion, given the strong overlap between Tidelift and NumFOCUS's goals > and the nature of our NumFOCUS affiliation. > Yeah I'm reaching out to Don as we speak. I've known him for a number of years and chatted about NumFOCUS working with Tidelift last year but this program didn't exist. I think the real game changer is having an automated way to scan a clients code base and spit out the dependencies. I would love to have that to take to every institute we work with. "Here NASA if you don't support these codes the next rover could die" =D > ___ > NumPy-Discussion mailing list > NumPy-Discussion@python.org > https://mail.python.org/mailman/listinfo/numpy-discussion > ___ NumPy-Discussion mailing list NumPy-Discussion@python.org https://mail.python.org/mailman/listinfo/numpy-discussion
Re: [Numpy-discussion] Tidelift
I've forwarded Donald this conversation. He said he is working on some of the finer details. He's up for chatting more in NYC next week so if we want to collect a set of questions it might be easy to get them all figured out there. On Tue, Sep 18, 2018 at 8:06 PM Stefan van der Walt wrote: > On Tue, 18 Sep 2018 16:54:16 -0500, Andy Ray Terrel wrote: > > FYI, Donald Fischer will be at the NumFOCUS forum next week if folks want > > to talk to him about it. It looks like individuals sign up with Tidelift > > and perform services to be paid this money. Looking at the contract it > > doesn't seem like something that works with anything but individuals or > for > > profit companies. Thus I don't know that "Numpy is eligible" more that > > "Numpy developers are eligible". > > On the website, they ask that all the maintainers discuss together how > the funds will be applied (the total given is for the project as a > whole). > > This seems tricky: all the maintainers are spending their time on the > project. Which ones will get paid? Will the ones getting paid be > expected to put in extra hours on top of what they are already doing, or > will they carry a more "formal" responsibility? Perhaps it makes sense > to fund specific activities, such as being release manager, that > increase the amount of time donated to the project? > > There are other subtleties: some developers work for companies that do > not allow them to get paid for external consulting, others have visa > issues that prevent them from working for compensation. > > One useful gain could be to incentivize those who would otherwise not be > able to contribute. Parents taking care of children, those who take > second jobs to survive, students, etc. [0] > > Best regards, > Stéfan > > > [0] Quoting Fernando Pérez: "When people are expected to work on open > source software for free, only the people who can afford to work for > free can participate". > ___ > NumPy-Discussion mailing list > NumPy-Discussion@python.org > https://mail.python.org/mailman/listinfo/numpy-discussion > ___ NumPy-Discussion mailing list NumPy-Discussion@python.org https://mail.python.org/mailman/listinfo/numpy-discussion
Re: [Numpy-discussion] Tidelift
On Tue, Sep 18, 2018 at 10:01 PM Nathaniel Smith wrote: > On Tue, Sep 18, 2018 at 6:04 PM, Stefan van der Walt > wrote: > > On Tue, 18 Sep 2018 16:54:16 -0500, Andy Ray Terrel wrote: > >> FYI, Donald Fischer will be at the NumFOCUS forum next week if folks > want > >> to talk to him about it. It looks like individuals sign up with Tidelift > >> and perform services to be paid this money. Looking at the contract it > >> doesn't seem like something that works with anything but individuals or > for > >> profit companies. Thus I don't know that "Numpy is eligible" more that > >> "Numpy developers are eligible". > > > > On the website, they ask that all the maintainers discuss together how > > the funds will be applied (the total given is for the project as a > > whole). > > > > This seems tricky: all the maintainers are spending their time on the > > project. Which ones will get paid? Will the ones getting paid be > > expected to put in extra hours on top of what they are already doing, or > > will they carry a more "formal" responsibility? Perhaps it makes sense > > to fund specific activities, such as being release manager, that > > increase the amount of time donated to the project? > > > > There are other subtleties: some developers work for companies that do > > not allow them to get paid for external consulting, others have visa > > issues that prevent them from working for compensation. > > > > One useful gain could be to incentivize those who would otherwise not be > > able to contribute. Parents taking care of children, those who take > > second jobs to survive, students, etc. [0] > > Assuming the details work out, and that it really is "free money" for > doing the things we're already doing, then I guess the obvious > approach would be to accept, put the money into the NumFOCUS project > account (alongside the money we get from donations etc.), and then > distribute it using the existing mechanisms for managing that money. > If it's really only $5k/year, then that's comparable to what we > currently get and we can use it to fund meetings or whatever; if it's > more, then we can consider using some to contract with individuals to > work on numpy, or whatever makes sense. > > -n > > -- > Nathaniel J. Smith -- https://vorpus.org The contract [0] mentions: "Tidelift wants to pay you to provide certain software maintenance, support, analysis, or other services to Tidelift and Tidelift’s Subscribers (the “Service,” as further defined below), and you want to provide such services." Depending on the context of these services, money to a 501c3 might not be the best approach. There is some nuance to whether a company is paying for a public good or a non-profit is providing a private service. At a minimum if it is really "only doing the work maintainers do anyways" then we need to write a better contract that says that. On the other hand if it is $5K for a small set of independent consultants, it might be nice money for folks but is a far cry from "paying the maintainers" model that they are marketing, more like "paying consultants" which is a lucrative business for many already. I would love to see it grow to paying a living wage to all maintainers so I think it is in our interest to try and help Tidelift overcome some of these challenges. -- Andy [0] https://tidelift.com/docs/lifting/agreement On Tue, Sep 18, 2018 at 10:01 PM Nathaniel Smith wrote: > On Tue, Sep 18, 2018 at 6:04 PM, Stefan van der Walt > wrote: > > On Tue, 18 Sep 2018 16:54:16 -0500, Andy Ray Terrel wrote: > >> FYI, Donald Fischer will be at the NumFOCUS forum next week if folks > want > >> to talk to him about it. It looks like individuals sign up with Tidelift > >> and perform services to be paid this money. Looking at the contract it > >> doesn't seem like something that works with anything but individuals or > for > >> profit companies. Thus I don't know that "Numpy is eligible" more that > >> "Numpy developers are eligible". > > > > On the website, they ask that all the maintainers discuss together how > > the funds will be applied (the total given is for the project as a > > whole). > > > > This seems tricky: all the maintainers are spending their time on the > > project. Which ones will get paid? Will the ones getting paid be > > expected to put in extra hours on top of what they are already doing, or > > will they carry a more "formal" responsibility? Perhaps it makes sense > > to fund specific ac
Re: [Numpy-discussion] adding Quansight Labs as institutional partner
On Tue, Apr 16, 2019 at 11:19 AM Paul Hobson wrote: > On Tue, Apr 16, 2019 at 8:32 AM Chris Barker - NOAA Federal < > chris.bar...@noaa.gov> wrote: > >> Another consideration is that some organizations, the US federal >> government, for instance, cannot make donations. I wouldn’t be surprised if >> some Universities might have similar restrictions on using grant money to >> make a donation to a non-profit. >> >> Is there any way for NumFocus to accept funds in a non-donation way? For >> example, we can pay for documentation, tech support, consulting services, >> etc. >> > > My company would happily reimburse me if I paid for documentation as a way > to get money into NumFocus. Doesn't have to be documentation per se, but > some "tangible" good that doesn't requires any paperwork like a Services > Agreement would greatly make giving to NumFocus easier. > > I can send you a service agreement from NumFOCUS. We've done one thus far and are testing out with more companies as we are able to manage them. Perhaps email me and our Executive Director, Leah Silen, l...@numfocus.org and a...@numfocus.org . -- Andy > > ___ > NumPy-Discussion mailing list > NumPy-Discussion@python.org > https://mail.python.org/mailman/listinfo/numpy-discussion > ___ NumPy-Discussion mailing list NumPy-Discussion@python.org https://mail.python.org/mailman/listinfo/numpy-discussion
Re: [Numpy-discussion] Replacement for Rackspace
If you are looking for servers, I can help with the NumFOCUS allocation from AWS. But anaconda.org will mean less work managing infrastructure. On Fri, Aug 7, 2020 at 8:01 AM Kevin Sheppard wrote: > The Rackspace hosted wheel endpoints at > > > > > https://7933911d6844c6c53a7d-47bd50c35cd79bd838daf386af554a83.ssl.cf2.rackcdn.com/ > > > > and > > > > > https://3f23b170c54c2533c070-1c8a9b3114517dc5fe17b7c3f8c63a43.ssl.cf2.rackcdn.com/ > > > > seem to not be working. I know NumPy, SciPy, pandas and scikit-learn are > all using a common end point on anacona.org. Statsmodels is preparing > for release, and the wheel builder at > https://github.com/MacPython/statsmodels-wheels is failing at upload. Is > there any shared resource for uploading nightlies and release wheels? Or > should we just use a separate account on anaconda.org? > > > > Thanks, > > Kevin > > > > > ___ > NumPy-Discussion mailing list > NumPy-Discussion@python.org > https://mail.python.org/mailman/listinfo/numpy-discussion > ___ NumPy-Discussion mailing list NumPy-Discussion@python.org https://mail.python.org/mailman/listinfo/numpy-discussion
Re: [Numpy-discussion] the NumPy paper is out!
This is awesome. Congratulations to the team! On Wed, Sep 16, 2020 at 3:09 PM Valerio Maggio wrote: > Congratulations everyone! > The paper is very well written, wonderfully organised, and something we > should all be proud of. > > I am super happy that NumPy has finally its own (Nature!) paper: truly > deserved for all the community effort, and for the key central role NumPy > now has for all the ecosystem. > > Thank you! > > Valerio > > On Wed, Sep 16, 2020 at 9:00 PM Frederic Bastien > wrote: > >> Congratulations everybody! >> >> >> >> *From:* NumPy-Discussion > nvidia@python.org> *On Behalf Of *Francesc Alted >> *Sent:* Wednesday, September 16, 2020 3:50 PM >> *To:* Discussion of Numerical Python >> *Subject:* Re: [Numpy-discussion] the NumPy paper is out! >> >> >> >> *External email: Use caution opening links or attachments* >> >> >> >> Very well written article! Congratulations everybody, most specially >> Travis and Chuck for their outstanding work! >> >> >> >> El dc., 16 set. 2020, 19.54, Ralf Gommers va >> escriure: >> >> Hi all, >> >> >> >> Nature published our first official paper: >> https://www.nature.com/articles/s41586-020-2649-2 >> >> >> >> And here is the Twitter announcement: >> https://twitter.com/numpy_team/status/1306268442450972674 >> >> >> >> Thanks to everyone who contributed to this milestone! A few special >> mentions: >> >> >> >> Chuck, for many years of tireless labour keeping our code base in good >> shape, and being the top committer on the NumPy project by now with more >> than twice the commits (says `git shortlog -sn`) as the number two >> committer. This is why Chuck is the first author on the paper. >> >> >> >> Travis, for creating NumPy. This is why Travis is the last author on the >> paper, as our "elder statesman". >> >> >> >> Jarrod and Stéfan, for spending a ton of time on making this the best >> possible paper we could possibly produce on NumPy. >> >> >> >> Cheers, >> >> Ralf >> >> >> >> >> >> ___ >> NumPy-Discussion mailing list >> NumPy-Discussion@python.org >> https://mail.python.org/mailman/listinfo/numpy-discussion >> >> ___ >> NumPy-Discussion mailing list >> NumPy-Discussion@python.org >> https://mail.python.org/mailman/listinfo/numpy-discussion >> > > > -- > # valerio > ___ > NumPy-Discussion mailing list > NumPy-Discussion@python.org > https://mail.python.org/mailman/listinfo/numpy-discussion > ___ NumPy-Discussion mailing list NumPy-Discussion@python.org https://mail.python.org/mailman/listinfo/numpy-discussion
Re: [Numpy-discussion] Comment published in Nature Astronomy about The ecological impact of computing with Python
I think we, the community, does have to take it seriously. NumPy and the rest of the ecosystem is trying to raise money to hire developers. This sentiment, which is much wider than a single paper, is a prevalent roadblock. -- Andy On Tue, Nov 24, 2020 at 11:12 AM Ilhan Polat wrote: > Do we have to take it seriously to start with? Because, with absolutely no > offense meant, I am having significant difficulty doing so. > > On Tue, Nov 24, 2020 at 4:58 PM PIERRE AUGIER < > pierre.aug...@univ-grenoble-alpes.fr> wrote: > >> Hi, >> >> I recently took a bit of time to study the comment "The ecological impact >> of high-performance computing in astrophysics" published in Nature >> Astronomy (Zwart, 2020, https://www.nature.com/articles/s41550-020-1208-y, >> https://arxiv.org/pdf/2009.11295.pdf), where it is stated that "Best >> however, for the environment is to abandon Python for a more >> environmentally friendly (compiled) programming language.". >> >> I wrote a simple Python-Numpy implementation of the problem used for this >> study (https://www.nbabel.org) and, accelerated by Transonic-Pythran, >> it's very efficient. Here are some numbers (elapsed times in s, smaller is >> better): >> >> | # particles | Py | C++ | Fortran | Julia | >> |-|-|-|-|---| >> | 1024| 29 | 55 | 41| 45 | >> | 2048| 123 | 231 | 166| 173 | >> >> The code and a modified figure are here: >> https://github.com/paugier/nbabel (There is no check on the results for >> https://www.nbabel.org, so one still has to be very careful.) >> >> I think that the Numpy community should spend a bit of energy to show >> what can be done with the existing tools to get very high performance (and >> low CO2 production) with Python. This work could be the basis of a serious >> reply to the comment by Zwart (2020). >> >> Unfortunately the Python solution in https://www.nbabel.org is very bad >> in terms of performance (and therefore CO2 production). It is also true for >> most of the Python solutions for the Computer Language Benchmarks Game in >> https://benchmarksgame-team.pages.debian.net/benchmarksgame/ (codes here >> https://salsa.debian.org/benchmarksgame-team/benchmarksgame#what-else). >> >> We could try to fix this so that people see that in many cases, it is not >> necessary to "abandon Python for a more environmentally friendly (compiled) >> programming language". One of the longest and hardest task would be to >> implement the different cases of the Computer Language Benchmarks Game in >> standard and modern Python-Numpy. Then, optimizing and accelerating such >> code should be doable and we should be able to get very good performance at >> least for some cases. Good news for this project, (i) the first point can >> be done by anyone with good knowledge in Python-Numpy (many potential >> workers), (ii) for some cases, there are already good Python >> implementations and (iii) the work can easily be parallelized. >> >> It is not a criticism, but the (beautiful and very nice) new Numpy >> website https://numpy.org/ is not very convincing in terms of >> performance. It's written "Performant The core of NumPy is well-optimized C >> code. Enjoy the flexibility of Python with the speed of compiled code." >> It's true that the core of Numpy is well-optimized C code but to seriously >> compete with C++, Fortran or Julia in terms of numerical performance, one >> needs to use other tools to move the compiled-interpreted boundary outside >> the hot loops. So it could be reasonable to mention such tools (in >> particular Numba, Pythran, Cython and Transonic). >> >> Is there already something planned to answer to Zwart (2020)? >> >> Any opinions or suggestions on this potential project? >> >> Pierre >> >> PS: Of course, alternative Python interpreters (PyPy, GraalPython, >> Pyjion, Pyston, etc.) could also be used, especially if HPy ( >> https://github.com/hpyproject/hpy) is successful (C core of Numpy >> written in HPy, Cython able to produce HPy code, etc.). However, I tend to >> be a bit skeptical in the ability of such technologies to reach very high >> performance for low-level Numpy code (performance that can be reached by >> replacing whole Python functions with optimized compiled code). Of course, >> I hope I'm wrong! IMHO, it does not remove the need for a successful HPy! >> >> -- >> Pierre Augier - CR CNRS http://www.legi.grenoble-inp.fr >> LEGI (UMR 5519) Laboratoire des Ecoulements Geophysiques et Industriels >> BP53, 38041 Grenoble Cedex, Francetel:+33.4.56.52.86.16 >> ___ >> NumPy-Discussion mailing list >> NumPy-Discussion@python.org >> https://mail.python.org/mailman/listinfo/numpy-discussion >> > ___ > NumPy-Discussion mailing list > NumPy-Discussion@python.org > https://mail.python.org/mailman/listinfo/numpy-discussion >
