Re: [openstack-dev] Requests + urllib3 + distro packages

2015-10-15 Thread Thomas Goirand
On 10/15/2015 12:08 PM, Cory Benfield wrote: >> On 14 Oct 2015, at 23:23, Thomas Goirand wrote: >> Though you could have avoid all of this pain if you were not bundling. >> Isn't all of this make you re-think your vendorizing policy? Or still >> not? I'm asking because I still didn't read your ans

Re: [openstack-dev] Requests + urllib3 + distro packages

2015-10-15 Thread Thomas Goirand
On 10/15/2015 11:20 AM, Dmitry Tantsur wrote: > On 10/15/2015 12:18 AM, Robert Collins wrote: >> On 15 October 2015 at 11:11, Thomas Goirand wrote: >>> >>> One major pain point is unfortunately something ridiculously easy to >>> fix, but which nobody seems to care about: the long & short descripti

Re: [openstack-dev] Requests + urllib3 + distro packages

2015-10-15 Thread Thomas Goirand
On 10/15/2015 03:59 PM, Monty Taylor wrote: > On 10/15/2015 02:53 AM, Thomas Goirand wrote: >> Well, having the changlog (and other stuff) of packages merged into the >> long description is not helpful, not for Debian, nor for upstream Python >> packages. > > I actually have gotten multiple reques

Re: [openstack-dev] Requests + urllib3 + distro packages

2015-10-15 Thread Monty Taylor
On 10/15/2015 02:53 AM, Thomas Goirand wrote: On 10/15/2015 12:18 AM, Robert Collins wrote: On 15 October 2015 at 11:11, Thomas Goirand wrote: One major pain point is unfortunately something ridiculously easy to fix, but which nobody seems to care about: the long & short descriptions format.

Re: [openstack-dev] Requests + urllib3 + distro packages

2015-10-15 Thread Cory Benfield
> On 14 Oct 2015, at 23:23, Thomas Goirand wrote: > I do understand that you don't like being called this way, though this > is still the reality. Vendorizing still inflicting some major pain to a > lot of your users: > - This thread one of the demonstration of it. > - You having to contact downs

Re: [openstack-dev] Requests + urllib3 + distro packages

2015-10-15 Thread Dmitry Tantsur
On 10/15/2015 12:18 AM, Robert Collins wrote: On 15 October 2015 at 11:11, Thomas Goirand wrote: One major pain point is unfortunately something ridiculously easy to fix, but which nobody seems to care about: the long & short descriptions format. These are usually buried into the setup.py blac

Re: [openstack-dev] Requests + urllib3 + distro packages

2015-10-14 Thread Thomas Goirand
On 10/15/2015 12:18 AM, Robert Collins wrote: > On 15 October 2015 at 11:11, Thomas Goirand wrote: >> >> One major pain point is unfortunately something ridiculously easy to >> fix, but which nobody seems to care about: the long & short descriptions >> format. These are usually buried into the set

Re: [openstack-dev] Requests + urllib3 + distro packages

2015-10-14 Thread Thomas Goirand
On 10/13/2015 09:41 AM, Cory Benfield wrote: > >> On 13 Oct 2015, at 07:42, Thomas Goirand wrote: >> In this particular case (ie: a difficult upstream which makes it >> impossible to have the same result with pip and system packages) > > I don’t know how carefully you’ve followed this email trai

Re: [openstack-dev] Requests + urllib3 + distro packages

2015-10-14 Thread Robert Collins
On 15 October 2015 at 11:11, Thomas Goirand wrote: > > One major pain point is unfortunately something ridiculously easy to > fix, but which nobody seems to care about: the long & short descriptions > format. These are usually buried into the setup.py black magic, which by > the way I feel is very

Re: [openstack-dev] Requests + urllib3 + distro packages

2015-10-14 Thread Thomas Goirand
On 10/13/2015 06:04 PM, Joshua Harlow wrote: > Thomas Goirand wrote: >> On 10/13/2015 12:44 AM, Joshua Harlow wrote: >>> Anvil gets somewhat far on this, although its not supporting DEBs it >>> does build its best attempt at RPMs building them automatically and >>> turning git repos of projects int

Re: [openstack-dev] Requests + urllib3 + distro packages

2015-10-13 Thread Joshua Harlow
Thomas Goirand wrote: On 10/13/2015 12:44 AM, Joshua Harlow wrote: Anvil gets somewhat far on this, although its not supporting DEBs it does build its best attempt at RPMs building them automatically and turning git repos of projects into RPMs. http://anvil.readthedocs.org/en/latest/topics/summ

Re: [openstack-dev] Requests + urllib3 + distro packages

2015-10-13 Thread Matthew Thode
On 10/08/2015 07:39 PM, Robert Collins wrote: > This is a bugbear that keeps cropping up and biting us. I'm hoping we > can figure out a permanent fix. > > The problem that occurs is the result of a few interacting things: > - requests has very very specific versions of urllib3 it works with. > S

Re: [openstack-dev] Requests + urllib3 + distro packages

2015-10-13 Thread Cory Benfield
> On 13 Oct 2015, at 07:42, Thomas Goirand wrote: > In this particular case (ie: a difficult upstream which makes it > impossible to have the same result with pip and system packages) I don’t know how carefully you’ve followed this email trail, but the “difficult upstream” has had a policy in p

Re: [openstack-dev] Requests + urllib3 + distro packages

2015-10-12 Thread Thomas Goirand
On 10/13/2015 12:44 AM, Joshua Harlow wrote: > Anvil gets somewhat far on this, although its not supporting DEBs it > does build its best attempt at RPMs building them automatically and > turning git repos of projects into RPMs. > > http://anvil.readthedocs.org/en/latest/topics/summary.html (hopef

Re: [openstack-dev] Requests + urllib3 + distro packages

2015-10-12 Thread Thomas Goirand
On 10/12/2015 03:58 PM, Jeremy Stanley wrote: > On 2015-10-12 15:40:48 +0200 (+0200), Thomas Goirand wrote: > [...] >> Has the infra team ever thought about doing that for (at least) all of >> the 3rd party libs we use? I'd love to work closer with the infra team >> to provide them with missing pac

Re: [openstack-dev] Requests + urllib3 + distro packages

2015-10-12 Thread Joshua Harlow
Jeremy Stanley wrote: On 2015-10-12 15:40:48 +0200 (+0200), Thomas Goirand wrote: [...] Has the infra team ever thought about doing that for (at least) all of the 3rd party libs we use? I'd love to work closer with the infra team to provide them with missing packages they would need, and I'm sur

Re: [openstack-dev] Requests + urllib3 + distro packages

2015-10-12 Thread Steve Baker
On 13/10/15 02:05, Thomas Goirand wrote: BTW, the same applies for tablib which is in a even more horrible state that makes it impossible to package with Py3 support. But tablib could be removed from our (build-)dependency list, if someone cares about re-writing cliff-tablib, which IMO wouldn't

Re: [openstack-dev] Requests + urllib3 + distro packages

2015-10-12 Thread Jeremy Stanley
On 2015-10-12 15:40:48 +0200 (+0200), Thomas Goirand wrote: [...] > Has the infra team ever thought about doing that for (at least) all of > the 3rd party libs we use? I'd love to work closer with the infra team > to provide them with missing packages they would need, and I'm sure my > RPM buddy Ha

Re: [openstack-dev] Requests + urllib3 + distro packages

2015-10-12 Thread Thomas Goirand
On 10/09/2015 03:39 PM, William M Edmonds wrote: > When you're using a distro, you're always going to have to worry about > someone pip installing something that conflicts with the rpm, no? The point of this thread is: no you don't. You do only if some (bad) upstream decide to vendorize. > Unless

Re: [openstack-dev] Requests + urllib3 + distro packages

2015-10-12 Thread Thomas Goirand
On 10/12/2015 02:16 AM, Robert Collins wrote: > On 10 October 2015 at 02:58, Cory Benfield wrote: >> >>> On 9 Oct 2015, at 14:40, William M Edmonds wrote: >>> >>> Cory Benfield writes: > The problem that occurs is the result of a few interacting things: > - requests has very very specif

Re: [openstack-dev] Requests + urllib3 + distro packages

2015-10-12 Thread Thomas Goirand
Note: it's not my intention to restart a flame war about vendorizing of urllib3 in requests, however, I can't let you write wrong things, and the point of this message is only that, not discussing if requests should stop vendorizing (I've given up a long time ago any attempt to convince upstream ab

Re: [openstack-dev] Requests + urllib3 + distro packages

2015-10-12 Thread Thomas Goirand
On 10/09/2015 02:39 AM, Robert Collins wrote: > - get the distros to stop un-vendoring urllib3 I'm not the package maintainer of requests, but I know that Barry Warsaw, the actual maintainer, will not want to do that. The other solutions which you didn't mention: 1- Stop using a vendorized versi

Re: [openstack-dev] Requests + urllib3 + distro packages

2015-10-12 Thread Cory Benfield
> On 12 Oct 2015, at 01:16, Robert Collins wrote: > To sum up the thread, it sounds to me like a viable way-forward is: > > - get distros to fixup their requests Python dependencies (and > hopefully they can update that in stable releases). > - fix the existing known bugs in pip where such accur

Re: [openstack-dev] Requests + urllib3 + distro packages

2015-10-11 Thread Robert Collins
On 10 October 2015 at 02:58, Cory Benfield wrote: > >> On 9 Oct 2015, at 14:40, William M Edmonds wrote: >> >> Cory Benfield writes: >> > > The problem that occurs is the result of a few interacting things: >> > > - requests has very very specific versions of urllib3 it works with. >> > > So sp

Re: [openstack-dev] Requests + urllib3 + distro packages

2015-10-09 Thread Robert Collins
On 10 October 2015 at 03:57, Cory Benfield wrote: > >> On 9 Oct 2015, at 15:18, Jeremy Stanley wrote: >> >> On 2015-10-09 14:58:36 +0100 (+0100), Cory Benfield wrote: >> [...] >>> IMO, what OpenStack needs is a decision about where it’s getting >>> its packages from, and then to refuse to mix the

Re: [openstack-dev] Requests + urllib3 + distro packages

2015-10-09 Thread Cory Benfield
> On 9 Oct 2015, at 15:18, Jeremy Stanley wrote: > > On 2015-10-09 14:58:36 +0100 (+0100), Cory Benfield wrote: > [...] >> IMO, what OpenStack needs is a decision about where it’s getting >> its packages from, and then to refuse to mix the two. > > I have yet to find a Python-based operating sy

Re: [openstack-dev] Requests + urllib3 + distro packages

2015-10-09 Thread Joshua Harlow
stop vendoring it likely won't be made here anyway ;) From: c...@lukasa.co.uk Date: Fri, 9 Oct 2015 14:58:36 +0100 To: openstack-dev@lists.openstack.org Subject: Re: [openstack-dev] Requests + urllib3 + distro packages > On 9 Oct 2015, at 14:40, William M Edmonds wrote: > > Co

Re: [openstack-dev] Requests + urllib3 + distro packages

2015-10-09 Thread Jeremy Stanley
On 2015-10-09 14:58:36 +0100 (+0100), Cory Benfield wrote: [...] > IMO, what OpenStack needs is a decision about where it’s getting > its packages from, and then to refuse to mix the two. I have yet to find a Python-based operating system installable in whole via pip. There will always be _at_leas

Re: [openstack-dev] Requests + urllib3 + distro packages

2015-10-09 Thread Cory Benfield
> On 9 Oct 2015, at 14:40, William M Edmonds wrote: > > Cory Benfield writes: > > > The problem that occurs is the result of a few interacting things: > > > - requests has very very specific versions of urllib3 it works with. > > > So specific they aren't always released yet. > > > > This shou

Re: [openstack-dev] Requests + urllib3 + distro packages

2015-10-09 Thread William M Edmonds
Cory Benfield writes: > > The problem that occurs is the result of a few interacting things: > > - requests has very very specific versions of urllib3 it works with. > > So specific they aren't always released yet. > > This should no longer be true. Our downstream redistributors pointedout to us

Re: [openstack-dev] Requests + urllib3 + distro packages

2015-10-09 Thread William M Edmonds
Robert Collins writes: > - Linux vendors often unbundle urllib3 from requests and then apply > what patches were needed to their urllib3; while not updating their > requests package dependencies to reflect this. I opened a bug on Fedora for them to update their requests package dependencies. Se

Re: [openstack-dev] Requests + urllib3 + distro packages

2015-10-09 Thread Cory Benfield
Robert Collins writes: > The problem that occurs is the result of a few interacting things: > - requests has very very specific versions of urllib3 it works with. > So specific they aren't always released yet. This should no longer be true. Our downstream redistributors pointed out to us that th

Re: [openstack-dev] Requests + urllib3 + distro packages

2015-10-08 Thread Matt Riedemann
On 10/8/2015 7:57 PM, Monty Taylor wrote: On 10/08/2015 08:39 PM, Robert Collins wrote: This is a bugbear that keeps cropping up and biting us. I'm hoping we can figure out a permanent fix. The problem that occurs is the result of a few interacting things: - requests has very very specific

Re: [openstack-dev] Requests + urllib3 + distro packages

2015-10-08 Thread Monty Taylor
On 10/08/2015 08:39 PM, Robert Collins wrote: This is a bugbear that keeps cropping up and biting us. I'm hoping we can figure out a permanent fix. The problem that occurs is the result of a few interacting things: - requests has very very specific versions of urllib3 it works with. So specifi

[openstack-dev] Requests + urllib3 + distro packages

2015-10-08 Thread Robert Collins
This is a bugbear that keeps cropping up and biting us. I'm hoping we can figure out a permanent fix. The problem that occurs is the result of a few interacting things: - requests has very very specific versions of urllib3 it works with. So specific they aren't always released yet. - Linux vend