Re: [Distutils] pythonhosted.org doc upload no longer works

2017-09-07 Thread Wes Turner 
Here's an http-equiv REFRESH index.html:

https://github.com/westurner/resume/blob/master/index.html

Is there a
Sphinx extension to generate redirect pages?

On Thursday, September 7, 2017, Giampaolo Rodola' 
wrote:

> Whops! I meant: http://pythonhosted.org/pyftpdlib/
>
> On Thu, Sep 7, 2017 at 5:28 PM, Giampaolo Rodola'  > wrote:
>
>> ...and also http://pyftpdlib.readthedocs.io/
>>  if possible; thanks a lot!
>>
>> On Thu, Sep 7, 2017 at 4:10 PM, Giampaolo Rodola' > > wrote:
>>
>>> OK I updated the new doc at http://psutil.readthedocs.io/
>>> Is it possible to redirect the old doc here?
>>>
>>> On Tue, Sep 5, 2017 at 3:31 PM, Giampaolo Rodola' >> > wrote:
>>>
 A bare redirect would also be fine. It's a shame setup.py classifiers /
 metadata does not have a "documentation" field otherwise
 pythonhosted.org/{project_name}
  could have automatically
 redirected to the project doc.
 Perhaps https://pypi.python.org/pypi?:action=pkg_edit&name={
 project_name} could provide a form where this can be specified.
 What do you think?

 On Tue, Sep 5, 2017 at 12:49 PM, Noah Kantrowitz >>> > wrote:

> This was discussed several years ago in https://mail.python.org/piperm
> ail/distutils-sig/2015-May/026381.html and a few other threads. The
> final phases went out earlier this year. I don't think there is any plan 
> to
> re-enable uploads to pythonhosted at this time. If you want a one-off
> redirect change or just having the old files removed, we can probably do
> that though, but I very much defer to Donald and others on that :)
>
> --Noah
>
> > On Sep 4, 2017, at 9:43 PM, Giampaolo Rodola'  > wrote:
> >
> > I think it's wise to revert that commit. It seems pythonhosted only
> suggested to migrate to RTD but there never was an official shutdown date
> or warning (either via direct email or message on the web page).
> >
> > On Tue, Sep 5, 2017 at 12:19 PM, Berker Peksağ <
> berker.pek...@gmail.com
> > wrote:
> > On Mon, Sep 4, 2017 at 4:56 PM, Nick Coghlan  > wrote:
> > > On 2 September 2017 at 15:34, Giampaolo Rodola' <
> g.rod...@gmail.com
> > wrote:
> > >> I know it was deprecated long ago in favor of readthedocs but I
> kept
> > >> postponing it and my doc is still hosted on
> > >> https://pythonhosted.org/psutil/.
> > >
> > > While we've talked about deprecating it, it *hasn't* been
> deprecated.
> > > Looking at https://github.com/pypa/pypi-legacy/commits/production,
> I'm
> > > not seeing anything obvious that would have caused problems with
> docs
> > > management, but that's probably still the best issue tracker to
> use to
> > > report the bug.
> >
> > See the 'doc_upload' handler at
> > https://github.com/pypa/pypi-legacy/commit/1598e6ea0f7fb0393
> 891f6c6bcbf84c191834a0e#diff-19fadc30e1b17100568adbd8c6c3cc13R2804
> > I've collected all information I found at
> > https://github.com/pypa/pypi-legacy/issues/672#issuecomment-
> 316125918
> > Please correct me if I missed anything.
> >
> > --Berker
> > ___
> > Distutils-SIG maillist  -  Distutils-SIG@python.org
> 
> > https://mail.python.org/mailman/listinfo/distutils-sig
> >
> >
> >
> > --
> > Giampaolo - http://grodola.blogspot.com
> >
> > ___
> > Distutils-SIG maillist  -  Distutils-SIG@python.org
> 
> > https://mail.python.org/mailman/listinfo/distutils-sig
>
> ___
> Distutils-SIG maillist  -  Distutils-SIG@python.org
> 
> https://mail.python.org/mailman/listinfo/distutils-sig
>



 --
 Giampaolo - http://grodola.blogspot.com


>>>
>>>
>>> --
>>> Giampaolo - http://grodola.blogspot.com
>>>
>>>
>>
>>
>> --
>> Giampaolo - http://grodola.blogspot.com
>>
>>
>
>
> --
> Giampaolo - http://grodola.blogspot.com
>
>
___
Distutils-SIG maillist  -  Distutils-SIG@python.org
https://mail.python.org/mailman/listinfo/distutils-sig

Re: [Distutils] supporting editable installs by PEP-517/518 by shim wheels - proposing a common implementation

2017-09-07 Thread Nick Coghlan 
On 7 September 2017 at 09:17, RonnyPfannschmidt
 wrote:
> for c extension im not quite sure, is python finally able to load them
> from folders belonging to a package?

As far as I'm aware, it's always been able to do this. Is there a
particular bug you're thinking of where it couldn't? (You can't
currently have *builtin* package hierarchies, but extension modules as
submodules is fine).

Cheers,
Nick.

-- 
Nick Coghlan   |   ncogh...@gmail.com   |   Brisbane, Australia
___
Distutils-SIG maillist  -  Distutils-SIG@python.org
https://mail.python.org/mailman/listinfo/distutils-sig

Re: [Distutils] supporting editable installs by PEP-517/518 by shim wheels - proposing a common implementation

2017-09-07 Thread Nick Coghlan 
On 7 September 2017 at 08:43, Paul Moore  wrote:
> So pip install -e ., instead of installing a .pth file which included
> the current directory on sys.path, would install a set of .py files
> which loaded the actual code from the current directory? That sounds
> like a plausible approach, and it would certainly stop editable
> installs being quite as much of a special case as they currently are.

It sounds like a recipe for obscure bugs to me, since there's no
standard mechanism for one Python file to transparently pretend to be
a different one (other than symlinking them).

By contrast, manipulating sys.path to include additional directories
is entirely normal - it can just have surprising name shadowing
effects if the directory has other files and directories in it (this
is one reason for the popularity of "src/" directories that *only*
include the "for import" files).

So for systems with reliable user level symlink support, the most
robust approach will be along the lines of:

1. Generate an "_install/" directory
2. Generate proper wheel metadata inside that directory
3. Symlink from that directory to any Python source files, package
directories and built extension modules based on the manifest in a
fully built wheel file
4. Install a *.pth file into the virtual environment that adds the
generated directory to sys.path (and refuse to run if no virtualenv is
active)

Doing things this way means that hot reloading in things like web
frameworks will still work properly, but you also won't inadvertently
be able to import random other files that happen to be lying around in
the source directory

Unfortunately, that approach *doesn't* work reliably on Windows, since
the symlinks in step 3 can't be generated with ordinary user
permissions. Instead, the installed *.pth needs to reference the given
source directory directly, which means you won't have the freedom to
rearrange things to match the layout in the wheel manifest.

Cheers,
Nick.

-- 
Nick Coghlan   |   ncogh...@gmail.com   |   Brisbane, Australia
___
Distutils-SIG maillist  -  Distutils-SIG@python.org
https://mail.python.org/mailman/listinfo/distutils-sig

Re: [Distutils] supporting editable installs by PEP-517/518 by shim wheels - proposing a common implementation

2017-09-07 Thread RonnyPfannschmidt 


Am 07.09.2017 um 17:43 schrieb Paul Moore:
> On 7 September 2017 at 14:26, RonnyPfannschmidt
>  wrote:
>> Hi Everyone,
>>
>> i'd like to propose a common tooling for installing packages in editable
>> mode
>> which is based on generating an actual wheel, which includes shim files
>> for the python packages
>> allows to sanely instal/uninstall editable packages
> 
> So pip install -e ., instead of installing a .pth file which included
> the current directory on sys.path, would install a set of .py files
> which loaded the actual code from the current directory? That sounds
> like a plausible approach, and it would certainly stop editable
> installs being quite as much of a special case as they currently are.
> One thought - how would you handle C extensions?
> 

for c extension im not quite sure, is python finally able to load them
from folders belonging to a package?

else something far more painful might be necessary

but since c extensions need a rebuild anyway, it may be reasonably
inexpensive to just put them into the wheel in the other case

but id strongly prefer just having them inside of the package discovered
via __path__

-- Ronny

> In principle, though, this sounds like a good idea.
> 
> Paul
> 
___
Distutils-SIG maillist  -  Distutils-SIG@python.org
https://mail.python.org/mailman/listinfo/distutils-sig

Re: [Distutils] supporting editable installs by PEP-517/518 by shim wheels - proposing a common implementation

2017-09-07 Thread Paul Moore 
On 7 September 2017 at 14:26, RonnyPfannschmidt
 wrote:
> Hi Everyone,
>
> i'd like to propose a common tooling for installing packages in editable
> mode
> which is based on generating an actual wheel, which includes shim files
> for the python packages
> allows to sanely instal/uninstall editable packages

So pip install -e ., instead of installing a .pth file which included
the current directory on sys.path, would install a set of .py files
which loaded the actual code from the current directory? That sounds
like a plausible approach, and it would certainly stop editable
installs being quite as much of a special case as they currently are.
One thought - how would you handle C extensions?

In principle, though, this sounds like a good idea.

Paul
___
Distutils-SIG maillist  -  Distutils-SIG@python.org
https://mail.python.org/mailman/listinfo/distutils-sig

[Distutils] supporting editable installs by PEP-517/518 by shim wheels - proposing a common implementation

2017-09-07 Thread RonnyPfannschmidt 
Hi Everyone,

i'd like to propose a common tooling for installing packages in editable
mode
which is based on generating an actual wheel, which includes shim files
for the python packages
allows to sanely instal/uninstall editable packages

a while back i implemented a prototype in gumby-elf which serves as my
example.
i'd like to start a discussion on this, and hopefully ensure that tools
like flit and setuptools adapt a similar mechanism, ideally sharing a
implementation

once this discussion is finished i'd also like to implement it for
setuptools

-- Ronny

___
Distutils-SIG maillist  -  Distutils-SIG@python.org
https://mail.python.org/mailman/listinfo/distutils-sig

Re: [Distutils] pythonhosted.org doc upload no longer works

2017-09-07 Thread Giampaolo Rodola' 
Whops! I meant: http://pythonhosted.org/pyftpdlib/

On Thu, Sep 7, 2017 at 5:28 PM, Giampaolo Rodola' 
wrote:

> ...and also http://pyftpdlib.readthedocs.io/
>  if possible; thanks a lot!
>
> On Thu, Sep 7, 2017 at 4:10 PM, Giampaolo Rodola' 
> wrote:
>
>> OK I updated the new doc at http://psutil.readthedocs.io/
>> Is it possible to redirect the old doc here?
>>
>> On Tue, Sep 5, 2017 at 3:31 PM, Giampaolo Rodola' 
>> wrote:
>>
>>> A bare redirect would also be fine. It's a shame setup.py classifiers /
>>> metadata does not have a "documentation" field otherwise
>>> pythonhosted.org/{project_name}
>>>  could have automatically
>>> redirected to the project doc.
>>> Perhaps https://pypi.python.org/pypi?:action=pkg_edit&name={
>>> project_name} could provide a form where this can be specified.
>>> What do you think?
>>>
>>> On Tue, Sep 5, 2017 at 12:49 PM, Noah Kantrowitz 
>>> wrote:
>>>
 This was discussed several years ago in https://mail.python.org/piperm
 ail/distutils-sig/2015-May/026381.html and a few other threads. The
 final phases went out earlier this year. I don't think there is any plan to
 re-enable uploads to pythonhosted at this time. If you want a one-off
 redirect change or just having the old files removed, we can probably do
 that though, but I very much defer to Donald and others on that :)

 --Noah

 > On Sep 4, 2017, at 9:43 PM, Giampaolo Rodola' 
 wrote:
 >
 > I think it's wise to revert that commit. It seems pythonhosted only
 suggested to migrate to RTD but there never was an official shutdown date
 or warning (either via direct email or message on the web page).
 >
 > On Tue, Sep 5, 2017 at 12:19 PM, Berker Peksağ <
 berker.pek...@gmail.com> wrote:
 > On Mon, Sep 4, 2017 at 4:56 PM, Nick Coghlan 
 wrote:
 > > On 2 September 2017 at 15:34, Giampaolo Rodola' 
 wrote:
 > >> I know it was deprecated long ago in favor of readthedocs but I
 kept
 > >> postponing it and my doc is still hosted on
 > >> https://pythonhosted.org/psutil/.
 > >
 > > While we've talked about deprecating it, it *hasn't* been
 deprecated.
 > > Looking at https://github.com/pypa/pypi-legacy/commits/production,
 I'm
 > > not seeing anything obvious that would have caused problems with
 docs
 > > management, but that's probably still the best issue tracker to use
 to
 > > report the bug.
 >
 > See the 'doc_upload' handler at
 > https://github.com/pypa/pypi-legacy/commit/1598e6ea0f7fb0393
 891f6c6bcbf84c191834a0e#diff-19fadc30e1b17100568adbd8c6c3cc13R2804
 > I've collected all information I found at
 > https://github.com/pypa/pypi-legacy/issues/672#issuecomment-316125918
 > Please correct me if I missed anything.
 >
 > --Berker
 > ___
 > Distutils-SIG maillist  -  Distutils-SIG@python.org
 > https://mail.python.org/mailman/listinfo/distutils-sig
 >
 >
 >
 > --
 > Giampaolo - http://grodola.blogspot.com
 >
 > ___
 > Distutils-SIG maillist  -  Distutils-SIG@python.org
 > https://mail.python.org/mailman/listinfo/distutils-sig

 ___
 Distutils-SIG maillist  -  Distutils-SIG@python.org
 https://mail.python.org/mailman/listinfo/distutils-sig

>>>
>>>
>>>
>>> --
>>> Giampaolo - http://grodola.blogspot.com
>>>
>>>
>>
>>
>> --
>> Giampaolo - http://grodola.blogspot.com
>>
>>
>
>
> --
> Giampaolo - http://grodola.blogspot.com
>
>


-- 
Giampaolo - http://grodola.blogspot.com
___
Distutils-SIG maillist  -  Distutils-SIG@python.org
https://mail.python.org/mailman/listinfo/distutils-sig

Re: [Distutils] pythonhosted.org doc upload no longer works

2017-09-07 Thread Giampaolo Rodola' 
...and also http://pyftpdlib.readthedocs.io/  if
possible; thanks a lot!

On Thu, Sep 7, 2017 at 4:10 PM, Giampaolo Rodola' 
wrote:

> OK I updated the new doc at http://psutil.readthedocs.io/
> Is it possible to redirect the old doc here?
>
> On Tue, Sep 5, 2017 at 3:31 PM, Giampaolo Rodola' 
> wrote:
>
>> A bare redirect would also be fine. It's a shame setup.py classifiers /
>> metadata does not have a "documentation" field otherwise
>> pythonhosted.org/{project_name}
>>  could have automatically
>> redirected to the project doc.
>> Perhaps https://pypi.python.org/pypi?:action=pkg_edit&name={project_name}
>> could provide a form where this can be specified.
>> What do you think?
>>
>> On Tue, Sep 5, 2017 at 12:49 PM, Noah Kantrowitz 
>> wrote:
>>
>>> This was discussed several years ago in https://mail.python.org/piperm
>>> ail/distutils-sig/2015-May/026381.html and a few other threads. The
>>> final phases went out earlier this year. I don't think there is any plan to
>>> re-enable uploads to pythonhosted at this time. If you want a one-off
>>> redirect change or just having the old files removed, we can probably do
>>> that though, but I very much defer to Donald and others on that :)
>>>
>>> --Noah
>>>
>>> > On Sep 4, 2017, at 9:43 PM, Giampaolo Rodola' 
>>> wrote:
>>> >
>>> > I think it's wise to revert that commit. It seems pythonhosted only
>>> suggested to migrate to RTD but there never was an official shutdown date
>>> or warning (either via direct email or message on the web page).
>>> >
>>> > On Tue, Sep 5, 2017 at 12:19 PM, Berker Peksağ <
>>> berker.pek...@gmail.com> wrote:
>>> > On Mon, Sep 4, 2017 at 4:56 PM, Nick Coghlan 
>>> wrote:
>>> > > On 2 September 2017 at 15:34, Giampaolo Rodola' 
>>> wrote:
>>> > >> I know it was deprecated long ago in favor of readthedocs but I kept
>>> > >> postponing it and my doc is still hosted on
>>> > >> https://pythonhosted.org/psutil/.
>>> > >
>>> > > While we've talked about deprecating it, it *hasn't* been deprecated.
>>> > > Looking at https://github.com/pypa/pypi-legacy/commits/production,
>>> I'm
>>> > > not seeing anything obvious that would have caused problems with docs
>>> > > management, but that's probably still the best issue tracker to use
>>> to
>>> > > report the bug.
>>> >
>>> > See the 'doc_upload' handler at
>>> > https://github.com/pypa/pypi-legacy/commit/1598e6ea0f7fb0393
>>> 891f6c6bcbf84c191834a0e#diff-19fadc30e1b17100568adbd8c6c3cc13R2804
>>> > I've collected all information I found at
>>> > https://github.com/pypa/pypi-legacy/issues/672#issuecomment-316125918
>>> > Please correct me if I missed anything.
>>> >
>>> > --Berker
>>> > ___
>>> > Distutils-SIG maillist  -  Distutils-SIG@python.org
>>> > https://mail.python.org/mailman/listinfo/distutils-sig
>>> >
>>> >
>>> >
>>> > --
>>> > Giampaolo - http://grodola.blogspot.com
>>> >
>>> > ___
>>> > Distutils-SIG maillist  -  Distutils-SIG@python.org
>>> > https://mail.python.org/mailman/listinfo/distutils-sig
>>>
>>> ___
>>> Distutils-SIG maillist  -  Distutils-SIG@python.org
>>> https://mail.python.org/mailman/listinfo/distutils-sig
>>>
>>
>>
>>
>> --
>> Giampaolo - http://grodola.blogspot.com
>>
>>
>
>
> --
> Giampaolo - http://grodola.blogspot.com
>
>


-- 
Giampaolo - http://grodola.blogspot.com
___
Distutils-SIG maillist  -  Distutils-SIG@python.org
https://mail.python.org/mailman/listinfo/distutils-sig

Re: [Distutils] pythonhosted.org doc upload no longer works

2017-09-07 Thread Giampaolo Rodola' 
OK I updated the new doc at http://psutil.readthedocs.io/
Is it possible to redirect the old doc here?

On Tue, Sep 5, 2017 at 3:31 PM, Giampaolo Rodola' 
wrote:

> A bare redirect would also be fine. It's a shame setup.py classifiers /
> metadata does not have a "documentation" field otherwise
> pythonhosted.org/{project_name}
>  could have automatically
> redirected to the project doc.
> Perhaps https://pypi.python.org/pypi?:action=pkg_edit&name={project_name}
> could provide a form where this can be specified.
> What do you think?
>
> On Tue, Sep 5, 2017 at 12:49 PM, Noah Kantrowitz 
> wrote:
>
>> This was discussed several years ago in https://mail.python.org/piperm
>> ail/distutils-sig/2015-May/026381.html and a few other threads. The
>> final phases went out earlier this year. I don't think there is any plan to
>> re-enable uploads to pythonhosted at this time. If you want a one-off
>> redirect change or just having the old files removed, we can probably do
>> that though, but I very much defer to Donald and others on that :)
>>
>> --Noah
>>
>> > On Sep 4, 2017, at 9:43 PM, Giampaolo Rodola' 
>> wrote:
>> >
>> > I think it's wise to revert that commit. It seems pythonhosted only
>> suggested to migrate to RTD but there never was an official shutdown date
>> or warning (either via direct email or message on the web page).
>> >
>> > On Tue, Sep 5, 2017 at 12:19 PM, Berker Peksağ 
>> wrote:
>> > On Mon, Sep 4, 2017 at 4:56 PM, Nick Coghlan 
>> wrote:
>> > > On 2 September 2017 at 15:34, Giampaolo Rodola' 
>> wrote:
>> > >> I know it was deprecated long ago in favor of readthedocs but I kept
>> > >> postponing it and my doc is still hosted on
>> > >> https://pythonhosted.org/psutil/.
>> > >
>> > > While we've talked about deprecating it, it *hasn't* been deprecated.
>> > > Looking at https://github.com/pypa/pypi-legacy/commits/production,
>> I'm
>> > > not seeing anything obvious that would have caused problems with docs
>> > > management, but that's probably still the best issue tracker to use to
>> > > report the bug.
>> >
>> > See the 'doc_upload' handler at
>> > https://github.com/pypa/pypi-legacy/commit/1598e6ea0f7fb0393
>> 891f6c6bcbf84c191834a0e#diff-19fadc30e1b17100568adbd8c6c3cc13R2804
>> > I've collected all information I found at
>> > https://github.com/pypa/pypi-legacy/issues/672#issuecomment-316125918
>> > Please correct me if I missed anything.
>> >
>> > --Berker
>> > ___
>> > Distutils-SIG maillist  -  Distutils-SIG@python.org
>> > https://mail.python.org/mailman/listinfo/distutils-sig
>> >
>> >
>> >
>> > --
>> > Giampaolo - http://grodola.blogspot.com
>> >
>> > ___
>> > Distutils-SIG maillist  -  Distutils-SIG@python.org
>> > https://mail.python.org/mailman/listinfo/distutils-sig
>>
>> ___
>> Distutils-SIG maillist  -  Distutils-SIG@python.org
>> https://mail.python.org/mailman/listinfo/distutils-sig
>>
>
>
>
> --
> Giampaolo - http://grodola.blogspot.com
>
>


-- 
Giampaolo - http://grodola.blogspot.com
___
Distutils-SIG maillist  -  Distutils-SIG@python.org
https://mail.python.org/mailman/listinfo/distutils-sig