Re: [VOTE] Release PyLucene 8.8.1

[Bart Moelans]

+1



Op di 2 mrt. 2021 om 03:36 schreef Andi Vajda :

>
> The PyLucene 8.8.1 (rc1) release tracking the recent release of
> Apache Lucene 8.8.1 is ready.
>
> A release candidate is available from:
>
> https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Flucene%2Fpylucene%2F8.8.1-rc1%2Fdata=04%7C01%7CBart.Moelans%40uantwerpen.be%7C7d20509b8a6e448a8fa708d8dd23e610%7C792e08fb2d544a8eaf72202548136ef6%7C0%7C0%7C637502493998256967%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000sdata=0XG%2FQ1fg4hzh%2FQJN%2Fd2QqyRknUEf16VLprMdDWqTZEU%3Dreserved=0
>
> PyLucene 8.8.1 is built with JCC 3.9, included in these release artifacts.
>
> JCC 3.9 supports Python 3.3 up to Python 3.9 (in addition to Python 2.3+).
> PyLucene may be built with Python 2 or Python 3.
>
> Please vote to release these artifacts as PyLucene 8.8.1.
> Anyone interested in this release can and should vote !
>
> Thanks !
>
> Andi..
>
> ps: the KEYS file for PyLucene release signing is at:
>
> https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Frelease%2Flucene%2Fpylucene%2FKEYSdata=04%7C01%7CBart.Moelans%40uantwerpen.be%7C7d20509b8a6e448a8fa708d8dd23e610%7C792e08fb2d544a8eaf72202548136ef6%7C0%7C0%7C637502493998266970%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000sdata=vcPETqAC4GCK5Xc0DxuWRQybCKktzVOAYU60hv0zk9Y%3Dreserved=0
>
> https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Flucene%2Fpylucene%2FKEYSdata=04%7C01%7CBart.Moelans%40uantwerpen.be%7C7d20509b8a6e448a8fa708d8dd23e610%7C792e08fb2d544a8eaf72202548136ef6%7C0%7C0%7C637502493998266970%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000sdata=2avUfzAV4oywhIhG0AdlnvNOXiXr4b3COtBciHUHtIk%3Dreserved=0
>
> pps: here is my +1
>

Re: [VOTE] Release PyLucene 8.8.1

[Nelia Vb]

+1

> On 2 Mar 2021, at 08:21, Marc Jeurissen  wrote:
> 
> +1
>  
> Met vriendelijke groeten,
> Marc Jeurissen
> 
> 
> 
> Bibliotheek UAntwerpen
> Stadscampus – Ve35.303
> Venusstraat 35 – 2000 Antwerpen
> marc.jeuris...@uantwerpen.be 
> T +32 3 265 49 71
>  
>  
> From: Andi Vajda 
> Sent: dinsdag 2 maart 2021 3:37
> To: pylucene-dev@lucene.apache.org 
> Cc: gene...@lucene.apache.org 
> Subject: [VOTE] Release PyLucene 8.8.1
>  
>  
> The PyLucene 8.8.1 (rc1) release tracking the recent release of
> Apache Lucene 8.8.1 is ready.
>  
> A release candidate is available from:
> 
> https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Flucene%2Fpylucene%2F8.8.1-rc1%2Fdata=04%7C01%7Cmarc.jeurissen%40uantwerpen.be%7C20ba06c7ec0046c7863f08d8dd23e66b%7C792e08fb2d544a8eaf72202548136ef6%7C0%7C0%7C637502494126459957%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000sdata=e0w9pmUGU8PhWPkTV0gm%2B2eGKlLvIaV8wM6GlDyAy9U%3Dreserved=0
>  
> 
>  
> PyLucene 8.8.1 is built with JCC 3.9, included in these release artifacts.
>  
> JCC 3.9 supports Python 3.3 up to Python 3.9 (in addition to Python 2.3+).
> PyLucene may be built with Python 2 or Python 3.
>  
> Please vote to release these artifacts as PyLucene 8.8.1.
> Anyone interested in this release can and should vote !
>  
> Thanks !
>  
> Andi..
>  
> ps: the KEYS file for PyLucene release signing is at:
> https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Frelease%2Flucene%2Fpylucene%2FKEYSdata=04%7C01%7Cmarc.jeurissen%40uantwerpen.be%7C20ba06c7ec0046c7863f08d8dd23e66b%7C792e08fb2d544a8eaf72202548136ef6%7C0%7C0%7C637502494126459957%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000sdata=TlLv6eAZxXSlgR8wKB4ipsyVfhYj05tDPP9Q7C%2Fhi1Q%3Dreserved=0
>  
> 
> https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Flucene%2Fpylucene%2FKEYSdata=04%7C01%7Cmarc.jeurissen%40uantwerpen.be%7C20ba06c7ec0046c7863f08d8dd23e66b%7C792e08fb2d544a8eaf72202548136ef6%7C0%7C0%7C637502494126459957%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000sdata=A%2B9KMqQMl51zcC9xAcQv4LZ2uLfEgaCBHoep60TlHOk%3Dreserved=0
>  
> 
>  
> pps: here is my +1
>  

RE: [VOTE] Release PyLucene 8.8.1

[Marc Jeurissen]

+1

Met vriendelijke groeten,
Marc Jeurissen

Bibliotheek UAntwerpen
Stadscampus – Ve35.303
Venusstraat 35 – 2000 Antwerpen
marc.jeuris...@uantwerpen.be
T +32 3 265 49 71


From: Andi Vajda
Sent: dinsdag 2 maart 2021 3:37
To: pylucene-dev@lucene.apache.org
Cc: gene...@lucene.apache.org
Subject: [VOTE] Release PyLucene 8.8.1


The PyLucene 8.8.1 (rc1) release tracking the recent release of
Apache Lucene 8.8.1 is ready.

A release candidate is available from:

https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Flucene%2Fpylucene%2F8.8.1-rc1%2Fdata=04%7C01%7Cmarc.jeurissen%40uantwerpen.be%7C20ba06c7ec0046c7863f08d8dd23e66b%7C792e08fb2d544a8eaf72202548136ef6%7C0%7C0%7C637502494126459957%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000sdata=e0w9pmUGU8PhWPkTV0gm%2B2eGKlLvIaV8wM6GlDyAy9U%3Dreserved=0

PyLucene 8.8.1 is built with JCC 3.9, included in these release artifacts.

JCC 3.9 supports Python 3.3 up to Python 3.9 (in addition to Python 2.3+).
PyLucene may be built with Python 2 or Python 3.

Please vote to release these artifacts as PyLucene 8.8.1.
Anyone interested in this release can and should vote !

Thanks !

Andi..

ps: the KEYS file for PyLucene release signing is at:
https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Frelease%2Flucene%2Fpylucene%2FKEYSdata=04%7C01%7Cmarc.jeurissen%40uantwerpen.be%7C20ba06c7ec0046c7863f08d8dd23e66b%7C792e08fb2d544a8eaf72202548136ef6%7C0%7C0%7C637502494126459957%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000sdata=TlLv6eAZxXSlgR8wKB4ipsyVfhYj05tDPP9Q7C%2Fhi1Q%3Dreserved=0
https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Flucene%2Fpylucene%2FKEYSdata=04%7C01%7Cmarc.jeurissen%40uantwerpen.be%7C20ba06c7ec0046c7863f08d8dd23e66b%7C792e08fb2d544a8eaf72202548136ef6%7C0%7C0%7C637502494126459957%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000sdata=A%2B9KMqQMl51zcC9xAcQv4LZ2uLfEgaCBHoep60TlHOk%3Dreserved=0

pps: here is my +1

Re: [VOTE] Release PyLucene 8.8.1

[Jeff Breidenbach]

+1

On Mon, Mar 1, 2021, 6:35 PM Andi Vajda  wrote:

>
> The PyLucene 8.8.1 (rc1) release tracking the recent release of
> Apache Lucene 8.8.1 is ready.
>
> A release candidate is available from:
> https://dist.apache.org/repos/dist/dev/lucene/pylucene/8.8.1-rc1/
>
> PyLucene 8.8.1 is built with JCC 3.9, included in these release artifacts.
>
> JCC 3.9 supports Python 3.3 up to Python 3.9 (in addition to Python 2.3+).
> PyLucene may be built with Python 2 or Python 3.
>
> Please vote to release these artifacts as PyLucene 8.8.1.
> Anyone interested in this release can and should vote !
>
> Thanks !
>
> Andi..
>
> ps: the KEYS file for PyLucene release signing is at:
> https://dist.apache.org/repos/dist/release/lucene/pylucene/KEYS
> https://dist.apache.org/repos/dist/dev/lucene/pylucene/KEYS
>
> pps: here is my +1
>

[VOTE] Release PyLucene 8.8.1

[Andi Vajda]

The PyLucene 8.8.1 (rc1) release tracking the recent release of
Apache Lucene 8.8.1 is ready.

A release candidate is available from:
   https://dist.apache.org/repos/dist/dev/lucene/pylucene/8.8.1-rc1/

PyLucene 8.8.1 is built with JCC 3.9, included in these release artifacts.

JCC 3.9 supports Python 3.3 up to Python 3.9 (in addition to Python 2.3+).
PyLucene may be built with Python 2 or Python 3.

Please vote to release these artifacts as PyLucene 8.8.1.
Anyone interested in this release can and should vote !

Thanks !

Andi..

ps: the KEYS file for PyLucene release signing is at:
https://dist.apache.org/repos/dist/release/lucene/pylucene/KEYS
https://dist.apache.org/repos/dist/dev/lucene/pylucene/KEYS

pps: here is my +1

Re: jcc - Output unbuilt package

[Andi Vajda]

 Hi Phil,

On Mon, 1 Mar 2021, Phil wrote:


Great - I've attached a one-line change that outputs the missing info to
stdout.  I haven't added a command line switch at this stage as there is
no functional change to the output - just an extra line of logging.


Yes, a flag is not necessary for this change.


Note this is necessary because although the program already outputs the
setup args which are also required, the Extension class doesn't render
its args as text on printing the setup args, so I also need to output
the inputs to the Extension so that I can capture all the inputs to setup().

This would be hugely useful for me if we could even this simple change.


I incorporated your change and committed into rev 1887063.


I will look at automating the full generation of a source package, and
adding an optional switch to control this - but this is a larger undertaking,
so I'll have to add it to the to-do list.  I'll let you know when I have
had a chance to implement this.


Great, thank you !

Andi..

Re: jcc - Output unbuilt package

[Phil]

Hi Andi,

Great - I've attached a one-line change that outputs the missing info to
stdout.  I haven't added a command line switch at this stage as there is
no functional change to the output - just an extra line of logging.

Note this is necessary because although the program already outputs the
setup args which are also required, the Extension class doesn't render
its args as text on printing the setup args, so I also need to output
the inputs to the Extension so that I can capture all the inputs to setup().

This would be hugely useful for me if we could even this simple change.

I will look at automating the full generation of a source package, and
adding an optional switch to control this - but this is a larger undertaking,
so I'll have to add it to the to-do list.  I'll let you know when I have
had a chance to implement this.

Cheers,
Phil.




Index: python.py
===
--- python.py	(revision 1887057)
+++ python.py	(working copy)
@@ -1870,6 +1870,7 @@
 i += 1
 config_vars['CFLAGS'] = ' '.join(cflags)
 
+print("extension args = %s" % args)
 extensions = [Extension('.'.join([moduleName, extname]), **args)]
 script_args.extend(extra_setup_args)
 

Andi Vajda writes:

>  Hi Phil,
>
> Excellent !
>
> Yes, I'd accept a patch that makes your feature available via a new
> command line flag to JCC (don't forget to document it in __main__.py).
>
> It's ok to only send in a patch for the python3 version (under
> jcc3). The python2 version (under jcc2) is maintenance only, don't
> bother.
>
> Thanks !
>
> Andi..
>
> On Sun, 28 Feb 2021, Phil wrote:
>
>>
>> Thanks very much for the reply Andi.
>>
>> I've done a bit more digging and the short answer is you can't do what I
>> wanted with the current JCC. but, it turns out it was fairly
>> straightforward to tweak JCC to provide me with the all details I needed.
>>
>> I successfully made this work today with Guix with the project
>> that previously used JCC to build a wheel.
>>
>> Do you accept patches onto the subversion source trunk? - I could
>> prepare a very simple, optional extension to dump out the data I needed.
>> If I have time I also could write something which would fully automate
>> the entire process in the future.
>>
>> Some more details below.
>>
>> Andi Vajda writes:
>>
>>> I did not write the bdist nor the wheel support, they were contributed
>>> and I don't now that --wheel makes a binary wheel, specifically.
>>> Note that you have binaries in whatever you distribute, if you
>>> consider that the JAR files or the .class files are binaries. They are
>>> required (.class files are) for JCC to operate as it uses reflection
>>> to do its job.
>>
>> Yes the --wheel switch implies that the C++ build will be performed.
>>
>> I agree the JAR/.class files will always be binaries, but it is
>> possible to distribute a package which contains only the JARs as
>> binaries, along with python API and unbuilt C/C++, with a setup.py,
>> describing the build process.
>>
>> This delays the calling of setuptools, and thus the building the C++ to
>> package install time rather than wheel creation time - and allows us to
>> create a regular setup.py file.
>>
>>>
>>> If you don't invoke JCC with --wheel, --bdist, --build or --compile,
>>> you get just source files (not countng .jar).
>>
>> Almost - you get the C++, but no setup.py or python wrapper generated.
>> At least this was the case for me.
>>
>> However, if you build the wheel the build directories do contain
>> everything you need apart from the setup.py - you just need to lift the
>> right files out and put them into the right directory structure.
>>
>> To create a setup.py you need both the setup and extension arguments
>> generated by JCC.  Normally these are fed straight into setuptools by
>> JCC, but we can leak them out instead.
>>
>> JCC already ouputs the setup arguments to stdout, so the only change I
>> had to do to the source was to also output the extension args
>> dictionary to stdout too, towards the end of:
>> https://svn.apache.org/repos/asf/lucene/pylucene/trunk/jcc/jcc3/python.py
>>
>> extensions = [Extension('.'.join([moduleName, extname]), **args)]
>>
>> print("extensions args = %s" % args) # I added this
>>
>>
>> Then at the bottom the setuptools args are already output to stdout:
>>
>> print("setup args = %s" % args)
>>
>> setup(**args)
>>
>>
>> My setup.py then contains a call to setuptools.setup() providing same
>> **args structure generated by the script (I'd link it here to demonstrate 
>> this,
>> but the repo is behind the a firewall, alas).
>>
>> This plus a tiny bit of tweaking and boilerplate gives me exactly what I 
>> want.
>>
>>
>>> Maybe what you actually want is to implement 'sdist' support for JCC ?
>>> (again, not familiar with wheels, so I may not be making sense here).
>>
>> I thought this too - but I couldn't get it to work.
>>
>> I tried passing '--extra-setup-arg sdist' 

Re: jcc - Output unbuilt package

[Andi Vajda]

 Hi Phil,

Excellent !

Yes, I'd accept a patch that makes your feature available via a new command 
line flag to JCC (don't forget to document it in __main__.py).


It's ok to only send in a patch for the python3 version (under jcc3). The 
python2 version (under jcc2) is maintenance only, don't bother.


Thanks !

Andi..

On Sun, 28 Feb 2021, Phil wrote:



Thanks very much for the reply Andi.

I've done a bit more digging and the short answer is you can't do what I
wanted with the current JCC. but, it turns out it was fairly
straightforward to tweak JCC to provide me with the all details I needed.

I successfully made this work today with Guix with the project
that previously used JCC to build a wheel.

Do you accept patches onto the subversion source trunk? - I could
prepare a very simple, optional extension to dump out the data I needed.
If I have time I also could write something which would fully automate
the entire process in the future.

Some more details below.

Andi Vajda writes:


I did not write the bdist nor the wheel support, they were contributed
and I don't now that --wheel makes a binary wheel, specifically.
Note that you have binaries in whatever you distribute, if you
consider that the JAR files or the .class files are binaries. They are
required (.class files are) for JCC to operate as it uses reflection
to do its job.


Yes the --wheel switch implies that the C++ build will be performed.

I agree the JAR/.class files will always be binaries, but it is
possible to distribute a package which contains only the JARs as
binaries, along with python API and unbuilt C/C++, with a setup.py,
describing the build process.

This delays the calling of setuptools, and thus the building the C++ to
package install time rather than wheel creation time - and allows us to
create a regular setup.py file.



If you don't invoke JCC with --wheel, --bdist, --build or --compile,
you get just source files (not countng .jar).


Almost - you get the C++, but no setup.py or python wrapper generated.
At least this was the case for me.

However, if you build the wheel the build directories do contain
everything you need apart from the setup.py - you just need to lift the
right files out and put them into the right directory structure.

To create a setup.py you need both the setup and extension arguments
generated by JCC.  Normally these are fed straight into setuptools by
JCC, but we can leak them out instead.

JCC already ouputs the setup arguments to stdout, so the only change I
had to do to the source was to also output the extension args
dictionary to stdout too, towards the end of:
https://svn.apache.org/repos/asf/lucene/pylucene/trunk/jcc/jcc3/python.py

extensions = [Extension('.'.join([moduleName, extname]), **args)]

print("extensions args = %s" % args) # I added this


Then at the bottom the setuptools args are already output to stdout:

print("setup args = %s" % args)

setup(**args)


My setup.py then contains a call to setuptools.setup() providing same
**args structure generated by the script (I'd link it here to demonstrate this,
but the repo is behind the a firewall, alas).

This plus a tiny bit of tweaking and boilerplate gives me exactly what I want.



Maybe what you actually want is to implement 'sdist' support for JCC ?
(again, not familiar with wheels, so I may not be making sense here).


I thought this too - but I couldn't get it to work.

I tried passing '--extra-setup-arg sdist' into JCC, but this got the
same result as not passing --build or --wheel as discussed above.  Only
C++ is generated.


As long as GUIX knows how to drive a C++ compiler and linker, build
python extensions (and knows how to build the libjcc shared library),
you should be fine.


Yep this all works perfectly in Guix once we have a regular python repo
containing the source with the setup.py as described.

The only downside is the whole thing is rather manual now - I'd like to
tweak JCC to make this more streamlined - let me know if a patch
interests you?