[Twisted-Python] Weekly Bug Summary

[trac]

Bug summary
__
Summary for 2021-03-07 through 2021-03-14
  Opened Closed  Total Change
Enhancements:  7  2   1479 +5
Defects:   6  2   1009 +4
Tasks: 0  0 94 +0
Regressions:   0  0  0 +0
Total:13  4   2584 +9

|== Type Changes   |== Priority Changes   |== Component Changes   
|Defect:   +4  |High:+1   |Core:  +6  
|Enhancement:  +5  |Normal:  +8   |Logger:+0  
  |Pydoctor:  -1  
  |Web:   +2  
  |Website:   +2  



Total Tickets
Open Tickets



New / Reopened Bugs
__
= High =
[#10125] flattening a lot of fired Deferreds causes a RecursionError (opened by pwestlak-xilinx)
defect  webhttp://twistedmatrix.com/trac/ticket/10125

= Normal =
[#10117] Migrate documentation to Read The Docs (opened by adiroiban)
enhancement core   http://twistedmatrix.com/trac/ticket/10117

[#10118] 21.2.0: test suite is failing (opened by kloczek)
defect  core   http://twistedmatrix.com/trac/ticket/10118

[#10119] t.l.Logger reports wrong return type for __get__ (opened by jchristgit) (CLOSED, fixed)
defect  logger http://twistedmatrix.com/trac/ticket/10119

[#10120] Increase awarness of the standard commit message (opened by adiroiban)
enhancement core   http://twistedmatrix.com/trac/ticket/10120

[#10121] Disable pypy coverage run in a bid to stop the random failures (opened by adiroiban)
enhancement core   http://twistedmatrix.com/trac/ticket/10121

[#10122] Remove TODO tests introduced with successResultOf and failureResultOf  coroutine support (opened by adiroiban) (CLOSED, fixed)
enhancement core   http://twistedmatrix.com/trac/ticket/10122

[#10123] Enable parallel job execution for Twisted tests. (opened by adiroiban)
enhancement core   http://twistedmatrix.com/trac/ticket/10123

[#10124] blockingCallFromThread hangs during reactor shutdown. (opened by cjw296)
defect  core   http://twistedmatrix.com/trac/ticket/10124

[#10126] HTTPParser: Do not keep connection headers out of responses (opened by Gallaecio)
enhancement webhttp://twistedmatrix.com/trac/ticket/10126

[#10127] Contributor documentation: black-reformat → lint (opened by Gallaecio)
defect  websitehttp://twistedmatrix.com/trac/ticket/10127

[#10128] Contributor documentation: bin/trial twisted does not work (opened by Gallaecio)
defect  websitehttp://twistedmatrix.com/trac/ticket/10128

[#10129] Report Python info both in and out of the tox env in GitHub Actions (opened by altendky)
enhancement core   http://twistedmatrix.com/trac/ticket/10129



Closed Bugs
__
= Normal =
[#10105] Sync templates with pydoctor 21.2.2 release (opened by mthuurne, closed by Maarten ter Huurne , fixed)
defect  pydoctor   http://twistedmatrix.com/trac/ticket/10105

[#10119] t.l.Logger reports wrong return type for __get__ (opened by jchristgit, closed by wsanchez, fixed)
defect  logger http://twistedmatrix.com/trac/ticket/10119

[#10109] Enable nodeps tests to CI matrix (opened by adiroiban, closed by Adi Roiban , fixed)
enhancement core   http://twistedmatrix.com/trac/ticket/10109

[#10122] Remove TODO tests introduced with successResultOf and failureResultOf  coroutine support (opened by adiroiban, closed by Adi Roiban , fixed)
enhancement core   http://twistedmatrix.com/trac/ticket/10122



Ticket Lifetime Stats
__
Oldest open ticket - [#50] conch command-line client doesn't work in win32 (since 2003-07-12 14:41:06).
Newest open ticket - [#10129] Report Python info both in and out of the tox env in GitHub Actions (since 2021-03-13 17:42:06.288010).

Mean open ticket age: 3018 days, 17:29:23.894532.
Median: 2975 days, 8:08:41.804237.
Standard deviation: 1512 days, 13:02:47.165711.
Interquartile range: 2215 days, 10:39:23.819706.

Mean time between ticket creation and ticket resolution: 616 days, 4:12:47.310788.
Median: 57 days, 21:19:02.
Standard deviation is 1023 days, 8:54:53.580407.
The interquartile range is 809 days, 9:09:44.822129.

Mean time spent in review: 101 days, 18:45:28.839176.
Median: 4 days, 19:19:01.
Standard deviation: 486 days, 21:42:12.106990.
Interquartile range: 23 days, 20:13:05.266486.

Mean number of times a ticket is reviewed: 1.78459821429.
Median: 1
Standard deviation: 1.40750041842.
Interquartile range: 1.


Contributor Stats
__
In the last 4 

Re: [Twisted-Python] Strange recursion error with twisted.web

[Glyph]

> On Mar 11, 2021, at 4:12 AM, Peter Westlake  wrote:
> 
> On Wed, 10 Mar 2021, at 23:11, Glyph wrote:
>> 
>> Would you mind filing a ticket in trac, or digging one up if you can 
>> find it? This problem rings a bell, and I think I might actually have 
>> some code for this lying around somewhere already.
> 
> Here is it: https://twistedmatrix.com/trac/ticket/10125#ticket
> 
> thanks,
> 
> Peter.

I did indeed have a half-finished experiment to fix this.  The fix is now 
finished and in review here: 
https://twistedmatrix.com/trac/ticket/10125#comment:1 
 .

If you could review it thoroughly enough, I could land it.

-g___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
https://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] Probot app to automatically delete merged branches

[Kyle Altendorf]

On 2021-03-13 10:40, Adi Roiban wrote:

> On Sat, 13 Mar 2021 at 14:29, Kyle Altendorf  wrote: 
> 
> On 2021-03-13 08:22, Adi Roiban wrote: 
> 
> Hi, 
> Do you see anything bad in enabling the delete-merged-branch app for 
> twisted/twisted ? 
> https://probot.github.io/apps/delete-merged-branch/ 
> 
> There's a checkbox for this.  Unless I'm missing something? 
> https://docs.github.com/en/github/administering-a-repository/managing-the-automatic-deletion-of-branches

Great. Thank for the info. 

So, new question: Should we enable the automatic deletion for
twisted/twisted? 

I suppose I could have responded to the underlying question as well... 
I do have deletion enabled in my repos.  I don't really like that you
lose the references in git though.  As long as you stick with GitHub you
do have the PR's as a record and from them you can recover the
associated branch. 

I do it but don't super care.  Hopefully someone else does. 

Cheers, 
-kyle___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
https://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] Probot app to automatically delete merged branches

[Adi Roiban]

On Sat, 13 Mar 2021 at 14:29, Kyle Altendorf  wrote:

>
> On 2021-03-13 08:22, Adi Roiban wrote:
>
> Hi,
>
> Do you see anything bad in enabling the delete-merged-branch app for
> twisted/twisted ?
>
> https://probot.github.io/apps/delete-merged-branch/
>
>
>
> There's a checkbox for this.  Unless I'm missing something?
>
>
> https://docs.github.com/en/github/administering-a-repository/managing-the-automatic-deletion-of-branches
>
>

Great. Thank for the info.

So, new question: Should we enable the automatic deletion for
twisted/twisted?

Regards


-- 
Adi Roiban
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
https://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] Probot app to automatically delete merged branches

[Kyle Altendorf]

On 2021-03-13 08:22, Adi Roiban wrote:

> Hi, 
> 
> Do you see anything bad in enabling the delete-merged-branch app for 
> twisted/twisted ? 
> 
> https://probot.github.io/apps/delete-merged-branch/

There's a checkbox for this.  Unless I'm missing something? 

https://docs.github.com/en/github/administering-a-repository/managing-the-automatic-deletion-of-branches


Cheers, 
-kyle___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
https://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Probot app to automatically delete merged branches

[Adi Roiban]

Hi,

Do you see anything bad in enabling the delete-merged-branch app for
twisted/twisted ?

https://probot.github.io/apps/delete-merged-branch/

Right now Twisted has 1877 branches.

My hope is that in this way we can keep the main repo clean and there will
be less noise in autocompletion.

Now, this will only handle future branches/merges ...but at least is a
start.

We can see later what to do with existing branches.

Cheers
-- 
Adi Roiban
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
https://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] reactor for Linux io_uring

[Tobias Oberstein]

Am 13.03.21 um 01:01 schrieb Ian Haywood:

On 12/03/2021 8:29 pm, Tobias Oberstein wrote:
since with io_uring the queue/ring to append to never blocks for 
writes, that buffering in twisted would lead to double buffering (as 
the ring already buffers)


then, io_uring follows a completion IO model (as IOCP). quite 
different from the "ready to write/read" model (as in epoll etc).


I am wondering, do you already have a design for these aspects of 
io_uring / twisted?
I haven't thought about it in detail, but python presents mmap as 
bytearray, so I would have thought it fairly easy to write directly to 
the ring from Protocol.write


fwiw, couple of thoughts:

to make it "zero copy" right up into python, a couple of things would be 
needed (there might be other ways of course ..):


the memory to write into on the producer side must be allocated and 
managed via liburing


that memory might for example actually reside inside a NIC and be DMA'ed 
into main memory ("zero CPU copy") or even directly mapped into the user 
level address space ("true zero copy")


even when taking the very basic case of just transmitting an unstructed 
bunch of bytes, to make it truly zero copy up into python, sth like


https://zero-buffer.readthedocs.io

might be needed rather than standard python str/bytes.

then, for structured data, if zero-buffer would be used in python lib of 
flatbuffers for str/bytes


https://google.github.io/flatbuffers/

this would result in a truly zero-copy transfer _and_ serialization for 
native structured objects.


all of that with zero/minimal syscalls.

in a way, the holy grail;)

cheers,
/Tobias

alternatives for flatbuffers:
https://capnproto.org/news/2014-06-17-capnproto-flatbuffers-sbe.html

___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
https://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python