[issue27271] asyncio lost udp packets

2016-07-23 Thread Yury Selivanov
Yury Selivanov added the comment: > Can you prove that packets may be lost even in UNIX sockets ? > (it is not related to this task directly) Quoting wiki: """Like named pipes, Unix domain sockets support transmission of a reliable stream of bytes (SOCK_STREAM, compare to TCP). In addition,

[issue27271] asyncio lost udp packets

2016-07-22 Thread Марк Коренберг
Марк Коренберг added the comment: @yselivanov Can you prove that packets may be lost even in UNIX sockets ? (it is not related to this task directly) -- nosy: +mmarkk ___ Python tracker

[issue27271] asyncio lost udp packets

2016-06-09 Thread Guido van Rossum
Guido van Rossum added the comment: You're welcome Valdemar. It's a wonderful world, there's so much to learn! Sounds like you're on the right path. Good luck! -- ___ Python tracker

[issue27271] asyncio lost udp packets

2016-06-09 Thread valdemar pavesi
valdemar pavesi added the comment: thanks Guido and Yury I am new on python world. I was working with automation tests, sw implemented in Delphi in 199x. this year I got a python certification from University Texas Arlington University by EDX. and I already wrote 4 projects in python3

[issue27271] asyncio lost udp packets

2016-06-08 Thread valdemar pavesi
valdemar pavesi added the comment: thanks Guido I will keep working with it. I am not able to debug between socket and asyncio-read-udp. There is no bottleneck on cpu/memory or network card. I cannot write debug with this heavy udp load. if I decrease the UDP per second then this problem

[issue27271] asyncio lost udp packets

2016-06-08 Thread Guido van Rossum
Guido van Rossum added the comment: You have not convinced anyone that this is asyncio's fault. I'm closing the issue. If you need help debugging this please use the python-tulip Google Group; if in the end it is found to be an asyncio issue we'll help you file a useful bug report on the

[issue27271] asyncio lost udp packets

2016-06-08 Thread valdemar pavesi
valdemar pavesi added the comment: hi, I did made a change, removing the queue and calling corotine. and now lost udp is bigger. def datagram_received(self, data, addr): asyncio.ensure_future(process_report(data)) @asyncio.coroutine def process_report(data): tcmpdump got

[issue27271] asyncio lost udp packets

2016-06-08 Thread Guido van Rossum
Guido van Rossum added the comment: How do you know the OS kernel isn't dropping them? -- ___ Python tracker ___

[issue27271] asyncio lost udp packets

2016-06-08 Thread valdemar pavesi
valdemar pavesi added the comment: I do understand the possibility to lose on udp. and I am monitoring all machines involved. I am not losing on network, I am losing between our network-card-dumpcap and read udp from socket. is it possible that read will be blocked and not able to read ?

[issue27271] asyncio lost udp packets

2016-06-08 Thread Yury Selivanov
Yury Selivanov added the comment: Even if you increase buffers you will lose data over UDP. The reason can be the network, or the kernel may simply skip sending the data. To work with buffer sizes use transport.set_write_buffer_limits -- ___

[issue27271] asyncio lost udp packets

2016-06-08 Thread Yury Selivanov
Yury Selivanov added the comment: > I think we could lose inside the network, but we cannot lose inside of our > application. UDP is fundamentally unreliable. It *will* lose data even over UNIX sockets. -- ___ Python tracker

[issue27271] asyncio lost udp packets

2016-06-08 Thread valdemar pavesi
valdemar pavesi added the comment: I am not getting any pause, or any message about buffer full. def pause_reading(self): print('pause_reading') def resume_reading(self): print('resume_reading') and I cannot find a way to increase the receive buffer by asyncio. --

[issue27271] asyncio lost udp packets

2016-06-08 Thread valdemar pavesi
valdemar pavesi added the comment: thanks Yury, I think we could lose inside the network, but we cannot lose inside of our application. regards! Valdemar -- ___ Python tracker

[issue27271] asyncio lost udp packets

2016-06-08 Thread Yury Selivanov
Yury Selivanov added the comment: Isn't it normal for UDP to lose some packets? -- ___ Python tracker ___ ___

[issue27271] asyncio lost udp packets

2016-06-08 Thread valdemar pavesi
New submission from valdemar pavesi: hello, I am using asyncio to handle 165 udp-packet per second everything received by (datagram_received) will be put into a queue. +++ 124605 UDP packets send from client. and received by server network: dumpcap ( filter "port 5 and len > 100" )