[issue42585] Segmentation fault on Linux with multiprocess queue

[Irit Katriel]

Irit Katriel  added the comment:

Python 3.8 is no longer maintained, and there have been changes in this area 
since then. Please create a new issue if you are having this problem with a 
more recent python version. 

To answer you last question, yes - there are platform dependent differences in 
the behavior of spawn.

--
nosy: +iritkatriel
resolution:  -> out of date
stage:  -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42585] Segmentation fault on Linux with multiprocess queue

[Alexey Izbyshev]

Change by Alexey Izbyshev :


--
components: +Library (Lib)
nosy: +davin, pitrou
versions:  -Python 3.6

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42585] Segmentation fault on Linux with multiprocess queue

[Stegle, Julien]

Stegle, Julien  added the comment:

By removing the use the of "spawn" context for multiprocessing everything works 
fine.
Does the "spawn" context have a different behavior on Linux ?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42585] Segmentation fault on Linux with multiprocess queue

[Stegle, Julien]

New submission from Stegle, Julien :

Hi,

I'm experiencing segmentation fault issues when running inside a Docker 
container (tested with python:3.8.6, python:3.8.6-slim, python:3.6.8 & 
python:3.6.8-slim).

On windows everything works fine, but when running on Docker when I try to put 
a string into my queue I'm experiencing the following error:

GNU gdb (Debian 8.2.1-2+b3) 8.2.1
Copyright (C) 2018 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later 
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Type "show copying" and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
.
Find the GDB manual and other documentation resources online at:
.

For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from python...(no debugging symbols found)...done.
Starting program: /usr/local/bin/python -m ge.xxx.core.runners.exec basic 
reader /home/executor/xxx/exemple1.ini
warning: Error disabling address space randomization: Operation not permitted
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
[Detaching after fork from child process 12]
[New Thread 0x7f11f66c7700 (LWP 13)]
[New Thread 0x7f11f3ec6700 (LWP 14)]
[New Thread 0x7f11f16c5700 (LWP 15)]
[New Thread 0x7f11eeec4700 (LWP 16)]
[New Thread 0x7f11ec6c3700 (LWP 17)]
[New Thread 0x7f11e9ec2700 (LWP 18)]
[New Thread 0x7f11e76c1700 (LWP 19)]
[New Thread 0x7f11e4ec0700 (LWP 20)]
[New Thread 0x7f11e26bf700 (LWP 21)]
[New Thread 0x7f11dfebe700 (LWP 22)]
[New Thread 0x7f11df6bd700 (LWP 23)]
[Thread 0x7f11e9ec2700 (LWP 18) exited]
[Thread 0x7f11e76c1700 (LWP 19) exited]
[Thread 0x7f11ec6c3700 (LWP 17) exited]
[Thread 0x7f11eeec4700 (LWP 16) exited]
[Thread 0x7f11f16c5700 (LWP 15) exited]
[Thread 0x7f11f3ec6700 (LWP 14) exited]
[Thread 0x7f11f66c7700 (LWP 13) exited]
[Thread 0x7f11e26bf700 (LWP 21) exited]
[Thread 0x7f11dfebe700 (LWP 22) exited]
[Thread 0x7f11e4ec0700 (LWP 20) exited]
[Thread 0x7f11df6bd700 (LWP 23) exited]
[Detaching after fork from child process 24]
[Detaching after fork from child process 25]
[New Thread 0x7f11df6bd700 (LWP 26)]
[New Thread 0x7f11dfebe700 (LWP 27)]
[New Thread 0x7f11e26bf700 (LWP 28)]
[New Thread 0x7f11e4ec0700 (LWP 29)]
[New Thread 0x7f11cc893700 (LWP 30)]
[New Thread 0x7f11ca092700 (LWP 31)]
[New Thread 0x7f11c7891700 (LWP 32)]
[New Thread 0x7f11c5090700 (LWP 33)]
[New Thread 0x7f11c488f700 (LWP 34)]
[New Thread 0x7f11c208e700 (LWP 35)]
[New Thread 0x7f11bd88d700 (LWP 36)]
[New Thread 0x7f11b5def700 (LWP 37)]
[Thread 0x7f11e4ec0700 (LWP 29) exited]
[Thread 0x7f11c7891700 (LWP 32) exited]
[Thread 0x7f11ca092700 (LWP 31) exited]
[Thread 0x7f11c488f700 (LWP 34) exited]
[Thread 0x7f11c5090700 (LWP 33) exited]
[Thread 0x7f11cc893700 (LWP 30) exited]
[Thread 0x7f11e26bf700 (LWP 28) exited]
[Thread 0x7f11dfebe700 (LWP 27) exited]
[Thread 0x7f11df6bd700 (LWP 26) exited]
[Thread 0x7f11bd88d700 (LWP 36) exited]
[Thread 0x7f11c208e700 (LWP 35) exited]
[Detaching after fork from child process 38]
[Thread 0x7f11b5def700 (LWP 37) exited]
2020-12-07T09:16:12.760+ - ge.xxx.inputs - INFO - Filesystem input 
"ge.xxx.core.inputs.reader.dicom" initialized, target: /data/dicoms
2020-12-07T09:16:12.780+ - ge.xxx.parsers - INFO - Dicom data parser 
initialized
2020-12-07T09:16:12.918+ - alembic.env - INFO - Migrating database 
engine_data
2020-12-07T09:16:12.927+ - alembic.env - INFO - Migrating database 
engine_application
2020-12-07T09:16:12.933+ - alembic.env - INFO - Migrating database 
engine_enhancement
2020-12-07T09:16:12.956+ - ge.xxx.core - INFO - Duct 'default' initialized
2020-12-07T09:16:12.957+ - ge.xxx.inputs - INFO - Start filesystem input 
thread "ge.xxx.core.inputs.reader.dicom"
[Detaching after fork from child process 39]
[Detaching after fork from child process 40]
2020-12-07T09:16:13.639+ - ge.xxx.inputs - DEBUG - Start reading file system
2020-12-07T09:16:13.666+ - ge.xxx.inputs - DEBUG - File 
/data/dicoms/1/XXX.dcm did not match filters
2020-12-07T09:16:15.881+ - ge.xxx.inputs - DEBUG - ADDING DICOMREADER W/ TO 
QUEUE 
Fatal Python error: Segmentation fault

Current thread 0x7f0cb732f740 (most recent call first):
  File "/usr/local/lib/python3.6/multiprocessing/queues.py", line 82 in put
  File 
"/home/executor/ge.xxx.extractor/ge/xxx/extractor/input/filesystem/reader.py", 
line 36 in feed
  File "/home/executor/ge.xxx.duct/ge/xxx/duct/input/filesystem/reader.py", 
line 58 in scan
  File "/usr/local/lib/python3.6/multiprocessing/process.py", line 93 in run
  File "/usr/local/lib/python3.6/multiprocessing/process.py", line 258 in