luederm commented on issue #37149: URL: https://github.com/apache/airflow/issues/37149#issuecomment-1930714936
Oh, interesting. I will keep that in mind next time I have compilation issues in a conda environment. > You have not mentioned if you have ARM/ M1/2/3 but I guess so. Then use Python 3.10 at least. Actually, my MacBook has an intel chip. > This might be related to some specifics of your environment - for example the way how you installed Python (was it conda?). The python I used with the venv was not installed with conda. I think it was installed with a MacOS update. Since you mentioned using at least python 3.10, I tested airflow 2.8.1 again but this time creating a venv with python 3.11, which was installed with brew. The error I get when running the example bash operator is the same as the original error: ``` scheduler | [2024-02-06T11:33:33.663-0500] {taskinstance.py:2700} ERROR - Executor reports task instance <TaskInstance: example_bash_operator.runme_0 manual__2024-02-06T16:33:26+00:00 [queued]> finished (failed) although the task says it's queued. (Info: None) Was the task killed externally? ``` I also tried other airflow versions and notice the error starts at 3.7.0. Also, I should have checked this earlier but I found crash reports in the Mac Console: ``` ------------------------------------- Translated Report (Full Report Below) ------------------------------------- Process: Python [55375] Path: /usr/local/Cellar/python@3.11/3.11.6_1/Frameworks/Python.framework/Versions/3.11/Resources/Python.app/Contents/MacOS/Python Identifier: org.python.python Version: 3.11.6 (3.11.6) Code Type: X86-64 (Native) Parent Process: Python [54935] Responsible: pycharm [6073] Date/Time: 2024-02-06 14:34:39.7479 -0500 OS Version: macOS 13.6 (22G120) Report Version: 12 Bridge OS Version: 8.1 (21P1069) Time Awake Since Boot: 320000 seconds Time Since Wake: 24719 seconds System Integrity Protection: enabled Crashed Thread: 0 Dispatch queue: com.apple.main-thread Exception Type: EXC_BAD_ACCESS (SIGSEGV) Exception Codes: KERN_INVALID_ADDRESS at 0x0000000000000000 Exception Codes: 0x0000000000000001, 0x0000000000000000 Termination Reason: Namespace SIGNAL, Code 11 Segmentation fault: 11 Terminating Process: exc handler [55375] VM Region Info: 0 is not in any region. Bytes before following region: 4391043072 REGION TYPE START - END [ VSIZE] PRT/MAX SHRMOD REGION DETAIL UNUSED SPACE AT START ---> __TEXT 105ba0000-105ba4000 [ 16K] r-x/r-x SM=COW .../MacOS/Python Application Specific Information: *** multi-threaded process forked *** crashed on child side of fork pre-exec Thread 0 Crashed:: Dispatch queue: com.apple.main-thread 0 libresolv.9.dylib 0x7ff81b06bdab dns_res_send + 3655 1 libresolv.9.dylib 0x7ff81b06af53 res_9_nsend_2 + 32 2 libresolv.9.dylib 0x7ff81b06a04c res_nquery_soa_min + 295 3 libresolv.9.dylib 0x7ff81b07304d _pdns_query + 145 4 libresolv.9.dylib 0x7ff81b072b13 _sdns_search + 732 5 libresolv.9.dylib 0x7ff81b0731fb dns_search + 158 6 libkrb5.3.3.dylib 0x108b31ddf krb5int_dns_init + 188 7 libkrb5.3.3.dylib 0x108b321fe k5_make_uri_query + 129 8 libkrb5.3.3.dylib 0x108b36a65 locate_server + 1359 9 libkrb5.3.3.dylib 0x108b364b2 k5_locate_server + 73 10 libkrb5.3.3.dylib 0x108b37c01 krb5_sendto_kdc + 201 11 libkrb5.3.3.dylib 0x108b13a1f krb5_tkt_creds_get + 212 12 libkrb5.3.3.dylib 0x108b14671 krb5_get_credentials + 113 13 libgssapi_krb5.2.2.dylib 0x108a00f10 krb5_gss_init_sec_context_ext + 2663 14 libgssapi_krb5.2.2.dylib 0x108a01559 krb5_gss_init_sec_context + 63 15 libgssapi_krb5.2.2.dylib 0x1089f0560 gss_init_sec_context + 497 16 libpq.5.dylib 0x10888b77d pqsecure_open_gss + 901 17 libpq.5.dylib 0x108877caf PQconnectPoll + 3417 18 libpq.5.dylib 0x1088752b0 connectDBComplete + 284 19 libpq.5.dylib 0x1088753db PQconnectdb + 36 20 _psycopg.cpython-311-darwin.so 0x108821dc4 conn_connect + 244 21 _psycopg.cpython-311-darwin.so 0x1088236a9 connection_init + 361 22 Python 0x106147975 type_call + 128 23 Python 0x1060ee998 _PyObject_MakeTpCall + 126 24 Python 0x1060efc80 _PyObject_CallFunctionVa + 295 25 Python 0x1060eff9a _PyObject_CallFunction_SizeT + 149 26 _psycopg.cpython-311-darwin.so 0x108830405 psyco_connect + 213 27 Python 0x10613240f cfunction_call + 50 28 Python 0x1060ef60a _PyObject_Call + 122 29 Python 0x1061c585e _PyEval_EvalFrameDefault + 54618 30 Python 0x1061c8082 _PyEval_Vector + 92 31 Python 0x1060ef32c _PyVectorcall_Call + 134 32 Python 0x1061c585e _PyEval_EvalFrameDefault + 54618 33 Python 0x1061c8082 _PyEval_Vector + 92 34 Python 0x1060f1dff method_vectorcall + 344 35 Python 0x1060ef32c _PyVectorcall_Call + 134 36 Python 0x1061c585e _PyEval_EvalFrameDefault + 54618 37 Python 0x1061c8082 _PyEval_Vector + 92 38 Python 0x1060eebe3 _PyObject_FastCallDictTstate + 87 39 Python 0x10614f066 slot_tp_init + 185 40 Python 0x106147975 type_call + 128 41 Python 0x1060ee998 _PyObject_MakeTpCall + 126 42 Python 0x1061c3592 _PyEval_EvalFrameDefault + 45710 43 Python 0x1061c8082 _PyEval_Vector + 92 44 Python 0x1060eec63 _PyObject_FastCallDictTstate + 215 45 Python 0x10614f066 slot_tp_init + 185 46 Python 0x106147975 type_call + 128 47 Python 0x1060ee998 _PyObject_MakeTpCall + 126 48 Python 0x1061c3592 _PyEval_EvalFrameDefault + 45710 49 Python 0x1061c8082 _PyEval_Vector + 92 50 Python 0x1060ef32c _PyVectorcall_Call + 134 51 Python 0x1061c585e _PyEval_EvalFrameDefault + 54618 52 Python 0x1061c8082 _PyEval_Vector + 92 53 Python 0x1060ef32c _PyVectorcall_Call + 134 54 Python 0x1061c585e _PyEval_EvalFrameDefault + 54618 55 Python 0x1061c8082 _PyEval_Vector + 92 56 Python 0x1061c585e _PyEval_EvalFrameDefault + 54618 57 Python 0x1061c8082 _PyEval_Vector + 92 58 Python 0x1060f1e52 method_vectorcall + 427 59 Python 0x1061c585e _PyEval_EvalFrameDefault + 54618 60 Python 0x1061b77a5 PyEval_EvalCode + 191 61 Python 0x1062105ec run_eval_code_obj + 72 62 Python 0x10621057c run_mod + 96 63 Python 0x106212527 PyRun_StringFlags + 100 64 Python 0x10621248b PyRun_SimpleStringFlags + 69 65 Python 0x10622a838 pymain_run_command + 134 66 Python 0x10622a305 Py_RunMain + 302 67 Python 0x10622b416 Py_BytesMain + 42 68 dyld 0x7ff80af6741f start + 1903 ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org