[issue35739] Enable verbose of tests during PGO build on amd64 platforms
Jorge Ramos added the comment: Mmm, I don't find that option documented in the readme of the MSI folder nor in the help for buildrelease.bat (and also is not intuitive, what does IIRC stand for?), nevertheless: It should be no problem if this PR doesn't pass but it should help newcomers like me to debug builds (the option -q is also not documented in the buildrelease but I found that option tracking the build calls all the way to regrtest.py) I leave this info here if anyone benefits from it. In fact I edited the PGO option in the buildrelease file to: PGO= -m test --pgo -uall -j8 -M 27Gb -x test_bigmem test_bz2 test_codecs test_httpservers test_nntplib test_platform test_regrtest test_sysconfig test_zlib The test suite now reads: PASS (I know, it is not necessary for all the tests to pass, but it is a nice view IMO). The benefit of the -j option is that it permits some tests to pass when they where failing before this option. The option -uall opens resources to the tests, so that some of them will no longer be denied to tests (and therefore leaving no tests run -or skipped- by lack of resources). The 27Gb memory "allocated" to the tests is overkill, but my system could handle it (it may be that some tests need more than that but I have no further memory). Sure, it takes a long time to build (close to 1 hr) but it is the best way I have found so far to minimize the number of failed tests: with this option, only those 9 tests fail out of the 407 in Python 3.6 This info was found by disabling the quiet option, so that is another plus. If you have time, can I ask a question related to the *.pgc files? -- ___ Python tracker <https://bugs.python.org/issue35739> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35299] LGHT0091: Duplicate symbol 'File:include_pyconfig.h' found
Jorge Ramos added the comment: I want to document a workaround if anyone benefits from it, this would be step 7: 7) This error goes away if you remove the pyconfig.h from the include directory before the tests end (and of course, after the test distutils). This is only a workaround and requires the user placing attention to the build process (maybe for the first 5-10 minutes). Having the option "-q" removed from the buildrelease.bat file (as discussed in issue https://bugs.python.org/issue35739 ) helps with determining when to safely remove the file so that the distutils test pass. -- ___ Python tracker <https://bugs.python.org/issue35299> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35739] Enable verbose of tests during PGO build on amd64 platforms
Change by Jorge Ramos : -- keywords: +patch, patch, patch pull_requests: +11193, 11194, 11195 stage: -> patch review ___ Python tracker <https://bugs.python.org/issue35739> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35739] Enable verbose of tests during PGO build on amd64 platforms
Change by Jorge Ramos : -- keywords: +patch, patch pull_requests: +11193, 11194 stage: -> patch review ___ Python tracker <https://bugs.python.org/issue35739> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35739] Enable verbose of tests during PGO build on amd64 platforms
Change by Jorge Ramos : -- keywords: +patch pull_requests: +11193 stage: -> patch review ___ Python tracker <https://bugs.python.org/issue35739> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35739] Enable verbose of tests during PGO build on amd64 platforms
New submission from Jorge Ramos :
It would be interesting to allow regrtests to output to command line during
testing with PGO enabled. The default behavior is to not display output unless
some fatal error occurs ("quiet" mode).
Making this issue to create a pull request.
--
components: Build, Windows
messages: 333648
nosy: neyuru, paul.moore, steve.dower, tim.golden, zach.ware
priority: normal
severity: normal
status: open
title: Enable verbose of tests during PGO build on amd64 platforms
type: enhancement
versions: Python 3.7, Python 3.8
___
Python tracker
<https://bugs.python.org/issue35739>
___
___
Python-bugs-list mailing list
Unsubscribe:
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35693] test_httpservers fails
Jorge Ramos added the comment: E:\RepoGiT\3.7>"E:\RepoGiT\3.7\PCbuild\amd64\python.exe" -u -Wd -E -bb -m test -v test_httpservers == CPython 3.7.2+ (heads/3.7:e1259886ab, Jan 13 2019, 19:16:24) [MSC v.1916 64 bit (AMD64)] == Windows-10-10.0.17763-SP0 little-endian == cwd: E:\RepoGiT\3.7\build\test_python_21704 == CPU count: 8 == encodings: locale=cp1252, FS=utf-8 Run tests sequentially 0:00:00 [1/1] test_httpservers test_err (test.test_httpservers.RequestHandlerLoggingTestCase) ... ok test_get (test.test_httpservers.RequestHandlerLoggingTestCase) ... ok test_close_connection (test.test_httpservers.BaseHTTPRequestHandlerTestCase) ... ok test_date_time_string (test.test_httpservers.BaseHTTPRequestHandlerTestCase) ... ok test_extra_space (test.test_httpservers.BaseHTTPRequestHandlerTestCase) ... ok test_header_buffering_of_send_error (test.test_httpservers.BaseHTTPRequestHandlerTestCase) ... ok test_header_buffering_of_send_header (test.test_httpservers.BaseHTTPRequestHandlerTestCase) ... ok test_header_buffering_of_send_response_only (test.test_httpservers.BaseHTTPRequestHandlerTestCase) ... ok test_header_length (test.test_httpservers.BaseHTTPRequestHandlerTestCase) ... ok test_header_unbuffered_when_continue (test.test_httpservers.BaseHTTPRequestHandlerTestCase) ... ok test_html_escape_on_error (test.test_httpservers.BaseHTTPRequestHandlerTestCase) ... ok test_http_0_9 (test.test_httpservers.BaseHTTPRequestHandlerTestCase) ... ok test_http_1_0 (test.test_httpservers.BaseHTTPRequestHandlerTestCase) ... ok test_http_1_1 (test.test_httpservers.BaseHTTPRequestHandlerTestCase) ... ok test_request_length (test.test_httpservers.BaseHTTPRequestHandlerTestCase) ... ok test_too_many_headers (test.test_httpservers.BaseHTTPRequestHandlerTestCase) ... ok test_with_continue_1_0 (test.test_httpservers.BaseHTTPRequestHandlerTestCase) ... ok test_with_continue_1_1 (test.test_httpservers.BaseHTTPRequestHandlerTestCase) ... ok test_with_continue_rejected (test.test_httpservers.BaseHTTPRequestHandlerTestCase) ... ok test_command (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_error_content_length (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_handler (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_head_via_send_error (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_header_close (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_header_keep_alive (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_internal_key_error (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_latin1_header (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_request_line_trimming (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_return_custom_status (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_return_explain_error (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_return_header_keep_alive (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_send_blank (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_send_error (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_version_bogus (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_version_digits (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_version_invalid (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_version_none (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_version_none_get (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_browser_cache (test.test_httpservers.SimpleHTTPServerTestCase) Check that when a request to /test is sent with the request header ... ok test_browser_cache_file_changed (test.test_httpservers.SimpleHTTPServerTestCase) ... ok test_browser_cache_with_If_None_Match_header (test.test_httpservers.SimpleHTTPServerTestCase) ... ok test_get (test.test_httpservers.SimpleHTTPServerTestCase) ... FAIL test_head (test.test_httpservers.SimpleHTTPServerTestCase) ... ok test_html_escape_filename (test.test_httpservers.SimpleHTTPServerTestCase) ... skipped 'Can not create file .txt on current file system' test_invalid_requests (test.test_httpservers.SimpleHTTPServerTestCase) ... ok test_last_modified (test.test_httpservers.SimpleHTTPServerTestCase) Checks that the datetime returned in Last-Modified response header ... ok test_path_without_leading_slash (test.test_httpservers.SimpleHTTPServerTestCase) ... E:\RepoGiT\3.7\lib\email\feedparser.py:89: ResourceWarning: unclosed for ateof in reversed(self._eofstack): ResourceWarning: Enable tracemalloc to get the object allocation traceback FAIL test_undecodable_filename (test.test_httpservers.SimpleHTTPServerTestCase) ... skipped 'undecodable name cannot be decoded on win32' test_authorization (test.test_httpservers.CGIHTTPServerTestCase) ... ok test_headers_and_content (test.test_httpservers.CGIHTTPServerTestCase) ... ok test_invaliduri (test.test_httpservers.CGIHTTPServerTestCase) ... ok test_issue19435 (test.test_httpservers.CGIHTTPS
[issue35693] test_httpservers fails
Jorge Ramos added the comment: the output is stored on the file run.txt above -- ___ Python tracker <https://bugs.python.org/issue35693> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35157] Missing pyconfig.h when building from source and pgo flag is enabled
Change by Jorge Ramos : -- stage: -> resolved status: open -> closed ___ Python tracker <https://bugs.python.org/issue35157> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35156] Consider revising documentation on Python Builds from source
Change by Jorge Ramos : -- stage: needs patch -> resolved status: open -> closed ___ Python tracker <https://bugs.python.org/issue35156> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35399] Sysconfig bug
Change by Jorge Ramos : -- stage: -> resolved status: open -> closed ___ Python tracker <https://bugs.python.org/issue35399> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35400] PGOMGR : warning PG0188:
Change by Jorge Ramos : -- stage: -> resolved status: open -> closed ___ Python tracker <https://bugs.python.org/issue35400> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35693] test_httpservers fails
Change by Jorge Ramos : -- stage: test needed -> resolved status: open -> closed ___ Python tracker <https://bugs.python.org/issue35693> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35693] test_httpservers fails
Jorge Ramos added the comment: It is true that I worry about failing tests during PGO training because they stop me from compiling Python -with- PGO. I also got here to report my experience and problems back to you guys but, if the problems are known, well, there's nothing much I can do then. Also, I know this isn't a platform for asking howto questions so I will not bother you guys with that either. I *could* get back to topic and try to help sorting out the test_httpservers (because they do fail on 3.7, at least on my side) but it seems I don't have the necessary experience to give any meaningful aid. There's a saying in my hometown which goes something like this: "the one that does not hinder, helps", so that's what I'll do. happy coding! -- ___ Python tracker <https://bugs.python.org/issue35693> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35693] test_httpservers fails
Jorge Ramos added the comment: Thanks! About the alternate set of training data, how (where) do I find it? and about the layouts, can you point me in the right direction as to learn about them, into what they do? or try to achieve? and how to use them? Quoting Steve Dower ( https://bugs.python.org/issue35299#msg330347 ), the test suite implemented in this project is as good as any other generic workload, which is easily accessible from this repo (I don't know what was he referring to in "ease of accessibility") but I understand it is not the only one out there. So, if there are as many combinations possible as from choosing the tests (the ones implemented here and/or others), why did python choose this in particular? It has to be "good enough" isn't it? and if so, why PGO optimizations where "left out" of the bug tracking loop? It may be not as important in reality, but people like me, crave for optimizations =) So, I would love the PGO feature to be revived here, what happened to previous work done here ( https://bugs.python.org/issue26359 )?. But I know also that I am daydreaming. I would appreciate any help, for me to keep digging into it, as I do not know where to start. thanks! -- ___ Python tracker <https://bugs.python.org/issue35693> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35693] test_httpservers fails
Jorge Ramos added the comment: I have realized that results from rt.bat differ from those when running buildrelease.bat (see example below) Why do the tests run OK in rt.bat but fail in buildrelase.bat? To my best understanding, the tests are summoned directly via rt.bat but also from buildrelease.bat (because these are used to generate data for the PGO optimization process right?)- but when run from the buildrelease.bat file, the tests are in "silent" mode, just fatal errors are displayed at the command prompt as opposed to . Is there a way to pass some arguments to buildrelease.bat so that the tests run in verbose mode? This is important, because that way i can know exactly which tests fail. - EXAMPLE verbose from in test_distutils: 0:03:57 [113/418] test_distutils xxmodule.c Creando biblioteca D:\Users\yorch\AppData\Local\Temp\tmpy9gd5kib\Release\Users\yorch\AppData\Local\Temp\tmpy9gd5kib\xx.cp38-win_amd64.lib y objeto D:\Users\yorch\AppData\Local\Temp\tmpy9gd5kib\Release\Users\yorch\AppData\Local\Temp\tmpy9gd5kib\xx.cp38-win_amd64.exp Generando código Generación de código finalizada foo.c Creando biblioteca D:\Users\yorch\AppData\Local\Temp\tmpxp_bpi50\tempt\Users\yorch\AppData\Local\Temp\tmpmz5_h8sb\foo.cp38-win_amd64.lib y objeto D:\Users\yorch\AppData\Local\Temp\tmpxp_bpi50\tempt\Users\yorch\AppData\Local\Temp\tmpmz5_h8sb\foo.cp38-win_amd64.exp Generando código Generación de código finalizada foo.c Creando biblioteca D:\Users\yorch\AppData\Local\Temp\tmpxp_bpi50\tempt\Users\yorch\AppData\Local\Temp\tmpmz5_h8sb\foo.cp38-win_amd64.lib y objeto D:\Users\yorch\AppData\Local\Temp\tmpxp_bpi50\tempt\Users\yorch\AppData\Local\Temp\tmpmz5_h8sb\foo.cp38-win_amd64.exp Generando código Generación de código finalizada xxmodule.c Creando biblioteca D:\Users\yorch\AppData\Local\Temp\tmptd13yi9i\Release\Users\yorch\AppData\Local\Temp\tmptd13yi9i\xx.cp38-win_amd64.lib y objeto D:\Users\yorch\AppData\Local\Temp\tmptd13yi9i\Release\Users\yorch\AppData\Local\Temp\tmptd13yi9i\xx.cp38-win_amd64.exp Generando código Generación de código finalizada foo.c Creando biblioteca D:\Users\yorch\AppData\Local\Temp\tmp4ttgsjp5\tempt\Users\yorch\AppData\Local\Temp\tmp1yxs7b6r\foo.cp38-win_amd64.lib y objeto D:\Users\yorch\AppData\Local\Temp\tmp4ttgsjp5\tempt\Users\yorch\AppData\Local\Temp\tmp1yxs7b6r\foo.cp38-win_amd64.exp Generando código Generación de código finalizada foo.c Creando biblioteca D:\Users\yorch\AppData\Local\Temp\tmp4ttgsjp5\tempt\Users\yorch\AppData\Local\Temp\tmp1yxs7b6r\foo.cp38-win_amd64.lib y objeto D:\Users\yorch\AppData\Local\Temp\tmp4ttgsjp5\tempt\Users\yorch\AppData\Local\Temp\tmp1yxs7b6r\foo.cp38-win_amd64.exp Generando código Generación de código finalizada xxmodule.c Creando biblioteca build\temp.win-amd64-3.8\Release\xx.cp38-win_amd64.lib y objeto build\temp.win-amd64-3.8\Release\xx.cp38-win_amd64.exp Generando código Generación de código finalizada E:\RepoGiT\3.8\build\test_python_2512>exit 1 E:\RepoGiT\3.8\build\test_python_2512>exit 0 0:04:41 [114/418] test_docxmlrpc -- test_distutils passed in 44 sec 267 ms *** verbose from buildrelease.bat -x64 from test_distutils *** xxmodule.c E:\RepoGiT\3.8\include\Python.h(8): fatal error C1083: No se puede abrir el archivo incluir: 'pyconfig.h': No such file or directory foo.c Creando biblioteca D:\Users\yorch\AppData\Local\Temp\tmpwzeadhd1\tempt\Users\yorch\AppData\Local\Temp\tmp196_7v3c\foo.cp38-win_amd64.lib y objeto D:\Users\yorch\AppData\Local\Temp\tmpwzeadhd1\tempt\Users\yorch\AppData\Local\Temp\tmp196_7v3c\foo.cp38-win_amd64.exp Generando código Generación de código finalizada foo.c Creando biblioteca D:\Users\yorch\AppData\Local\Temp\tmpwzeadhd1\tempt\Users\yorch\AppData\Local\Temp\tmp196_7v3c\foo.cp38-win_amd64.lib y objeto D:\Users\yorch\AppData\Local\Temp\tmpwzeadhd1\tempt\Users\yorch\AppData\Local\Temp\tmp196_7v3c\foo.cp38-win_amd64.exp Generando código Generación de código finalizada xxmodule.c E:\RepoGiT\3.8\include\Python.h(8): fatal error C1083: No se puede abrir el archivo incluir: 'pyconfig.h': No such file or directory foo.c Creando biblioteca D:\Users\yorch\AppData\Local\Temp\tmp9093ml9w\tempt\Users\yorch\AppData\Local\Temp\tmpsn45j3j7\foo.cp38-win_amd64.lib y objeto D:\Users\yorch\AppData\Local\Temp\tmp9093ml9w\tempt\Users\yorch\AppData\Local\Temp\tmpsn45j3j7\foo.cp38-win_amd64.exp Generando código Generación de código finalizada foo.c Creando biblioteca D:\Users\yorch\AppData\Local\Temp\tmp9093ml9w\tempt\Users\yorch\AppData\Local\Temp\tmpsn45j3j7\foo.cp38-win_amd64.lib y objeto D:\Users\yorch\AppData\Local\Temp\tmp9093ml9w\tempt\Users\yorch\AppData\Local\Temp\tmps
[issue35693] test_httpservers fails
Change by Jorge Ramos : -- versions: +Python 3.6 ___ Python tracker <https://bugs.python.org/issue35693> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35693] test_httpservers fails
Jorge Ramos added the comment: Ok, thank you. Here are my findings: steps taken: 1) download today's version of 3.7.2 and 3.8.0 alpha 0 2) navigate to tools/msi 3) run build.bat -x64 (to create amd64 folder under pcbuild) 4) navigate to pcbuild 5) run rt.bat -x64 -v test_httpservers results: 1) FAILED for 3.7.2 (same as 3.6.8) 2) SUCCESS for 3.8.0 alpha 0 According to PEP-0537 python 3.7.2 is still under bugfixes, so, can I help in something to sort this out? -- ___ Python tracker <https://bugs.python.org/issue35693> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35693] test_httpservers fails
Jorge Ramos added the comment: The thread doesn't display the attachment icon in bugtracker webpage, so I will copy the output here: E:\RepoGiT\3.6>PCbuild\rt.bat -x64 -v test_httpservers Deleting .pyc files ... 0 .pyc deleted Cleaning _pth files ... E:\RepoGiT\3.6>"E:\RepoGiT\3.6\PCbuild\amd64\python.exe" -u -Wd -E -bb -m test -v test_httpservers == CPython 3.6.8+ (heads/3.6:c2340619a7, Jan 7 2019, 21:35:13) [MSC v.1916 64 bit (AMD64)] == Windows-10-10.0.17763-SP0 little-endian == cwd: E:\RepoGiT\3.6\build\test_python_19808 == CPU count: 8 == encodings: locale=cp1252, FS=utf-8 Run tests sequentially 0:00:00 [1/1] test_httpservers test_err (test.test_httpservers.RequestHandlerLoggingTestCase) ... ok test_get (test.test_httpservers.RequestHandlerLoggingTestCase) ... ok test_close_connection (test.test_httpservers.BaseHTTPRequestHandlerTestCase) ... ok test_date_time_string (test.test_httpservers.BaseHTTPRequestHandlerTestCase) ... ok test_header_buffering_of_send_error (test.test_httpservers.BaseHTTPRequestHandlerTestCase) ... ok test_header_buffering_of_send_header (test.test_httpservers.BaseHTTPRequestHandlerTestCase) ... ok test_header_buffering_of_send_response_only (test.test_httpservers.BaseHTTPRequestHandlerTestCase) ... ok test_header_length (test.test_httpservers.BaseHTTPRequestHandlerTestCase) ... ok test_header_unbuffered_when_continue (test.test_httpservers.BaseHTTPRequestHandlerTestCase) ... ok test_html_escape_on_error (test.test_httpservers.BaseHTTPRequestHandlerTestCase) ... ok test_http_0_9 (test.test_httpservers.BaseHTTPRequestHandlerTestCase) ... ok test_http_1_0 (test.test_httpservers.BaseHTTPRequestHandlerTestCase) ... ok test_http_1_1 (test.test_httpservers.BaseHTTPRequestHandlerTestCase) ... ok test_request_length (test.test_httpservers.BaseHTTPRequestHandlerTestCase) ... ok test_too_many_headers (test.test_httpservers.BaseHTTPRequestHandlerTestCase) ... ok test_with_continue_1_0 (test.test_httpservers.BaseHTTPRequestHandlerTestCase) ... ok test_with_continue_1_1 (test.test_httpservers.BaseHTTPRequestHandlerTestCase) ... ok test_with_continue_rejected (test.test_httpservers.BaseHTTPRequestHandlerTestCase) ... ok test_command (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_error_content_length (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_handler (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_head_via_send_error (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_header_close (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_header_keep_alive (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_internal_key_error (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_latin1_header (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_request_line_trimming (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_return_custom_status (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_return_explain_error (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_return_header_keep_alive (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_send_blank (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_send_error (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_version_bogus (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_version_digits (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_version_invalid (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_version_none (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_version_none_get (test.test_httpservers.BaseHTTPServerTestCase) ... ok test_get (test.test_httpservers.SimpleHTTPServerTestCase) ... FAIL test_head (test.test_httpservers.SimpleHTTPServerTestCase) ... ok test_html_escape_filename (test.test_httpservers.SimpleHTTPServerTestCase) ... skipped 'Can not create file .txt on current file system' test_invalid_requests (test.test_httpservers.SimpleHTTPServerTestCase) ... ok test_path_without_leading_slash (test.test_httpservers.SimpleHTTPServerTestCase) ... FAIL test_undecodable_filename (test.test_httpservers.SimpleHTTPServerTestCase) ... skipped 'undecodable name cannot be decoded on win32' test_authorization (test.test_httpservers.CGIHTTPServerTestCase) ... E:\RepoGiT\3.6\lib\encodings\cp1252.py:21: ResourceWarning: unclosed class IncrementalDecoder(codecs.IncrementalDecoder): E:\RepoGiT\3.6\lib\encodings\cp1252.py:21: ResourceWarning: unclosed class IncrementalDecoder(codecs.IncrementalDecoder): ok test_headers_and_content (test.test_httpservers.CGIHTTPServerTestCase) ... ok test_invaliduri (test.test_httpservers.CGIHTTPServerTestCase) ... ok test_issue19435 (test.test_httpservers.CGIHTTPServerTestCase) ... ok test_nested_cgi_path_issue21323 (test.test_httpservers.CGIHTTPServerTestCase) ... ok test_no_leading_slash (test.test_httpservers.CGIHTTPServerTestCase) ... ok test_os_environ_is_not_altered (test.test_httpservers.CGIHTTPServerTestCase)
[issue35693] test_httpservers fails
Jorge Ramos added the comment: The test failed, the results on attached file! -- Added file: https://bugs.python.org/file48037/failed.txt ___ Python tracker <https://bugs.python.org/issue35693> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35693] test_httpservers fails
Jorge Ramos added the comment: Got it, i'll get back with the results -- ___ Python tracker <https://bugs.python.org/issue35693> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35695] missing attributes
Jorge Ramos added the comment: Got it, maybe the warnings should be more explanatory, like this one: 0:06:17 [219/407/1] test_multiprocessing_fork test_multiprocessing_fork skipped -- fork is not available on Windows 0:06:17 [220/407/1] test_multiprocessing_forkserver -- test_multiprocessing_fork skipped test_multiprocessing_forkserver skipped -- forkserver is not available on Windows just my 2 cents. -- ___ Python tracker <https://bugs.python.org/issue35695> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35694] missing modules on test suite
Jorge Ramos added the comment: Got it (y) -- ___ Python tracker <https://bugs.python.org/issue35694> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35695] missing attributes
New submission from Jorge Ramos : while running : 0:04:26 [136/407] test_fork1 test_fork1 skipped -- object has no attribute 'fork' 0:11:56 [384/407/1] test_wait4 -- test_wait3 skipped test_wait4 skipped -- object has no attribute 'fork' see attached file -- components: Tests, Windows files: run.txt messages: 333282 nosy: neyuru, paul.moore, steve.dower, tim.golden, zach.ware priority: normal severity: normal status: open title: missing attributes versions: Python 3.6 Added file: https://bugs.python.org/file48036/run.txt ___ Python tracker <https://bugs.python.org/issue35695> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35694] missing modules on test suite
New submission from Jorge Ramos : when running some tests where skipped due to missing modules: 0:02:52 [ 86/407] test_crypt test_crypt skipped -- No module named '_crypt' 0:02:55 [ 93/407] test_dbm_gnu test_dbm_gnu skipped -- No module named '_gdbm' 0:02:55 [ 94/407] test_dbm_ndbm -- test_dbm_gnu skipped test_dbm_ndbm skipped -- No module named '_dbm' 0:05:25 [183/407/1] test_ioctl test_ioctl skipped -- No module named 'fcntl' 0:07:43 [224/407/1] test_nis test_nis skipped -- No module named 'nis' full verbose on attached file -- components: Tests, Windows files: run.txt messages: 333280 nosy: neyuru, paul.moore, steve.dower, tim.golden, zach.ware priority: normal severity: normal status: open title: missing modules on test suite versions: Python 3.6 Added file: https://bugs.python.org/file48035/run.txt ___ Python tracker <https://bugs.python.org/issue35694> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35693] test_httpservers fails
New submission from Jorge Ramos : when running test_httpservers fails: 0:04:53 [171/407] test_httpservers E:\RepoGiT\3.6\lib\socket.py:144: ResourceWarning: unclosed _socket.socket.__init__(self, family, type, proto, fileno) E:\RepoGiT\3.6\lib\test\support\__init__.py:1542: ResourceWarning: unclosed gc.collect() test test_httpservers failed -- multiple errors occurred; run in verbose mode for details full run on attached file -- components: Tests, Windows files: run.txt messages: 333279 nosy: neyuru, paul.moore, steve.dower, tim.golden, zach.ware priority: normal severity: normal status: open title: test_httpservers fails versions: Python 3.6 Added file: https://bugs.python.org/file48034/run.txt ___ Python tracker <https://bugs.python.org/issue35693> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue30170] "tests may fail, unable to create temporary directory" warning on buildbot: add a cleanup step to buildbots
Jorge Ramos added the comment: May I add that this directory exists, maybe before this run tried to create it and hence not being able to do it as the first post suggested? -- ___ Python tracker <https://bugs.python.org/issue30170> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue30170] "tests may fail, unable to create temporary directory" warning on buildbot: add a cleanup step to buildbots
Jorge Ramos added the comment: I got this error trying to build Python 3.6.7, why is this closed? Running PGInstrument|x64 interpreter... E:\RepoGiT\3.6\lib\test\support\__init__.py:1029: RuntimeWarning: tests may fail, unable to create temp dir: D:\Users\yorch\AppData\Local\Temp\test_python_15660 with temp_dir(path=name, quiet=quiet) as temp_path: Run tests sequentially -- nosy: +neyuru ___ Python tracker <https://bugs.python.org/issue30170> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35399] Sysconfig bug
Change by Jorge Ramos : -- components: +Build ___ Python tracker <https://bugs.python.org/issue35399> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35400] PGOMGR : warning PG0188:
New submission from Jorge Ramos : The following command: Tools\msi\buildrelease.bat -x64 is used to build a 64 bit version (on win_10_64) of python (using visual studio 2017). The following modules did not build correctly because, presumably, the corresponding .PGC files could not be found, even when the PGO tests ran perfectly well: _elementtree _multiprocessing _ctypes winsound pyexpat _socket _bz2 _ssl _lzma _hashlib select See details in the attached file (search for the text "PGOMGR"). -- components: Build files: missing_pgc_files.txt messages: 331008 nosy: neyuru priority: normal severity: normal status: open title: PGOMGR : warning PG0188: type: compile error versions: Python 3.6 Added file: https://bugs.python.org/file47970/missing_pgc_files.txt ___ Python tracker <https://bugs.python.org/issue35400> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35399] Sysconfig bug
New submission from Jorge Ramos : As can be seen in the file, the sysconfig test fails when profiling (PGO) this utility. This is the very same bug as described in issue#35299 https://bugs.python.org/issue35299 but in distutils. The problem is that when the test for sysconfig runs, it does not find the file pyconfig.h in the include directory. If this file is manually copied there, the test runs OK. -- files: sysconfig_bug.txt messages: 331007 nosy: neyuru priority: normal severity: normal status: open title: Sysconfig bug type: compile error versions: Python 3.6, Python 3.7, Python 3.8 Added file: https://bugs.python.org/file47969/sysconfig_bug.txt ___ Python tracker <https://bugs.python.org/issue35399> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35299] LGHT0091: Duplicate symbol 'File:include_pyconfig.h' found
New submission from Jorge Ramos : Build of Python 3.6.7 fails with error "LGHT0091: Duplicate symbol 'File:include_pyconfig.h' found" I am using Windows 10 64bit. Steps to reproduce this error: 1) Install Visual Studio 2017 (With the python development and native dev tools) (I have also installed NVIDIA CUDA Toolkit but I don't think this matters) 2) Download source code from Python to folder E:\RepoGit\3.6 (this is the download folder) 3) Open a command prompt, navigate to "E:\RepoGit" and run "PCBuild\build.bat -p x64" 4) Close the command prompt 5) Copy file pyconfig.h file from E:\RepoGit\3.6\PC and paste it to E:\RepoGit\3.6\include. Also, create an environment variable called "LIB" that contains the folder "E:\RepoGiT\3.6\PCbuild\amd64" (this folder was created at step 3) 6) Open a command prompt and run "Tools\msi\buildrelease.bat -x64" NOTE1: if step 5 is skipped, the overall build does not fail, but the PGInstrument x64 Interpreter fails in distutils with error "E:\RepoGiT\3.6\include\Python.h(8): fatal error C1083: Cannot open include file: 'pyconfig.h': No such file or directory", as shown in message https://bugs.python.org/msg329247 of issue https://bugs.python.org/issue35157 NOTE2: if pyconfig.h in step 5 is copied but the environment variable is not created, the PGInstrument x64 Interpreter fails in distutils with error "LINK : fatal error LNK1104: cannot open file 'python36.lib'", and the overall build fails with the same error shown in the title of this Issue. NOTE3: If all the steps are run, the PGInstrument x64 Interpreter succeeds in its tests but the overall build fails with the error shown in the title of this issue. All the verbose of this compilation is included in the file attached. -- components: Build, Windows files: LIBenRepogiT.txt messages: 330299 nosy: neyuru, paul.moore, steve.dower, tim.golden, zach.ware priority: normal severity: normal status: open title: LGHT0091: Duplicate symbol 'File:include_pyconfig.h' found type: compile error versions: Python 3.6 Added file: https://bugs.python.org/file47941/LIBenRepogiT.txt ___ Python tracker <https://bugs.python.org/issue35299> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35253] Linker warning LNK4281
Jorge Ramos added the comment: Ok, thanks! If it helps, here are all the modules that gave me that suggestion: pythoncore.vcxproj _testbuffer.vcxproj _testcapi.vcxproj _testimportmultiple.vcxproj select.vcxproj _overlapped.vcxproj _elementtree.vcxproj _decimal.vcxproj unicodedata.vcxproj _msi.vcxproj _multiprocessing.vcxproj _socket.vcxproj _bz2.vcxproj _ctypes.vcxproj _sqlite3.vcxproj python.vcxproj pythonw.vcxproj and it seems that the suggestions were repeated more than once for all of them. -- ___ Python tracker <https://bugs.python.org/issue35253> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35253] Linker warning LNK4281
New submission from Jorge Ramos : When building python 3.6.7 x64 from source I get multiple warnings: LINK : LNK4281 - "undesirable base address 0x1D11 for x64 image; set base address above 4GB for best ASLR optimization". after that, the build gives the offending module: -- [..\PCbuild\pythoncore.vcxproj] --- (e.g., there are many others) the .. means whatever parent directory the build files are on. I use the following batch file: Tools\msi\buildrelease.bat -x64 --pgo '-m test -q --pgo' - Is this a problem? -- components: Build messages: 329938 nosy: neyuru priority: normal severity: normal status: open title: Linker warning LNK4281 type: compile error versions: Python 3.6 ___ Python tracker <https://bugs.python.org/issue35253> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35156] Consider revising documentation on Python Builds from source
Jorge Ramos added the comment: Although I appreciate the confidence placed in me, I think I'm not exactly the most competent person to make changes to such an important project. I know what -probably- could be improved (from my very narrow point of view) but I don't even know where or how to start so to not screw things up. Don't get me wrong, participating in a project like this (no matter how minor the contribution) is an exciting thought but I ignore so many things that I'm afraid I would probably make it worse rather than making it better. Those things where written for a reason and I'm not even close to know or understand the context on why it was so, as to make a meaningful contribution. -- ___ Python tracker <https://bugs.python.org/issue35156> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35157] Missing pyconfig.h when building from source and pgo flag is enabled
Jorge Ramos added the comment: Yes, my last message is a trimmed version of my next to last message (which itself is a trimmed version of all the verbose of the build, showing just after the PGO interpreter wakes up). Although, obviously they where run at different times (one run completed in 31 minutes while the other was in 35 minutes), because I no longer had the output of my next to last message available. Other than that, the messages are 'identical'. The commands followed to get to this are: git clone g...@github.com:neyuru/cpython.git git remote add upstream g...@github.com:python/cpython.git git remote -v cd cpython git checkout 3.6 PCBuild\get_externals.bat Tools\msi\get_externals.bat PCBuild\build.bat -d -p x64 PCBuild\build.bat --pgo -p x64 -- ___ Python tracker <https://bugs.python.org/issue35157> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35156] Consider revising documentation on Python Builds from source
Jorge Ramos added the comment: One more thing: point in case #6 does credit a revision IMO. The build_pgo.bat file does not exist. -- ___ Python tracker <https://bugs.python.org/issue35156> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35156] Consider revising documentation on Python Builds from source
Jorge Ramos added the comment: Thank you, I think that will suffice. At least guide folks like myself who want to build from source and with optimizations in the right direction (on which folder to work on and which commands to issue to the terminal) Please keep me posted. -- ___ Python tracker <https://bugs.python.org/issue35156> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35157] Missing pyconfig.h when building from source and pgo flag is enabled
Jorge Ramos added the comment:
Hi:
Hmm.. but the installation does fail ("PGO run did not succeed (no
python36!*.pgc files) and there is no data to merge"):
*
Total duration: 35 min 2 sec
Tests result: FAILURE
E:\repogit\cpython>"C:\Program Files (x86)\Microsoft Visual
Studio\2017\Community\\MSBuild\15.0\Bin\msbuild.exe"
"E:\RepoGiT\cpython\PCbuild\\pythoncore.vcxproj" /t:KillPython /nologo /v:m
/p:Configuration=PGInstrument /p:Platform=x64 /p:KillPython=true
Killing any running python.exe instances...
E:\repogit\cpython>"C:\Program Files (x86)\Microsoft Visual
Studio\2017\Community\\MSBuild\15.0\Bin\msbuild.exe"
"E:\RepoGiT\cpython\PCbuild\pcbuild.proj" /t:Build /m /nologo /v:m
/p:Configuration=PGUpdate /p:Platform=x64 /p:IncludeExternals=true
/p:IncludeSSL=true /p:IncludeTkinter=true /p:UseTestMarker= /p:GIT="C:\Program
Files\Git\cmd\git.exe"
Killing any running python.exe instances...
E:\RepoGiT\cpython\PCbuild\pyproject.props(173,5): error : PGO run did not
succeed (no python36!*.pgc files) and there is no data to merge
[E:\RepoGiT\cpython\PCbuild\pythoncore.vcxproj]
So I can´t omit these issues and call it a day. =(
--
___
Python tracker
<https://bugs.python.org/issue35157>
___
___
Python-bugs-list mailing list
Unsubscribe:
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35157] Missing pyconfig.h when building from source and pgo flag is enabled
Jorge Ramos added the comment: Hello: I followed the same command: PCBuild\build.bat -d -p x64 -r --pgo and in summary, it found 5 errors (the last part of this messages contains the PGInstrument|x64 interpreter verbose). I include a number between parenthesis to show the test number: *** test_distutils failed in 43 sec 783 ms (107) test_httpservers failed (171) test_platform failed(246) test_regrtest failed in 1 min 36 sec(273) test_sysconfig failed (330) *** And for the sake of completeness I also runh the command "python.exe -m test.pythoninfo" which basically gave the same results as yours. But my problem is not with the exixting python installation but at compile time when using PGO. *** Running PGInstrument|x64 interpreter... Run tests sequentially 0:00:00 [ 1/407] test_grammar 0:00:00 [ 2/407] test_opcodes 0:00:00 [ 3/407] test_dict 0:00:01 [ 4/407] test_builtin 0:00:02 [ 5/407] test_exceptions 0:00:10 [ 6/407] test_types 0:00:11 [ 7/407] test_unittest 0:00:18 [ 8/407] test_doctest 0:00:25 [ 9/407] test_doctest2 0:00:26 [ 10/407] test_support 0:00:26 [ 11/407] test___all__ 0:00:33 [ 12/407] test___future__ 0:00:33 [ 13/407] test__locale 0:00:33 [ 14/407] test__opcode 0:00:33 [ 15/407] test__osx_support 0:00:33 [ 16/407] test_abc 0:00:34 [ 17/407] test_abstract_numbers 0:00:34 [ 18/407] test_aifc 0:00:35 [ 19/407] test_argparse 0:00:41 [ 20/407] test_array 0:00:46 [ 21/407] test_asdl_parser 0:00:46 [ 22/407] test_ast -- test_asdl_parser skipped 0:00:52 [ 23/407] test_asyncgen 0:00:53 [ 24/407] test_asynchat 0:00:56 [ 25/407] test_asyncio Executing .start() done, defined at E:\RepoGiT\cpython\lib\test\test_asyncio\test_pep492.py:150> result=None created at E:\RepoGiT\cpython\lib\asyncio\base_events.py:452> took 0.141 seconds 0:02:28 [ 26/407] test_asyncore -- test_asyncio passed in 1 min 32 sec 0:02:28 [ 27/407] test_atexit -- test_asyncore skipped 0:02:29 [ 28/407] test_audioop 0:02:29 [ 29/407] test_augassign 0:02:29 [ 30/407] test_base64 0:02:32 [ 31/407] test_baseexception 0:02:32 [ 32/407] test_bdb 0:02:32 [ 33/407] test_bigaddrspace 0:02:32 [ 34/407] test_bigmem 0:02:33 [ 35/407] test_binascii 0:02:33 [ 36/407] test_binhex 0:02:33 [ 37/407] test_binop 0:02:34 [ 38/407] test_bisect 0:02:34 [ 39/407] test_bool 0:02:34 [ 40/407] test_buffer 0:03:18 [ 41/407] test_bufio -- test_buffer passed in 43 sec 970 ms 0:03:22 [ 42/407] test_bytes 0:03:31 [ 43/407] test_bz2 0:03:39 [ 44/407] test_calendar 0:03:58 [ 45/407] test_call 0:03:59 [ 46/407] test_capi 0:04:12 [ 47/407] test_cgi 0:04:12 [ 48/407] test_cgitb 0:04:14 [ 49/407] test_charmapcodec 0:04:15 [ 50/407] test_class 0:04:15 [ 51/407] test_cmath 0:04:15 [ 52/407] test_cmd 0:04:16 [ 53/407] test_cmd_line 0:04:38 [ 54/407] test_cmd_line_script 0:05:19 [ 55/407] test_code -- test_cmd_line_script passed in 41 sec 453 ms 0:05:19 [ 56/407] test_code_module 0:05:20 [ 57/407] test_codeccallbacks 0:05:20 [ 58/407] test_codecencodings_cn 0:05:21 [ 59/407] test_codecencodings_hk 0:05:22 [ 60/407] test_codecencodings_iso2022 0:05:23 [ 61/407] test_codecencodings_jp 0:05:26 [ 62/407] test_codecencodings_kr 0:05:27 [ 63/407] test_codecencodings_tw 0:05:27 [ 64/407] test_codecmaps_cn 0:05:27 [ 65/407] test_codecmaps_hk 0:05:28 [ 66/407] test_codecmaps_jp 0:05:28 [ 67/407] test_codecmaps_kr 0:05:28 [ 68/407] test_codecmaps_tw 0:05:28 [ 69/407] test_codecs 0:05:35 [ 70/407] test_codeop 0:05:35 [ 71/407] test_collections 0:05:39 [ 72/407] test_colorsys 0:05:39 [ 73/407] test_compare 0:05:39 [ 74/407] test_compile 0:05:40 [ 75/407] test_compileall 0:06:27 [ 76/407] test_complex -- test_compileall passed in 46 sec 78 ms 0:06:28 [ 77/407] test_concurrent_futures 0:08:34 [ 78/407] test_configparser -- test_concurrent_futures passed in 2 min 6 sec 0:08:36 [ 79/407] test_contains 0:08:37 [ 80/407] test_contextlib 0:08:37 [ 81/407] test_copy 0:08:37 [ 82/407] test_copyreg 0:08:38 [ 83/407] test_coroutines 0:08:39 [ 84/407] test_cprofile 0:08:40 [ 85/407] test_crashers 0:08:40 [ 86/407] test_crypt 0:08:40 [ 87/407] test_csv -- test_crypt skipped 0:08:41 [ 88/407] test_ctypes 0:08:44 [ 89/407] test_curses 0:08:44 [ 90/407] test_datetime -- test_curses skipped (resource denied) 0:08:50 [ 91/407] test_dbm 0:08:51 [ 92/407] test_dbm_dumb 0:08:52 [ 93/407] test_dbm_gnu 0:08:52 [ 94/407] test_dbm_ndbm -- test_dbm_gnu skipped 0:08:52 [ 95/407] test_decimal -- test_dbm_ndbm skipped 0:09:14 [ 96/407] test_decorators 0:09:14 [ 97/407] test_defaultdict 0:09:14 [ 98/407] test_deque 0:09:25 [ 99/407] test_descr 0:09:30 [100/407] test_descrtut 0:09:31 [101/407] test_devpoll 0:09:31 [102/407] test_dict_version
[issue33834] test_asyncio: test_sendfile_close_peer_in_the_middle_of_receiving() of ProactorEventLoop logs InvalidStateError error
Jorge Ramos added the comment: While building 3.6.7. Path set to 3.6.7 working directory Running PGInstrument|x64 interpreter... Run tests sequentially Exception in callback _ProactorReadPipeTransport._loop_reading(<_OverlappedF...ne, 64, None)>) handle: )> Traceback (most recent call last): File "E:\cpython\lib\asyncio\windows_events.py", line 429, in finish_recv return ov.getresult() OSError: [WinError 64] El nombre de red especificado ya no está disponible During handling of the above exception, another exception occurred: Traceback (most recent call last): File "E:\cpython\lib\asyncio\proactor_events.py", line 256, in _loop_reading data = fut.result() File "E:\cpython\lib\asyncio\windows_events.py", line 733, in _poll value = callback(transferred, key, ov) File "E:\cpython\lib\asyncio\windows_events.py", line 433, in finish_recv raise ConnectionResetError(*exc.args) ConnectionResetError: [WinError 64] El nombre de red especificado ya no está disponible During handling of the above exception, another exception occurred: Traceback (most recent call last): File "E:\cpython\lib\asyncio\events.py", line 81, in _run self._context.run(self._callback, *self._args) File "E:\cpython\lib\asyncio\proactor_events.py", line 283, in _loop_reading self._force_close(exc) File "E:\cpython\lib\asyncio\proactor_events.py", line 118, in _force_close self._empty_waiter.set_exception(exc) asyncio.exceptions.InvalidStateError: invalid state An open stream object is being garbage collected; call "stream.close()" explicitly. Task was destroyed but it is pending! task: ()>> Task was destroyed but it is pending! task: ()>> Task was destroyed but it is pending! task: ()>> -- nosy: +neyuru ___ Python tracker <https://bugs.python.org/issue33834> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35157] Missing pyconfig.h when building from source
New submission from Jorge Ramos : When testing the builds when PGO is enabled, or by simply running rt.bat, the following error is (always) issued: cpython\include\Python.h(8): fatal error C1083: Cannot include: 'pyconfig.h': No such file or directory One example of steps taken is: git clone g...@github.com:python/cpython.git cd cpython git checkout 3.6 PCBuild\get_externals.bat Tools\msi\get_externals.bat PCBuild\build.bat -p x64 I have to manually copy a pyconfig.h file from a working Python's include directory to the repositorie's include directory to fix this error. By the way, I had PYTHONHOME environment variable pointing to ...\Python36\DLLs; ...\Python36\Lib; ...\Python36\Lib\site-packages; ...\Python36\include with no success. -- components: Build messages: 329212 nosy: neyuru priority: normal severity: normal status: open title: Missing pyconfig.h when building from source type: compile error versions: Python 3.6 ___ Python tracker <https://bugs.python.org/issue35157> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue35156] Consider revising documentation on Python Builds from source
New submission from Jorge Ramos : I want to build from source a 3.6 Python, using PGO for windows. Followed instructions at https://devguide.python.org/setup/ (the original search from google was "build python from source windows"). From a newbie perspective there are several problems: 1) it is suggested that you should build first a "debug" python (header 1.3) but they don't tell you how. 2) it is suggested that you should first build via "PCBuild\build.bat" but they don't tell you that this builds a win32 platform. What if I want to build a x64 version? (lost much time here figuring out how) 3) I ran into problems when building with "PCBuild\build.bat" (header 1.3.2) because the dependencies where not all downloaded in the first pass (but this is a bug I could fill later). Lost much time here figuring why the build did not succeed. 4) in (1.3.2) it is suggested you keep reading in a readme file: https://github.com/python/cpython/blob/master/PCbuild/readme.txt This is the first time an optimization is mentioned (other than simply compiling from your machine. I did not know that using PGO was mandatory for real speedups compared to the downloadable “general” binaries). 5) In this very same readme, it says that there are other "subprojects" that you need to consider building with Python. Lost much time here trying to figure out that these subprojects are downloaded via "get_externals.bat" in the "Getting External Sources" section. Why not simply put the "Getting External Sources" section first and avoid worrying the newcomer of potential projects that are "not included with python"? 6) They tell you that PGO is automated via a "build_pgo.bat" file. But this does not exist. 7) They tell you that first, you have to run the PGInstrument option in the build, but it is not clear what should be run next: PCBuild\build.bat -c PGUpdate -p x64" or "PCBuild\build.bat --pgo -p x64" 8) After 2 days of trying to build (and learn in the process by trial and error) I stumble upon YET ANOTHER WAY TO BUILD: the one found in "cpython\Tools\msi" NOT the first one: "cpython\PCbuild" And this is the one I was interested in the first place: building an installable version of python (yet I have to figure out how to pack all cab files and such into one exe), not a developer’s python for testing. And after now 3 days with this, I noticed that all previous testing and building techniques are indeed reachable from "cpython\Tools\msi\buildrelease.bat -x64" which tries to build a python in x64 version AND using GPO (by default -in the x64 but not in the win32-, which is not mentioned in the documentation, by the way) also generating the dependencies required (I could have avoided losing some time if knowing this from the very beginning- see point 5) As you can see, I lost few hours here, few there. And because I am not a developer (my intention is to have an optimized python for my PC for AI research) I lost much time trying to figure out things that are not explicitly said in the documentation: I managed to learn from other sources (googling around), by careful observation of the compilation results, and digging into the help section of each of the files used. Hope I successfully communicated Python’s lack of proper documentation (just for the case of building from source!) -- assignee: docs@python components: Documentation messages: 329211 nosy: docs@python, neyuru priority: normal severity: normal status: open title: Consider revising documentation on Python Builds from source type: enhancement versions: Python 3.6 ___ Python tracker <https://bugs.python.org/issue35156> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
