I ran with the Perl client and it worked fine. I'm struggling to get a valid .ini file for the python client to test further. I keep getting internal NoneType errors in the python client, which probably (hopefully) means that the .ini is not quite correct. Can you send me a simple, valid pyclient .ini file to run? The ones in mtt/sample/python do not seem to be current.
On Fri, Sep 2, 2016 at 9:37 AM, r...@open-mpi.org <r...@open-mpi.org> wrote: > I tried converting all the stdout/stderr input to single strings using a > “join”, and now I’m getting a different error - looks like we are failing > to get a submit id? > > <<<<<<<---------------- Raw Output (Start) ---------------->>>>>> > <!DOCTYPE html PUBLIC > "-//W3C//DTD XHTML 1.0 Transitional//EN" > "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd"> > <html> > <head> > <meta http-equiv="Content-Type" content="text/html; > charset=utf-8"></meta> > <title>500 Internal Server Error</title> > <style type="text/css"> > #powered_by { > margin-top: 20px; > border-top: 2px solid black; > font-style: italic; > } > > #traceback { > color: red; > } > </style> > </head> > <body> > <h2>500 Internal Server Error</h2> > <p>The server encountered an unexpected condition which prevented > it from fulfilling the request.</p> > <pre id="traceback">Traceback (most recent call last): > File "/nfs/data/osl/www/mtt.open-mpi.org/mtt-modern/server/php/ > cherrypy/src/env/lib/python2.6/site-packages/cherrypy/_cprequest.py", > line 670, in respond > response.body = self.handler() > File "/nfs/data/osl/www/mtt.open-mpi.org/mtt-modern/server/php/ > cherrypy/src/env/lib/python2.6/site-packages/cherrypy/lib/encoding.py", > line 217, in __call__ > self.body = self.oldhandler(*args, **kwargs) > File "/nfs/data/osl/www/mtt.open-mpi.org/mtt-modern/server/php/ > cherrypy/src/env/lib/python2.6/site-packages/cherrypy/lib/jsontools.py", > line 63, in json_handler > value = cherrypy.serving.request._json_inner_handler(*args, **kwargs) > File "/nfs/data/osl/www/mtt.open-mpi.org/mtt-modern/server/php/ > cherrypy/src/env/lib/python2.6/site-packages/cherrypy/_cpdispatch.py", > line 60, in __call__ > return self.callable(*self.args, **self.kwargs) > File "/nfs/data/osl/www/mtt.open-mpi.org/mtt-modern/server/php/ > cherrypy/src/webapp/dispatchers.py", line 318, in POST > submit_info = self._db.get_submit_id(data['metadata']) > File "/nfs/data/osl/www/mtt.open-mpi.org/mtt-modern/server/php/ > cherrypy/src/webapp/db_pgv3.py", line 234, in get_submit_id > submit_id = self._select_insert("submit", "submit_id", fields, values) > File "/nfs/data/osl/www/mtt.open-mpi.org/mtt-modern/server/php/ > cherrypy/src/webapp/db_pgv3.py", line 183, in _select_insert > cursor.execute( select_stmt, values ) > InternalError: current transaction is aborted, commands ignored until end > of transaction block > > </pre> > <div id="powered_by"> > <span> > Powered by <a href="http://www.cherrypy.org">CherryPy 5.1.0</a> > </span> > </div> > </body> > </html> > > <<<<<<<---------------- Raw Output (End ) ---------------->>>>>> > > > On Aug 29, 2016, at 9:03 AM, Josh Hursey <jjhur...@open-mpi.org> wrote: > > Looking at the cherrypy server log it looks like the error is related to > this: > "result_stderr": [ > "Option middleware is not supported" > ], > > This value was set to an array instead of string. > > result_stdout is coming through fine as a string, but it looks like you > are submitting the result_stderr as an array still. The server treats both > of those keys the same, so it must be on the python client side. > > I don't think the server requires a MPI Install phase. It's listed as an > optional field for the test_build/test_run phases. If you don't submit an > MPI Install phase it might not show up in the MTT Reporter's default view, > but that's the same with the Perl client configured to use an already > installed build. > > > On Fri, Aug 26, 2016 at 9:40 PM, r...@open-mpi.org <r...@open-mpi.org> > wrote: > >> Hmmm...Hey Josh - is it possible that your server is requiring an >> MPI_Install phase? We don’t have one since we just build and then set the >> path accordingly - is it complaining about missing data for an install >> phase? >> >> >> On Aug 26, 2016, at 7:33 PM, r...@open-mpi.org wrote: >> >> Okay, I cleaned things up some more and got a little bit further - now >> hitting an error in the server? >> >> <<<<<<<---------------- Payload (End ) -------------------------->>>>>> >> INFO:requests.packages.urllib3.connectionpool:Resetting dropped >> connection: mtt.open-mpi.org >> DEBUG:requests.packages.urllib3.connectionpool:"POST >> /submit/cpy/api/submit HTTP/1.1" 500 2535 >> <<<<<<<---------------- Response -------------------------->>>>>> >> Result: 500: text/html;charset=utf-8 >> {'content-length': '2535', 'set-cookie': >> 'session_id=1b3f3c3df893e673e072430844afe27b4389be71; >> expires=Sat, 27 Aug 2016 03:31:28 GMT; Path=/', 'server': 'CherryPy/5.1.0', >> 'connection': 'close', 'allow': 'POST', 'date': 'Sat, 27 Aug 2016 02:31:28 >> GMT', 'access-control-allow-origin': '*', 'content-type': >> 'text/html;charset=utf-8'} >> Internal Server Error >> <<<<<<<---------------- Raw Output (Start) ---------------->>>>>> >> <!DOCTYPE html PUBLIC >> "-//W3C//DTD XHTML 1.0 Transitional//EN" >> "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd"> >> <html> >> <head> >> <meta http-equiv="Content-Type" content="text/html; >> charset=utf-8"></meta> >> <title>500 Internal Server Error</title> >> <style type="text/css"> >> #powered_by { >> margin-top: 20px; >> border-top: 2px solid black; >> font-style: italic; >> } >> >> #traceback { >> color: red; >> } >> </style> >> </head> >> <body> >> <h2>500 Internal Server Error</h2> >> <p>The server encountered an unexpected condition which prevented >> it from fulfilling the request.</p> >> <pre id="traceback">Traceback (most recent call last): >> File "/nfs/data/osl/www/mtt.open-mpi.org/mtt-modern/server/php/ch >> errypy/src/env/lib/python2.6/site-packages/cherrypy/_cprequest.py", line >> 670, in respond >> response.body = self.handler() >> File "/nfs/data/osl/www/mtt.open-mpi.org/mtt-modern/server/php/ch >> errypy/src/env/lib/python2.6/site-packages/cherrypy/lib/encoding.py", >> line 217, in __call__ >> self.body = self.oldhandler(*args, **kwargs) >> File "/nfs/data/osl/www/mtt.open-mpi.org/mtt-modern/server/php/ch >> errypy/src/env/lib/python2.6/site-packages/cherrypy/lib/jsontools.py", >> line 63, in json_handler >> value = cherrypy.serving.request._json_inner_handler(*args, **kwargs) >> File "/nfs/data/osl/www/mtt.open-mpi.org/mtt-modern/server/php/ch >> errypy/src/env/lib/python2.6/site-packages/cherrypy/_cpdispatch.py", >> line 60, in __call__ >> return self.callable(*self.args, **self.kwargs) >> File "/nfs/data/osl/www/mtt.open-mpi.org/mtt-modern/server/php/ch >> errypy/src/webapp/dispatchers.py", line 333, in POST >> value = self._db.insert_mpi_install(submit_info['submit_id'], >> data['metadata'], entry) >> File "/nfs/data/osl/www/mtt.open-mpi.org/mtt-modern/server/php/ch >> errypy/src/webapp/db_pgv3.py", line 641, in insert_mpi_install >> fields, values) >> File "/nfs/data/osl/www/mtt.open-mpi.org/mtt-modern/server/php/ch >> errypy/src/webapp/db_pgv3.py", line 183, in _select_insert >> cursor.execute( select_stmt, values ) >> ProgrammingError: operator does not exist: text = text[] >> LINE 3: ... merge_stdout_stderr = E'false' AND result_stderr = ARRAY[E'... >> ^ >> HINT: No operator matches the given name and argument type(s). You might >> need to add explicit type casts. >> >> </pre> >> <div id="powered_by"> >> <span> >> Powered by <a href="http://www.cherrypy.org">CherryPy 5.1.0</a> >> </span> >> </div> >> </body> >> </html> >> >> <<<<<<<---------------- Raw Output (End ) ---------------->>>>>> >> >> >> >> On Aug 26, 2016, at 2:01 PM, r...@open-mpi.org wrote: >> >> That appears to resolve the connection issue: >> >> <<<<<<<---------------- Payload (End ) -------------------------->>>>>> >> INFO:requests.packages.urllib3.connectionpool:Resetting dropped >> connection: mtt.open-mpi.org >> DEBUG:requests.packages.urllib3.connectionpool:"POST >> /submit/cpy/api/submit HTTP/1.1" 200 90 >> <<<<<<<---------------- Response -------------------------->>>>>> >> Result: 200: application/json >> {'content-length': '90', 'set-cookie': >> 'session_id=df54fbc661acdd2cdda5e5ee74de3b62e1fac8e5; >> expires=Fri, 26 Aug 2016 22:00:12 GMT; Path=/', 'server': 'CherryPy/5.1.0', >> 'connection': 'close', 'allow': 'POST', 'date': 'Fri, 26 Aug 2016 21:00:12 >> GMT', 'access-control-allow-origin': '*', 'content-type': >> 'application/json'} >> OK >> <<<<<<<---------------- Raw Output (Start) ---------------->>>>>> >> {"status": -2, "status_message": "[DB PG V3] (mpi_install) Missing >> field: compiler_name"} >> <<<<<<<---------------- Raw Output (End ) ---------------->>>>>> >> >> >> Looks like we are still missing some fields, though... >> >> >> On Aug 26, 2016, at 1:36 PM, Josh Hursey <jjhur...@open-mpi.org> wrote: >> >> Try this for the url: >> url = https://mtt.open-mpi.org/submit/cpy/api >> >> I'm looking back at one of my testing scripts and that's what I was using. >> >> On Fri, Aug 26, 2016 at 2:11 PM, r...@open-mpi.org <r...@open-mpi.org> >> wrote: >> >>> FWIW: the extra “/“ is inserted in the IUDatabase reporter plugin. >>> Removing it didn’t make any difference >>> >>> Must be something on the server side, I fear >>> >>> >>> On Aug 26, 2016, at 12:08 PM, r...@open-mpi.org wrote: >>> >>> BTW: here is my .ini snippet >>> >>> >>> [Reporter:IUdatabase] >>> plugin = IUDatabase >>> >>> realm = OMPI >>> username = intel >>> pwfile = /home/common/mttpwd.txt >>> platform = bend-rsh >>> hostname = rhc00[1-2] >>> url = https://mtt.open-mpi.org/submit/cpy/ >>> email = r...@open-mpi.org >>> >>> >>> So it looks like the CherryPi server is adding a /submit to the end, and >>> that might be the issue? >>> >>> On Aug 26, 2016, at 12:07 PM, r...@open-mpi.org wrote: >>> >>> Even though I can get there with the browser, I do still hit this error: >>> >>> <<<<<<<---------------- Raw Output (Start) ---------------->>>>>> >>> <!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN"> >>> <html><head> >>> <title>404 Not Found</title> >>> </head><body> >>> <h1>Not Found</h1> >>> <p>The requested URL /submit/cpy//submit was not found on this >>> server.</p> >>> <hr> >>> <address>Apache/2.2.15 (Red Hat) Server at mtt.open-mpi.org Port >>> 443</address> >>> </body></html> >>> >>> <<<<<<<---------------- Raw Output (End ) ---------------->>>>>> >>> >>> >>> It looks to me like the URL isn’t correctly set - yes? >>> >>> On Aug 26, 2016, at 7:10 AM, r...@open-mpi.org wrote: >>> >>> I checked it with my browser and got the expected return message >>> >>> >>> On Aug 25, 2016, at 1:46 PM, Josh Hursey <jjhur...@open-mpi.org> wrote: >>> >>> Can you send me the portion of the ini script that you are using? >>> >>> Can you access this site via the browser (you will need your login >>> credentials): >>> https://mtt.open-mpi.org/submit/cpy/api/ >>> It should return: >>> {"status": 0, "status_message": "Success"} >>> >>> >>> On Thu, Aug 25, 2016 at 3:01 PM, Howard Pritchard <hpprit...@gmail.com> >>> wrote: >>> >>>> HI Josh, >>>> >>>> That doesn't seem to help: >>>> >>>> <<<<<<<---------------- Payload (End ) -------------------------->>>> >>>> >> >>>> >>>> INFO:requests.packages.urllib3.connectionpool:Starting new HTTPS >>>> connection (1): mtt.open-mpi.org >>>> >>>> /Users/hpp/.virtualenvs/mtt_py3/lib/python2.7/site-packages/ >>>> requests/packages/urllib3/util/ssl_.py:315: SNIMissingWarning: An >>>> HTTPS request has been made, but the SNI (Subject Name Indication) >>>> extension to TLS is not available on this platform. This may cause the >>>> server to present an incorrect TLS certificate, which can cause validation >>>> failures. For more information, see https://urllib3.readthedocs.or >>>> g/en/latest/security.html#snimissingwarning. >>>> >>>> SNIMissingWarning >>>> >>>> /Users/hpp/.virtualenvs/mtt_py3/lib/python2.7/site-packages/ >>>> requests/packages/urllib3/util/ssl_.py:120: InsecurePlatformWarning: A >>>> true SSLContext object is not available. This prevents urllib3 from >>>> configuring SSL appropriately and may cause certain SSL connections to >>>> fail. For more information, see https://urllib3.readthedocs.or >>>> g/en/latest/security.html#insecureplatformwarning. >>>> >>>> InsecurePlatformWarning >>>> >>>> /Users/hpp/.virtualenvs/mtt_py3/lib/python2.7/site-packages/ >>>> requests/packages/urllib3/connectionpool.py:791: >>>> InsecureRequestWarning: Unverified HTTPS request is being made. Adding >>>> certificate verification is strongly advised. See: >>>> https://urllib3.readthedocs.org/en/latest/security.html >>>> >>>> InsecureRequestWarning) >>>> >>>> DEBUG:requests.packages.urllib3.connectionpool:"POST >>>> /submit/cpy//serial HTTP/1.1" 404 300 >>>> >>>> <<<<<<<---------------- Response -------------------------->>>>>> >>>> >>>> Result: 404: text/html; charset=iso-8859-1 >>>> >>>> {'Date': 'Thu, 25 Aug 2016 19:58:41 GMT', 'Content-Length': '300', >>>> 'Content-Type': 'text/html; charset=iso-8859-1', 'Connection': 'close', >>>> 'Server': 'Apache/2.2.15 (Red Hat)'} >>>> >>>> Not Found >>>> >>>> <<<<<<<---------------- Raw Output (Start) ---------------->>>>>> >>>> >>>> <!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN"> >>>> >>>> <html><head> >>>> >>>> <title>404 Not Found</title> >>>> >>>> </head><body> >>>> >>>> <h1>Not Found</h1> >>>> >>>> <p>The requested URL /submit/cpy/serial was not found on this >>>> server.</p> >>>> >>>> <hr> >>>> >>>> <address>Apache/2.2.15 (Red Hat) Server at mtt.open-mpi.org Port >>>> 443</address> >>>> >>>> </body></html> >>>> >>>> >>>> >>>> 2016-08-23 10:54 GMT-06:00 Josh Hursey <jjhur...@open-mpi.org>: >>>> >>>>> For the CherryPy submission you need to change the url to: >>>>> https://mtt.open-mpi.org/submit/cpy/ >>>>> >>>>> This is so we can have the old PHP version and the CherryPy version >>>>> running concurrently. Give that a try. >>>>> >>>>> I checked and the server is still running. >>>>> >>>>> >>>>> On Tue, Aug 23, 2016 at 10:53 AM, Howard Pritchard < >>>>> hpprit...@gmail.com> wrote: >>>>> >>>>>> HI Folks, >>>>>> >>>>>> More info, grokking the IUdatabase python code and modified my input >>>>>> I seem to get to something, but then the http request to the database >>>>>> times >>>>>> out: >>>>>> >>>>>> Hmm....okay I turned off my vpn and things got further but it looks >>>>>> like there's nothing >>>>>> at mtt.open-org: >>>>>> >>>>>> <<<<<<<---------------- Response -------------------------->>>>>> >>>>>> >>>>>> Result: 404: text/html; charset=iso-8859-1 >>>>>> >>>>>> {'Date': 'Fri, 19 Aug 2016 17:38:49 GMT', 'Content-Length': '296', >>>>>> 'Content-Type': 'text/html; charset=iso-8859-1', 'Connection': 'close', >>>>>> 'Server': 'Apache/2.2.15 (Red Hat)'} >>>>>> >>>>>> Not Found >>>>>> >>>>>> <<<<<<<---------------- Raw Output (Start) ---------------->>>>>> >>>>>> >>>>>> <!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN"> >>>>>> >>>>>> <html><head> >>>>>> >>>>>> <title>404 Not Found</title> >>>>>> >>>>>> </head><body> >>>>>> >>>>>> <h1>Not Found</h1> >>>>>> >>>>>> <p>The requested URL /submit//serial was not found on this server.</p> >>>>>> >>>>>> <hr> >>>>>> >>>>>> <address>Apache/2.2.15 (Red Hat) Server at mtt.open-mpi.org Port >>>>>> 443</address> >>>>>> >>>>>> </body></html> >>>>>> >>>>>> >>>>>> Any ideas on how to proceed? >>>>>> >>>>>> _______________________________________________ >>>>>> mtt-devel mailing list >>>>>> mtt-devel@lists.open-mpi.org >>>>>> https://rfd.newmexicoconsortium.org/mailman/listinfo/mtt-devel >>>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> Josh Hursey >>>>> IBM Spectrum MPI Developer >>>>> >>>>> _______________________________________________ >>>>> mtt-devel mailing list >>>>> mtt-devel@lists.open-mpi.org >>>>> https://rfd.newmexicoconsortium.org/mailman/listinfo/mtt-devel >>>>> >>>> >>>> >>>> _______________________________________________ >>>> mtt-devel mailing list >>>> mtt-devel@lists.open-mpi.org >>>> https://rfd.newmexicoconsortium.org/mailman/listinfo/mtt-devel >>>> >>> >>> >>> >>> -- >>> Josh Hursey >>> IBM Spectrum MPI Developer >>> _______________________________________________ >>> mtt-devel mailing list >>> mtt-devel@lists.open-mpi.org >>> https://rfd.newmexicoconsortium.org/mailman/listinfo/mtt-devel >>> >>> >>> _______________________________________________ >>> mtt-devel mailing list >>> mtt-devel@lists.open-mpi.org >>> https://rfd.newmexicoconsortium.org/mailman/listinfo/mtt-devel >>> >>> >>> >>> _______________________________________________ >>> mtt-devel mailing list >>> mtt-devel@lists.open-mpi.org >>> https://rfd.newmexicoconsortium.org/mailman/listinfo/mtt-devel >>> >>> >>> >>> _______________________________________________ >>> mtt-devel mailing list >>> mtt-devel@lists.open-mpi.org >>> https://rfd.newmexicoconsortium.org/mailman/listinfo/mtt-devel >>> >> >> >> >> -- >> Josh Hursey >> IBM Spectrum MPI Developer >> _______________________________________________ >> mtt-devel mailing list >> mtt-devel@lists.open-mpi.org >> https://rfd.newmexicoconsortium.org/mailman/listinfo/mtt-devel >> >> >> _______________________________________________ >> mtt-devel mailing list >> mtt-devel@lists.open-mpi.org >> https://rfd.newmexicoconsortium.org/mailman/listinfo/mtt-devel >> >> >> _______________________________________________ >> mtt-devel mailing list >> mtt-devel@lists.open-mpi.org >> https://rfd.newmexicoconsortium.org/mailman/listinfo/mtt-devel >> >> >> >> _______________________________________________ >> mtt-devel mailing list >> mtt-devel@lists.open-mpi.org >> https://rfd.newmexicoconsortium.org/mailman/listinfo/mtt-devel >> > > > > -- > Josh Hursey > IBM Spectrum MPI Developer > _______________________________________________ > mtt-devel mailing list > mtt-devel@lists.open-mpi.org > https://rfd.newmexicoconsortium.org/mailman/listinfo/mtt-devel > > > > _______________________________________________ > mtt-devel mailing list > mtt-devel@lists.open-mpi.org > https://rfd.newmexicoconsortium.org/mailman/listinfo/mtt-devel > -- Josh Hursey IBM Spectrum MPI Developer
_______________________________________________ mtt-devel mailing list mtt-devel@lists.open-mpi.org https://rfd.newmexicoconsortium.org/mailman/listinfo/mtt-devel