I have been sending summary reports of test data to qa-reports@ for a few weeks. I produce these results using a new cross-platform test tool, PFTT, the Php Full Test Tool, which can run PHPT and PhpUnit tests across a variety of scenarios, including on Apache.
The summary report email messages are really long and hard to read in text form. What about posting my test results on qa.php.net? The summary email messages could continue as is, or only include a link to the appropriate part of qa.php.net or I could stop sending them too. I have created a mock-up of what that patch to qa.php.net might look like. You can see it here: http://131.107.220.66/PFTT-Results/qa.php.net/qa-reports.htm This would replace the page currently at (doesn't touch rest of web site): http://qa.php.net/reports/ We can't really mix test results/reports from run-test and PFTT, so they have to be shown separately. My patch first has users select which tool they want test data from. Currently, all the results I am publishing are for PHP on Windows, though I or others could run PFTT on Linux too, and publish results here also. The existing run-test page is still accessible from the patched page. I have added instructions on how to read the reports, see: http://131.107.220.66/PFTT-Results/qa.php.net/howto_phpt.htm. To try reproducing results from those reports, the report contains the PFTT command to run. Implementation wise, I can FTP(S)/SFTP the reports as flat files up to qa.php.net where PHP scripts would just get a directory listing to generate the list of branches, builds, revisions and reports. This avoids creating some complex web service or RDBMS system (which couldn't really hold all the test data anyway). Regards -Matt
