Re: [webkit-dev] Re: Automated tests (was: WebKit Project Goals)
Do the tests need anything special in them, or do standard HTML/JavaScript pages unadorned work? We have a fairly large library of HTML/JavaScript pages that can be donated to the cause at work here, mostly based on real world websites for internal testing of our rich media products. I can probably get permission to release them under an open source license from my manager (it might take up to 2 weeks thanks to the lawyer, but its possible) On 7/26/07, Darin Adler <[EMAIL PROTECTED]> wrote: On Jul 26, 2007, at 11:13 AM, Andre-John Mas wrote: > What should the requirements for the tool be, other than being > freely available? I'm not sure these are requirements, but here are some of the things I'd like to see: - representative of real world performance - one way to make it a real-world test is to use content from real-world websites, but that's the rub because the copyright owner may not give us license to use it as we wish - easy to run in an automated fashion so we can post results on the buildbots - easy to run with performance analysis tools - possible to run in non-WebKit browsers too - no "axe to grind" -- this wouldn't be a test specifically designed to highlight a particular performance problem - doesn't change a lot over time -- it's hard to judge changes in performance of the engine if the test is changing too There are other more subtle requirements. If we have too many different performance tests, they are no good because we can't run them all. If benchmarks are created by unaffiliated third parties, they are even more valuable because people won't assume they are "slanted". -- Darin ___ webkit-dev mailing list webkit-dev@lists.webkit.org http://lists.webkit.org/mailman/listinfo/webkit-dev ___ webkit-dev mailing list webkit-dev@lists.webkit.org http://lists.webkit.org/mailman/listinfo/webkit-dev
Re: [webkit-dev] Re: Automated tests (was: WebKit Project Goals)
On Jul 26, 2007, at 11:13 AM, Andre-John Mas wrote: What should the requirements for the tool be, other than being freely available? I'm not sure these are requirements, but here are some of the things I'd like to see: - representative of real world performance - one way to make it a real-world test is to use content from real-world websites, but that's the rub because the copyright owner may not give us license to use it as we wish - easy to run in an automated fashion so we can post results on the buildbots - easy to run with performance analysis tools - possible to run in non-WebKit browsers too - no "axe to grind" -- this wouldn't be a test specifically designed to highlight a particular performance problem - doesn't change a lot over time -- it's hard to judge changes in performance of the engine if the test is changing too There are other more subtle requirements. If we have too many different performance tests, they are no good because we can't run them all. If benchmarks are created by unaffiliated third parties, they are even more valuable because people won't assume they are "slanted". -- Darin ___ webkit-dev mailing list webkit-dev@lists.webkit.org http://lists.webkit.org/mailman/listinfo/webkit-dev
Re: [webkit-dev] Re: Automated tests (was: WebKit Project Goals)
On 26-Jul-07, at 14:00 , Darin Adler wrote: On Jul 26, 2007, at 10:42 AM, Andre-John Mas wrote: Are there any publicly available tools that we could use instead? I believe it would be of benefit to everyone if we were on the same page with the way we approaching testing. At the very least even if Apple uses a separate test process internally, it would be good if there were some universally available testing process that was part of the WebKit project. I agree. That would be great. We've had a hard time finding tools like what you describe, though. Any specific ideas? Can you do something to help with this? What should the requirements for the tool be, other than being freely available? Andre ___ webkit-dev mailing list webkit-dev@lists.webkit.org http://lists.webkit.org/mailman/listinfo/webkit-dev
Re: [webkit-dev] Re: Automated tests (was: WebKit Project Goals)
On Jul 26, 2007, at 10:42 AM, Andre-John Mas wrote: Are there any publicly available tools that we could use instead? I believe it would be of benefit to everyone if we were on the same page with the way we approaching testing. At the very least even if Apple uses a separate test process internally, it would be good if there were some universally available testing process that was part of the WebKit project. I agree. That would be great. We've had a hard time finding tools like what you describe, though. Any specific ideas? Can you do something to help with this? -- Darin ___ webkit-dev mailing list webkit-dev@lists.webkit.org http://lists.webkit.org/mailman/listinfo/webkit-dev
[webkit-dev] Re: Automated tests (was: WebKit Project Goals)
On 26-Jul-07, at 03:09 , Maciej Stachowiak wrote: Is there a tool or tests that can be used to ensure that Performance doesn't regress? We use a number of benchmarks internally at Apple, sadly most of them depend on things that are not freely redistributable. There are however some publicly available JavaScript and DOM benchmarks. Are there any publicly available tools that we could use instead? I believe it would be of benefit to everyone if we were on the same page with the way we approaching testing. At the very least even if Apple uses a separate test process internally, it would be good if there were some universally available testing process that was part of the WebKit project. Andre ___ webkit-dev mailing list webkit-dev@lists.webkit.org http://lists.webkit.org/mailman/listinfo/webkit-dev
Re: [webkit-dev] Building on Windows: WebKitSupportLibrary.zip is incomplete
Hi, Adam, indeed, I have missed this step. After running the update-webkit script (and passing some additional flags to curl to work via proxy), it seems all the required files are in WebKitLibraries directory. I will proceed with building WebKit. Thanks, Artem Adam Roben wrote: On Jul 26, 2007, at 12:15 AM, Artem Ananiev wrote: Hi, all, I'm trying to build WebKit on Windows platform and getting some compilation errors like missing header files: pthread.h, unicode/uchar.h and others - for example, when building JavaScriptCore sub-project. When I manually open WebKit solution in VC++ 2005 Express and check JavaScriptCode properties, I see the following list of additional include directories: "$(WebKitOutputDir)\obj\JavaScriptCore\$(ConfigurationName)\DerivedSources\" ../../ "../../os-win32/" ../../pcre/ ../../kjs/ ../../wtf/ "$(WebKitLibrariesDir)\include" "$(WebKitLibrariesDir)\include\icu" ../../../icu/include ../../bindings ../../bindings/c ../../bindings/jni "$(WebKitOutputDir)\include\JavaScriptCore" "$(WebKitLibrariesDir)\include\pthreads" In particular, pthreads.h, unicode/uchar.h, etc. are supposed to be in $(WebKitLibrariesDir) subdirs. This directory is generated by the perl script from the WebKitSupportLibrary.zip at the very beginning of the build process, before VCExpress.exe is launched. The problem is that WebKitSupportLibrary.zip archive *does not* contain the header files mentioned above. Is it a known problem with WebKit? Should I download anything else to build WebKit on Windows? The headers you mentioned are actually part of a separate zip file that update-webkit downloads and extracts for you. Did you run the update-webkit script like http://webkit.org/building/checkout.html says? -Adam ___ webkit-dev mailing list webkit-dev@lists.webkit.org http://lists.webkit.org/mailman/listinfo/webkit-dev ___ webkit-dev mailing list webkit-dev@lists.webkit.org http://lists.webkit.org/mailman/listinfo/webkit-dev
Re: [webkit-dev] Building on Windows: WebKitSupportLibrary.zip is incomplete
On Jul 26, 2007, at 12:15 AM, Artem Ananiev wrote: Hi, all, I'm trying to build WebKit on Windows platform and getting some compilation errors like missing header files: pthread.h, unicode/ uchar.h and others - for example, when building JavaScriptCore sub- project. When I manually open WebKit solution in VC++ 2005 Express and check JavaScriptCode properties, I see the following list of additional include directories: "$(WebKitOutputDir)\obj\JavaScriptCore\$(ConfigurationName) \DerivedSources\" ../../ "../../os-win32/" ../../pcre/ ../../kjs/ ../../wtf/ "$(WebKitLibrariesDir)\include" "$(WebKitLibrariesDir)\include\icu" ../../../icu/include ../../bindings ../../bindings/c ../../bindings/jni "$(WebKitOutputDir)\include\JavaScriptCore" "$(WebKitLibrariesDir)\include\pthreads" In particular, pthreads.h, unicode/uchar.h, etc. are supposed to be in $(WebKitLibrariesDir) subdirs. This directory is generated by the perl script from the WebKitSupportLibrary.zip at the very beginning of the build process, before VCExpress.exe is launched. The problem is that WebKitSupportLibrary.zip archive *does not* contain the header files mentioned above. Is it a known problem with WebKit? Should I download anything else to build WebKit on Windows? The headers you mentioned are actually part of a separate zip file that update-webkit downloads and extracts for you. Did you run the update-webkit script like http://webkit.org/building/checkout.html says? -Adam ___ webkit-dev mailing list webkit-dev@lists.webkit.org http://lists.webkit.org/mailman/listinfo/webkit-dev
Re: [webkit-dev] WebKit Project Goals
On Jul 24, 2007, at 5:05 PM, Darin Adler wrote: On Jul 24, 2007, at 5:04 PM, Maciej Stachowiak wrote: I sent this a while ago with not much comment. Any thoughts? Should I post this on webkit.org somewhere? I think you should! All right, done. I made a few changes as suggested by others: On Jul 24, 2007, at 11:27 PM, Benjamin Hawkes-Lewis wrote: Would it not be worth making an explicit goal of accessibility, or at least explicitly bracketing it under usability? I added mention of accessibility to the usability goal. On Jul 25, 2007, at 4:34 AM, David Carson wrote: Maciej, A couple of comments: Maybe in relation to the your licensing email, the LGPL statements should be updated. I made it specifically mention LGPL 2.1+. Is there a tool or tests that can be used to ensure that Performance doesn't regress? We use a number of benchmarks internally at Apple, sadly most of them depend on things that are not freely redistributable. There are however some publicly available JavaScript and DOM benchmarks. With 'Hackability', maybe add something about automated tests help ensure rapid progress. I added mention of automated regression tests. On Jul 25, 2007, at 10:35 AM, Adam Roben wrote: Here's a possible additional goal: Community - We strive to create a courteous, welcoming environment that feels approachable to newcomers. WebKit maintains a public IRC chat room and public mailing list where the ideas of contributors both new and old are heard and discussed with equal weight. I added this to the "Open Source" goal, because I think it's a key part of being a real open source project. ___ webkit-dev mailing list webkit-dev@lists.webkit.org http://lists.webkit.org/mailman/listinfo/webkit-dev
[webkit-dev] Building on Windows: WebKitSupportLibrary.zip is incomplete
Hi, all, I'm trying to build WebKit on Windows platform and getting some compilation errors like missing header files: pthread.h, unicode/uchar.h and others - for example, when building JavaScriptCore sub-project. When I manually open WebKit solution in VC++ 2005 Express and check JavaScriptCode properties, I see the following list of additional include directories: "$(WebKitOutputDir)\obj\JavaScriptCore\$(ConfigurationName)\DerivedSources\" ../../ "../../os-win32/" ../../pcre/ ../../kjs/ ../../wtf/ "$(WebKitLibrariesDir)\include" "$(WebKitLibrariesDir)\include\icu" ../../../icu/include ../../bindings ../../bindings/c ../../bindings/jni "$(WebKitOutputDir)\include\JavaScriptCore" "$(WebKitLibrariesDir)\include\pthreads" In particular, pthreads.h, unicode/uchar.h, etc. are supposed to be in $(WebKitLibrariesDir) subdirs. This directory is generated by the perl script from the WebKitSupportLibrary.zip at the very beginning of the build process, before VCExpress.exe is launched. The problem is that WebKitSupportLibrary.zip archive *does not* contain the header files mentioned above. Is it a known problem with WebKit? Should I download anything else to build WebKit on Windows? Thanks, Artem ___ webkit-dev mailing list webkit-dev@lists.webkit.org http://lists.webkit.org/mailman/listinfo/webkit-dev
