Branch: refs/heads/main
Home: https://github.com/WebKit/WebKit
Commit: b96e73ea307e8a07ea7dd850da351453baae23d9
https://github.com/WebKit/WebKit/commit/b96e73ea307e8a07ea7dd850da351453baae23d9
Author: Jonathan Bedard <[email protected]>
Date: 2026-05-06 (Wed, 06 May 2026)
Changed paths:
A .claude/plugins/git-webkit/skills/classify/tests/basic.yaml
A .claude/plugins/git-webkit/skills/find/tests/basic.yaml
A Tools/Scripts/libraries/webkitcorepy/run-llm-tests
M Tools/Scripts/libraries/webkitcorepy/setup.py
A
Tools/Scripts/libraries/webkitcorepy/webkitcorepy/skill_testing/__init__.py
A
Tools/Scripts/libraries/webkitcorepy/webkitcorepy/skill_testing/skill_file.py
A
Tools/Scripts/libraries/webkitcorepy/webkitcorepy/skill_testing/skill_test.py
A
Tools/Scripts/libraries/webkitcorepy/webkitcorepy/skill_testing/validators.py
M Tools/Scripts/libraries/webkitcorepy/webkitcorepy/testing/__init__.py
A
Tools/Scripts/libraries/webkitcorepy/webkitcorepy/testing/llm_test_runner.py
A
Tools/Scripts/libraries/webkitcorepy/webkitcorepy/tests/skill_testing/__init__.py
A
Tools/Scripts/libraries/webkitcorepy/webkitcorepy/tests/skill_testing/skill_file_unittest.py
A
Tools/Scripts/libraries/webkitcorepy/webkitcorepy/tests/skill_testing/skill_test_unittest.py
A
Tools/Scripts/libraries/webkitcorepy/webkitcorepy/tests/skill_testing/validators_unittest.py
A Tools/Scripts/run-llm-tests
Log Message:
-----------
[claude] Add test harness
https://bugs.webkit.org/show_bug.cgi?id=314017
rdar://176211978
Reviewed by David Kilzer.
Add a new script, run-llm-tests, which lints and validates Claude skills within
a repository.
* .claude/plugins/git-webkit/skills/classify/tests/basic.yaml: Added new
testcase.
* .claude/plugins/git-webkit/skills/find/tests/basic.yaml: Added new testcase.
* Tools/Scripts/libraries/webkitcorepy/run-llm-tests: Generic test runner which
tests the first .claude directory it encounters.
* Tools/Scripts/libraries/webkitcorepy/setup.py: Add skill_testing.
* Tools/Scripts/libraries/webkitcorepy/webkitcorepy/skill_testing/__init__.py:
Added.
* Tools/Scripts/libraries/webkitcorepy/webkitcorepy/skill_testing/skill_file.py:
(SkillFile): Parsed representation of a Skill file.
*
Tools/Scripts/libraries/webkitcorepy/webkitcorepy/skill_testing/skill_test.py:
Added.
(SkillTest): Integration test for a single Skill.
*
Tools/Scripts/libraries/webkitcorepy/webkitcorepy/skill_testing/validators.py:
Added.
(ValidationResult):
(SkillValidator): Specific skill-linting rules.
(DirectoryValidator): Specific .claude directory linting rules.
* Tools/Scripts/libraries/webkitcorepy/webkitcorepy/testing/__init__.py:
* Tools/Scripts/libraries/webkitcorepy/webkitcorepy/testing/llm_test_runner.py:
(LLMTestRunner): Test runner invoked by run-llm-tests scripts.
*
Tools/Scripts/libraries/webkitcorepy/webkitcorepy/tests/skill_testing/__init__.py:
Added..
*
Tools/Scripts/libraries/webkitcorepy/webkitcorepy/tests/skill_testing/skill_file_unittest.py:
Added.
(SkillFileParseTest):
*
Tools/Scripts/libraries/webkitcorepy/webkitcorepy/tests/skill_testing/skill_test_unittest.py:
Added.
(SkillTestParseTest):
(SkillTestDiscoverTest):
*
Tools/Scripts/libraries/webkitcorepy/webkitcorepy/tests/skill_testing/validators_unittest.py:
Added.
(ValidationResultTest):
(ValidateFrontmatterPresenceTest):
(ValidateRequiredFieldsTest):
(ValidateFieldValuesTest):
(ValidateUnknownKeysTest):
(ValidateAllowedToolsFormatTest):
(ValidateNameMatchesDirectoryTest):
(ValidateReferencesExistTest):
(ValidateAllTest):
(ValidateSettingsJsonTest):
(ValidateMarketplaceJsonTest):
* Tools/Scripts/run-llm-tests: Run LLM tests for the WebKit project,
specifically.
Canonical link: https://commits.webkit.org/312718@main
To unsubscribe from these emails, change your notification settings at
https://github.com/WebKit/WebKit/settings/notifications
