-
Notifications
You must be signed in to change notification settings - Fork 15
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add proper out-of-line test expectation files #9
Comments
As of #13 I opted for a "make code be code" approach, and there is not a function in the code where you can designate to what extent a test should run, and whether a test is expected to pass/fail at a specific step or is busted/random. There is an explicit place where one could vendor the code and apply a patch to this logic: |
As of #20 anyone using the vendor patch probably has a merge conflict of sorts from the test harness being completely rewritten, but the function and code is largely the same: Lines 35 to 50 in 6ba6865
|
You should be able to have static files checked in with your project that configure expectation/execution of tests. Similar to the web-platform-tests (WPT), you want to be able to have a shared repository of tests and for different projects to be able to pull them in. However different projects may pass/fail different tests, so you want them to be able to apply their own set of expectations externally from the actual test decls.
The default for all tests is that they will be run and expected to pass. The expectation file should ideally allow:
all-tests: run, pass
, and everything is just modifying thatPossible sources of inspiration:
The text was updated successfully, but these errors were encountered: