Layout Tests

Test run summary

Timing statsHelp

Close

Timing stats

Virtual suites

Close

Keyboard navigation

• Space Show full results of the next test. This is the easiest way to navigate, just hit spacebar (and shift space to go back).
• Tab to select the next test.
• Enter to see test details. This will automatically close other details.
• ctrl A to select text of all tests for easy copying.
• f to flag/unflag a test.
• ? to blink error region of a failed image test.
• p prints full record of currently selected test to console.

Modifiers:

• Shift hold shift key to keep other details open.
• Meta meta means all. Set/unset all flags or open/close all results (max 100).

This page lets you query and display test results.

Querying Results

Select the results you are interested in using "Query" buttons.

Narrow down the results further with "Filter" search box and checkboxes. The search string can be a (full or partial) test name or bug number. Additionally, the following range specifiers are supported:

• Range of test time duration: 'time:min-' or 'time:min-max' or 'time:-max' in seconds,
• Total pixel difference: 'pixels:min-' or 'pixels:min-max' or 'pixels:-max',
• Maximum channel difference: 'channel_max:min-' or 'channel_max:min-max' or 'channel_max:-max'.

Displaying results.

You can view the list of matched tests in several result formats. Select format that works best for what you are trying to accomplish using "format" popup. Following formats are available:

1. Plain text

fast/forms/[validation-bubble-appearance-rtl-ui.html](https://cs.chromium.org/chromium/src/third_party/blink/web_tests/fast/forms/validation-bubble-appearance-rtl-ui.html?q=validation-bubble-appearance-rtl-ui.html&dr=)

Plain text shows the test path.

2. TestExpectations

[crbug.com/bug](#)layout/test/path/[test.html](#)[Status]

TestExpectationsshow lines as they'd appear in TestExpectations file.

The interesting part here is [Status]. Inside TestExpectations file, [Status] can have multiple values, representing all expected results. For example:

[Failure Timeout Crash Pass]

Result lines include existing expected values, and make a guess about what the new test expectation line should look like by merging together expected and actual results. The actual result will be shown in bold, and unexpected actual result will be shown in red (unexpected failure) or green (unexpected pass). For example:

TestResult(PASS) + TestExpectation(Failure) => [FailurePass]
TestResult(TIMEOUT CRASH) + TextExpectation(Timeout Failure) => [FailureTimeoutCrash]

If you are doing a lot of TestExpectation edits, the hope is that this will make your job as easy as copy and paste.

3. Crash site

### Crash site: Internals.cpp(3455)
  editing/pasteboard/[copy-paste-white-space.html](https://cs.chromium.org/chromium/src/third_party/blink/web_tests/editing/pasteboard/copy-paste-white-space.html?q=copy-paste-white-space.html&dr=)

Crash site groups "Crash" tests with similar stack traces together. For best results, use it while filtering only crashes.

4. Text mismatch

### Text mismatch failure: general text mismatch
  accessibility/dimensions-include-descendants.html
### Text mismatch failure: newlines only
  accessibility/aria-controls-with-tabs.html
### Text mismatch failure: spaces and tabs only
  accessibility/aria-describedby-on-input.html

Text mistmatch groups "Text failure" tests together.

5. Rebaseline

Generates a bash script to rebaseline based on new results. @xiaochengh knows the details on how to use it, and @kojii is our one user.

Viewing results of a single test

Image results

Click on images to zoom in. Select image viewing mode from the popup.

When viewing images for the first time, red flash highlights enclosing rectangle that was colored red in the diff. Diff flash and color eyedropper will not be available on file:// urls because of CSP.

Text results

Different panels show the expected, actual text results and differences.

For repaint tests, the "repaint" panel visualizes the repaint rectangles.

Flagging

Tests can be flagged by clicking on that square box on the right hand side. View all flagged tests with "Flagged" filter. "F" is the keyboard shortcut.

Bugs

If you are unhappy with results, please file a bug, or fix it here.

window.localStorage.setItem("testLocationOverride", "file://path/to/your/web_tests") is a secret preference to redirect test links to a custom url.

Passed

Regressions

Total

Counts

Query Regressions Unexpected Pass Did not pass All Flaky Unexpected flaky Flagged failures passes unexpected passes

FiltersCrash Timeout Text failure Harness failure Image failure Image+text failure Audio failure Skipped Pass Leak

Tests shown in format: Plain textTestExpectationsCrash siteText mismatchRebaseline script Copy report Copy test names Flagged only Copied.