Runner - Webdriverio

import CodeBlock from '@theme/CodeBlock';

A runner in WebdriverIO orchestrates how and where tests are being run when using the testrunner. WebdriverIO currently supports two different types of runner: local and browser runner.

Local Runner

The Local Runner initiates your framework (e.g. Mocha, Jasmine or Cucumber) within worker a process and runs all your test files within your Node.js environment. Every test file is being run in a separate worker process per capability allowing for maximum concurrency. Every worker process uses a single browser instance and therefore runs its own browser session allowing for maximum isolation.

Given every test is run in its own isolated process, it is not possible to share data across test files. There are two ways to work around this:

use the @wdio/shared-store-service to share data across all workers
group spec files (read more in Organizing Test Suite)

If nothing else is defined in the wdio.conf.js the Local Runner is the default runner in WebdriverIO.

Install

To use the Local Runner you can install it via:

npm install --save-dev @wdio/local-runner

Setup

The Local Runner is the default runner in WebdriverIO so there is no need to define it within your wdio.conf.js. If you want to explicitly set it, you can define it as follows:

// wdio.conf.js
export const {
    // ...
    runner: 'local',
    // ...
}

Browser Runner

As opposed to the Local Runner the Browser Runner initiates and executes the framework within the browser. This allows you to run unit tests or component tests in an actual browser rather than in a JSDOM like many other test frameworks.

While JSDOM is widely used for testing purposes, it is in the end not an actual browser nor can you emulate mobile environments with it. With this runner WebdriverIO enables you to easily run your tests in the browser and use WebDriver commands to interact with elements rendered on the page.

Here is an overview of running tests within JSDOM vs. WebdriverIOs Browser Runner

	JSDOM	WebdriverIO Browser Runner
1.	Runs your tests within Node.js using a re-implementation of web standards, notably the WHATWG DOM and HTML Standards	Executes your test in an actual browser and runs the code in an environment that your users use
2.	Interactions with components can only be imitated via JavaScript	You can use the WebdriverIO API to interact with elements through the WebDriver protocol
3.	Canvas support requires additional dependencies and has limitations	You have access to the real Canvas API
4.	JSDOM has some caveats and unsupported Web APIs	All Web APIs are supported as test run in an actual browser
5.	Impossible to detect errors cross browser	Support for all browsers including mobile browser
6.	Can not test for element pseudo states	Support for pseudo states such as `:hover` or `:active`

This runner uses Vite to compile your test code and load it in the browser. It comes with presets for the following component frameworks:

React
Preact
Vue.js
Svelte
SolidJS
Stencil

Every test file / test file group runs within a single page which means that between each test the page is being reloaded to guarantee isolation between tests.

Install

To use the Browser Runner you can install it via:

npm install --save-dev @wdio/browser-runner

Setup

To use the Browser runner, you have to define a runner property within your wdio.conf.js file, e.g.:

// wdio.conf.js
export const {
    // ...
    runner: 'browser',
    // ...
}

Runner Options

The Browser runner allows following configurations:

`preset`

If you test components using one of the mentioned frameworks above, you can define a preset that ensures everything is configured out of the box. This option can't be used together with viteConfig.

Example:

export const {
    // ...
    runner: ['browser', {
        preset: 'svelte'
    }],
    // ...
}

`viteConfig`

Define your own Vite configuration. You can either pass in a custom object or import an existing vite.conf.ts file if you use Vite.js for development. Note that WebdriverIO keeps custom Vite configurations to set up the test harness.

Type: string or UserConfig or (env: ConfigEnv) => UserConfig | Promise<UserConfig>

Example:

import viteConfig from '../vite.config.ts'

export const {
    // ...
    runner: ['browser', { viteConfig }],
    // or just:
    runner: ['browser', { viteConfig: '../vites.config.ts' }],
    // or use a function if your vite config contains a lot of plugins
    // which you only want to resolve when value is read
    runner: ['browser', {
        viteConfig: () => ({
            // ...
        })
    }],
    // ...
}

`headless`

If set to true the runner will update capabilities to run tests headless. By default this is enabled within CI environments where a CI environment variable is set to '1' or 'true'.

Type: boolean

Default: false, set to true if CI environment variable is set

`rootDir`

Project root directory.

Type: string

Default: process.cwd()

`coverage`

WebdriverIO supports test coverage reporting through istanbul. See Coverage Options for more details.

Type: object

Default: undefined

Coverage Options

The following options allow to configure coverage reporting.

`enabled`

Enables coverage collection.

Type: boolean

Default: false

`include`

List of files included in coverage as glob patterns.

Type: string[]

Default: [**]

`exclude`

List of files excluded in coverage as glob patterns.

Type: string[]

Default:

[
  'coverage/**',
  'dist/**',
  'packages/*/test{,s}/**',
  '**/*.d.ts',
  'cypress/**',
  'test{,s}/**',
  'test{,-*}.{js,cjs,mjs,ts,tsx,jsx}',
  '**/*{.,-}test.{js,cjs,mjs,ts,tsx,jsx}',
  '**/*{.,-}spec.{js,cjs,mjs,ts,tsx,jsx}',
  '**/__tests__/**',
  '**/{karma,rollup,webpack,vite,vitest,jest,ava,babel,nyc,cypress,tsup,build}.config.*',
  '**/.{eslint,mocha,prettier}rc.{js,cjs,yml}',
]

Make sure to check out the docs around component testing and have a look into the example repository for examples using these and various other frameworks.