Run mobile tests on real devices in the cloud

Website
·
Documentation
·
npm

---

---

Run Espresso, XCUITest and Maestro tests on real devices in the cloud.

- Real Devices — Test on thousands of real iOS and Android devices
- Emulators & Simulators — Fast feedback with virtual devices
- Parallel Execution — Split tests across multiple devices with sharding
- CI/CD Ready — Integrates with GitHub Actions, Jenkins, and more
- Live Results — Watch tests run in real-time
- Artifacts — Download videos, screenshots, and logs

Get Started →

---

Installation

``sh
npm install -g @testingbot/cli
`

Requirements: NodeJS 20 or higher

Authentication

The CLI requires TestingBot API credentials. You can authenticate in several ways:

$3

`sh
testingbot login
`

This opens your browser for authentication. After logging in, your credentials are saved to ~/.testingbot.

$3

- Command-line options: --api-key and --api-secret
- Environment variables: TB_KEY and TB_SECRET
- Config file: Create ~/.testingbot with content key:secret

Commands

$3

Run Maestro UI tests on real devices and emulators/simulators.

`sh
testingbot maestro [options]
`

Arguments:
- app - Path to your app file (.apk, .ipa, .app, or .zip)
- flows - One or more paths to flow files (.yaml/.yml), directories, .zip files, or glob patterns

Device Options:

| Option | Description |
|--------|-------------|
| --device | Device name (e.g., "Pixel 9", "iPhone 16") |
| --platform | Platform: Android or iOS |
| --deviceVersion | OS version (e.g., "14", "17.2") |
| --real-device | Use a real device instead of emulator/simulator |
| --orientation | Screen orientation: PORTRAIT or LANDSCAPE |
| --device-locale | Device locale (e.g., "en_US", "de_DE") |
| --timezone | Timezone (e.g., "America/New_York", "Europe/London") |

Test Configuration:

| Option | Description |
|--------|-------------|
| --name | Test name for dashboard identification |
| --build | Build identifier for grouping test runs |
| --include-tags | Only run flows with these tags (comma-separated) |
| --exclude-tags | Exclude flows with these tags (comma-separated) |
| -e, --env | Environment variable for flows (can be repeated) |
| --maestro-version | Maestro version to use (e.g., "2.0.10") |

Network & Location:

| Option | Description |
|--------|-------------|
| --throttle-network | Network throttling: 4G, 3G, Edge, airplane, or disable |
| --geo-country-code | Geographic IP location (ISO country code, e.g., "US", "DE") |

Output Options:

| Option | Description |
|--------|-------------|
| --async | Start tests and exit without waiting for results |
| -q, --quiet | Suppress progress output |
| --report | Download report after completion: html or junit |
| --report-output-dir | Directory to save reports (required with --report) |
| --download-artifacts [mode] | Download test artifacts (logs, screenshots, video). Mode: all (default) or failed |
| --artifacts-output-dir | Directory to save artifacts zip (defaults to current directory) |

Advanced Options:

| Option | Description |
|--------|-------------|
| --shard-split | Split flows into N parallel sessions for faster execution |
| --ignore-checksum-check | Skip checksum verification and always upload the app |

CI/CD Integration:

| Option | Description |
|--------|-------------|
| --commit-sha | Git commit SHA associated with this test run |
| --pull-request-id | Pull request ID this test run originated from |
| --repo-name | Repository name (e.g., GitHub repo slug) |
| --repo-owner | Repository owner (e.g., GitHub organization or username) |

Examples:

`sh


Basic usage