Software Alternatives & Startups

Officially verified details Orcraft

The platform for test development and orchestration that lets you and your AI agents run the entire testing operation.

Orcraft

Orcraft Reviews and Details

This page is designed to help you find out whether Orcraft is good and if it is the right choice for you.

Screenshots and images

  • Build Test Suites with your AI agent //
    2026-11-12
  • Test configuration GUI generated from the Python code //
    2026-11-12
  • Running tests on remote Windows, Linux, macOS endpoints //
    2026-11-12
  • Analyze results down to step level, export to spreadsheet or for your AI agent //
    2026-11-12

Features & Specs

  1. GUI built from your code

    The controller reads your Python suite and builds the GUI from it: a widget for every parameter, dimension and endpoint. No config files, no plugins.

  2. Multi-machine tests

    One test drives several machines step by step: generate on one, transfer, verify on another. Runs queue and execute in parallel across Windows, Linux and macOS.

  3. AI agent ready

    Plain-Python suites, a full CLI and a plain-text results export let an AI agent write tests, run them and analyze the results end to end.

  4. Case matrix

    Dimensions expand one test into a matrix of cases, run in fixed or random order over any number of cycles.

  5. Step-level results

    Live logs and results per endpoint, down to the single step, with export to a spreadsheet.

  6. Endpoint pools

    A test takes any free machine that matches a label, such as an operating system or attached hardware.

  7. Automatic upload and updates

    The controller uploads the test package to each endpoint and updates its software whenever versions differ.

  8. GUI to CI

    Export a run configured in the GUI as a snapshot that runs unattended from the command line or any CI pipeline.

  9. Secure connection

    Optional mutual TLS between controller and endpoints, with token-based access control.

  10. Shared endpoints

    Endpoint machines are shared by every team member, CI runner and AI agent, and each machine is licensed once.

  11. Endpoint fan-out

    One test runs on every machine you select, as a separate run per machine with its own results. Several fan-out roles run as every combination.

  12. Sessions

    A session holds the suites, the plan and the runs. Save it to a file, reopen it later, share it, and run it again with the same plan.

  13. Run history

    Every run writes a history file beside its logs, also from the command line or CI. Open it in the controller to see that run in the tree.

  14. Rerun

    Each test run keeps the exact configuration it ran with, and reruns with that same configuration at a click.

Badges

Promote Orcraft. You can add any of these badges on your website.

SaaSHub badge
Show embed code

Questions & Answers

As answered by people managing Orcraft.
  1. What makes Orcraft unique?

    The test code is the only source of truth. Suites, tests, flows and steps are plain Python, and the controller builds its GUI from that code, including the configuration widgets for every parameter and every target machine. There is no separate configuration language, and there are no configuration files or plugins to maintain. The same suite then runs from the GUI, the command line, CI or an AI agent, across Windows, Linux and macOS machines.

  2. How would you describe the primary audience of Orcraft?

    Engineers who develop and run automated tests: test, validation and QA engineers in hardware, embedded and system labs, and software teams.

    On a single computer, Orcraft gives the tests one standard structure in plain Python, with a GUI, a command line and CI runs from the same code. With more machines, the same suite runs across a fleet of Windows, Linux and macOS machines.

    Every part of the work can be done by a person or by an AI agent, whichever suits you: writing the tests, configuring a run, running it and reading the results.

  3. Why should a person choose Orcraft over its competitors?

    Choose Orcraft to give your tests one structure, whether they run on one computer or across the real machines of a lab. Each step says which machine it runs on, so one test can work across several machines. The controller uploads the test package, runs tests in parallel and brings the logs and results back to one place.

    Because everything is plain Python, every part of the work can be done by you or by an AI agent: writing the suites, configuring a run, running it and reading the results.

    It is free to start: running tests on your own computer needs no account, and the Free Plan adds two remote machines with no card and no time limit.

  4. What's the story behind Orcraft?

    Orcraft comes out of nearly two decades of validation work: software, hardware, firmware, drivers, applications and whole systems. It puts that experience into one tool: one structure for every test suite, one way to configure and run it on a single machine or across a lab, and one place for the logs and results.

  5. Which are the primary technologies used for building Orcraft?

    Orcraft is written in Python and installs from PyPI. The controller's GUI is built with Qt, through PySide6. The controller and the endpoints talk to each other over gRPC with Protocol Buffers, directly on your own network.

Videos

Orcraft: Demo

Do you know an article comparing Orcraft to other products?
Suggest a link to a post with product alternatives.

Suggest an article

Orcraft discussion

Log in or Post with

Is Orcraft good? This is an informative page that will help you find out. Moreover, you can review and discuss Orcraft here. The primary details have been verified within the last quarter. So they could be considered up to date. If you think we are missing something, please use the means on this page to comment or suggest changes. All reviews and comments are highly encouranged and appreciated as they help everyone in the community to make an informed choice. Please always be kind and objective when evaluating a product and sharing your opinion.