Reinforcement learning environments went from research plumbing to a funded vendor category in about a year. The reason is agents: once labs started training models to complete long-horizon tasks in software, they needed realistic places for those agents to practice, with verifiable rewards to learn from. Building a convincing replica of Salesforce, a hospital records system, or a full coding workflow is real work, and a wave of companies now sells exactly that.
This guide maps who builds RL environments in 2026, how the vendors differ, and the part of the stack that environments do not replace: the real-world data underneath.
What an RL environment actually is
An RL environment is a controlled world where an agent acts and gets scored. In practice that means three components: a simulated task space, such as a replica of enterprise software, a codebase, a browser, or an operating system; a goal specification, often written by domain experts; and a verifier that decides whether the agent succeeded, which is where most of the engineering difficulty lives. Weak verifiers get gamed, and reward hacking is the failure mode everyone in this market is quietly fighting. Our explainer on what RL environments are covers how they train an agent, the kinds labs use, and what they cost. Our guide to training data for AI agents covers what the environments are built from.
Three kinds of vendors sell them
The first group is the human data companies that added environments to existing RLHF and evaluation businesses. Scale AI sells simulated web apps, desktop VMs, and tool-based environments. Surge AI built an enterprise simulation suite. Mercor added environments alongside its expert networks, including through acquisitions. Our guide to Mercor alternatives covers that company's full trajectory.
Turing and Centific pitch environments as part of broader data services; we cover Centific's version in our guide to Centific alternatives. The pitch here is one vendor for data, evals, and environments together.
The second group is environment-native startups, founded for this market specifically. Mechanize builds high-fidelity coding environments for frontier labs. Fleet AI replicates enterprise software like CRMs and spreadsheets in high fidelity. HUD wraps real software as agent-callable tools in containers. Veris AI and Plato build simulated enterprise and web worlds. Bespoke Labs comes at it from the tooling side, with open-source libraries for curation and evaluation. These companies tend to be deeper on a specific environment type and faster-moving than the incumbents. If you're building on that side of the market, our guide to how to sell RL environments to AI labs covers who buys, what they pay, and the three ways to reach them.
The third group is open ecosystems and infrastructure. Prime Intellect hosts thousands of community-built environments with an open verifier library. General Reasoning runs a community hub with a unified API. Underneath all of it sit sandbox and compute providers like Modal and E2B, which run the containers everyone else's environments execute in.
The landscape
| Company | Category | Known for |
|---|---|---|
| Scale AI | Data giant | Simulated web apps, desktop VMs and tool-based environments |
| Surge AI | Data giant | Enterprise simulation suite |
| Mercor | Data giant | Environments alongside its expert networks |
| Centific | Data giant | Environments as part of broader data services |
| Turing | Data giant | Coding environments over real and private codebases |
| Mechanize | Environment-native | High-fidelity coding environments for frontier labs |
| Fleet AI | Environment-native | Enterprise software replicas |
| HUD | Environment-native | Real software wrapped as agent-callable tools |
| Veris AI | Environment-native | Simulated enterprise and web worlds |
| Bespoke Labs | Environment-native | Open tooling for curation and evals |
| Prime Intellect | Open ecosystem | Community hub of thousands of environments |
| Modal, E2B | Infrastructure | Sandboxed compute the environments run on |
Which RL environment vendor fits which job
Most vendors go deep on one or two kinds of environment, so start from what your agent has to do.
- Coding and software engineering agents. Mechanize builds high-fidelity coding environments for frontier labs, and Turing builds coding environments over real and private codebases.
- Computer-use and browser agents. Scale AI sells simulated web apps, desktop VMs and tool-based environments. HUD wraps real software as tools an agent can call, and Veris AI and Plato build simulated web worlds.
- Enterprise software and knowledge-work agents. Fleet AI replicates enterprise software like CRMs and spreadsheets, Surge AI built an enterprise simulation suite, and Veris AI and Plato build simulated enterprise worlds.
- One vendor for data, evaluation and environments. Mercor sells environments alongside its expert networks, and Centific and Turing sell them as part of broader data services.
- Open environments you run yourself. Prime Intellect hosts thousands of community-built environments with an open verifier library, General Reasoning runs a community hub with a unified API, and Modal and E2B supply the sandboxes they run in.
For narrower jobs like security auditing, report writing or data analysis, expect custom work. Bring the vendor your task list and ask which of their existing environments come closest.
Whichever vendor you pick, ask three things about reward hacking before you sign:
- How do you test a verifier against an agent that's trying to game it?
- Which failure cases have you caught, and what did you change?
- Can we run our own agent against a sample environment first?
How to buy in a market this young
Three cautions. First, definitions vary wildly: one vendor's "environment" is a full software replica with expert-written goals and verifiers, another's is a sandbox with a prompt. Ask exactly what ships. Second, verifier quality is the product. A beautiful simulation with a gameable reward teaches your agent to cheat; ask how verifiers are tested against reward hacking. Third, most environment work is still custom, so treat public offerings as starting points and scope carefully, the same discipline we recommend for choosing any data vendor.
Environments do not replace data
Here is the part of the stack the environment wave tends to obscure. An environment teaches an agent to act, but the model inside the agent still has to understand the world it is acting in, and that understanding comes from training data. World models learn physics and object behavior from real video. Agents that operate software learn interfaces from real demonstrations. Game-playing and embodied models learn from gameplay data, task demonstrations, and first-person footage of humans actually doing things.
Simulation and real-world data are complements: the environment provides practice and verification, the data provides the ground truth the simulation is built from and the model is grounded in. Labs that skip the second half get agents that ace the benchmark and fumble reality.
Where Troveo fits
Troveo does not build RL environments. Troveo licenses the real-world interaction data that agent and world-model teams train on: gameplay footage, task demonstrations, tool manipulation, first-person navigation, and real workflows, sourced from more than 7,000 rights holders and cleared for AI training with documentation per asset. If you are standing up an environment program, that data is what grounds the model before the environment sharpens it. Our guide to AI training data marketplaces covers how labs buy licensed data like this. Talk to us about what your agents need to learn from.
