Agents on the open web: a research note on browsing inside a decisioning loop
A taxonomy of agentic browsing, the failure modes we spent the most time on, and empirical results from six enterprise workspaces measured against a preserved holdout.
Team Markin·
#Agentic AI
#Research
#Open web
Most enterprise deployments of language-model agents still treat the open web as a footnote: a demo affordance, a search wrapper, a way to hydrate a prompt. We argue the opposite. For a revenue decisioning system, the browsing layer is not a convenience feature. It is the mechanism that lifts hypothesis generation out of the operator’s own data distribution, and it is the single largest source of new degrees of freedom the loop has gained in the past eighteen months.
This is a research note, not a product page. It documents the design choices, the failure modes we spent the most time on, and the empirical results from six enterprise workspaces that ran the browsing layer against a preserved holdout for at least eight weeks.
1. Why the open web belongs inside the loop
A revenue decisioning loop has four stations: signal, hypothesis, candidate action, experiment. Three of the four are naturally bounded by the operator’s own data. Signals are computed on first-party events. Candidate actions are constrained by the action layer the operator has wired up. Experiments are measured against a holdout on the operator’s own base. Only one station is unbounded by construction: hypothesis authorship.
Hypothesis authorship is the step that asks, of a given revenue opportunity, what plausible mechanisms might move it. In practice this step has always been the ceiling on loop throughput. A team of five senior analysts can score thousands of opportunities per week, but the number of distinct, testable hypotheses they can articulate against those opportunities is closer to fifty. The rest of the loop starves.
Language-model agents raise that ceiling, but only up to the edge of their training distribution. Without external context, an agent will produce fluent hypotheses that recycle whatever patterns already exist in the operator’s data and in the model’s pre-training. Both are, by definition, backward-looking. The browsing layer is what lets hypothesis authorship attach to the present tense.
2. A taxonomy of what browsing is actually for
We looked at 41,000 agent-initiated fetches across the six pilot workspaces and clustered them by intent. Five categories cover 94% of the traffic. They are worth naming, because most of the confusion around agentic browsing collapses when the categories are held apart.
Category A. Reference lookup. Fetching a specific public document the agent already knows exists: a regulator’s guidance page, a published tariff schedule, a company’s stated returns policy. Low creative content, high citation value. 38% of fetches.
Category B. Tonal and format widening. Reading adjacent-category material to broaden the range of candidate creative variants the agent will propose. The intent is not to copy: it is to move the agent’s proposal distribution away from the mode of its training data. 21% of fetches.
Category C. External signal discovery. Surfacing facts about the world that plausibly influence a revenue opportunity but are unreachable from first-party data: device launches, sports calendar changes, a public pricing move by a competitor, a weather anomaly. 19% of fetches.
Category D. Competitor offer surveillance. The most requested category and the most disciplined. Structured fetches of a named set of competitor surfaces on a fixed cadence, diffed against a prior snapshot, typed into the opportunity feed. 12% of fetches.
Category E. Hypothesis stress-testing. Given a proposed hypothesis, actively searching for public evidence that would falsify it before an experiment is designed. This is the highest-leverage use per fetch, and the least intuitive one. 4% of fetches, and responsible for a disproportionate share of the hypotheses that were killed before they consumed holdout.
The remaining 6% is a long tail of one-off intents that did not stabilize into a category. We keep watching them.
3. What we deliberately did not build
Two design decisions took roughly a third of the total design-review time on this project. They are worth naming explicitly, because both are load-bearing.
3.1 No autonomous writes against third-party surfaces
The browsing layer is read-only against any surface the operator does not own. Any write, whether creating an account, submitting a form, or transacting, is routed through the workspace’s normal action layer, which already has human authorization and audit. This is not a capability limitation. We chose it. The moment an agent can write to a third-party surface, the operator inherits that surface’s terms of service, its rate discipline, and its adversarial risk. None of those belong in the revenue decisioning loop.
3.2 No crawler-scale volume
The layer is bounded above by what a human analyst would plausibly fetch in a working day, with a per-workspace cap that is tunable but hard-capped. If a workspace needs higher-volume external data, the correct move is to license or purchase a feed, not to have an agent iterate. This bound is not primarily about cost. It is about the quality of the signal that survives when volume is constrained: bounded fetching forces the agent to be specific about what it is asking for, which improves the hypotheses that result.
4. Provenance, or why every fetch is a first-class object
In the workspace data model, a fetch is not a side effect of a prompt. It is a stored object with a URL, a captured timestamp, a content hash, a rendered snapshot, and a pointer to the hypothesis or candidate action that requested it. Anything the agent later cites resolves back to a specific fetch object. Anything a human reviewer wants to audit resolves back to the same object.
This matters for three reasons that are easy to underweight until an incident forces the point.
Reproducibility. A hypothesis that referenced a public page is reproducible only if the page as the agent saw it is preserved. Public pages change. Without a captured snapshot, a downstream reviewer cannot distinguish an agent hallucination from a page edit.
Attribution of causal reads. When an experiment moves ARPU, the retrospective often needs to identify which external context contributed to the hypothesis that led to the design. Provenance turns that retrospective from an anecdote into a query.
Governance of the model itself. If a browsing pattern proves to be low-quality (say, a category B source that consistently produces creative variants that underperform), the workspace can down-weight or block that source at the policy level. This is only possible because every fetch is tagged and stored.
5. Failure modes we spent the most time on
5.1 Confirmation search
The default failure mode of any browsing agent is to search for evidence that supports the hypothesis it has already produced. Left alone, the loop becomes a machine for confirmation. Our mitigation is structural, not prompt-level: category E fetches (hypothesis stress-testing) are scheduled by the loop, not requested by the hypothesis-authoring agent. A second agent, with a different system prompt and no visibility into the original hypothesis’s framing, is tasked with finding public evidence that would falsify it. The stress-test result is attached to the hypothesis before it is eligible for an experiment slot.
5.2 Source monoculture
Agents left to their own devices converge on a small number of high-authority sources. This is efficient and wrong. It narrows the tonal and analytical distribution exactly where the browsing layer is meant to widen it. Our mitigation is a per-workspace source-diversity metric computed weekly, with a soft floor. When the metric drops, the loop biases fetches toward under-represented sources for the next week. It is a small correction, applied continuously, and it has kept the pilot workspaces off the monoculture attractor for the full observation window.
5.3 Freshness illusion
A fetched page carries a timestamp, but the content on the page may be years old. Agents will treat any fetched content as recent unless forced to reason about it. The mitigation is a required extracted-date field on any category C or D fetch, with the extraction itself double-checked by a second pass. Fetches that cannot resolve an extracted date are demoted in the hypothesis authorship context.
5.4 Prompt-injection risk
Public pages are an untrusted input surface. The mitigation is standard now but was not obvious a year ago: fetched content is never composed directly into a system prompt. It is passed through a parser that strips instructions, preserved as data in a separate context slot, and the agent is prompted to treat it as evidence to reason over, not as directions to follow. Every workspace runs a red team injection suite weekly against a rotating pool of real pages the agents have fetched.
6. Empirical results from the pilot cohort
Six workspaces, eight to fourteen weeks each, browsing layer enabled on a randomized 50% of hypothesis authorship slots and disabled on the other 50%. The comparison is at the hypothesis level, not the experiment level, because the browsing layer’s effect is upstream of experiment selection.
Novel hypothesis rate. Hypotheses judged by human reviewers as materially different from any previously proposed hypothesis in the workspace rose from 11% to 27% of eligible slots. This is the primary result.
Hypothesis kill rate before experiment. Rose from 19% to 34%. This is a good outcome. It reflects category E stress-testing killing hypotheses that would previously have consumed holdout. The saved holdout was reallocated to higher-priority tests.
Experiment win rate. Rose from 22% to 29% of shipped experiments moving the target metric with significance. The mechanism, as best we can identify it, is a compositional effect of the first two: novel hypotheses that survive stress-testing are systematically better-designed at the moment they enter the experiment queue.
Time to first candidate action. Dropped 41% at the median. Category A reference lookups eliminate a large class of clarification loops between the agent and the human reviewer.
Full methodology, cohort composition, and per-workspace deltas are in the appendix distributed to the pilot operators. We will publish an anonymized version once a second cohort finishes in Q3.
7. What this changes about how the loop is staffed
The browsing layer does not reduce the number of humans involved in the loop. It changes what they do. Before, the senior analyst’s scarce skill was hypothesis authorship itself: knowing what to ask of a given revenue opportunity. After, the scarce skill is hypothesis adjudication: knowing which of the agent’s proposed hypotheses deserves holdout. This is a genuinely different job, closer to a scientific reviewer than to an analyst, and the workspaces that got the largest lift were the ones that adjusted staffing to reflect it.
8. What is next
Typed extraction. Category D fetches will land in the opportunity feed as schema-conformant objects rather than free text, so a competitor pricing change becomes a typed signal that can be joined against the workspace’s own price elasticity model.
Research notebooks. A reviewable surface where a human can see the agent’s full browsing session for a given hypothesis, including the pages it fetched, the pages it rejected, and the reasoning trace, before the hypothesis is eligible for an experiment slot.
Cross-workspace source reputation. Anonymized, opt-in signal on which sources produce hypotheses that survive stress-testing across the operator base. This is the piece we are most cautious about, because reputation systems have their own failure modes, and we would rather ship it late than ship it wrong.
9. Closing
The value of the browsing layer is not that agents can read the internet. Agents have been able to read the internet for years. The value is that inside a decisioning loop with strict provenance, structural mitigations for confirmation search, and randomized measurement against a preserved holdout, external context becomes an input that can be evaluated as rigorously as any first-party signal. The web stops being a demo and becomes a controlled source of variance in the only station of the loop that was ever really constrained by imagination.
Agentic browsing is a scoped, auditable capability that lets AI agents fetch, read and cite public web pages as part of a decisioning loop, with every fetch stored as a first-class object with URL, timestamp and content hash.
Why let agents browse the open web at all?
Because hypothesis authorship is the only station in a revenue decisioning loop that is not naturally bounded by first-party data. External context is what lifts hypotheses out of the operator's own data distribution and the model's pre-training.
How is prompt injection handled when agents browse public pages?
Fetched content is never composed directly into a system prompt. It is parsed to strip instructions, preserved as evidence in a separate context slot, and the agent is prompted to reason over it as data. A red team injection suite runs weekly against a rotating pool of real fetched pages.
Can Markin agents purchase, sign up or submit forms on third-party sites?
No. The browsing layer is read-only against any surface the operator does not own. Any write goes through the workspace action layer with human authorization.
See it in the product
This runs in Markin today.
The same loops this note describes run 24/7 against your customer base. Watch the workspace decide, experiment and execute 1:1.