What is an AI agent in search?

An AI agent is an assistant that does more than answer a question. It can search, open web pages, compare options and take steps such as filling in a form or starting a booking for the person who asked. It sees your website the way a very literal visitor would.

Is SEO dead because of AI agents?

No. Agents and AI assistants mostly find candidates through search, so crawlable pages, relevant content and a strong reputation still decide whether you are considered. What changes is that your pages also need to state facts plainly and let a machine complete key tasks.

Should we block AI crawlers in robots.txt?

It depends on the crawler and your goals. Blocking crawlers used to train models is a reasonable choice for some businesses, but blocking the ones that retrieve pages to answer live questions can stop assistants from reading your site when someone asks about you. Review them one by one rather than with a blanket rule.

Do we need schema markup for AI agents to understand our site?

It helps machines read basic facts reliably, but it is not required and not a guarantee. Google states that its AI features need no special markup. Make sure the facts are written plainly on the page first, then add markup that matches them.

The Future of SEO When AI Agents Browse for You

From searching to delegating

For most of the history of search, the process went like this: a person typed a query, scanned ten results, opened a few tabs and decided. The website’s job was to win the click and then persuade a human being.

AI assistants have added a different pattern. A buyer describes what they need (“find me an accountant in Moncton who works with construction companies and can start before year end”) and the assistant does some or all of the legwork. It searches, opens pages, reads them, compares options and summarizes. The more capable versions, usually called agents, can go further: fill in a form, check availability, start a booking, add something to a cart, and hand the person a short list or a confirmation.

How quickly this becomes the normal way people buy is genuinely uncertain, and it will vary a lot by category. Booking a table or comparing products is easier to delegate than choosing a lawyer. But the direction is clear enough to act on, and the useful actions are the same whatever the pace.

This article is about what agents do on your site. For how AI assistants decide which businesses to mention in the first place, see how AI search engines find and recommend businesses.

What does not change

It is tempting to treat agents as a reason to throw out everything known about search. That would be a mistake. Agents mostly find candidates through search, either a traditional search index or the assistant’s own retrieval, which means the fundamentals still decide whether you are considered at all:

A site that can be crawled and indexed.
Pages that clearly match what people are looking for.
Content that answers real questions accurately.
A reputation that independent sources confirm: reviews, directories, associations, press, partners.

Agents also inherit the limits of the systems they use. They can be wrong, they can be inconsistent, and nobody can buy a guaranteed place in their answers. Anyone selling “agent optimization” as a separate trick that bypasses all of this is selling a slogan. Our overview of SEO and AI search visibility as one strategy covers the foundations in order.

What changes: from persuading a visitor to passing an inspection

An agent is a very patient, very literal visitor. It does not respond to atmosphere. It is looking for answers to specific questions on behalf of someone else, and when it cannot find them, it moves on to a competitor that states them plainly. Four things matter more than before.

Facts that are stated, not implied

A person can infer from a photo of a team in hard hats that you do commercial work. An agent comparing options wants it written down: what you do, for whom, where, how you price (even if the answer is “by quote after a site visit”), how soon you can start, what you do not do. Vague marketing copy that a human might forgive leaves an agent with nothing to compare.

Consistency everywhere

Agents cross-check. If your website says you serve all of southern New Brunswick, your Business Profile lists three towns and a directory still shows an old phone number, the agent has to guess, and it may simply prefer a business whose facts agree. Our guide to the business information AI systems need lists what to publish and keep aligned.

Tasks that can be completed

An agent asked to request a quote or book an appointment has to get through your form or booking tool. Unlabelled fields, steps that only work with a mouse, booking widgets that load in odd ways and contact pages with nothing but an email address all make that harder. A good rule: if a screen reader user would struggle with your form, an agent probably will too. Accessible, standard, well-labelled forms serve both.

Access

An agent cannot evaluate a page it is not allowed to load. This is the quiet failure behind many “why doesn’t the AI know about us” questions, covered in the next section.

Check that you are not blocking them by accident

Many websites block AI systems without anyone deciding to. Three places to check:

robots.txt. The major AI companies publish the names of their crawlers and what each one is used for. Some are for training models, some for retrieving pages to answer a live question, and some act for a user who asked the assistant to visit your site. Blocking a training crawler is a legitimate business choice. Blocking a retrieval crawler by accident means the assistant cannot read your pages when someone asks about you. Decide deliberately, crawler by crawler.
Firewall and bot protection. Hosting providers and content delivery networks increasingly offer settings that block AI bots in one click, and some have turned such settings on by default for new sites. Check what yours does.
Content that only appears after scripts run or a login. Prices, service areas or menus loaded by a script after the page appears, or hidden behind a login or a cookie wall, may be invisible to some systems. Put the important facts in the page itself.

This is a policy decision as much as a technical one. Some publishers have good reasons to restrict AI access to their content. For most service businesses, whose goal is to be found and hired, being readable is the point.

Structured data, in perspective

Structured data (schema markup) describes your organization, locations, services, products and events in a format machines read reliably. It is worth doing properly, because it reduces ambiguity about basic facts. It is not magic. Google has said its AI features do not require special markup beyond normal search guidance, and no AI company has published a promise that markup earns citations.

Two rules keep it useful. First, mark up what is visible on the page and true; markup that contradicts the page, or claims reviews and ratings you do not display, is a liability. Second, the visible text matters more. An agent that reads your page and finds the facts plainly stated does not need markup to understand them; one that finds only markup and vague copy has a weaker basis for recommending you.

You may also hear about new proposals for files that summarize a site specifically for AI systems. Treat those as optional experiments, not priorities, until the platforms that matter say they use them.

A worked example: the agent visits a contractor

Picture an illustrative renovation contractor serving Fredericton and the surrounding area. A homeowner asks an assistant to find three contractors who do basement renovations, are available this winter and offer written quotes, and to request quotes from them.

The agent finds candidates through search and Maps. On the first contractor’s site, the services page says “quality craftsmanship for every project” with a gallery, no mention of basements, no service area and a contact form with a required “How did you hear about us” dropdown that fails to load. The agent moves on.

The second site has a basement renovation page that states the towns served, explains that quotes follow a free site visit, notes that winter is a good season for interior work and lists the steps from inquiry to start date. The quote form has labelled fields and a clear confirmation. The Business Profile and the site agree. That contractor makes the short list and gets a quote request. Nothing about the second site required new technology. It required stating plainly what a careful human buyer would also want to know.

The no-regret moves

Because the pace is uncertain, focus on work that pays off whether agents become mainstream next year or in five:

Audit access. Review robots.txt and bot protection settings, and make a deliberate decision about each type of AI crawler.
Write down the facts. On each service page: what, for whom, where, how pricing works, how soon, what happens next. This also helps service pages rank for commercial searches.
Make key tasks completable. Test every form and booking flow with a keyboard only and a screen reader. Fix what fails.
Align your listings. Business Profile, directories, association listings and social profiles should match the website.
Keep structured data honest and current. Organization, locations and services that match the visible page.
Measure what you can. Watch referrals from AI assistants, check how they describe you on a fixed set of questions, and ask new inquiries how they found you. Our guide to measuring AI search visibility explains how to do that without false precision.

Each of those makes the site better for human visitors too, which is the point. A site that a sceptical buyer and a literal-minded agent can both understand and use is the safest bet available. That is how we approach SEO and AI visibility: fundamentals first, honest about what anyone can control.