Automatic Website Re-Reading Keeps Answers Current
Your website changes every week. Here is how your AI agent re-reads it on a schedule, what it adds and removes on its own, and what to connect for data that changes by the hour.
Automatic website re-reading keeps your AI agent's answers in step with your site: the agent visits your pages again on a schedule, so a new price, a changed policy or a new page reaches its answers without you uploading anything. In Ultimo Bots the feature is called automatic rescraping. It is opt-in and runs monthly on Boost or up to daily on Ultimo.
What is automatic website re-reading?
Automatic website re-reading is a schedule that makes an AI agent visit your web pages again and replace what it learned from them with their current text, so its answers follow your site without manual uploads. The Ultimo Bots portal calls it automatic rescraping; this guide uses both words.
Ultimo Bots is the AI agent platform where you tell Mo, the builder in the AI Studio, in plain words what your agent should do, and Mo builds it as skills that work in your own systems through public APIs and MCP servers. The agent answers from your own content: website pages, files, Q&A pairs, Google Drive, OneDrive and Notion. It learns a page when you add it. From then on it knows that page as it was on the day it last read it, so when you change the page, the agent keeps the old version until the next read.
That gap is the whole problem. A price raised on Monday, a holiday closing added on Tuesday, a service you stopped offering last month: the agent answers from the version it has. Answers from your own content are only as good as the copy of it the agent holds. Re-reading closes the gap on a rhythm you choose, and it uses no AI credits, because credits pay for answers and for Mo, not for reading your pages.
Haircut≠Parking=Holidays≠
Your page$48FreeClosed
Agent’s copy$42FreeOpen
Example values. Until the next re-read, the agent answers from its copy.
Which plans re-read your website automatically?
Two of the three plans do. As of October 29, 2026, per agent:
Smart, $29 a month or $19 a month billed yearly, with 500 AI credits: no automatic re-reading. You refresh pages by hand.
Boost, $59 a month or $39 a month billed yearly, with 2,000 AI credits: re-reads your site once a month, on the first day of the month.
Ultimo, $249 a month or $199 a month billed yearly, with 10,000 AI credits: monthly or daily, your choice.
A standard answer uses 1 AI credit, there are no per-seat fees, and teammates are free. Knowledge sources, roughly the number of pages and files the agent can learn from, run 200 on Smart, 1,000 on Boost and 10,000 on Ultimo. The pricing page has the full comparison.
The schedule checks the plan at every run. A daily schedule needs Ultimo and a monthly one needs Boost or Ultimo; if the plan no longer fits, runs are skipped until it does again. Refreshing pages by hand works on every plan.
How do you turn on automatic rescraping?
It takes a few minutes in the portal, and nothing is scheduled until you switch it on.
1
Open Website Links
In the sidebar, open Knowledge Base and then Website Links. The line above the list tells you how fresh the agent's website knowledge is, for example "Website knowledge refreshed 12 days ago", and turns into a warning after 45 days.
2
Switch it on
Turn on Activate automatic rescraping. From this moment the pages your agent already knows are on a monthly schedule, and the Automatic Rescraping Settings window opens. The sliders icon next to the switch opens it again later.
3
Pick the frequency
Choose Monthly or Daily. On Boost, Daily is greyed out with the note "Ultimo plan required".
4
Add your website
Under Websites to keep updated, type your address, for example yourcompany.com. Use Add another website for a shop or help center on its own subdomain. Every page the agent knows on these addresses is re-read at each run.
5
Set the two switches
Scan for New URLs During Rescraping adds pages that appeared on your site. Remove Old Links During Rescraping drops pages that are gone. Check both, because they only work on the addresses you added in the step before.
6
Tick other pages, then save
Pages from other sites, say a booking page on a partner's domain, appear under Other pages. Tick the ones to keep fresh (Search Links and Select All help on long lists) and click Save.
What happens to new and deleted pages?
New pages are found the way search engines find them. At each run Ultimo Bots looks for your sitemap, first in the Sitemap line of your robots.txt file, then at the usual sitemap addresses. If it finds none, it follows the links on your site two levels deep. With Scan for New URLs During Rescraping on, every page under your address that the agent does not know yet is added and read.
So when your site has a sitemap, a new page has to be in it: links are followed only when no sitemap is found. Most website builders publish a sitemap for you: Google notes that a CMS such as WordPress or Wix has likely made one available already, and shows the one line that points to it from robots.txt (Google Search Central, read October 29, 2026). If you keep a page out of your sitemap on purpose, add it by hand in Website Links: once the agent knows it, every run re-reads it, and it stays as long as it is online.
Removal is deliberately careful. With Remove Old Links During Rescraping on, a page leaves the agent's knowledge only when it is gone for sure: your server says it does not exist (404 or 410), or it redirects to a different page, as when a retired service page points to your services overview. A page missing from the sitemap but still online stays. A slow or blocked answer keeps the page until the next run checks again, and a crawl that fails or stops at its limit removes nothing at all.
Removed
404 / 410
Redirect elsewhere
Kept
Online, not in sitemap
Slow or blocked
Only a page that is gone for sure leaves the agent's knowledge. Every unsure answer keeps it.
Two kinds of pages are never removed automatically: the website address you entered, and everything under Other pages. When you retire one of those, delete it in the Website Links list.
What does a re-read actually pick up?
The text in your page's HTML. Menus, forms and buttons are left out, so the agent learns your content rather than your navigation.
Three things stay invisible. Images are read only by their alt text, so a price list posted as a picture teaches the agent the alt text and nothing more. Embedded frames (iframes), such as booking widgets, calendars and maps, are skipped. And pages behind a login are not read. If visitors ask about something that lives in one of these, put the answer in plain text on a page or add it as a Q&A pair.
Your other sources keep their own rhythm. Google Drive, OneDrive and Notion files re-sync with the Auto-sync files switch above each connector's list, monthly on Boost and up to daily on Ultimo (see the Google Drive guide and the OneDrive guide). Uploaded documents and Q&A pairs change when you change them. All of it sits in one knowledge base.
Which schedule fits your site?
Start from how often your pages really change, and remember the two ways to refresh by hand on any plan. Select pages in Website Links and click the refresh icon, Rescrape, to re-read exactly those. Or click Check for updates: it scans your site and lists "Add new pages", "Refresh existing pages" and "Remove pages that no longer exist", and removals stay unticked until you tick them.
You publish every week. A blog, news or a growing help center: Ultimo with Daily and Scan for New URLs During Rescraping on, so a new article reaches the agent the next day.
Your site changes a few times a year. Services, prices, opening hours: Boost with Monthly is enough. After a bigger edit, click Rescrape on the changed pages instead of waiting for the first of the month.
A launch or a price change is coming. On Ultimo, switch to Daily for the launch week and back to Monthly afterwards. On Boost, run Check for updates right after you publish and pick what the agent should learn.
Three ways to keep answers currentBy handRescrapingLive skill
When it updatesWhen you clickMonthly or dailyAt every question
PlansEvery planBoost and UltimoEvery plan, within its skill limit
New pagesCheck for updates lists themAdded with the scan switch onNot needed
Best forA change you just madePages that change now and thenData that changes by the hour
Whichever you pick, the schedule matters most when nobody is around to correct the agent. When no one on your team is online, the agent answers alone from what it last read, so an old page means an old answer. When it cannot answer reliably from your content, it gives what answer it can and, by default, offers once to pass the question to your team. When a teammate is online, visitors also see Talk to a human and continue in live chat in the same window.
What if your data changes faster than any schedule?
Some answers are out of date by the afternoon. Take a small music venue (a made-up example) whose program lives in its ticketing system. The program page on the website is built from it, so the page is right, but a show added at noon or a start time moved from 8 to 9 pm reaches the agent only with the next re-read, tomorrow at the earliest.
For that kind of data the agent should not read a page at all. It should ask the system that owns the data, at the moment a visitor asks. That is a skill, and you build it by telling Mo, the builder in the AI Studio, what you want in plain words:
"When someone asks what is on, get this week's shows from our ticketing system's API: date, start time, price and the ticket link. Everything else, like directions and the bar menu, still comes from our website."
Mo reads the ticketing system's public API documentation (or the part you paste in), asks for your API key in a secure field, where it is stored encrypted and never shown to the AI, then builds the skill and tests the call against your real system. On a Thursday afternoon a visitor asks: "Is anything on tonight?" The agent calls the API and replies: "I'm the venue's AI assistant. Tonight the Marta Quintet starts at 9 pm, tickets are $22, and you can get them here." The link goes straight to that show, and the start time is the one your team changed at noon.
Skill asks
Ticketingsystem9 pm
Programpage9 pm
Agent’scopy8 pm
Made-up example. The re-read copy lags behind; the skill asks the ticketing system at the moment of the question.
Mo connects your system through its public HTTPS API with an API key or access token, and Wix, Calendly, Cal.com, Stripe, HubSpot and Mailchimp have ready-made skills. Keep the skill to public data such as the week's program. Calls in Mo's test chat and in your own tests are real requests to your system.
Mo's work runs on the same AI credits as answers: a quick question uses a few credits, building a skill more. Each plan includes a number of skills, 3 on Smart, 10 on Boost and 30 on Ultimo. The same pattern fits any public figure your own system serves and changes during the day, such as current prices from your price list or today's rates. Re-reading keeps everything that changes by the week; the skill covers what changes by the hour.
Questions and answers
Does automatic rescraping cost AI credits?
No. Re-reading your pages, by hand or on a schedule, uses no AI credits. Credits pay for the agent's answers (1 per standard answer) and for Mo's work in the AI Studio. Automatic rescraping is part of Boost, $59 a month or $39 billed yearly with 2,000 AI credits, and Ultimo, $249 a month or $199 billed yearly with 10,000.
Can I re-read my website by hand?
Yes, on every plan. In Knowledge Base > Website Links, select pages and click the refresh icon (Rescrape), or click Check for updates to scan your site for new, existing and removed pages and pick what the agent should learn. Removals stay unticked until you tick them.
What happens when I delete a page from my website?
With Remove Old Links During Rescraping on, the next run removes it once the crawl no longer finds it (in your sitemap, or your links if you have no sitemap) and your server reports it gone (404 or 410) or redirects it to another page, for pages under an address in Websites to keep updated. With the switch off, or for pages under Other pages, the agent keeps the last version until you delete it in Website Links.
Why did the agent not pick up my new page?
A new page is added only when Scan for New URLs During Rescraping is on, the page sits under an address in Websites to keep updated, and the crawl finds it: in your sitemap, or, if your site has no sitemap, through links within two levels of that address. Pages more than four levels deep in the address are skipped. Add any other page by hand in Website Links. Text in images, iframes or behind a login is not read.
How often does monthly re-reading run?
Once a month, on the first day of the month, on Boost and Ultimo. Daily runs every day and needs Ultimo. If your plan no longer covers the schedule, runs are skipped until it does again, and refreshing pages by hand keeps working on every plan.
Do Google Drive, OneDrive and Notion files re-sync too?
Yes, with their own auto-sync per connector in the Knowledge Base: monthly on Boost and up to daily on Ultimo. OneDrive and Notion can also add new files and remove deleted ones, both off until you turn them on. Files you delete in Google Drive stay in the agent's knowledge until you remove them from the list.