XML Sitemaps & Robots.txt
Configuring your XML sitemap and robots.txt so search engines find new pages quickly and skip the ones that should not be crawled.
- Price
- From $3,800.00 per audit
- Free trial
- A free crawl and findings on up to 100 URLs, no card, no commitment.
What to send us
Access to your robots.txt, current sitemaps, CMS settings and search console, and a list of sections that should or should not be crawled.
What you get back
Updated XML sitemaps containing indexable canonical URLs, a reviewed robots.txt file, and sitemap submission and monitoring in Search Console.
What to check before you sign off
Check that sitemaps do not include redirected, blocked or noindexed pages. Clean sitemaps help search engines trust the list you provide.
Part of Technical SEO. How the work runs and what it costs across the family are set out in the SEO services guide.
Rates and common questions for this work are on the SEO Services page.
How we approach this work
Articles from the journal, written by the people who do this work. More on this subject →
XML Sitemaps, Done Properly
Six common misconceptions about XML sitemaps, debunked, with a worked example, inclusion rules, lastmod practice and a checklist for doing sitemaps properly.
SEO ServicesRobots.txt and Crawl Control: The Decisions That Matter
Learn when to use robots.txt, noindex, X-Robots-Tag, authentication or removal, with a scored comparison, a worked example and a verdict for each situation.
SEO ServicesTechnical SEO Audits, Done Properly
Learn what technical SEO audits check, how to verify crawling, rendering and indexing with Search Console, and how to rank fixes by traffic and revenue.
Often combined with XML Sitemaps & Robots.txt
The work that usually sits either side of this one. One team handles all of it, under one brief.
Technical & Documentation
Clear documentation for products and developers, written so users can get something done without contacting support.
Priced per project
Multilingual SEO Alignment
Researching what people actually search for in each language, since direct translations of keywords are often not the te...
Priced per project
Website Design
Structure first, surface second.
From $4,800.00 per project
Website Development
WordPress, Shopify, Laravel, React — built to be maintained.
From $145.00 per hour
Conversion Rate Optimization
Research first. Testing without a hypothesis is just guessing slowly.
From $2,200.00 per engagement
Paid Media
Accounts run on evidence rather than on platform defaults.
From $2,400.00 per month
Related services
Try it free: a free crawl and findings on up to 100 URLs.
No card and no commitment. If the standard is not what you need, you have lost nothing.