Last reviewed
Learn Technical SEO: From Zero to Expert
Technical SEO is the work of making sure search engines and AI assistants can find, crawl, render and index a website's pages. This learning path takes you from zero to job-ready in four stages, with over 100 resources across videos, courses, guides, tools and communities, lessons from people who do the job, and a project at every stage.
- 213resources
- 4stages
- 6 to 9 monthsto job-ready
What is technical SEO?
Technical SEO covers everything about how a website is built and served that affects whether search engines can use it. Before a page can rank in Google or be cited by ChatGPT, a crawler has to find it, fetch it, read it and decide to store it. Technical SEO makes each of those steps work.
It sits alongside two other parts of SEO. On-page SEO makes the content match what people search for. Off-page SEO earns links and mentions from other sites. Technical SEO is the foundation under both: if it is broken, good content and strong links can’t help.
- 1DiscoverCrawlers find URLs through links, sitemaps and direct submissions.
- 2CrawlA bot requests the page, follows robots.txt rules and reads the response.
- 3RenderGoogle runs the JavaScript so it can see the full page. Many AI crawlers don't.
- 4IndexThe page is stored, and one URL is chosen as the canonical version.
- 5Rank and citeStored pages appear in results and AI answers when they answer a query best.
What does a technical SEO specialist do?
- 1Crawl and audit sitesRun crawls with Screaming Frog or Sitebulb and turn hundreds of warnings into a short, prioritised fix list.
- 2Monitor Search ConsoleWatch indexing, crawl stats and Core Web Vitals, and investigate drops the day they happen.
- 3Write developer ticketsDescribe the problem, show example URLs, say what correct looks like and how to test it.
- 4Check releases before they shipTest status codes, canonicals, robots rules and rendering on staging before every launch.
- 5Plan site migrationsMap old URLs to new ones, set up redirects and track recovery after domain, CMS or URL changes.
- 6Keep sites readable for AIMake sure AI crawlers can reach key pages and that structured data describes the business correctly.
How to learn technical SEO: a step-by-step roadmap
Work through the stages in order. Each stage mixes formats so you can learn the way that suits you, then proves the skill with a checklist and a project. The hours are a rough guide for someone starting from zero. Use the filter to show only videos, only courses or only free resources.
0 to 20About 20 to 30 hours
Stage 1: Technical SEO basics
Understand how search engines find, read and store pages, and read the HTML and HTTP signals they rely on.
How search engines and AI assistants work
Start with the whole journey from a link to a ranking, so every later topic has a place to fit.
- Crawling
- Indexing
- Ranking
- Rendering
- Search index
- AI Overviews
- Retrieval for AI answers
- VideoFree
SEO course for beginnersAhrefs Academy, Sam Oh, short video lessons - VideoFree
How Google adds pages to its indexGoogle Search Central, A five minute walk through what indexing keeps and what it skips. - VideoFree
How Google finds and fetches pagesGoogle Search Central, The Search team explains discovery and crawling in plain terms. - VideoFree
How AI search engines choose sourcesAhrefs, Shows why crawl access and indexing still matter when an answer comes from an AI tool. - DocsFree
In-depth guide to how Google Search worksGoogle Search Central - GuideFree
No resources in this format for this topic.
HTML, HTTP and DNS for SEO
You do not need to code, but you must read a page source, know what a status code means and understand how a domain name finds a server.
- The head section
- Title tag
- Meta description
- Headings
- Anchor links
- View source vs inspect
- Status codes
- Response headers
- DNS
- VideoFree
HTML in under three minutesFireship, A fast tour of the tags you will see in every page source. - VideoFree
DNS in under three minutesFireship, Explains how a domain name turns into a server address. - CourseFree
Structuring content with HTMLMDN Web Docs - CourseFree
Learn HTML on web.devweb.dev, A free course from the Chrome team. The semantic HTML modules are the useful ones for SEO. - DocsFree
How HTTP worksMDN Web Docs, Requests, responses and headers explained clearly. - DocsFree
HTTP response status codesMDN Web Docs - DocsFree
SEO starter guideGoogle Search Central
No resources in this format for this topic.
Google Search Console and Bing Webmaster Tools
The free tools every technical SEO uses daily. Learn the Page indexing report and URL Inspection first, then connect Bing as well.
- Page indexing report
- URL Inspection
- Performance report
- Sitemaps report
- Property types
- Bing Webmaster Tools
- VideoFree
Five reasons to use Search ConsoleGoogle Search Central, A short case for why every site owner should set it up. - VideoFree
What to do when Google is not indexing your pagesGoogle Search Central, A first checklist from the Search team for pages that will not appear. - VideoFree
Using the URL Inspection toolGoogle Search Central, Shows how to test a live URL and read what Google stored. Menus have moved a little since. - VideoFree
Getting started with Search Console InsightsGoogle Search Central, A gentle first look at the reports for site owners. - ToolFree
Google Search ConsoleGoogle - DocsFree
URL Inspection toolSearch Console Help - DocsFree
Get started with Search ConsoleGoogle Search Central, Official setup steps and an overview of every report. - VideoFree
Google Search CentralYouTube channel - DocsFree
Google Search EssentialsGoogle Search Central - DocsFree
Bing Webmaster Tools recommendationsMicrosoft Bing
No resources in this format for this topic.
Free extensions, crawlers and checkers
You do not need a paid tool to start auditing. Install two or three extensions and use the free crawlers for status codes, headers and duplicate content.
- Browser extensions
- Free crawlers
- Header checks
- Status code checks
- Duplicate content
- VideoFree
Free SEO Chrome extensions worth installingSemrush, A quick comparison to help you pick two or three. - ToolFree
Detailed SEO ExtensionDetailed.com, quick on-page and indexability view - ToolFree
SEO Pro ExtensionChrome Web Store - ToolFree
SEO MinionKeywords Everywhere, broken links, hreflang and on-page checks - DocsFree
Inspect network activityChrome DevTools docs, see status codes and headers yourself - ToolFree
Ahrefs Webmaster ToolsAhrefs, free site audit for sites you verify - ToolGFreeGreenflareGreenflare
- ToolFree
httpstatus.iohttpstatus.io - ToolSFreeServer Headersserverheaders.com
- ToolFree plan
SitelinerSiteliner
No resources in this format for this topic.
Read one complete guide end to end
Different writers explain the same ideas differently. Pick one or two of these and read them in full before stage 2.
- Pick one guide
- Finish it
- Note what you do not understand
- Compare two writers
- VideoFree
What technical SEO is and why it mattersAhrefs, The first video in the Ahrefs course, in plain language. - VideoFree
Technical SEO habits for beginnersAhrefs, Covers the checks to run on every new site. - VideoFree
Getting started with technical SEOMoz, A short Moz introduction to what the job involves. - VideoFree
How to think about technical SEOMoz, A mental model for where technical work fits in SEO. - VideoFree
Technical SEO practices to know for 2026Rank Math SEO, A 20 minute checklist that includes AI search. - GuideFree
- GuideFree
- GuideFree
Learn technical SEOLumar Academy - GuideFree
Learn SEOScreaming Frog, short explainers for every term - GuideFree
Technical SEO hubConductor Academy, topic-by-topic articles
No resources in this format for this topic.
Check yourself: you are ready for the next stage when you can
Project
Set up and read your own site
Create a free WordPress or Blogger site with ten pages, or use a site you already control. Add it to Search Console and Bing Webmaster Tools and submit a sitemap.
- Deliver
- A one-page note explaining what the Page indexing report shows after two weeks, with screenshots.
- Done when
- You can explain every status in the report and why each page is or isn't indexed.
20 to 50About 40 to 60 hours
Stage 2: Crawling, indexing and site structure
Control what gets crawled and indexed, and explain why any page is or isn't in search.
Crawl and index control
robots.txt decides what can be crawled; meta robots and noindex decide what can be indexed. Add crawlable links, clean URLs and mobile-first indexing to complete the picture.
- robots.txt
- User agents
- Disallow vs noindex
- Meta robots
- X-Robots-Tag
- nosnippet
- Crawlable links
- Mobile-first indexing
- VideoFree
How robots.txt worksGoogle Search Central, Short and clear. Watch it before you write your first rule. - VideoFree
How Googlebot crawls the webGoogle Search Central, A longer look at fetching, limits and what slows crawling. - VideoFree
Fixing rogue robots directivesGoogle Search Central, Real cases of rules that block more than intended. - DocsFree
Robots.txt introduction and guideGoogle Search Central - DocsFree
Block search indexing with noindexGoogle Search Central - DocsFree
Robots meta tag specificationsGoogle Search Central, every directive, including X-Robots-Tag - SKILL.mdFree
Robots rules and noindex, step by stepSkill.md library, A practical checklist for choosing between Disallow, noindex and X-Robots-Tag. - DocsFree
URL structure best practicesGoogle Search Central - DocsFree
SEO link best practicesGoogle Search Central - DocsFree
Mobile-first indexing best practicesGoogle Search Central - ToolFree
Free robots.txt and rendering testersTechnicalSEO.com - ToolFree
Crawler Test SiteCrawler Test
No resources in this format for this topic.
Sitemaps, canonicals, duplicates and pagination
Sitemaps tell search engines what you want indexed; canonical tags tell them which version of similar pages to keep.
- Sitemap index files
- lastmod
- Only indexable URLs
- rel=canonical
- Duplicate URLs
- Parameters
- Canonical signals
- Pagination
- VideoFree
Do sitemaps still matter?Google Search Central, A recent discussion of what sitemaps do and do not achieve. - VideoFree
Three tips for setting up a sitemapGoogle Search Central, A short checklist before you submit one. - VideoFree
How Google picks the canonical URLGoogle Search Central, Explains the signals Google weighs when it ignores your tag. - VideoFree
Duplicate content and what to do with itGoogle Search Central, Separates harmless duplication from real problems. - DocsFree
What is a sitemapGoogle Search Central - DocsFree
Build and submit a sitemapGoogle Search Central, Formats, limits and how to submit. - GuideFree
How to audit an XML sitemapSEOSLY, Olga Zarr, step by step - DocsFree
How to specify a canonicalGoogle Search Central - DocsFree
What is URL canonicalizationGoogle Search Central, how Google chooses a canonical - SKILL.mdFree
Canonicalisation, step by stepSkill.md library, A method for finding duplicates and making all signals agree. - SKILL.mdFree
XML sitemaps, step by stepSkill.md library, A method for building clean sitemaps and auditing them against a crawl. - DocsFree
Pagination and incremental page loadingGoogle Search Central, infinite scroll and load-more buttons
No resources in this format for this topic.
Status codes, redirects and site architecture
Redirect chains, soft 404s and server errors waste crawling and lose link value. How pages link together decides what gets crawled most and what looks important.
- 301 vs 302
- Redirect chains
- Soft 404
- 410 Gone
- 5xx errors
- URL structure
- Click depth
- Orphan pages
- Hub and spoke
- VideoFree
Figuring out finicky 404sGoogle Search Central, Covers soft 404s and odd not found behaviour. - VideoFree
How to use internal linking for SEOGoogle Search Central, Google explains what internal links tell it about your pages. - VideoFree
Do URL structure changes affect SEO?Google Search Central, A short answer on when changing URLs is worth the risk. - VideoFree
Debugging the internet: HTTP, TCP and youGoogle Search Central, A deeper look at what happens between a request and a response. - VideoFree
Auditing internal links with SitebulbSitebulb, A live session that shows depth, orphans and link distribution in a real crawl. - DocsFree
How HTTP status codes affect Google's crawlersGoogle Search Central - DocsFree
Redirects and Google SearchGoogle Search Central, which redirect type to use when - DocsFree
Redirects and migrations on MDNMDN Web Docs, How redirects work at protocol level, which helps when you brief developers. - SKILL.mdFree
Redirects and status codes SKILL.mdSkill.md library, use with Claude or Codex - SKILL.mdFree
Internal linking SKILL.mdSkill.md library - GuideFree
Sitebulb Hints librarySitebulb, every issue explained with fixes
No resources in this format for this topic.
Structured data, images and video
Structured data tells search engines and AI systems what a page is about: a product, an article, an organisation. Learn the vocabulary and test everything.
- JSON-LD
- schema.org types
- Rich results
- Organization and Person
- sameAs
- Structured data policies
- Image alt text
- Image and video sitemaps
- VideoFree
Structured data for beginnersGoogle Search Central, Under three minutes on what markup is for. - VideoFree
Structured data for web developersGoogle Search Central, Shows the markup in code, useful for talking to developers. - VideoFree
SEO for Google ImagesGoogle Search Central, How images get found, and what to do about it. - DocsFree
Intro to structured dataGoogle Search Central - DocsFree
Structured data Google Search supportsGoogle Search Central, every rich result type - DocsFree
Getting started with schema.orgschema.org - DocsFree
General structured data guidelinesGoogle Search Central, The rules that decide whether markup is eligible for rich results. - SKILL.mdFree
Structured data SKILL.mdSkill.md library - DocsFree
Image SEO best practicesGoogle Search Central - DocsFree
Video SEO best practicesGoogle Search Central - DocsFree
Image sitemapsGoogle Search Central - DocsFree
Video sitemapsGoogle Search Central
No resources in this format for this topic.
Courses and crawling in practice
If you prefer one guided course over separate topics, pick one of these and do it end to end.
- Pick one course
- Finish it
- Run a crawl
- Segment a crawl
- Apply each module to a real site
- VideoFree
How to segment a crawlScreaming Frog, Group URLs by template so you can see which sections hold the problems. - VideoFree
Crawling subfolders and subdomainsScreaming Frog, Useful for the project in this stage. - VideoFree
Fundamentals of crawling for SEOMoz, Jes Scholz on what to check and in which order. - VideoFree
Screaming FrogYouTube channel - DocsFree
SEO Spider user guide and tutorialsScreaming Frog - VideoFree
Technical SEO courseAhrefs Academy, curated video lessons - CourseFree
Technical SEO and AI Search EssentialsSemrush Academy - CourseFree
SEO Learning Hub course (technical module by Aleyda Solis)Wix SEO Learning Hub
No resources in this format for this topic.
Check yourself: you are ready for the next stage when you can
Project
Your first crawl report
Crawl a real 100 to 500 page site with Screaming Frog's free version (a local business, a charity or your own site), and practise first on crawler-test.com.
- Deliver
- A report of the ten biggest issues, why each matters, and the fix, ranked by impact.
- Done when
- Someone without SEO knowledge can read your report and know what to fix first.
50 to 80About 80 to 120 hours, mostly hands-on
Stage 3: Technical SEO audits in practice
Run a full audit on a real site, prioritise the fixes, get them built and measure the result.
Running a full audit and reading Search Console data
An audit is only as good as its prioritisation. Learn a repeatable process, then adapt it. Read Search Console like a doctor reads test results: every status has a cause.
- Crawl configuration
- Issue prioritisation
- Templates vs pages
- Crawl comparison
- Audit deliverables
- Developer tickets
- Page indexing report
- Crawl Stats
- VideoFree
A technical audit in six stepsSitebulb, A short walkthrough with a free checklist to copy. - VideoFree
Structuring and communicating technical auditsSitebulb, Shows how to turn findings into work developers will accept. - VideoFree
How to read the Indexing reportGoogle Search Central, A long, careful tour of every status in the Page indexing report. - VideoFree
Crawl budget and the Crawl Stats reportGoogle Search Central, Shows how to read host status and response codes. - VideoFree
How to make a technical SEO recommendationMoz, Moz on writing a recommendation that gets built. - GuideFree
- GuideFree
SEO audit guide and templateSEOSLY, Olga Zarr, detailed checklist from a specialist auditor - SKILL.mdFree
Technical SEO audit SKILL.mdSkill.md library - SKILL.mdFree
Crawlability and indexation audit, step by stepSkill.md library, A method for diagnosing pages that are not crawled or indexed. - DocsFree
Page indexing reportSearch Console Help, what each status means and how to fix it - DocsFree
Crawl Stats reportSearch Console Help, response codes, file types and crawl purpose - GuideFree
How to compare crawlsScreaming Frog, spot what changed between two crawls
No resources in this format for this topic.
JavaScript SEO and rendering
More sites are built on React, Vue and Next.js. You need to know when content depends on JavaScript and what that costs.
- Client-side rendering
- Server-side rendering
- Static generation
- Hydration
- Rendered HTML
- Lazy loading
- VideoFree
How Google renders JavaScriptGoogle Search Central, Search Relations staff talk through rendering queues and common mistakes. - VideoFree
Website rendering strategiesGoogle Search Central, Compares client, server and static rendering for search. - VideoFree
JavaScript product page problemsGoogle Search Central, Shows typical failures on shop pages built with JavaScript. - VideoFree
JavaScript and SEO in 2025brightonSEO, A conference talk on what technical SEOs need to know now. - VideoFree
How to crawl JavaScript websitesScreaming Frog, Set up rendering in Screaming Frog and compare it with the raw HTML. - DocsFree
Understand JavaScript SEO basicsGoogle Search Central - GuideFree
The definitive guide to JavaScript SEOMoz, Jamie Indigo - DocsFree
Rendering on the webweb.dev, SSR, CSR and static rendering compared - DocsFree
Fix search-related JavaScript problemsGoogle Search Central, a debugging checklist - DocsFree
SEO Spider rendering configurationScreaming Frog, crawl with JavaScript rendering on - SKILL.mdFree
JavaScript SEO, step by stepSkill.md library, A method for finding content that only exists after rendering. - DocsFree
Lazy loading and searchGoogle Search Central, How to lazy load without hiding content from Google.
No resources in this format for this topic.
Page speed and Core Web Vitals
Learn what the three metrics measure and which fixes developers can actually make.
- LCP
- INP
- CLS
- Field vs lab data
- CrUX
- Lighthouse
- VideoFree
Understanding performance with Core Web VitalsChrome for Developers, A clear overview of the three metrics from the Chrome team. - VideoFree
How to improve responsiveness with INPChrome for Developers, Explains Interaction to Next Paint and the usual causes of slow clicks. - VideoFree
A deep dive into optimising LCPChrome for Developers, Breaks LCP into its parts so you know which part to fix. - DocsFree
Web Vitalsweb.dev - DocsFree
Core Web Vitals in SearchGoogle Search Central, What Google says about vitals and ranking. - CourseFree
Learn Performanceweb.dev - SKILL.mdFree
Core Web Vitals SKILL.mdSkill.md library - DocsFree
Introduction to LighthouseChrome for Developers - DocsFree
Chrome UX Report overviewChrome for Developers, where the real-user data comes from - GuideFree
- GuideFree
- GuideFree
No resources in this format for this topic.
Site migrations
Domain changes, redesigns and CMS moves are where most traffic is lost, and where technical SEOs earn their reputation.
- URL mapping
- Redirect maps
- Benchmarks
- Staging checks
- Post-launch monitoring
- VideoFree
Overcoming SEO problems in website migrationsbrightonSEO, A conference talk on what goes wrong and how to prevent it. - VideoFree
Migrations built to lastbrightonSEO, A recent talk on planning a migration that holds up. - VideoFree
Developers, logs and reporting during migrationsbrightonSEO, Shows how to work with engineers and watch the launch. - VideoFree
Explaining a site migration to clientsMoz, Helps you set expectations before the move. - VideoFree
What makes or breaks a migrationMoz, A short Whiteboard Friday on the common failure point. - GuideFree
The website migration guideMoz, the most-cited migration process - GuideFree
SEO checklist for site migrationWebflow, with contributing SEO consultants - DocsFree
Site moves and migrationsGoogle Search Central - SKILL.mdFree
Site migration SKILL.mdSkill.md library
No resources in this format for this topic.
AI crawlers, agent readiness and CMS platforms
AI assistants use their own bots with their own rules, and most sites you audit run on a CMS. Check access for each bot and learn where the CMS keeps its SEO settings.
- Search vs training crawlers
- User-fetch bots
- AI Overviews eligibility
- Agent-friendly pages
- CMS defaults
- SEO plugins
- Theme templates
- VideoFree
Technical SEO for AI searchAhrefs, Covers robots.txt rules for AI bots and the llms.txt proposal. - VideoFree
Building a website for the agentic eraChrome for Developers, The Chrome team on making pages work for browsing agents. - VideoFree
Blocking AI bots and crawlers with CloudflareCloudflare, Shows the settings and what each one does. - DocsFree
- DocsFree
AI features and your websiteGoogle Search Central - DocsFree
Google crawler overviewGoogle Search Central - ToolFree
AI agent readiness checkerFree tool on this site, checks 15 crawlers on any page - SKILL.mdFree
AI crawler access, step by stepSkill.md library, A method for setting one policy across robots.txt, CDN rules and logs. - SKILL.mdFree
Agent readiness, step by stepSkill.md library, A method for testing whether browsing agents can complete tasks on your site. - VideoFree
Yoast crawl optimisation settingsYoast, Shows what the plugin can remove from crawling, with its trade-offs. - GuideFree
- DocsFree
Rank Math knowledge baseRank Math
No resources in this format for this topic.
Check yourself: you are ready for the next stage when you can
Project
A real audit that gets fixes shipped
Audit a real business site with permission: a friend's business, a charity or your employer. Agree which fixes they'll build.
- Deliver
- An audit deck, the tickets you wrote, and a before-and-after Search Console comparison four to eight weeks after the fixes.
- Done when
- At least three fixes are live and you can show what changed in the data.
80 to 100Ongoing, 6 months or more
Stage 4: Advanced technical SEO
Handle large sites, unusual setups and constant change, and lead technical work with engineering teams.
Large sites, crawl budget and log files
On sites with hundreds of thousands of URLs, what Google chooses to crawl becomes a real constraint. Server logs are the ground truth behind Search Console summaries.
- Crawl capacity
- Crawl demand
- Faceted navigation
- Parameter handling
- Access logs
- Bot verification
- Wasted crawl
- VideoFree
Should you worry about crawl budget?Google Search Central, Google staff explain who needs to care and who does not. - VideoFree
Crawling challenges in the 2025 year-end reportGoogle Search Central, Shows what Google sees go wrong most often. - VideoFree
Getting into log filesbrightonSEO, A practical conference talk on what to pull from logs. - VideoFree
How log analysis helps SEObrightonSEO, Short examples of findings that led to fixes. - VideoFree
What logs say about AI search visibilityOncrawl, Shows how to see AI bots in your own logs. - DocsFree
Crawl budget managementGoogle Search Central - GuideFree
- DocsFree
Managing crawling of faceted navigation URLsGoogle Search Central - SKILL.mdFree
Faceted navigation and parameters SKILL.mdSkill.md library - DocsFree
Verifying Googlebot requestsGoogle Search Central, How to tell real Googlebot hits from fakes in your logs. - ToolFree plan
Screaming Frog Log File AnalyserScreaming Frog, free version for small log files - SKILL.mdFree
Log file analysis SKILL.mdSkill.md library
No resources in this format for this topic.
International SEO and hreflang
Multi-country and multi-language sites need hreflang, which is easy to get wrong at scale.
- hreflang
- x-default
- ccTLDs vs subfolders
- Return tags
- Language vs region
- VideoFree
Internationalisation and hreflangGoogle Search Central, Google staff discuss what hreflang can and cannot do. - VideoFree
Hunting a heinous hreflang headacheGoogle Search Central, A case study in debugging hreflang that was not working. - VideoFree
Strategic hreflang for international SEObrightonSEO, A recent talk on planning hreflang across markets. - VideoFree
XML and hreflang on large shopsbrightonSEO, Shows how to run hreflang from sitemaps at scale. - VideoFree
Three tips for international websitesGoogle Search Central, A short refresher on URL structure and language targeting. - DocsFree
Localized versions of your pagesGoogle Search Central - GuideFree
How to audit and test hreflangScreaming Frog - DocsFree
Managing multi-regional and multilingual sitesGoogle Search Central - SKILL.mdFree
Hreflang, step by stepSkill.md library, A method for planning, writing and checking hreflang. - SKILL.mdFree
International technical SEO, step by stepSkill.md library, Covers URL structure, servers and redirects for multi-market sites.
No resources in this format for this topic.
AI crawlers, bot control and edge SEO
Each AI company documents its own bots, and the CDN is where you enforce the rules. Know the names, what blocking each one does and how to act at the edge.
- Training vs search crawlers
- User agents
- robots.txt rules for AI bots
- CDN bot rules
- Edge workers
- IndexNow
- llms.txt
- VideoFree
Google crawlers behind the scenesGoogle Search Central, Search Relations staff on how Google fetchers differ. - VideoFree
SEO fixes with Cloudflare WorkersbrightonSEO, Shows edge changes made without waiting for a release. - VideoFree
Advanced SEO with htaccessbrightonSEO, Redirects and headers on Apache servers. - VideoFree
Tracking AI traffic in GA4Ahrefs, How to separate visits from AI tools in your reports. - DocsFree
- DocsFree
Perplexity crawlersPerplexity - DocsFree
The llms.txt proposalllmstxt.org, a proposal, not a standard; no major engine confirms using it for ranking - DocsFree
Cloudflare AI Crawl ControlCloudflare docs - DocsFree
Cloudflare WorkersCloudflare docs, edge changes without touching the CMS - DocsFree
IndexNow documentationIndexNow.org, How to tell Bing and other engines about changed URLs straight away. - DocsFree
Bing Webmaster GuidelinesMicrosoft Bing - DocsFree
Robots Exclusion Protocol standardIETF, The formal rules behind robots.txt, for when a parser behaves oddly.
No resources in this format for this topic.
Automation, SEO testing and diagnosing traffic drops
Senior roles expect you to pull data at scale, test changes properly and stay calm when traffic falls. Start with regex and the Search Console API, then add Python.
- Python
- Regex
- Custom extraction
- Search Console API
- BigQuery
- SEO testing
- Algorithm updates
- Annotations
- Segmenting traffic
- Technical vs content causes
- VideoFree
Search Console data in BigQuerybrightonSEO, Shows what you can answer once the export is running. - VideoFree
A one page SEO testing planSearchPilot, How to get agreement to test changes properly. - VideoFree
Custom extraction with Screaming FrogScreaming Frog, Pull prices, authors or schema fields from every page. - VideoFree
How AI is changing Google Search and SEOGoogle Search Central, A long talk that helps when you explain traffic shifts to others. - DocsFree
Search Console APIGoogle for Developers - DocsFree
Bulk data export to BigQuerySearch Central Blog, every query and URL, without row limits - CourseFree
Python for SEO: complete guide in 9 chaptersJC Chouinard - GuideFree
Custom extraction and web scrapingScreaming Frog, pull any element from every page - ToolFree
regex101Regex tester, test patterns for GSC filters and crawl rules - GuideFree
SEO test results librarySearchPilot, real split-test outcomes - DocsFree
Debug Google Search traffic dropsGoogle Search Central - DocsFree
Spam policies for Google web searchGoogle Search Central, what can get a site demoted or removed
No resources in this format for this topic.
Advanced training, newsletters, podcasts and communities
At this level you learn most from other practitioners. Pick one course, one podcast and one community.
- Specialist courses
- Podcasts
- Communities
- Conferences
- Newsletters
- CoursePaid
Tech SEO ProKristina Azarenko, about 15 hours, with certificate - VideoFree
Crawling MondaysAleyda Solis on YouTube - VideoFree
BrightonSEO talksYouTube channel, conference talks from practitioners - VideoFree
Thoughts on SEO and SEO for AIGoogle Search Central, Two Google staff discuss what has and has not changed. - PodcastGFreeSearch Off the RecordGoogle Search Relations team
- GuideFree
- GuideFree
Search Central BlogGoogle - GuideFree
Screaming Frog blogScreaming Frog - CommunityFree
Women in Tech SEOGlobal community - GuideFree
Search Engine RoundtableBarry Schwartz, daily search news - GuideFree
Polemic Digital blogBarry Adams, technical and news SEO - GuideFree plan
Growth MemoKevin Indig, SEO strategy and research
No resources in this format for this topic.
Check yourself: you are ready for the next stage when you can
Project
A public case study
Lead or support a migration, a large-site crawl project or a traffic-drop investigation.
- Deliver
- A public case study with before-and-after data, including what went wrong and what you would do differently.
- Done when
- A hiring manager could read it and understand exactly what you did and what changed.
Technical SEO tools to learn
Is technical SEO a good career?
Yes, for people who like solving puzzles and working with developers. Technical SEO is one of the most specialised parts of marketing, and the specialism tends to hold its value as search changes.
Every SEO channel depends on it
Content, links and AI search only work if pages can be crawled and indexed, so technical checks come first in almost every SEO audit.
AI search raises the stakes
AI assistants send their own crawlers, and many don't run JavaScript. Sites now have to be readable by more bots with different rules.
It bridges marketing and engineering
People who can turn a ranking problem into a clear engineering ticket are scarce in most teams, which makes the skill valuable.
It opens several career doors
Technical SEOs move into SEO leadership, growth product management, analytics and engineering roles, or go independent as consultants.
Technical SEO career path and jobs
- Entry
SEO Executive or SEO Assistant
Runs crawls, monitors Search Console and logs issues for developers to fix.
- Mid
Technical SEO Specialist
Owns audits, writes tickets, checks fixes and tests every release.
- Senior
Technical SEO Manager or Lead
Sets priorities with engineering, leads migrations and sets standards for templates.
- Leadership
Head of SEO or SEO Director
Owns organic growth across technical, content and AI search, with a budget and a team.
- Specialist
SEO Engineer
Builds SEO into code, templates and rendering, usually on large sites and marketplaces.
- Independent
Technical SEO Consultant
Runs audits and migrations for several clients at once.
Common technical SEO mistakes beginners make
MistakeTreating every crawler warning as urgent.
Do thisRank issues by pages affected and their value. Most audit warnings can wait; a few can't.
MistakeBlocking pages in robots.txt to remove them from Google.
Do thisLet them be crawled and add noindex, or return 404 or 410 if they're gone.
MistakeLaunching without checking staging leftovers.
Do thisCheck robots.txt, noindex tags and canonicals within minutes of every launch.
MistakeWriting audits that read like essays.
Do thisWrite tickets: example URLs, the problem, what correct looks like and how to test it.
MistakeOnly checking Googlebot.
Do thisTest access and readability for Bing and the AI crawlers too, especially on JavaScript sites.
MistakeFixing things without measuring.
Do thisRecord the release date and compare data before and after. Results are what get you hired and promoted.
How to get a technical SEO job
Employers hiring a first technical SEO look for evidence that you can find problems, explain them and get them fixed. Your portfolio matters more than certificates.
Job-ready checklist
- You can run a crawl and explain every major issue it finds
- You can read Search Console's indexing and performance reports fluently
- You can explain JavaScript rendering and when it causes problems
- You have written developer tickets that were built
- You can plan a basic site migration with a redirect map
- You can talk about one project where your fixes changed the numbers
Portfolio pieces that get interviews
- A technical audit of a real site, with your prioritised fix list
- A crawl comparison: JavaScript rendering off versus on, with what changed
- A redirect map and launch checklist for a migration, real or practice
- A before-and-after case study with Search Console data and dates
Technical SEO interview questions
A page isn't showing in Google. How would you find out why?
A strong answer covers: URL Inspection first: is it indexed, crawled, blocked or canonicalised elsewhere? Then robots.txt, noindex, status code, canonical, internal links and whether the content needs JavaScript. A good answer follows a clear order, not a random list.
What's the difference between robots.txt and noindex?
A strong answer covers: robots.txt controls crawling, noindex controls indexing. A blocked page can still be indexed from links, and noindex only works if the page can be crawled. Mention when you'd use each.
How would you prioritise 200 issues from an audit?
A strong answer covers: Impact on important pages, number of pages affected, effort and risk. Group issues by template, fix the ones that affect revenue pages first, and explain the trade-offs to stakeholders.
Walk me through a site migration.
A strong answer covers: Benchmark first, crawl and inventory every URL, map old to new, set 301 redirects, test on staging, launch with monitoring, then check logs, Search Console and rankings for weeks after. Mention what usually goes wrong.
How do AI crawlers change technical SEO?
A strong answer covers: More bots with different rules: training versus search crawlers, many not running JavaScript, and robots.txt or firewall settings that block them by accident. Show you'd test access for each one.
Technical SEO glossary
- Crawling
- A bot requesting pages and following links to discover more of a site.
- Indexing
- Storing a crawled page so it can appear in search results and AI answers.
- Rendering
- Running a page's JavaScript to build the final content a user sees.
- Crawl budget
- How many URLs a search engine is willing and able to crawl on a site in a given time.
- robots.txt
- A file at the root of a site that tells crawlers which paths they may request.
- noindex
- A meta tag or header that tells search engines not to keep a page in their index.
- Canonical URL
- The version of a page a search engine chooses to index when several URLs show the same content.
- 301 redirect
- A permanent redirect that passes users and most signals from an old URL to a new one.
- Soft 404
- A page that says 'not found' to users but returns a 200 status code to bots.
- XML sitemap
- A file listing the URLs a site wants search engines to crawl and index.
- hreflang
- An attribute that tells search engines which language or country version of a page to show.
- Structured data
- Code, usually JSON-LD, that describes a page's content using schema.org types.
- Core Web Vitals
- Google's three user-experience metrics: LCP for loading, INP for responsiveness and CLS for visual stability.
- Mobile-first indexing
- Google using the mobile version of a page for indexing and ranking.
- Server-side rendering
- Building the full HTML on the server so crawlers get the content without running JavaScript.
- Faceted navigation
- Filters on listing pages, such as size or colour, that can create millions of URL combinations.
- Log file
- A server record of every request, including which bots asked for which URLs and when.
- Orphan page
- A page with no internal links pointing to it, so crawlers struggle to find it.
- Redirect chain
- Several redirects in a row before reaching the final URL, which slows crawling and loses signals.
- Edge SEO
- Changing pages or headers at the CDN level, for example with Cloudflare Workers, without touching the CMS.
- User agent
- The name a bot or browser sends with each request, such as Googlebot or OAI-SearchBot.
- IndexNow
- A protocol that lets sites notify Bing and other engines instantly when URLs change.
Technical SEO FAQs
Do I need to know how to code for technical SEO?
You need to read code, not write it. Learn enough HTML to inspect a page, enough HTTP to read status codes and headers, and enough JavaScript to know when content depends on it. Most technical SEOs never ship code; they write clear tickets and check the result.
How long does it take to learn technical SEO?
As a rough guide, with five to ten hours a week you can finish the basics in about a month and be ready for a first role in six to nine months, if you do the projects. Real expertise comes from working on many different sites, which takes years.
What's the difference between technical SEO and on-page SEO?
Technical SEO makes sure pages can be crawled, rendered and indexed. On-page SEO makes the content on those pages match what people search for. They overlap on titles, headings and internal links, and most SEO jobs need both, with one as your main strength.
Is technical SEO still relevant with AI search?
More than before. AI assistants rely on crawlers too, and several don't run JavaScript, so a page that hides its content behind scripts or blocks those bots can't be cited. Checking access for every crawler is now part of the job.
Which technical SEO certification is worth getting?
Certificates help less than a portfolio, but a structured course keeps you on track. Free options include the Ahrefs and Semrush technical SEO courses; Tech SEO Pro is a respected paid option. Pair any course with a real audit you can show.
Can I learn technical SEO for free?
Yes. Every core topic on this page has free resources, and the main tools have free versions: Search Console, Bing Webmaster Tools, Screaming Frog up to 500 URLs and PageSpeed Insights. Paid tools and courses speed things up but aren't required.
More learning paths in the seo and ai search map
- Content and on-page SEOKeyword research, search intent, briefs and on-page optimisation.
- AI search optimisation (AEO and GEO)Getting cited and recommended in ChatGPT, Perplexity, Gemini and AI Overviews.
- International SEOHreflang, market selection and localisation for search.
- Local SEOGoogle Business Profiles, citations and reviews.
- E-commerce SEOProduct and category pages, faceted navigation.
- Programmatic SEOComing soonData-driven page templates at scale.
- Enterprise SEOComing soonSEO across large sites, teams and governance.
- Link building and digital PREarning links and mentions through stories and data.
- Marketplace SEOComing soonRanking inside Amazon, Jumia and Etsy search.
- App Store OptimisationApp store rankings and conversion.
- Video SEOComing soonYouTube and video search.
