Get more traffic and sales making
website health perfect

Detect all technical SEO issues in one place, fix them and get more organic traffic, satisfied users and sales

Why website health matters

Make website health perfect

With the help of website crawler you can fix all technical errors, review website structure and TOP landing pages to make sure you have a website with ideal health.

Grow organic traffic

Googlebot loves websites with no errors. Help Google understand your website’s content and get higher rankings and more traffic.

Grow conversion rate and sales

Users love fast and easy to use websites with unique and useful content. Speed up your selling pages, improve link navigation and get more conversions and sales.

Website on any CMS can be crawled

Your Сustom CMS

Sitechecker Crawler helps

Find broken links and audit redirects

Explore HTTP status code for each Uniform Resource Locator, find 404 pages, check where redirects lead your traffic.

Audit the most important meta tags for each URL in one window

Check meta title, h1, canonical tag, robots tags and content length for TOP landing pages. Make your on page seo optimization perfect for Google.

Check external, internal links and anchors for each URL

Check the relevance and http status codes of internal links placed a specific page. Explore the anchor list from internal links for the checked page.

Make web page speed test for each URL

Detect issues those slow down your page and use step-by-step guides to understand what files, images or code should be optimized to improve page speed.

Audit you internal Page Rank

Analyze which weight each page has. Delete from index unimportant URLs and optimize your internal links structure.

Search any URL by text or type of a technical error

No matter how big is your website. Convenient search by URL and type of mistakes will help to make your site ideal step by step.

Visualize your website structure

Our visualizer builds the tree of your site depends on internal linking structure (it's called virtual siloing). It helps to understand what changes you should make in your internal linking to improve rankings.

Share crawl report with subordinates, contractors or clients

Delegate to fix technical errors on site to your subordinates or contractors. Just give access to crawl report via link or email and recrawl domain when the work will finished.

How to use website crawler

Step 1.

Enter your domain.

Enter domain address as domain.com.

Step 2.

Use advanced settings to specify rules of crawling.

Advanced settings help to apply your robots.txt and sitemap.xml files before starting a crawl process.

Step 3.

Watch how site crawler collects data in real time.

You can see how crawler works in real time. Just open the report by domain which status is ‘in progress’.

Step 4.

Make a cup of tea or coffee.

Wait some time while crawling ends. You’ll get an email alert that audit is finished.

Step 5.

Research the collected results.

Detect critical errors and fix them at first. Quick navigation will help you. All errors are prioritized from the most critical to the least critical.

Step 6.

Pay more attention to the most valuable pages.

On the most websites some pages are more valuable than another. Start from improving pages which gives the most of traffic and sales.

Wow, I want to try it right now!

How it works

Website crawler detects domain’s preferred version (http / https and www / non-www)

Before starting an audit, crawler tool checks different versions of the home page and identify which of them has 200 http status code.

Bot discovers and scans all links on the website

Crawler starts from scanning the main page. Using links on each page, it collects all available pages. If there are no internal links to a page, crawler won’t identify it.

Page Weight is calculated depends on website’s link structure

Page Weight parameter is calculated depends on PageRank algorithm, but only for internal links on your website. You can learn more details about this formula in original article of Sergey Brin and Lawrence Page or Ian Rogers guide.

How Sitechecker Crawler
different from others

Our site crawler will help you detect and fix seo errors much
faster than others due to following reasons:

Easy transition between website audit and on-page audit.

On-Page SEO Checker analyzes many technical parameters for only one specific URL. Website SEO Checker analyzes all detected URLs on the site. To fix all errors you need regularly navigate from On Page Audit to Website Audit. We made this process as easy as possible.

Easy sorting and filtering by technical parameters.

SEO errors have different importance. All parameters inside crawler were developed and prioritized by our SEO experts in order from the most critical to the least important.

Stats for the last month

7352

domains added

2317931

URLs crawled

3064534

technical issues detected