Get more traffic and sales making
website health perfect
Try out our free website crawler to detect all technical SEO issues in one place, fix them and get more organic traffic, satisfied users and sales
Why website health matters
Make website health perfect
Internal links can make a huge impact on website performance. Sitechecker site crawler tool will help to find broken links, explore redirects and review all the external and internal links to any single web page on your website. With the help of website crawler tool, you can fix all technical errors, review website structure and TOP landing pages to make sure you have a website with ideal health. You can download a report with "To Do" list in a few clicks, the free check of 20 URls are available for all users. Check our guide on how to crawl a website with Sitechecker.
Grow organic traffic
Googlebot loves websites with no errors. Help Google understand your website’s content and get higher rankings and more traffic. Test the overall health of your website’s SEO.
Grow conversion rate and sales
Users love fast and easy to use websites with unique and useful content. Speed up your selling pages, improve link navigation and get more conversions and sales.
Technical SEO audit is perfect for:
Entrepreneurs
- Detect problems and issues that slow down the growth of your online business
- Delegate fixing the errors to subordinates or freelancers
- Make sure your website health became perfect
- Increase sales due to better ranking
SEO specialists
- Explore link structure of any website
- Detect duplicate content, broken links and issues with meta tags
- Receive comprehensive SEO report to amaze your clients
- Save time by using automatic seo mistakes check
Developers
- Detect server side errors
- Identify pages with slow page speed
- Use step-by-step guides to fix any errors
- Make sure that your site works with any of the gadgets
What users are saying
Website on any CMS can be crawled
Your Сustom CMS
Sitechecker Crawler helps
Find broken links and audit redirects
Explore HTTP status code for each Uniform Resource Locator, find 404 pages, check where redirects lead your traffic.
Audit the most important meta tags for each URL in one window
Check meta title, h1, canonical tag, robots tags and content length for TOP landing pages. Make your on page seo optimization perfect for Google.
Check external, internal links and anchors for each URL
Check the relevance and http status codes of internal links placed a specific page. Explore the anchor list from internal links for the checked page.
Make web page speed test for each URL
Detect issues those slow down your page and use step-by-step guides to understand what files, images or code should be optimized to improve site speed.
Audit you internal Page Rank
Analyze which weight each page has. Delete from index unimportant URLs and optimize your internal links structure.
Search any URL by text or type of a technical error
No matter how big is your website. Sitechecker crawls even JavaScript websites. Convenient search by URL and type of mistakes will help to make your website ideal step by step.
Visualize your website structure
Our visualizer builds the tree of your site depends on internal linking structure (it's called virtual siloing). Also, you can check single page application architecture. It helps to understand what changes you should make in your internal linking to improve rankings.
Share crawl report with subordinates, contractors or clients
Delegate to fix technical errors on site to your subordinates or contractors. Just give access to crawl report via link or email and recrawl domain when the work will finished.
How to use website crawler
Step 1
Enter your domain.
Enter domain address as domain.com.
Step 2
Use advanced settings to specify rules of site crawling.
Advanced settings help to apply your robots.txt and sitemap.xml files.
Step 3
Watch how site crawler collects data in real time.
You can see how crawler works in real time. Just open the report by domain which status is ‘in progress’.
Step 4
Make a cup of tea or coffee.
Wait some time while crawling ends and get all urls from a website. You’ll get an email alert that audit is finished.
Step 5
Research the collected results.
Detect critical errors and fix them at first. Quick navigation will help you. All errors are prioritized from the most critical to the least critical.
Step 6
Pay more attention to the most valuable pages.
Some web pages are more valuable than others. Start from improving pages which bring the most of traffic and sales.
Wow, I want to try it right now!
How it works
Website crawler detects domain’s preferred version (http / https and www / non-www)
Before starting an audit, crawler tool checks different versions of the home page and identify which of them has 200 http status code.
Bot discovers and scans all internal and external links
Our bot finds all pages on a website. Crawler starts with scanning the main page. Using links on each page, it collects all available pages. If there are no internal links to a page, crawler won’t identify it. But how to crawl JavaScript (SPA) websites? Most crawlers can't scan dynamic websites, so they are only able to detect static response HTML. Sitechecker SEO crawler enables JavaScript rendering functionality, so JavaScript generated pages can be scanned.
Page Weight is calculated depends on website’s link structure
Page Weight parameter is calculated depends on PageRank algorithm, but only for internal links on your website. You can learn more details about this formula in original article of Sergey Brin and Lawrence Page or Ian Rogers guide.
How is Sitechecker Crawler
different from others?
Our site crawler will help you detect and fix seo errors
faster than others due to the following reasons:
Easy transition between website audit and on-page audit.
On-Page SEO Checker analyzes many technical parameters for only one specific URL. Website SEO Checker gets and analyzes all URLs from a website. To fix all errors you need regularly navigate from On Page Audit to Website Audit. We made this process as easy as possible.
Easy sorting and filtering by technical parameters.
SEO errors have different importance. All parameters inside SEO crawler were developed and prioritized by our experts in order from the most critical to the least important.
Stats for the last month
7352
domains added
2317931
URLs crawled
3064534
technical issues detected
Start from audit, continue with monitoring
- One time website’s health audit will help to get more traffic and sales.
- Hourly monitoring of website’s health will help keep your business running.
- Start from audit and we will notify you when something critical will happens.