Explore What 404 Page Is, Why It Appears and How to Track 404 Errors on the Website

page_watches 267270 page_stars
img-border What is a 404 error?

Table of contents

 

 

What is a 404 error?

 

“Error 404” (or “Page Not Found”) – is a standard HTTP status code that occurs when the server can’t find the document requested by a user. Basically, this is a page that doesn’t exist.

 

img-border
404 page exampleimg-close

 

The reasons for a page not found error

 

Ideally, there shouldn’t be any links that return 404 errors on the site (or external links). But let’s be realistic, if the site has more than a thousand pages, the occurrence of a 404 error can’t be avoided. It can be a bit surprising though when you find a site with a small number of pages (which means that all broken pages can be traced manually) that contain three broken links to articles in the “Latest News” section of the front page.

 

Significant increase in the number of 404 errors

 

It’s one thing when a site is bypassed, and search engine robots report on several dozens of errors, but what if this number increases by hundreds or even thousands? A prompt intervention and solution should be initiated if the number of 404 errors exceed 10% of the total number of pages on the website. There can be many reasons for the appearance of such a larger number of non-existent pages, but mostly they are related to problems with the code (for instance, these pages were created with the help of scripts and styles, and the styles are in the code of the template, and not in a separate file).
Another reason why robots bypass pages that have never been on the site is because of virus attacks (for example, placing doorway pages on the website). Even after its prevention and removal, robots will continue to bypass the created pages for some time afterwards, and this can lead to the appearance of numerous 404 errors. But, thanks to various tools, you can easily track conversions on such links.

 

How to track down broken links and their redirections?

 

Yandex.Metrica
To track broken links and redirections in Yandex.Metrica you need to go to “Visitor settings”. Just place this string in the counter code:

params:window.yaParams||{ }});

Also you should place this JS-code somewhere on the 404 page:

<script>
var url = document.location.pathname + document.location.search
var url_referrer = document.referrer;
var yaParams = {error404: {page: url, from: url_referrer}};
</script>

Here url – is the current address of the 404 page, and url referrer is the address from which it was accessed. This way you can not only track all the broken links, but also the pages on which they are placed.

 

Google Analytics
To track the redirections, you should place this code on a 404 page:

<script>
ga('send', 'pageview', '404.html?page='+ document.location.pathname + document.location.search +'&from=' + document.referrer);
</script>

Where document.location.pathname + document.location.search – is the URL of the page not found on the site;
document.referrer – URL of the page which the user was redirected from.

 

Yandex.Webmaster
To find these pages you need to select the section “Indexing” – “Searchable pages” – “Excluded pages”. Here you can select the pages that have the error using the “Error HTTP: 404” filter.

 

img-border
404 pages in Yandex Webmastersimg-close

 

Google Search Console
You can also find errors using “Crawl” – “Crawl errors” – “Error 404” in Google Webmaster.

 

img-border
404 pages in Google Search Consoleimg-close

 

What is the danger of a 404 error?

 

There is an opinion that pages with a 404 error directly influence the indexing of the site and its position in the search results negatively, but in most cases this statement is wrong. What happens to such a page when the robot finds it? It removes it from the index (if it’s there, if not – the bot simply doesn’t scan it). This is natural, because the page is no longer informative and useful. But you need to remember the existence of SOFT errors. SOFT 404 is not an official response from the server, but rather a tag, assigned to pages by search engines after a crawl.
What is wrong with these pages and why do search engines make such decisions?

1. There is little or no content on the page (Google can consider it as 404, Yandex as substandard quality).
2. There is a redirection to the page, which does not meet the users’ request.
3. The non-existent page doesn’t provide either a 404 or 410 server response.

 

What to choose: 301 or 404?
After deleting the page, a new question arises: what is the next step? Do you configure a 404 server response or a 301 redirect? To determine this, each case has to be analyzed separately. For instance, a method which was previously successful used for a web shop might not be a good choice for a site that offers services. Configure a 404 server response if, for some reason, a page is deleted completely from the site.
301 redirect is better when:

301 redirect to the homepage is not the best solution for both users (will cause confusion) and SEO (for example, Googlebot considers them as SOFT 404).

 

404 error and behavioral factors
Remember the feeling when you visit a site in search of something, and instead of finding what you’re looking for you discover a 404 error page. What does the user usually do in this case? Closes the tab and searches for a new site of course. Naturally, the more pages on the site that show a 404 server response, the more users experience this error, the less time they will spend on the site and more rejections will occur. The search engine algorithms function in a way that special attention is paid to behavioral factors as they play a very important role in the ranking process. To avoid worsening behavioral factors, you should motivate users to stay on the site. To do this you should approach the issue of creating 404 page in an interesting and creative way.

 

Your own 404 page

 

If you want users to stay on the site, you should think about creating and displaying your own 404 page once an error occurs. In most cases, webmasters do not pay much attention to this solution.

 

Page objectives:

When speaking about your own 404 page, search engines recommend the following:

 

Yandex:

 

Google:

 

General recommendations:

The recommendations above are not unconditional rules for 404 pages. It all depends on the theme of the website and the target audience. For a web shop it is relevant to add a search line, and for site that offer services – contact information.

 

Hotjar 404 error

 

img-border
404 error on hotjar websiteimg-close

 

GitHub 404 error

 

img-border
404 error on Githubimg-close

 

Facebook 404 error

 

img-border
404 error on facebookimg-close

 

Ahrefs 404 error

 

img-border
404 error on ahrefsimg-close

 

Semrush 404 page

 

img-border
404 error on Semrushimg-close

1 Star2 Stars3 Stars4 Stars5 Stars (11 votes, average: 4.09 out of 5)
Loading...

Interesting now

How to Conduct SEO Content Analysis Properly?

Every text on the web is created for some purpose. An effective text is the one that performs the necessary tasks. To achieve your goals, we recommend performing SEO content analysis at the several

E-commerce SEO: Best Practices for Your Store

E-commerce retailers are generally skeptical when they are told that they can double sales and traffic to their site by applying SEO best practices.

How to Use Meta Robots Tag Correctly?

Meta robots tags are used to pass instructions to search engines on how they should index or crawl sections of a website. This article gives an overview of the different values that can be used in a

What Is JSON-LD Markup and Why Is It Better than Schema Markup?

If you understand how to use schema.org, but do not dare to mark pages up because of the complexity of the process, this article is for you. There is an effective and easy-to-use alternative - the

Causes of Duplicate Content and How to Solve the Problem

All search engines, including Google, have problems with duplicate content. When the same content is shown at numerous locations on the internet, a search engine can’t determine which URL should be

The Comprehensive Technical SEO Checklist

All the painstaking site optimization work can be crossed out by technical mistakes that will interfere with: the project's ability to be fully indexed, the search robot's ability to understand the

Show more

sent-mail

The password link was sent to you by email

The password changed