Skip to content

How to work with Robots.txt for SEO

What we check:

availability of link to XML card

closing all unnecessary sections

Lack of prohibition on indexing styles, images

Checking tools:

Robots.txt analysis from Yandex, Txt Tester from Google

5.6. Site Parsing

What we check:

The presence of broken links on the site

the presence of links leading after 301 redirects to the final Url

Checking tools:

Parsing programs: Xenu, Comparser, Screaming Frog, Siteanalyzer, etc.

5.7. Viruses

What we check:

The presence of viruses on the site

Checking tools:

Website Scanner Qttera, site scanner from Dr.web, Rescan.pro scanner

5.8. Saved copies (Yandex, Google)

What we check:

Site content indexing

The availability of text in the preserved version

lack of large through blocks on the site in a text copy

Checking tools:

Checking saved copies in the issuance of Yandex and Google

5.9. Tags

What we check:

the presence of noindex tags in important blocks, content

Checking tools:

Manual search for html code

5.10. Display: None

What we check:

the presence of arrays of non -native hidden content

Checking tools:

Visual assessment of code through a browser

5.11. Pagination

What we check:

the presence of unique meta-tags on pagination pages

the presence of unique headers H1

Lack of indexation prohibition (in Robots.txt, Noindex nofollow tags)

correct Canonical, not leading to the page of the main section (reasons)

Checking tools:

Checking page code

Checking the document Robots.txt

Using extensions for browser (for example, bookmarks or SEO bars)

5.12. H1-H6 headlines

What we check:

Lack of huvs h1 on the pages

Excessive number of H2-H6 tags on the pages

Tags of headlines in through blocks, in templates

Checking tools:

Checking page code

Using extensions for browser (for example, SEO Meta in 1 Click)

5.13. Alt and Title images

What we check:

The presence of ALT and Title tags filled

Lack of duplication in tags

Lack of emergency room in tags

Checking tools:

Checking page code

Using extensions for browser (for example, SEO Meta in 1 Click)

5.14. Protected connection

What we check:

Having HTTPS version on the site

SSL certificate

Checking the availability and correctness of the installed redirects on the HTTPS version of the site

Lack of errors of installation of SSL certificate

Disconnect the advertisement

Finance

Bonuses for friends, an application for self-employed SOL, online business currency-and this is not all in the new digest

Archimedes promised to turn the land over, if you give him a point of support. We turn the business banking industry, based on our experience and needs of entrepreneurs, and we are clearly moving according to the plan 😎

Checking tools:

SSL Server Test

5.15. Noindex nofollow tags

What we check:

The presence of Noindex nofollow tags in the pages code

Assessment of the need for installed tags (if any)

Checking tools:

Checking page code

5.16. Mirrors and subdomains

What we check:

the presence of a site in the PS index of the site

the presence of PS subdomains in the PS index (technical, duplicate the main domain, etc.)

Checking tools:

Search for subdomains and search for site mirrors from Pixelplus

5.17. Garbage pages in the index

What we check:

The presence of administrative pages (entrance pages to the admin panel, etc.)

The presence of pages with dynamic parameters – sorting, filters, etc.

Checking tools:

Analysis of the site index through Yandex.webmaster and Google Search Console

Comparser

5.18. The correctness of the site indexation

What we check:

The number of indexed pages in Yandex

The number of indexed pages in Google

Checking tools:

Analysis of the site index through Yandex.webmaster and Google Search Console

5.19. Duplication of content

What we check:

the presence of complete or partial duplication of pages content

Checking tools:

Analysis of the site index through Yandex.webmaster and Google Search Console

6. Loading speed

This metric in recent years has become one of the key for all PS. The algorithms take it into account in ranking, and in the panels of the Yandex and Google webmasters there appeared data on the speed assessment of the site loading. Accordingly, if there are problems with this indicator, it is possible to lower the site in the issuance, as well as an increase in the number of refusals by users who did not wait for the page load of your site and left it.

Analysis of the speed of loading

PageSpeed ​​and GTMetrix tools (under VPN) allow you to evaluate the speed of loading the site pages. The services also display advice on eliminating problems on the site (types of errors and methods for solving them).

6.2. JS and CSS optimization

JavaScript and CSS codes are recommended to simplify, cleansing them of extra elements and reducing the names of functions. Methods of combining several CSS or JS files are also often used to reduce the number of HTTP checks per server.

6.3. Optimization of images and other visual objects

It is important to monitor what size images are posted on the site. It is not recommended to use too large file sizes. In addition to the sizes of images, you can use the deferred loading – Lazyload, which loads the images as the page is scrolling with the user.

Microdistrict

A microde is the marking of the structured data of your organization, thanks to which search engines better understand the contents of the site. It allows you to improve the site snippetes, as well as display blocks in the issuance in a format convenient for users (for example, carousel photos, questions-fasteners, instructions, etc.).

Services are used to verify the correctness of the implemented microdeus:

Validator microdulator from Yandex

Checking structured data from Google

7.1. Schema.org microde

This type of marking is supported by both Yandex and Google and makes it possible to mark many data types on the site. All the options can be seen in the dictionary https://schema.org/. Below are the most popular and important types of sections for sites

7.1.1. Organization

The organization’s microdistrict is the marking of data about your company. It includes the name, region, address of the site.