Robots.txt resources
Robots exclusion standard (Wikipedia)
Robots.txt Specifications (Google)
Using robots.txt (Yandex)
A Standard for Robot Exclusion (Robotstxt.org)
A Method for Web Robots Control (Robotstxt.org)
An Extended Standard for Robot Exclusion (Sean Connor)
Useful tools
Create and test robots.txt (Google)
Analyze robots.txt (Yandex)
Robots.txt theory | How to check robots.txt | 

Check robots.txt file

 
Domain
We appreciate every opinion which can help to improve the service.
Name
Email
Subject
Text