Posts
A robots.txt file is to be used to allow or disallow search engine bots to index some specific part of the website. They are used to block website or its internal directories. If you don’t want to hide any directory or page of the website then you don’t need a robots txt file. For security season you must need to have robots file on your website so that you can protect your website from spam crawlers.
Top Search Engines and their Robots Name
Subscribe to:
Post Comments (Atom)
0 comments:
Post a Comment