...
| Info |
|---|
If you don't like having IDs at the start of the slug, you can change that in the field "Route to products" to something like this:
|
Robots file generation
A robots.txt file enables you to block specific automated bots and web spiders which crawl the Web in order to find more web pages to add to their company's servers. Some bots you want to have full access to your website, such as Google's or Yahoo!'s, and some others you would rather not, such as spam bots, content thieves, e-mail collectors, etc. Note that the worst of bots do not respect this file's directives, as it is purely advisory.
...