Basic robots.txt generator plugin for Hexo
npm install hexo-generator-robotstxtA very simple plugin to generate a robots.txt file automatically for Hexo 3.
``
npm install hexo-generator-robotstxt --save
Add hexo-generator-robotstxt to plugins in _config.yml.
` yaml`
plugins:
- hexo-generator-robotstxt
Add config for robots.txt to _config.yml.` yaml``
robotstxt:
useragent: "*"
disallow:
- /one_file_to_disallow.html
- /2nd_file_to_disallow.html
- /3rd_file_to_disallow.html
allow:
- /one_file_to_allow.html
- /2nd_file_to_allow.html
- /3rd_file_to_allow.html
sitemap: /sitemap.xml
| Setting | Description | Default |
| --------- | --------------------------------------------- | ------- |
| useragent | Set the User-Agent | * |
| disallow | Disallow files or folders for this User-Agent | |
| allow | Allow files or folders for this User-Agent | |
| sitemap | Set the path to your sitemap | |