generate robots.txt based on env content for static websites
npm install env-robotstxt - Set env variable to generate robots.txt file
- Generate Disallow: / by default (without env variable)
- Allow generate in to different folder
- Easy to config robots.txt if you use git (different branch different robots content)
- For all static website projects, like html, vue, react, angular, php, etc.
npm install env-robotstxt
# or
yarn add env-robotstxt
Config
Add the
(or your preferred command) command in scripts object:`json
"scripts": {
"robot": "npx env-robotstxt" // default
},
`json
"scripts": {
"robot": "npx env-robotstxt dist" // generate into dist folder
},
`then set up the env variable
:
`javascript
ENV_ROBOTS_CONTENT="User-agent: *\nDisallow: \nSitemap: https://domain.name/sitemap.xml"
`Run
npm run robot
or
yarn robot