A light weight JS library to check if a user agent is a web crawler.
npm install is-web-crawlerA javascript based library to check if the current user agent is a web crawler.
It uses the list of known web crawlers using the package crawler-user-agents.
npm install is-web-crawler
`Usage
$3
If you want to know if the current user agent is a web crawler.
`
import { isCrawlerUserAgent } from 'is-web-crawler';const isCurrentUserAgentABot = isCrawlerUserAgent();
`NOTE: The regex pattern matching under the hood is cached, so calling this method multiple times will not affect performance.
$3
If you only want to tackle the top X web crawlers (from the list provided by crawler-user-agents), then simply pass in the number as an argument:
`
const topCrawlers = 10;
const isCurrentUserAgentABot = isCrawlerUserAgent(topCrawlers);
`$3
There might a scenario where you want to check a custom user agent string, instead of the current user agent. In this case, you can use the
isCrawler method instead.`
import { isCrawlerUserAgent } from 'is-web-crawler';const myUserAgent = ... get user agent ...;
const topCrawlers = 10;
// the second argument is optional
const isCurrentUserAgentABot = isCrawler(myUserAgent, topCrawlers);
``