PhantomJS Console Crawler

This crawler will scan a website for links, follow them, then report back any javascript console errors.

Useful for javascript heavy websites to check updates have not caused any JS errors.

Requirements

- Currently this only works on unix systems
- You need to have pkill installed, try typing which pkill, if not you can try brew install pkill

Installation

You can easily install the package via npm npm install consolecrawler -g

> As long as your NPM modules is in your $PATH you should be able to run consolecrawler from your command line.

Usage

``
Usage: consolecrawler [options]

Crawls a given website using PhantomJS - and logging any console errors

Options:

-h, --help output usage information
-V, --version output the version number
-u, --url Define the URL you want to crawl
-m, --max Defines max pages to scan (defaults to 25)
-i, --id Defines the ID of a scan, useful for debugging logs

-l, --log Writes the raw output to file
-v, --verbose Gives more verbose logging messages
`

Notes


- For each webpage crawled, a new process gets created on the machine, these should get cleaned up after shutting down, but if they don't you can run pkill -f phantomjs`
- Your computer may take off into space.