Implements https://github.com/simplecrawler to get all html links within the domain
npm install html-link-crawlerImplements the simplecrawler module to return a bugger for each html link found on a domain.
Get all html for a localhost:3000, and strip 'fromSearch' query param in order to remove duplicates.
``ecmascript 6
const htmlLinkCrawler = require('html-link-crawler');
htmlLinkCrawler({url: 'http://localhost:3000/', ignoreQsParams: ['fromSearch']})
.on('htmlFetchComplete', html => {
console.info(Object.keys(html))
})
.start();
`
The object returned is exactly as the simplecrawler module, with one
additional event:
* htmlFetchComplete` - fired on complete. Returns an object with path to resource as the key and the html as the value.