the-crawler-base

the-crawler-base
==========

[![Build Status][bd_travis_shield_url]][bd_travis_url]
[![npm Version][bd_npm_shield_url]][bd_npm_url]
[![JS Standard][bd_standard_shield_url]][bd_standard_url]

[bd_repo_url]: https://github.com/the-labo/the-crawler-base
[bd_travis_url]: http://travis-ci.org/the-labo/the-crawler-base
[bd_travis_shield_url]: http://img.shields.io/travis/the-labo/the-crawler-base.svg?style=flat
[bd_travis_com_url]: http://travis-ci.com/the-labo/the-crawler-base
[bd_travis_com_shield_url]: https://api.travis-ci.com/the-labo/the-crawler-base.svg?token=
[bd_license_url]: https://github.com/the-labo/the-crawler-base/blob/master/LICENSE
[bd_codeclimate_url]: http://codeclimate.com/github/the-labo/the-crawler-base
[bd_codeclimate_shield_url]: http://img.shields.io/codeclimate/github/the-labo/the-crawler-base.svg?style=flat
[bd_codeclimate_coverage_shield_url]: http://img.shields.io/codeclimate/coverage/github/the-labo/the-crawler-base.svg?style=flat
[bd_gemnasium_url]: https://gemnasium.com/the-labo/the-crawler-base
[bd_gemnasium_shield_url]: https://gemnasium.com/the-labo/the-crawler-base.svg
[bd_npm_url]: http://www.npmjs.org/package/the-crawler-base
[bd_npm_shield_url]: http://img.shields.io/npm/v/the-crawler-base.svg?style=flat
[bd_standard_url]: http://standardjs.com/
[bd_standard_shield_url]: https://img.shields.io/badge/code%20style-standard-brightgreen.svg

Base of the-crawlers

Installation
-----

``bash
$ npm install the-crawler-base --save
`

Usage
---------

`javascript
'use strict'

const { TheCrwl } = require('the-crawler-base')
const theDB = require('the-db')

async function tryExample () {
let db = theDB({ / ... / })

class MyCrwl extends TheCrwl {
async crawl (config = {}) {
/ ... /
return [
{ resource: 'Site', id: 1, attributes: { / ... / } },
{ resource: 'Article', id: 1, attributes: { / ... / } }
]
}
}

let crwl = new MyCrwl({})
crwl.setResource('Site', db.resource('Site'))
crwl.setResource('Article', db.resource('Article'))

/ ... /
}

tryExample().catch((err) => console.error(err))

``

API Guide
-----

+ the-crawler-base@2.1.2
+ create(args)

License
-------
This software is released under the MIT License.

Links
------

+ [THE Labo][t_h_e_labo_url]

[t_h_e_labo_url]: https://github.com/the-labo