Interactive CLI for monitoring procurement scrapers across multiple government portals
npm install conscrapurs
Interactive CLI for monitoring procurement scrapers across multiple government portals.
``bashInstall globally from npm
npm install -g conscrapurs
Quick Start
bash
Launch interactive mode
conscrapursOr use direct commands
conscrapurs status # View all scrapers status
conscrapurs tail # Tail all logs live
`Commands
| Command | Description |
|---------|-------------|
|
| Launch interactive mode |
| conscrapurs status | Show status dashboard |
| conscrapurs tail [scraper] | Tail scraper logs |
| conscrapurs start | Start a scraper |
| conscrapurs stop | Stop a scraper |
| conscrapurs output | View output summary |$3
`bash
conscrapurs start eperolehan # Start with defaults
conscrapurs start zakupsk --details # Fetch tender details
conscrapurs start zakupsk --pages 10 # Limit to 10 pages
`Supported Scrapers
| ID | Portal | Country | Source |
|----|--------|---------|--------|
|
| Zakupsk | š°šæ Kazakhstan | zakup.sk.kz |
| eperolehan | ePerolehan | š²š¾ Malaysia | eperolehan.gov.my |
| smartgep | SmartGEP | š²š¾ Malaysia | smartgep.gov.my |Configuration
Configure via environment variables:
`bash
export CONSCRAPURS_HOST=your-vps-ip
export CONSCRAPURS_PORT=22
export CONSCRAPURS_USER=root
`Default configuration:
- Host:
- Port:
- User:
- Base Dir: Requirements
- Node.js 16+
- SSH access to VPS with key-based authentication
- Scrapers deployed at configured base directory
Interactive Mode
Running
without arguments launches an interactive menu:`
___
/ __\___ _ __ ___ ___ _ __ __ _ _ __ _ _ _ __ ___
/ / / _ \| '_ \/ __|/ __| '__/ _? What would you like to do?
āÆ š View All Scrapers Status
š Tail All Logs (Live)
š Monitor Specific Scraper
š Start a Scraper
š Stop a Scraper
š View Output Data
āļø Settings
ā Exit
```
MIT Ā© ConsurvBL