Changelog:
Release “1.0-alpha” (2014-07-11)
- Added Crawler URL normalization.
- Added Crawler API results merging from N nodes.
- Added Crawler incremental sites crawling.
- Added Crawler additional support of structure formats.
- Added Processor improvements of basic and predefined templates for scraping.
- Added run-time change of logging level and polling timeouts.
- Complete updated integration and deployment for Debian OS.
- Complete updated main networking and crawling engine.
- and many more…