Scapactra (scraper, parser and crawler) is a framework to extract data from different data sources. The idea for scapactra bases on the ETL (extract, transform and load) process (ETL) and defines an modular design pattern providing a basic ETL workflow.
The framework is structured into three basic modules.
- Parser: The parser extracts the data from a defined document.
- Browser: The browser navigates through a structure and retrieves the desired fragments for the parser.
- Scraper: A scraper executes the browsers an parsers and providing their results over an centralized interface.
