Cochrane-Web-Crawler

https://www.cochranelibrary.com/

Following program is to crawl Cochrane website (above given link) and gather reviews on available topics

Requirement

1. JDK 1.7+
2. Jsoup 1.11.3 +

Output

All reviews will be stored in cochrane_reviews.txt file in following format URL | TOPIC | TITLE | AUTHOR | DATE

Note

You need to be log in to cochrane website with active session as the program uses cookies to crawl. Cochrane website does not allow to view page data without active session.