ScienceDirect Web Agent
From Ben Shirt-Ediss
A web agent, written in the C programming language, which acts on the ScienceDirect.com website as a scientific paper mining tool.
The user specifies search criteria such as keywords and author, and then the web agent goes away and does its work. Running as a background process, the agent makes multiple search queries on ScienceDirect.com, noting down relevant papers plus papers related to the relevant ones. When the search is complete, the user is presented with a “scatter summary” – an HTML page launched in the default Internet browser – showing graphically the papers found, and providing immediate links to down-loadable PDF versions.
Submitted as coursework for the Programming Techniques module of EASy MSc, Sussex University, January 2008.
Files
