Sphider is a lightweight web spider and search engine written in PHP, using MySQL as its back end database. It is suitable for adding search functionality to small or medium sites (up to around 100,000 pages). It also works great as a tool for site analysis – finding broken links, gathering statistics about the site etc.
Take a look at the demo section or the showcase for sample sites running Sphider.
10-November-2006: Version 1.3.1d released. Check the Download section. Continue reading