SPyDI Is a powerful engine to create distributed full text indexing
systems and distributed search engines. It supports harvesting,
crawling (pull mehtods), and push methods (via a Web interface or
SPyRO Web services). It supports boolean and vector Information
retrieval models. It has few dependencies, and comes with its own HTTP
server and HTML embedded pages language (called pyew and wey pages),
and session manager. It can use the SMTP of the Python library. It
supports replacing the default modules with some better modules
(Apache, exim, etc).
Components
News