Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project. Heritrix (sometimes spelled heretrix, or misspelled or mis-said as heratrix/heritix/ heretix/heratix) is an archaic word for heiress (woman who inherits). Since our crawler seeks to collect and preserve the digital artifacts of our culture for the benefit of future researchers and generations, this name seemed apt.
Mixnode is a fast, flexible, massively scalable platform to extract and analyze data from the web. Mixnode allows you to thin ...
Search over millions of documents, and give to your users unique, amazing and unforgettable experiences.
StormCrawler is an open source SDK for building distributed web crawlers with Apache Storm. The project is under Apache licens ...
With Google Custom Search, add a search box to your homepage to help people find what they need on your website.
Expertrec site search engine helps you add ultra fast search to your website . It adds a superb autosuggest and search listing ...
ACHE is a web crawler for domain-specific search
Apache Nutch is a highly extensible and scalable open source web crawler software project. Nutch is coded entirely in the Java ...
