YACY YACY is a distributed Web crawler and also a caching HTTP/HTTPS proxy.
Download

YACY Ranking & Summary

YACY Tags

web crawler web crawler HTTP proxy HTTPS proxy YACY

YACY Description

YACY is a distributed Web crawler and also a caching HTTP/HTTPS proxy. YACY is a distributed Web crawler and also a caching HTTP/HTTPS proxy. Pages that pass through the proxy are indexed and can be searched using a built-in HTTP server.YACY peers connect each other and form a P2P-based index exchange network based on distributed hash tables. Explicit web crawls can be done locally or collaboratively, forming a global search and distributed indexing engine for the Web.YACY also provides URL filtering with blacklist sharing among other proxy peers, individual Web and servlet page hosting, a file sharing zone, and a database engine. Here are some key features of "YACY": · Search your own or the global index · Crawl your own pages or start distributed crawling · Run your peer to support other YaCy crawlers · Provide Information on your peer using the built-in http-server, file-sharing zone and wiki · Built-in caching http proxy · Indexing benefits from the proxy cache; private information is not stored or indexed · Usage of the proxy is not a requisite for web indexing, but it enables you to access the new top-level-domains '.yacy' · Filter unwanted content like ad- or spyware; share your web-blacklist with other peers · Easy installation! No additional database required! · No central server! · GPL'ed, freeware What's New in This Release: · The full international character set and all UTF-8 characters are now supported for indexing and search. · Support has been added for site:, inurl:, and filetype: operator search. · A public API has been added to the search results, the indexing, and link structure in XML and JSON syntax.

YACY Related Software