A Scaleable and Fault-tolerant Architecture for Distributed Web Resource Discovery

A. Fongen, F. Eliassen (Norway), I. Ferguson, S. Stobart, and J. Tait (UK)

Keywords

Large scale distribution, distributed resource discovery, peertopeer networking

Abstract

Most Internet search engines are built on a centralised design, and will therefore not cope with the expected future growth in information and query volume. A distributed approach to Internet resource discovery seems necessary. Many distributed designs have been pro posed, but their scaleability is largely unknown. We propose a distributed design based on the use of classified metadata, which can be proven to be extremely scaleable, and has interesting fault-tolerant properties. We will show the principles of this design, called the Content Sensitive Infrastructure (CSI), and demonstrate its proper ties through formal analysis and simulation.

Important Links:



Go Back