Authoritative Sources in a Hyperlinked Environment
📜 Abstract
The network structure of a hyperlinked environment can be a rich source of information about the content of the environment, provided we have effective means for understanding it. We develop a set of algorithmic tools for extracting information from the link structures of such environments, and report on experiments that demonstrate their effectiveness in a variety of contexts on the World Wide Web. The central issue we address within our framework is the distillation of broad search topics, through the discovery of “authoritative” information sources on such topics. We propose and test an algorithmic formulation of the notion of authority, based on the relationship between a set of relevant authoritative pages and the set of “hub pages” that join them together in the link structure. Our formulation has connections to the eigenvectors of certain matrices associated with the link graph; these connections in turn motivate additional heuristics for link-based analysis.
✨ Summary
The paper introduced the hubs-and-authorities model now commonly associated with the Hyperlink-Induced Topic Search (HITS) algorithm. It represents Web pages as a directed graph, constructs a query-focused subgraph from text-search results and neighboring pages, and iteratively computes mutually reinforcing authority and hub scores. In matrix terms, the authority and hub vectors correspond to principal eigenvectors of $A^T A$ and $A A^T$, respectively. Non-principal eigenvectors are proposed for identifying multiple topical communities, including separated communities associated with ambiguous or polarized queries.
The work influenced subsequent research on Web link analysis, including studies of HITS variants, stability, spam resistance, topic drift, and unified comparisons between HITS, PageRank, and related algorithms. Later evaluations examined HITS at Web scale and found that its effectiveness depended on query specificity and was broadly comparable to other link-based features in some settings. (microsoft.com)
The paper also had a documented industry connection: Ask Jeeves reported that its Teoma search technology ranked pages using authority within subject-matter communities, a design closely aligned with the paper’s distinction between popularity and topical authority. (sec.gov)