Magnet: Practical Subscription Clustering for Internet-Scale Publish/Subscribe

Girdzijauskas, Sarunas and Chockler, Gregory and Vigfusson, Ymir and Tock, Yoav and Melamed, Roie (2010) Magnet: Practical Subscription Clustering for Internet-Scale Publish/Subscribe. In: The 4th ACM International Conference on Distributed Event-Based Systems (DEBS), 12-15 July 2010, Cambridge, UK.

PDF (Magnet: Practical Subscription Clustering for Internet-Scale Publish/Subscribe) - Accepted Version


An effective means for building Internet-scale distributed applications, and in particular those involving group-based information sharing, is to deploy peer-to-peer overlay networks. The key pre-requisite for supporting these types of applications on top of the overlays is efficient distribution of messages to multiple subscribers dispersed across numerous multicast groups. In this paper, we introduce Magnet: a peer-to-peer publish/ subscribe system which achieves efficient message distribution by dynamically organizing peers with similar subscriptions into dissemination structures which preserve locality in the subscription space. Magnet is able to significantly reduce the message propagation costs by taking advantage of subscription correlations present in many large-scale groupbased applications. We evaluate Magnet by comparing its performance against a strawman pub/sub system which does not cluster similar subscriptions by simulation. We find that Magnet outperforms the strawman by a substantial margin on clustered subscription workloads produced using both generative models and real application traces.

Item Type:Conference or Workshop Item (Paper)
ID Code:4071
Deposited By:Sarunas Girdzijauskas
Deposited On:04 Feb 2011 14:21
Last Modified:04 Feb 2011 14:21

Repository Staff Only: item control page