DISH - Dynamic information-based scalable hashing on a cluster of web cache servers

Andrew Sohn, Hukeun Kwak, Kyusik Chung

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

Caching web pages is an important part of web infrastructure. The effects of caching services are even more pronounced for wireless infrastructures due to their limited bandwidth. Medium to large-scale infrastructures deploy a cluster of servers to solve the scalability problem and hot spot problem inherent in caching. In this report, we present Dynamic Information-based Scalable Hashing (DISH) that evenly hashes client requests to a cluster of cache servers. Three types of runtime information are used to determine when and how to cache pages, including cache utilization, CPU usage, and number of connections. Pages cached are stored and retrieved mutually exclusively to/from all the servers. We have implemented our approach and performed various experiments using publicly available traces. Experimental results on a cluster of 16 cache servers demonstrate that the proposed hashing method gives 45% to 114% performance improvement over other widely used methods, while addressing the hot spot problem.

Original languageEnglish (US)
Title of host publicationHigh Performance Computing and Communications - Third International Conference, HPCC 2007, Proceedings
PublisherSpringer Verlag
Pages785-796
Number of pages12
ISBN (Print)9783540754435
DOIs
StatePublished - 2007
Event3rd International Conference on High Performance Computing and Communications, HPCC 2007 - Houston, TX, United States
Duration: Sep 26 2007Sep 28 2007

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume4782 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other3rd International Conference on High Performance Computing and Communications, HPCC 2007
Country/TerritoryUnited States
CityHouston, TX
Period9/26/079/28/07

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • General Computer Science

Fingerprint

Dive into the research topics of 'DISH - Dynamic information-based scalable hashing on a cluster of web cache servers'. Together they form a unique fingerprint.

Cite this