Wikipedia Workload Analysis for Decentralized Hosting

G.A. Urdaneta Paredes; G.E.O. Pierre; M.R. van Steen

doi:10.1016/j.comnet.2009.02.019

Wikipedia Workload Analysis for Decentralized Hosting

G.A. Urdaneta Paredes, G.E.O. Pierre, M.R. van Steen

Research output: Contribution to Journal › Article

Abstract

We study an access trace containing a sample of Wikipedia's traffic over a 107-day period aiming to identify appropriate replication and distribution strategies in a fully decentralized hosting environment. We perform a global analysis of the whole trace, and a detailed analysis of the requests directed to the English edition of Wikipedia. In our study, we classify client requests and examine aspects such as the number of read and save operations, significant load variations and requests for nonexisting pages. We also review proposed decentralized wiki architectures and discuss how they would handle Wikipedia's workload. We conclude that decentralized architectures must focus on applying techniques to efficiently handle read operations while maintaining consistency and dealing with typical issues on decentralized systems such as churn, unbalanced loads and malicious participating nodes. © 2009 Elsevier B.V. All rights reserved.

Original language	English
Pages (from-to)	1830-1845
Journal	Computer Networks (1999)
Volume	53
Issue number	11
DOIs	https://doi.org/10.1016/j.comnet.2009.02.019
Publication status	Published - 2009

Cite this

Urdaneta Paredes, G. A., Pierre, G. E. O., & van Steen, M. R. (2009). Wikipedia Workload Analysis for Decentralized Hosting. Computer Networks (1999), 53(11), 1830-1845. https://doi.org/10.1016/j.comnet.2009.02.019

@article{e9d0a82ecad6423e9b6beba4fa9ec329,

title = "Wikipedia Workload Analysis for Decentralized Hosting",

abstract = "We study an access trace containing a sample of Wikipedia's traffic over a 107-day period aiming to identify appropriate replication and distribution strategies in a fully decentralized hosting environment. We perform a global analysis of the whole trace, and a detailed analysis of the requests directed to the English edition of Wikipedia. In our study, we classify client requests and examine aspects such as the number of read and save operations, significant load variations and requests for nonexisting pages. We also review proposed decentralized wiki architectures and discuss how they would handle Wikipedia's workload. We conclude that decentralized architectures must focus on applying techniques to efficiently handle read operations while maintaining consistency and dealing with typical issues on decentralized systems such as churn, unbalanced loads and malicious participating nodes. {\circledC} 2009 Elsevier B.V. All rights reserved.",

author = "{Urdaneta Paredes}, G.A. and G.E.O. Pierre and {van Steen}, M.R.",

year = "2009",

doi = "10.1016/j.comnet.2009.02.019",

language = "English",

volume = "53",

pages = "1830--1845",

journal = "Computer Networks (1999)",

issn = "1389-1286",

publisher = "Elsevier",

number = "11",

}

TY - JOUR

T1 - Wikipedia Workload Analysis for Decentralized Hosting

AU - Urdaneta Paredes, G.A.

AU - Pierre, G.E.O.

AU - van Steen, M.R.

PY - 2009

Y1 - 2009

N2 - We study an access trace containing a sample of Wikipedia's traffic over a 107-day period aiming to identify appropriate replication and distribution strategies in a fully decentralized hosting environment. We perform a global analysis of the whole trace, and a detailed analysis of the requests directed to the English edition of Wikipedia. In our study, we classify client requests and examine aspects such as the number of read and save operations, significant load variations and requests for nonexisting pages. We also review proposed decentralized wiki architectures and discuss how they would handle Wikipedia's workload. We conclude that decentralized architectures must focus on applying techniques to efficiently handle read operations while maintaining consistency and dealing with typical issues on decentralized systems such as churn, unbalanced loads and malicious participating nodes. © 2009 Elsevier B.V. All rights reserved.

AB - We study an access trace containing a sample of Wikipedia's traffic over a 107-day period aiming to identify appropriate replication and distribution strategies in a fully decentralized hosting environment. We perform a global analysis of the whole trace, and a detailed analysis of the requests directed to the English edition of Wikipedia. In our study, we classify client requests and examine aspects such as the number of read and save operations, significant load variations and requests for nonexisting pages. We also review proposed decentralized wiki architectures and discuss how they would handle Wikipedia's workload. We conclude that decentralized architectures must focus on applying techniques to efficiently handle read operations while maintaining consistency and dealing with typical issues on decentralized systems such as churn, unbalanced loads and malicious participating nodes. © 2009 Elsevier B.V. All rights reserved.

U2 - 10.1016/j.comnet.2009.02.019

DO - 10.1016/j.comnet.2009.02.019

M3 - Article

VL - 53

SP - 1830

EP - 1845

JO - Computer Networks (1999)

JF - Computer Networks (1999)

SN - 1389-1286

IS - 11

ER -

Access to Document

10.1016/j.comnet.2009.02.019