arXiv preprint ·
WPTokens: A Dataset for Studying the Regulation of Wikipedia
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
Studying how Wikipedia is regulated requires knowing who adds, rewrites, moves and deletes which piece of content, when and where. WPTokens is a dataset that answers these questions over the full revision history of the French-language Wikipedia. It relies on a positional diff over two layers: a text layer made of sentences, and a node layer made of the structural elements of wikitext (templates, links, references, headings, tables, lists, etc.). Each piece of content keeps a stable identifier for its whole life, and every change to it is recorded as an addition, an update, a move, a move with update, or a deletion. Built from the April 2026 dump, the dataset covers 2.75 million articles, 153.6 million revisions, 342.6 million tokens and 573.7 million token events, stored in an indexed SQLite database. A companion R package turns these records into temporal contributor--token multigraphs, completed by a layer of revert ties between contributors. We describe the tokenization, the diff algorithm, the data model and the graph construction, and discuss the limitations of the approach.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Social & Information Networks
Graph Data Augmentation via Contrastive Generator Inversion ($\texttt{DCBA}$)
Disentangling Models from Personas in Heterogeneous LLM Simulations
FairProp: Fair Node Representation Learning via Differentiable Propagation Layers
Benchmarking System One Models in Online Moderation
Learning to Simulate Individuals from Macro Social Signals
Get the few papers worth your time in Social & Information Networks every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.