Zeit Online

What the Bundestag is Talking About

An in-depth analysis of all speeches held in the German Parliament since its foundation in 1949.

Tasks
Natural Language Processing
Data Analysis
Prototyping
API Development
Data Visualization
Team
Kai Biermann
Paul Blickle
Ron Drongowski
Annick Ehmann
and more...
Published
2019/09/09
More than 4,200 plenary sessions were held in the German Parliament since its founding in 1949. All of these sessions have been protocolled and the documents are available to the public. However, they have never been evaluated. The goal of this project was to turn the protocols into machine readable formats to perform a detailed speech analysis.
The application lets you search for every word ever spoken in the parliament
The application lets you search for every word ever spoken in the parliament
To get an overview of the massive dataset and to find interesting stories for the article, some research and prototyping was necessary. This resulted in a small tool and API which we open-sourced later on: Smart Wordcounter. The tool does some normalization on the input text, like removing stop-words and then counts the word frequencies. You can find a more detailed explanation of the wordcounter in this blog post.
Using the wordcounter, we were able to build another prototype of an API, which allowed us to search for a word in the parliament protocols and get the time series frequencies of the particular word. This research tool was used to find interesting words for the article and as a proof of concept.
Visualization of word frequencies
Visualization of word frequencies
For visualizing the topics over time, a simple area chart visualization was chosen. The area chart is used overall the article so that users can easily understand the data that is visualized.
Besides that some other visual elements were developed, like video loops of the moment a particular word was said for the first time.
Topics that have characterized a decade
Topics that have characterized a decade
We supported the Zeit Online team in multiple stages of this project and helped to process, analyze and visualize the data.
Technology Stack
Python NLTK
NodeJS
D3
React.js
Are you interested in a collaboration?
Contact us
Featured Projects
webkid logo
webkid GmbH
Oranienstra├če 19A
10999 Berlin
[email protected]
+49 30 983 227 20
Imprint
Privacy