Timelines Revisited
A Design Space and Considerations for Expressive Storytelling
Matthew Brehmer · Microsoft Research · @mattbrehmer
in collaboration with Bongshin Lee · Benjamin Bach · Nathalie Henry Riche · Tamara Munzner
IEEE VIS 2017 · 10-03-2017 · slides: timelinesrevisited.github.io
Thank you.
Throughout history, people have recorded events on timelines;
and the space of timeline design choices is remarkably varied.
A Timeline Design Space
representation
scale
layout
Today I'm going to introduce you to a structured way to think about this design space.
CLICK : and I'm glad to be speaking in the 'Time and Space' session, because I'll begin with a primer on SPATIAL metaphors for time.
and these icons correspond to some of most common representations appearing in the design of timelines, which is the first dimension of our design space.
Image: Joseph Priestley (1765)
Perhaps the most common representation for time is linear: the time as an arrow metaphor.
What you see here is part of Joseph Priestley's 'Chart of Biography published over 250 years ago,
Image: Joseph Priestley (1765)
Here time is mapped from left to right (the years are BCE here); you can see the lifespans of a number historical figures, offset vertically to avoid overdrawing.
Otherwise there’s no meaning to the verical placement aside from faceting the data with statesmen at the bottom and "men of learning" at the top.
This left-to-right linear representation of time remains popular today, but it is certainly not the only way to present a set of events.
Image: LadyofHats (Wikimedia Commons)
Radial representations are especially effective when presenting and highlighting natural cycles and events that repeat,
Like biological life cycles or the seasons of the year.
Image: flickr/46704958@N07
But of course time is both linear AND cyclic, like this staircase, something that repeats and yet coils upwards or forwards.
Spirals are certainly another way to represent time, though one that is less common than the line or the circle.
Image: flickr/studiocurve
Yet another representation for time is the grid, often manifested as a calendar.
Like radial representations, calendars are good for showing repeating events and deviations from patterns of events,
especially when these patterns correspond to conventions of weekdays and weekends, and months.
See "How to make history dates stick " by Mark Twain in Harper's Monthly Magazine (1914).
The last class of representation that I'll speak about is not restrained by a specific shape.
These whimsical curved timelines were drawn by Mark Twain, which he proposed as a mnemonic aid for remembering dates using annotated curves.
Many timeline infographics that we see today have this sort-of freeform board-game-like appearance,
though I can't say if they actually help people to remember events.
Common visual representations of time :
So I just gave you a brief and certainly incomplete primer of different spatial metaphors for time,
and the first dimension in our design space.
Now, before I introduce the second dimension, I want you to consider the following question:
What is a Timeline For?
And that is, what is a timeline for?
Why do we draw these in the first place?
What happened when?
In what sequence did the events occur?
How long did the events last?
How long between event A and event B ?
Did A and B co-occur?
When did A and B occur relative to event C ?
Basically, a timeline communicates to the viewer "WHAT HAPPENED WHEN?".
CLICK : But if we unpack this question, a timeline can answer a number of more detailed questions, like:
In what sequence did events occur? How long were they? Did event A and event B co-occur? And when did they occur relative to some baseline event, say event C?
These questions relate to the second dimension of our design space, and that pertains to time scale.
The Careers of U.S. Open Golf Champions
Wikimedia Commons; L: Dustin Johnson ; R: Jim Furyk
To illustrate these questions and the effects of different time scales, I'm going to talk about golf.
Specifially, I'm going to talk about professional golfers who at some point in their career, won the U.S. Open golf tournament, which is an annual event that dates back to 1895.
I'm going to begin by focusing on the careers of Dustin Johnson and Jim Furyk, who won and placed 2nd, respectively, at the 2016 U.S. Open.
The Careers of U.S. Open Golf Champions
Data source: Wikipedia . This data is also featured in this demo video .
MAX : What you're seeing here are two timelines, Furyk's is on top, Johnson's on the bottom, indicating the results of every U.S. Open appearance in their respective careers.
With red indicating a victory, gold indicating a finishing placement, and grey indicating that they were cut from the tournament after the first 36 holes.
NEXT : You can see that Furyk has appeared at the U.S. Open for longer than Johnson, and that they both have only one victory to date under their belt.
NEXT : In comparison, golf legend Ben Hogan appeared many times over the course of 4 decades, and he won an impressive four times during a six year span in the late 1940s / early 1950s.
NEXT : Johnson and Furyk never played with Hogan, they were born at different times, and it's a bit unfair to compare a mid-career golfer and an early-career golfer to a legend like Hogan.
NEXT : But by changing the scale to one that is relative to their births, we can see if Johnson or Furyk are on track to follow in Hogan's footsteps.
we can also see that Johnson and Furyk were about the same age when they won the U.S Open.
Hogan was older during his winning streak, but perhaps he would have won earlier during the gap in his early 30s, which corresponds to World War II and years that the tournament was cancelled.
NEXT : Or we can remove relative chronology altogether and keep just the sequence of their U.S. Open appearances, where we learn that, coincidentally, all 3 golfers won in their 9th appearance.
NEXT : And finally I can introduce you to another legend, Jack Nicklaus, who appeared more than 40 times, and his 4 victories were more spaced out than Hogan's.
A Timeline Design Space
So, now that I've shown you different representations and time scales, I want to summarize our design space.
A Timeline Design Space
5 representations:
5 scales:
4 layouts:
Our timeline design space has
CLICK : Five representions, NEXT : five scales, NEXT : and third dimension which we call "Layout", or how to draw one or more timelines within a page or display:
this has to do with deciding between a single timeline, faceting into multiple timelines, like how I showed one timeline per golfer,
or wrapping a single timeline into meaningful segments of time, like a decade or a century.
The Careers of U.S. Open Golf Champions
1 / 5 representations:
3 / 5 scales:
1 / 4 layouts:
As a point of reference in terms of coverage of the design space, the golf demo I just gave spanned several scales while keeping representation and layout constant.
Our process: Phase 1
Collect and categorize 145 timelines and timeline tools.
Sources included Cartographies of Time (Rosenberg & Grafton), Visualization of Time-Oriented Data (Aigner et al. ), Making Timelines (Groeger), ...
So how did we come up with this design space? Well,
CLICK : First, we collected and categorized 145 timelines and timeline visualization tools from various sources, and out of that came the dimensions of the design space.
Our process: Phase 2
Validate with 118 additional timelines (263 total).
Sources included visual.ly , the Kantar IIB Showcase , massvis.mit.edu , ...
Implement points in the design space with 28 representative datasets.
Survey data and dataset index can be found at timelinesrevisited.github.io
CLICK : Next, we verified that the design space could be used to label 118 additional timelines that we collected from different sources.
CLICK : We also implemented points in the design space with 28 event datasets, which varied in a number of ways, such as the number of events, the temporal extent of the data, or the rate of event co-ocurrence.
20 purposeful , interpretable , & generalizable timeline designs at timelinesrevisited.github.io
And this process of categorization and implementation also led us to identify 20 viable points in the design space,
or combinations of representation, scale, and layout that are:
Purposeful in terms of their communicative intent, interpretable in terms of which perceptual task the viewer is expected to make, and generalizable across a range of timeline datasets.
ZOOM : This thumbnail gallery from our paper acts as a visual index for these 20 designs, and if you go to timelinesrevisited.github.io,
You can see each of these example designs in detail along with a description of what narrative or communicative intent they serve.
Expressive Storytelling With Timelines
Choice of representations and time scales
Support for chronological or non-chronological narratives
So now that we have all of these design choices, how do we use these design choices to tell stories with timelines?
CLICK : In other words, how do combine different points in this design space?
This is important because despite the variety of ways that we visually represent and scale time, existing timeline presentation tools limit us linear representations and chronological time scales.
CLICK : Existing tools also tend towards a chronological narrative: either the whole timeline is shown up front, so readers are likely to begin at the start of the timeline, or events are revealed in chronological order.
For some stories, a chronological introduction of events makes sense, while for others it does not, like in my golf example, in which I revealed the careers of golf legends Ben Hogan and Jack Nicklaus later, adding context to the careers of current golfers.
To achieve this expressive narrative design, we can make use of animation, highlighting, and annotation to incrementally reveal parts of a narrative and make new comparisons.
The daily routines of famous creative people
Inspired by infographics by Podio and info we trust ; data source: Daily Rituals: How Artists Work by Mason Currey (2013)
As a second example that ties all of this together, I'm going to present a story about the daily routines of famous creative people.
MAX : What you see here is a set of radial timelines depicting a typical 24 hours in the lives of 26 writers, artists, composers, and the like.
When they work, eat, sleep, exercise, and do other activities.
NEXT : A good starting point is to ask: when do creative people create? Are people similar in this regard?
It looks as though some people prefer to work in short, focused bursts, like Darwin or Kant, while people like Murakami and Voltaire get up early and work for long uninterrupted periods of time.
Meanwhile, you have people like Kafka who work all night long.
NEXT : We can also ask about the relationship between sleep and creativity: how much? how often? and when do creative people sleep?
Most people in this dataset sleep at night, with notable exceptions like Balzac who would turn in at 6pm, and Kafka, who just seemed to keep odd hours.
What about variation and creativity? How often should you change activities if you want to be creative?
NEXT : This chronological scale isn't the best way to convey the number or heterogeneity of activities, so let's transition to a sequential scale.
NEXT : To determine who varied the most and least, a linear representation is perhaps best, where we can easily see that Darwin has the most varied day of all the people in this dataset,
while Murakami prefers less variation.
NEXT : Finally, we can restore chronology to compare these timelines just by scanning up and down, to spot synchronocities like who tends to work or sleep at the same time.
And this is a good design choice to close with, to invite the viewer to compare their own daily rhythym to these creative people.
Summary: The Timeline Design Space
Different combinations of timeline representation and scale communicate different aspects of the data.
I want to finish by reiterating that despite the apparent simplicity of the question of "what happened when?",
I've hopefully relayed the richness of the timeline design space in terms of different visual representations and time scales and their different communicative purposes,
Summary: Storytelling Considerations
Use animated transitions, highlighting, and annotation to incrementally reveal and connect narrative points.
Consider more than one point in the design space.
...and this design space grows even richer when we introduce dynamic storytelling elements like the incremental reveal, selective annotation and highlighting,
NEXT : and animated transitions between points in the design space.
Timelines Revisited . . . Revisited: An Epilogue
And before I pause for questions, a brief epilogue.
Our paper is based on work that took place in summer 2015, and much has happened since then.
First, we developed and released Timeline Storyteller,
the tool that I used to present the examples in this talk.
timelinestoryteller .com
Choice of representation, scale, layout, & narrative structure,
Initially released as open-source web application ,
Featured at OpenVisConf 2017 ,
Now available as free add-on for Microsoft Power BI ,
Featured in the 2017 Data Insights Summit keynote ,
This tool, which you can use now at timelinestoryteller.com, realizes our design space and our proposed considersations for storytelling.
We initially released it as an open-source web application in January.
I then presented it at OpenVisConf, and it you want to see my longer and more detailed talk about timelines, OpenVis talk videos are up on youtube.
We recently released it as a free add-on to Microsoft Power BI, which allows you to publish iframes of timeline stories like I did in this talk
and you can also see it featured in the opening keynote of this past summer's Microsoft Data Insights Summit.
Thanks
Bongshin Lee, Benjamin Bach, Nathalie Henry Riche, and Tamara Munzner.
+
Darren Edge, Chris White, David Tittsworth, Kate Lytvynets
Microsoft Research , HCI@MSR ,
the UBC InfoVis Group , the Timeline Consortium ,
Microsoft Power BI , & the MSFT Data Journalism Program .
Both this paper and Timeline Storyteller wouldn't have been possible without the help of my coauthors and colleagues at Microsoft and beyond.