Year 3 / Module 33

Data visualisation in practice

HCI3109 · 15 credits · Level 6

Optional module. It shares the year three elective slot with HCI3107 Professional practice and the HCI profession: a student takes exactly one of the two, and both carry the same 15 credits. Visual evidence made to work for an audience that did not make it, under the real constraints of medium, colour, uncertainty and trust.

Ten units

  1. 1Whose question is this chart answering? Commissioning and framing visual evidenceA chart is commissioned to answer someone's question, and the first design decision is naming that question and the reader who holds it, because a task-level error cannot be repaired by any later choice of encoding.
  2. 2Choosing a form under constraint: print, screen, slide, phone, wallThe form follows the display and the medium as much as the data, because the channel a reader can actually use is limited by size, viewing distance and reproduction, and the perceptual ranking of channels predicts how a chart degrades when the medium changes.
  3. 3Colour under accessibility and reproduction: daltonism, greyscale, low-quality printColour carries identity or order, and a palette that is perceptually uniform and legible under colour-vision deficiency and greyscale is a reproduction requirement rather than a matter of taste.
  4. 4Uncertainty for non-specialists: intervals, ranges, and what readers actually inferAn uncertainty display changes what readers infer only when the representation matches the inference the decision requires, and an interval that scores well on an abstract judgement can still mislead about the direction of an effect.
  5. 5Annotation and sequence: making a static figure carry an argumentA static figure carries an argument through what the author selects, annotates and orders, and the narrative-visualisation literature shows that this framing is rhetoric, so the author's reading enters the chart and has to be disclosed.
  6. 6Interactive views for a public that will not read the documentationInteraction lets a reader who will not read the manual find their own question, but interaction carries a cost in attention and orientation, and the evidence on public and general audiences shows that literacy and expectations decide whether the view is used.
  7. 7Maps, rates and small numbers: the geography trapA map encodes geography as well as data, so rates, areal units and the instability of small counts manufacture patterns that are not in the underlying process.
  8. 8Health and risk communication: what the trials say about what readers understandThe health and risk literature is the one place where visual communication has randomised evidence, and it shows that format decided in the design changes comprehension, which makes it the strictest test of the module's other claims.
  9. 9Dashboards in organisations: instruments, governance and the cost of a wrong panelA dashboard is an instrument inside an organisation, and its failures are governance failures as much as design failures, because a measured panel changes behaviour and invites the improvement of the number rather than the thing it represents.
  10. 10Evaluating a visualisation: comprehension, trust, decisions, and the ethics of persuasionEvaluating a visualisation means choosing what counts, comprehension, trust or decision quality, and living with the limits of that choice, while the ethics of persuasion begins where an accurate display still leads a reader to the author's conclusion.

10 of 10 units written. Rows marked in preparation have no body yet.

Code HCI3109Credits 15Level 6Year 3

Specification

Assessment is by coursework unless a row says otherwise.
AssessmentWeightType
Commissioned figure with a stated brief and form rationale35%coursework
Accessibility and reproduction audit of an existing graphic25%coursework
Evaluation study of a public visualisation25%coursework
Map and small-number artefact analysis15%coursework

What you will be able to do

  • Turn a commissioning request into a named judgement, and state what the chart is for before choosing a form.
  • Choose an encoding for a stated judgement and predict how it degrades across print, screen, slide, phone and wall.
  • Design a colour scheme that is perceptually uniform, legible under colour-vision deficiency, and readable in greyscale.
  • Present an uncertain estimate so that a non-specialist infers the right amount of confidence, and say which inference the display protects.
  • Audit a map, rate or small-count comparison and name the artefact that could mislead.
  • Evaluate a visualisation on comprehension, trust or decision quality, state the limits of the measure, and identify the ethical choices the display makes.

The reading this module rests on

  • Munzner, T. (2014). Visualization Analysis and Design. CRC Press. The task-first framework the framing unit is built on; read with HCI4104 in mind.
  • Cleveland, W. and McGill, R. (1984). Graphical perception. Journal of the American Statistical Association 79(387), 531-554. The channel ranking the medium and form unit leans on.
  • Heer, J. and Bostock, M. (2010). Crowdsourcing graphical perception. CHI 2010. The replication that shows what survives a change of display and population.
  • Crameri, F., Shephard, G. and Heron, P. (2020). The misuse of colour in science communication. Nature Communications 11:5444. The colour and accessibility unit's central source.
  • Hullman, J., Qiao, Y., Correll, M., Kale, A. and Kay, M. (2019). In pursuit of error. IEEE Transactions on Visualization and Computer Graphics 26(1), 774-783. Why an uncertainty display that scores well can still mislead.
  • Gigerenzer, G., Gaissmaier, W., Kurz-Milcke, E., Schwartz, L. and Woloshin, S. (2007). Helping doctors and patients make sense of health statistics. Psychological Science in the Public Interest 8(2), 53-96. The randomised evidence that the health and risk unit is built on.

Data visualisation in practice

Data visualisation in practice is an optional module. It shares the year three elective slot with HCI3107 Professional practice and the HCI profession. A student takes exactly one of the two, and both carry the same 15 credits. The difference is the subject, not the weight. HCI3107 is about how design work is scoped, sold and delivered. This module is about making visual evidence do its job for an audience that did not make it.

The distinction that governs everything below is between encoding data correctly and making a chart work for someone else. Encoding is a solved problem in principle: the perceptual ranking of channels, the rules for colour and scale, and the catalogue of distortions are all in the literature and are taught at master's level in HCI4104. What is not solved is the second half. A figure is commissioned by one person, drawn by another, read by a third who has ten seconds and no context, and then used to decide something that affects people who never saw it. This module teaches the second half.

A chart answers a question, and the question is usually someone else's

Every visualisation encodes an answer, but the answer is only useful if it addresses a question a reader actually holds. Munzner's framework begins with three questions in a fixed order: what data does the reader need to see, why do they need it, and only then how should it be drawn (Munzner, 2014). The nested model that sits above it exists because errors at the wrong level are expensive. In the nested model, a design that solves a problem the reader never had cannot be rescued by better colour or a cleaner layout, because it fails at the task level, and the later levels depend on the earlier ones (Munzner, 2014).

The commissioning conversation is where this failure is made or avoided. The person asking for a chart usually brings a request rather than a question. They want a dashboard, or a map, or the same figure the board saw last quarter. The designer's job is to convert the request into a named judgement: a comparison, a ranking, a trend, a distribution or an outlier. The work of the unit is to practise that conversion on real briefs, because a chart that answers a question nobody asked is not a lesser chart, it is a different object.

The medium constrains the form before the data does

A form that works on a laptop fails on a phone, a slide, and a printed page. The reason is perceptual rather than aesthetic. The ranking of channels by the accuracy of the judgements they support was established in controlled experiments, and position on a common scale supports the most accurate quantitative judgement while area, angle and colour saturation support the least (Cleveland and McGill, 1984). Twenty-six years later the same comparisons were run with crowdworkers on the web, and the order survived while two things changed: the most accurate tasks moved closer together, and rectangular area proved surprisingly poor at an aspect ratio of one (Heer and Bostock, 2010).

Those findings decide what survives a change of medium. Shrink a chart to a phone and the small differences that position made legible disappear; a reader can no longer resolve the gaps between bars that carried the argument. Project it on a wall and the opposite happens: text becomes unreadable while gross position and colour survive. Print it in greyscale on cheap paper and any encoding that leaned on hue stops working. This unit takes one dataset and one question and rebuilds the chart for five media, judging each version against the channel ranking rather than against taste.

Colour is an accessibility and reproduction requirement, not a finish

Colour does two different jobs that are often confused. It can carry identity, when categories have no order, and it can carry magnitude, when values are ordered. A palette that is perceptually uniform, meaning equal steps in the data produce equal steps in what the eye sees, is required for the second job, and the first job has an entirely separate set of constraints. The common defaults fail both tests more often than designers expect. Crameri and colleagues catalogued the palette literature and reported that colour maps which distort data through uneven gradients, or which are unreadable for readers with colour-vision deficiency, remained prevalent in science, and they proposed derived maps that report true variation while staying readable (Crameri, Shephard and Heron, 2020).

The accessibility half is a reproduction requirement because it is a legal and professional one, not a preference. Roughly one in twelve men has a form of colour-vision deficiency, and the number of readers affected by greyscale printing, low-quality projectors and bright screens is larger still. This unit therefore asks for every palette to be tested under simulation and in greyscale before it is used, and for a chart to keep working when the colour is removed entirely.

Uncertainty is where published charts fail most often

An estimate drawn without its interval invites a reader to treat it as a fact. Drawing the interval is necessary but not sufficient, because the representation changes what the reader infers. Hullman and colleagues surveyed the field and set out a taxonomy of the decisions an evaluation of an uncertainty display must make, from the behavioural target down to the analysis, and then applied it to eighty-six user studies (Hullman, Qiao, Correll, Kale and Kay, 2019). They found that evaluation practice concentrates on performance and satisfaction measures, and that those measures assume more predictable judgement than the research on judgement and decision making supports.

The practical consequence is uncomfortable. A display that shows uncertainty can score worse on a standard abstract task and still improve a decision, and a clean interval that is statistically correct can make a reader more confident about the direction of an effect than the data warrants. This unit teaches the range of established remedies, from error bars and violin plots to hypothetical outcome plots, and it asks you to say which inference each one protects and which it exposes.

Annotation and sequence are how a static figure carries an argument

A chart that only shows data leaves the reading to the reader. A chart that carries an argument selects, annotates and orders, and the research on narrative visualisation shows how much of the author's reading enters at that point. Segel and Heer reviewed fifty-eight published examples and derived seven genres, among them the magazine style, the annotated chart and the slide show, organised by the balance between an author-driven narrative and reader-driven exploration (Segel and Heer, 2010). Hullman later showed that the same accurate data can support opposite conclusions depending on how the sequence is framed, which is why this module treats annotation as a rhetorical act and asks you to disclose the reading you have built in.

Maps, rates and small numbers manufacture patterns

A map is not a neutral container. It encodes geography alongside data, and geography brings three traps that recur in professional work. The first is the choice of areal unit: the same underlying values produce different correlations when they are aggregated into different boundaries, which is the modifiable areal unit problem. The second is the ecological fallacy, the error of reading a relationship between areas as a relationship between the people who live in them, a mistake named by Robinson seventy years ago and still made in dashboards today (Robinson, 1950). The third is the instability of small counts, where a rate computed from a handful of cases can top a ranking and then fall away in the next period.

The remedies are established. Rates are preferred to counts for comparison, counts are shown rather than hidden, unstable rates are smoothed or shown with their interval, and the choice of unit is stated. This unit asks you to build the same dataset as a count map and a rate map and to explain, with the numbers, why a reader could reach two different conclusions.

Health and risk communication is where the design claims are tested

The evidence base for visual communication is thin almost everywhere except one area: health and risk communication, where randomised studies have tested what readers actually understand. That literature is unusually specific. Gigerenzer and colleagues reviewed the evidence on how doctors and patients make sense of health statistics and found widespread difficulty with conditional probabilities, and they showed that the same information presented as natural frequencies rather than percentages, and as absolute rather than relative risk, is understood by markedly more people (Gigerenzer, Gaissmaier, Kurz-Milcke, Schwartz and Woloshin, 2007). Ancker and colleagues reviewed the design features of graphs used in health risk communication and found that although graphics have a strong theoretical basis, the accumulating evidence is mixed, and that design features such as use of colour, scales and the presence of a reference point can change comprehension and preference in ways that editors rarely control (Ancker, Senathirajah, Kukafka and Starren, 2006).

This unit uses that literature as the strictest available test of the design claims in the rest of the module. If a frequency format reliably beats a percentage format in a trial, then the general claim that format matters has at least one place where it was measured rather than asserted.

Dashboards are instruments inside organisations, judged by decisions

A dashboard is not a large chart. It is an instrument with an owner, a cadence and a decision attached, and that is why its failures are organisational as well as visual. Sarikaya and colleagues asked what people actually talk about when they talk about dashboards, and found a body of practice held together by convention rather than definition, with design considerations that are rarely made explicit (Sarikaya, Correll, Bartram, Tory and Fisher, 2019). A panel that is measured changes behaviour, and a measured panel invites the organisation to improve the number rather than the thing it was meant to represent. This unit connects dashboard design to the performance-measurement literature, and it asks you to cost a wrong panel: which decision it would distort, who would feel it, and how the distortion would be detected.

Evaluating a visualisation means choosing what counts

Evaluation forces the question that everything above circles. Comprehension, trust, decision quality and insight are different targets, and a method that measures one says little about the others. An insight-based method counts the observations a reader makes in a think-aloud protocol rather than scoring answers to a set question, which measures something closer to what analysts do, at the cost of being labour intensive and hard to standardise (Saraiya, North and Duca, 2005). A comprehension test is repeatable but can only report on the search it taught. A trust measure captures confidence, which is not the same as appropriate reliance.

This is also where the ethics of the module sit. A display can be accurate and still lead a reader to a conclusion the author wanted, and the difference between informing and persuading is a design decision, not an accident. Correll argues that visualisation research carries ethical responsibilities that its methods rarely examine, from the framing of a result to the consequences of a display that will be read as fact (Correll, 2019). The module asks you to state what your evaluation measured, what it could not measure, and what a reader might reasonably take from your chart that you did not intend.

The next stage is the ten units themselves. Each one takes a slice of this literature, argues a position, names where the evidence disagrees, and ends with questions that test whether you can predict what a given design will do to a given reader.

Check your understanding & apply it · 7 questions, 2 essays

1A product manager asks for a pie chart of last quarter's sales across twelve regions. The regions range from 2 per cent to 40 per cent of the total. Which is the strongest design reason to question the form before drawing it?
2The same line chart is to be shown on a phone in a field app as well as a wall-mounted operations screen. Which statement best predicts where the chart fails?
3A team encodes a continuous infection rate with a rainbow colour ramp. A reviewer objects. Which mechanism makes the reviewer's objection correct?
4An analyst reports two treatment means with 95 per cent error bars and concludes that one treatment is clearly better. A colleague warns this may mislead readers. Which statement is the most defensible basis for that warning?
5A public dashboard maps confirmed case counts by district. A densely populated city district appears at the top of the ranking, and a rural district at the bottom. Which is the most likely artefact a designer should check first?
6A health leaflet states that a drug 'cuts your risk by 50 per cent'. The evidence on risk communication suggests the sentence will be misunderstood by many readers. What is the best-supported revision?
7An operations team's performance is judged on a dashboard whose headline panel is 'average call handling time'. Within a quarter the metric improves sharply while customer complaints rise. Which explanation best names the failure?
8Essay A local council commissions a chart for a public web page. The brief says: 'Show residents how air quality has changed.' You are asked to turn this request into a designed figure. State the question you would name, the form and encoding you would choose, the medium and accessibility constraints you would design for, and the single thing you would test before publication. Justify each choice against the perceptual and communication evidence.
9Essay You must evaluate a new interactive visualisation designed to help members of the public explore local health data. The team wants to report a single measure of success. Write the evaluation you would run, state what you would measure and why, name the limits of each measure, and say how you would decide whether the visualisation works. Refer to the evidence on evaluation methods and on narrative and uncertainty.