Direct Segmented Sonification

Paul Vickers and Robert Höldrich presented Direct Segmented Sonification, or DSSon (Vickers & Höldrich, 2019) as a way of sonifying one-dimensional time series data in a temporally compressed form that picks out key features in the data.

Data was gathered from users on the FRED machine. Below are two examples of using DSSon.

The first example is a DSSOn of one minute of a first-time user's data. The second one is one minute of data taken from an expert user.

The DSSon here emphasised poor technique, so the less sound you hear, the better the user is operating the machine.

References

  1. Vickers, P., & Höldrich, R. (2019). Direct Segmented Sonification of Characteristic Features of the Data Domain. In P. Vickers, M. Gröhn, & T. Stockman (Eds.), ICAD 2019 — The 25th Meeting of the International Conference on Auditory Display (pp. 244–253). Newcastle upon Tyne, UK: Department of Computer and Information Sciences, Northumbria University.