PREPRINT
9B9E6CC4-0F0F-4129-9F4E-8916899ED2A8

Evaluating the efficacy of sonification for signal detection in univariate, evenly sampled light curves using astronify

J. Tucker Brown, C. M. Harrison, A. Zanella, J. Trayford

Submitted on 9 September 2022

Abstract

Sonification is the technique of representing data with sound, with potential applications in astronomy research for aiding discovery and accessibility. Several astronomy-focused sonification tools have been developed; however, efficacy testing is extremely limited. We performed testing of astronify, a prototype tool for sonification functionality within the Barbara A. Mikulski Archive for Space Telescopes (MAST). We created synthetic light curves containing zero, one, or two transit-like signals with a range of signal-to-noise ratios (SNRs=3-100) and applied the default mapping of brightness to pitch. We performed remote testing, asking participants to count signals when presented with light curves as a sonification, visual plot, or combination of both. We obtained 192 responses, of which 118 self-classified as experts in astronomy and data analysis. For high SNRs (=30 and 100), experts and non-experts performed well with sonified data (85-100% successful signal counting). At low SNRs (=3 and 5) both groups were consistent with guessing with sonifications. At medium SNRs (=7 and 10), experts performed no better than non-experts with sonifications but significantly better (factor of ~2-3) with visuals. We infer that sonification training, like that experienced by experts for visual data inspection, will be important if this sonification method is to be useful for moderate SNR signal detection within astronomical archives and broader research. Nonetheless, we show that even a very simple, and non-optimised, sonification approach allows users to identify high SNR signals. A more optimised approach, for which we present ideas, would likely yield higher success for lower SNR signals.

Preprint

Comment: Accepted for publication in MNRAS (10 pages, 5 figures). Sonifications of Figure 1 (4 audio files) and Figure 5 (2 movie files) are available in the ancillary files folder. These, plus all other data products associated with this article are also available at: https://doi.org/10.25405/data.ncl.20936749

Subjects: Astrophysics - Instrumentation and Methods for Astrophysics; Physics - Data Analysis, Statistics and Probability

URL: https://arxiv.org/abs/2209.04465