There are four examples of each sound: the original from
which the statistics were measured, a synthetic version matching only
the spectrum of the original sound, a synthetic version matching the
marginal statistics of "cochlear" filter envelopes (producing the
same spectrum, and sparsity, as the original recording), and a
synthetic version matching a larger set of statistics
(including correlations between filters).
Matching the spectrum alone produces signals that sound like noise, and that rarely resemble the original sound.
Matching the marginal statistics (yielding sounds with sparsity comparable to the originals) generally produces
realistic
synthesis only for water, and the results often
sound watery irrespective of whether the original sound was water or
not. We believe this is because the salient properties of
water are produced by independent bandpass events, and are thus easily
captured by marginal statistics of bandpass filters. Most other sounds
have statistical dependencies that are more complex. With the larger
set of statistics, however, we can synthesize many different natural
sound textures.
The synthesis algorithm, along with experiments exploring the perception of textures, is described in this paper (2011, Neuron). An earlier
version of this work is described in this paper (2009, WASPAA). The perception of texture was further explored in this paper (2013, Nature Neuroscience).
Headphones are recommended.
Quicktime must be installed for the sounds to play.
**Please note - sound files make take a few seconds to load. If not all sound load, please try refreshing the page.**
Sound Type | Original Recording | Synthetic - Spectrum | Synthetic - Marginals | Synthetic - Full Set of Statistics |
Insects | ||||
Bees | ||||
Sparrows | ||||
Cocktail Party | ||||
Applause |