What Is Audio Fingerprinting?

Peaks in a spectrogram

An audio fingerprint is calculated from the sound itself. A typical approach turns the audio into a spectrogram, a map of how much energy sits at each frequency over time, and picks out distinctive points such as prominent peaks. The relationships between those points form a compact signature. Because the signature depends on the shape of the sound rather than the exact bytes, it survives format changes, lower bitrates and a fair amount of background noise. That is why music recognition apps can identify a song from a phone held up in a noisy bar.

Matching compares a fingerprint from an unknown clip against a database of reference fingerprints. A short excerpt is usually enough to identify the recording and the position within it.

Why video teams care about the soundtrack

Audio fingerprinting is associated with music, but it matters for film, series and sport too. Pirates who want to avoid automated detection on upload platforms often alter the picture: mirroring it, cropping heavily, placing it inside a frame or overlaying graphics. Those changes can defeat video fingerprinting. The soundtrack is usually left alone, because altering it spoils the viewing. A match on the audio then identifies the title even when the picture no longer matches.

It works the other way as well. Uploads that replace the soundtrack with music, or carry a dubbed track in a language missing from the reference database, can pass audio matching while the picture still matches. Running both checks closes more gaps than either alone, as the audio and video fingerprinting comparison sets out.

Recordings, performances and works

An audio fingerprint identifies a specific recording. A cover version, a live performance or a karaoke track of the same song produces a different fingerprint, even though the underlying composition is the same. Music rights holders need to keep that in mind: a fingerprinting system will find copies of the master recording, but not every use of the song.

The same distinction affects evidence. A fingerprint match supports the statement that a file contains a particular recording. Whether that use is licensed, falls under an exception in the relevant jurisdiction, or is the rights holder's own promotion is a separate question that a person answers before a notice is sent. For patterns specific to music, see music piracy.