[LAA] Silvet Note Transcription Vamp plugin v1.0 released

Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]
To: <linux-audio-user@...>, <linux-audio-announce@...>
Date: Wednesday, August 13, 2014 - 12:58 pm

Silvet is a Vamp plugin for note transcription in polyphonic music.

http://code.soundsoftware.ac.uk/projects/silvet

** What does it do?

Silvet listens to audio recordings of music and tries to work out what
notes are being played.

To use it, you need a Vamp plugin host (such as Sonic Visualiser).

How to use the plugin will depend on the host you use, but in the case
of Sonic Visualiser, you should load an audio file and then run Silvet
Note Transcription from the Transform menu. This will add a note
layer to your session with the transcription in it, which you can
listen to or export as a MIDI file.

** How good is it?

Silvet performs well for some recordings, but the range of music that
works well is quite limited at this stage. Generally it works best
with piano or acoustic instruments in solo or small-ensemble music.

Silvet does not transcribe percussion and has a limited range of
instrument support. It does not technically support vocals, although
it will sometimes transcribe them anyway.

You can usually expect the output to be reasonably informative and to
bear some audible relationship to the actual notes, but you shouldn't
expect to get something that can be directly converted to a readable
score. For much rock/pop music in particular the results will be, at
best, recognisable.

To summarise: try it and see.

** Can it be used live?

In theory it can, because the plugin is causal: it emits notes as it
hears the audio. But it has to operate on long blocks of audio with a
latency of many seconds, so although it will work with non-seekable
streams, it isn't in practice responsive enough to use live.

** How does it work?

Silvet uses the method described in "A Shift-Invariant Latent Variable
Model for Automatic Music Transcription" by Emmanouil Benetos and
Simon Dixon (Computer Music Journal, 2012).

It uses probablistic latent-variable estimation to decompose a
Constant-Q time-frequency matrix into note activations using a set of
spectral templates learned from recordings of solo instruments.

For a formal evaluation, please refer to the 2012 edition of MIREX,
the Music Information Retrieval Evaluation Exchange, where the basic
method implemented in Silvet formed the BD1, BD2 and BD3 submissions
in the Multiple F0 Tracking task:

http://www.music-ir.org/mirex/wiki/2012:Multiple_Fundamental_Frequency_E...

_______________________________________________
Linux-audio-announce mailing list
Linux-audio-announce@lists.linuxaudio.org
http://lists.linuxaudio.org/listinfo/linux-audio-announce

Previous message: [thread] [date] [author]
Next message: [thread] [date] [author]

Messages in current thread:
[linux-audio-announce] Sweep 0.5.5, Conrad Parker, (Fri Sep 20, 11:26 am)
[linux-audio-announce] [ANN] KMetronome 0.6 released, Pedro Lopez-Cabanillas, (Mon Jun 20, 8:35 pm)
[LAA] [ANN] KMidimon 0.7.1 released, Pedro Lopez-Cabanillas, (Sat Aug 15, 9:19 am)
[LAA] [ANN] Virtual MIDI Piano Keyboard 0.3.0 released, Pedro Lopez-Cabanillas, (Sun Oct 11, 5:11 pm)
[LAA] BigBand - compose music for small ensembles, W.Boeke, (Fri Nov 13, 11:21 pm)
[LAA] [ANN] Announcing the first public release of libmapper, Stephen Sinclair, (Sat Feb 19, 8:05 am)
[LAA] [ANN] Ecasound 2.8.0 released, Kai Vehmanen, (Thu May 12, 8:35 am)
[LAA] , Diemo Schwarz, (Fri Jul 15, 8:03 am)
[LAA] Petri-Foo 0.1.4 now released, James Morris, (Mon Jul 2, 8:04 am)
[LAA] OpenAV Productions : Sorcer, Harry van Haaren, (Sat May 11, 8:10 am)
[LAA] Vee One Suite 0.3.3 - Late spring blossoming, Rui Nuno Capela, (Sat Jun 8, 10:02 am)
[LAA] OpenAV Fabla, Harry van Haaren, (Tue Jul 23, 5:25 pm)
[LAA] lm3jo en deb version 1.1.1-5, temps, (Mon Feb 24, 9:54 am)
[LAA] Silvet Note Transcription Vamp plugin v1.0 released, Chris Cannam, (Wed Aug 13, 12:58 pm)