Hm, you could certainly d it with csound. :-)
Honestly, sorry for that remakr. :-) but the idea of Yoshimi mae me think:
You might be able to do it in Ingen, since it is - as far as I know - based on
the connection of LADSPA effects. So if Ingen allows for audio input, you
should be able to connect all the relevant plugin ports.
Good luck and goodbye
Music was my first love and it will be my last (John Miles)