Audio retrieval by timbral and rhythmic similarity
fLoop attempts to solve a common issue faced by artists who compose with audio loops; which loop can follow the current one?
fLoop is an audio file navigation tool that provides a simple interface to navigate a large number of loops by tempo, rhythmic and timbral distances. It is a GPL licensed standalone application, built on the JUCE framework in C++. It also uses the Eigen library for linear algebra routines and an FFT.
The interface consists of two list boxes, along with playback and visualization functions. The user selects a file on the left box, and selects a range out of the three sliders for tempo, rhythmic distance and timbral distance. The files that match the selected criteria are displayed in the list box on the right, which the user can audition individually.
The rhythmic distance measure was based on a periodicity measure built from the self-similarity matrix in the spectral domain, while the timbral distance measure was derived from statistical features of the Mel Frequency Cepstral Coefficients and their derivatives.
You can read into the technical details in the paper (link coming soon!), or access the source on GitHub.Tags: 2013, Audio Content Analysis, C++, DSP, Georgia Tech, JUCE, Matlab, MIR