DAFx Digital Audio Effects 2008

DAFx-08 / DAFxTRa

11th International Conference
on Digital Audio Effects
DAFx-08
September 1-4, 2008
Espoo, Finland

Home

Call for papers

DAFxTRa has been postponed to 2009. Please join the open planning meeting on Wednesday, September 3rd at 5.30 PM.

Call for DAFxTRa 2008 (DAFx Transformation RAting)

We announce and call for your participation in a cross-community evaluation of audio effects.

DAFxTRa 2008 (DAFx Transformation RAting) is a new initiative promoted by MTG-UPF and DAFx-08 aimed at evaluating and comparing algorithms for audio effects. Our goal is to have the main evaluation in September 2008 during DAFx-08 but to make it happen we need the involvement of the audio effects research community.

We do not know of any major initiative to compare audio effects algorithms, which might be the related to the difficulty of the evaluation task. It is hard because it requires standardized procedures for carefully controlled subjective experiments. But we believe that now is the time to try it, so we can all learn from the process and in turn improve our audio effects algorithms.

Inspired by the success of MIREX in the evaluation of Music Information Retrieval algorithms, and having acquired some experience by organizing the audio description contest at ISMIR 2004-Barcelona, we want to promote a similar initiative for the digital audio effects community.

However most audio effects tasks do not afford an objective measure of ground truth, like in MIR, and thus we have to define specific evaluation strategies. We want to do it by involving the developers of algorithms interested in participating and by specifying with them the evaluation process. The participants should learn from the process and the whole DAFx community should benefit from it.

Our initial aims are the following:

1. Propose several audio effects categories. Initial proposal: time-scaling, pitch-shifting, source separation, morphing, distortion effects and deconstruction.

2. Select the categories for which there is a sufficient number of participants.

3. Select sounds from Freesound to be used as test sounds for each category.

4. Define the evaluation procedure for each category.

5. Define the evaluation procedure for each category.

6. Ask the participants to submit the transformed sounds (not the algorithms).

7. Perform the evaluation both live at DAFx-08 and also online in Freesound.

8. Publish the results of the evaluation.