Letter-to-Phoneme Conversion Challenge

For letter-to-phoneme conversion, evaluation will be by 10-fold cross validation. Each of the available datasets is already split into 10 subsets (`folds') so that everyone is using the same ones. This will promote comparability of results. Take each fold in turn, train on the remaining nine folds and test on that particular fold. Repeat this 10 times, so that each of the 10 folds is used exactly once as the test set, and report the mean and standard deviation of the phoneme accuracy (and, if you wish, word accuracy also) computed over the 10 trials.

For other tasks (alignment, syllabification, stress assignment, ...), you should follow the above procedure as far as possible.