DARPA Resource Management Benchmark Test Results June 1990

DARPA Resource Management Benchmark Test Results June 1990 D. S. Pallett, J. G. Fiscus, and J. S. Garofolo Room A 216 Technology Building National Institute of Standards and Technology (NIST) Gaithersburg, MD 20899 in order to accommodate the larger volume of Introduction test data. (For each of the four speakers, The June 1990 DARPA Resource Management there were a total of 120 sentence utterances, Benchmark Test makes use of the first of so that the test consisted of a total of 480 several test sets provided with the Extended sentence utterances, in contrast to the test set Resource Management Speaker-Dependent size of 300 sentence utterances used in Corpus (RM2) [I]. The corpus was designed previous tests.) Scoring options were not as a speaker-dependent extension to the changed from previous tests. Resource Management (RM1) Corpus [2], consisting of (only) four speakers, but with a large number (2400) of sentence utterances Tabulated Results for each of these speakers for system training purposes. The corpus was produced on CD- Table 1 presents results of NIST scoring of the ROM by NIST in April 1990, and distributed June 1990 RM2 Test Set results received by to DARPA contractors. Results have been NIST as of June 21, 1990. reported to NIST for both speaker-dependent and speaker-independent systems, and the For speaker-dependent systems, results are results of NIST scoring and preliminary presented for systems from BBN and MIT/LL analysis of ...