4278 Lessons for Reproducible Science from the DARPA Speech and Language Program

Saturday, February 19, 2011: 4:00 PM
159AB (Washington Convention Center )
Mark Liberman , University of Pennsylvania, Philadelphia, PA
Since 1987, DARPA has organized most of its speech and language research in terms of formal, quantitative evaluation of computational solutions to well-defined "common task" problems. What began as an attempt to ensure against fraud turned out to be an extraordinarily effective way to foster technical communication and to explore a complex space of problems and solutions. This engineering experience offers some useful (if partial) models for reproducible science, especially in the area of data publication; and it also suggests that the most important effects may be in lowering barriers to entry and in increasing the speed of scientific communication.
<< Previous Presentation | Next Presentation