Til hovedinnhold

Evaluation in natural language processing

Evaluation in natural language processing

Kategori
Vitenskapelig foredrag
Sammendrag
What are the purposes of evaluation. Different kinds of evaluation (of an hypothesis, of a resource, of a system in terms of its requirements, of a system in termos of usability, of model adequacy, of economical impact). Measures and concepts (properties of measures, relationship with desirable properties, statistical remarks). Evaluation of user-visible vs. user-transparent tasks; black-box vs. glass-box evaluation. The evaluation contest paradigm. Evaluation resources (golden resources, pooling, ablation). Baselines, ceilings, inter-annotator agreement. Corpus-based evaluation. Detailed examples: parsing, information retrieval, information extraction, machine translation, morphological analysis, and generation.
Språk
Engelsk
Forfatter(e)
  • Diana Santos
Institusjon(er)
  • SINTEF Digital / Software and Service Innovation
Presentert på
19th European Summer School in Logic, Language and Information, ESSLLI 2007
Sted
Dublin, England
Dato
06.08.2007 - 17.08.2007
Arrangør
University of Dublin
År