IBEREVAL 2010: 1st Workshop on Evaluation of Human Language Technologies for modern iberian languages
September 6-7, 2010
In conjunction with SEPLN 2010 Valencia, Spain
Webpage: http://gplsi.dlsi.ua.es/congresos/ibereval10/
==============================================================
CALL FOR PAPERS
==============================================================
DESCRIPTION
With the aim of encouraging and promoting the development of Human Language Technologies (HLT) for modern iberian languages, the goal of this workshop is creating a discussion forum about different aspects regarding the evaluation of Natural Language Processing systems, emphasizing the main problems that modern iberian languages implied: Spanish, Catalan, Basque, Galician and Portuguese.

The implementation of this type of systems requires a deep evaluation and validation of them. In order to validate the HLT, similar evaluation methods must exists for similar applications, in order to compare them straightforwardly.

Besides, most tasks of HLT, as summarization and automatic translation, does not have a unique valid solution, but more than one can be accepted. Therefore, the evaluation methods required must be clear and adjusted to the system goals.

Following the line of other workshops focused in the evaluation of HLT systems, this IBEREVAL I workshop is presented as a discussion forum about the evaluation of systems working with modern iberian languages, with the aim of discovering the interests and necessities of the scientific community, dealing with the problems that evaluation implies, and promoting the creation of evaluation resources and training corpus for HLT systems working on these languages.

TOPICS OF INTEREST
This IBEREVAL I workshop will bring together researchers, academic institutions and companies working on the development of HLT systems and their evaluation, participating through submissions regarding issues such as:

Development of evaluation resources over different HLT modules and applications:
creation of gold-standard corpus for iberian languages (Catalan, Basque, Galician, Portuguese and Spanish); Part of Speech tagging; syntactic parsing; semantic interpretation; anaphora resolution; information retrieval and extraction; summarization; machine translation, etc.
Evaluation metrics for the different HLT modules and applications.
General modules of evaluation: direct and indirect evaluation.
Development of testing, supervision and evaluation frameworks for HLT systems.
Manual, supervised and semi-supervised evaluation.
Creation and development of evaluation standards.
IMPORTANT DATES
Paper submission deadline:	June 15, 2010
Acceptance Notification:	July 15, 2010
Camera Ready Copy:	July 31, 2010
Workshop:	September 6-7, 2010
 
SUBMISSIONS
Submitted papers can be written in English or Spanish, and must not exceed the length of 4 pages with SEPLN format. Author guides can be found in:

http://www.sepln.org/revistaSEPLN/Instrevista.php?lang=en
Authors must focused in the relevant aspects of the submissions. Online system for electronically submissions will be available in a few weeks. All submissions will be double-blind peer-reviewed by two reviewers. The initial manuscript submission should not include acknowledgements, authors' names or their affiliations. The program committee will be responsible for the final decision about acceptance of papers submitted to the workshop. All accepted papers will be included in the workshop working notes. Extended/revised versions of contributions will be ellectronically published as CEUR workshop proceedings (http://CEUR-WS.org). At least one author must be registered at the workshop for each accepted paper.

 

PROGRAM COMMITTEE
Chair: Patricio Martínez-Barco (University of Alicante)

Program Committee Members:
Eneko Aguirre (EHU)
Anabela Barreiro (U. Porto)
Víctor Díaz (U. Sevilla)
Xavier Gómez-Guinovart (U. Vigo)
Fernando Llopis (U. Alicante)
M. Antonia Martí (U. Barcelona)
Paloma Martínez (U. Carlos III)
Manuel Montes (INAOE, Mexico)
Lidia Moreno (UPV)
German Rigau (EHU)
Horacio Rodríguez (UPC)
Paolo Rosso (UPV)
Alfonso Ureña (U. Jaén)
Felisa Verdejo (UNED)
CONTACT
Borja Navarro-Colorado
Dept. of Software and Computing Systems
University of Alicante, Spain
Email: borja@dlsi.ua.es