By Carol Peters (auth.), Carol Peters, Thomas Deselaers, Nicola Ferro, Julio Gonzalo, Gareth J. F. Jones, Mikko Kurimo, Thomas Mandl, Anselmo Peñas, Vivien Petras (eds.)

The 9th crusade of the Cross-Language evaluate discussion board (CLEF) for eu languages was once held from January to September 2008. there have been seven major eval- tion tracks in CLEF 2008 plus pilot initiatives. the purpose, as ordinary, was once to check the p- formance of quite a lot of multilingual details entry (MLIA) structures or s- tem parts. This 12 months, a hundred teams, customarily yet not just from academia, parti- pated within the crusade. lots of the teams have been from Europe yet there has been additionally a great contingent from North the United States and Asia plus a number of individuals from South the US and Africa. complete information concerning the layout of the tracks, the methodologies used for review, and the consequences got by way of the contributors are available within the diversified sections of those lawsuits. the result of the CLEF 2008 crusade have been provided at a two-and-a-half day workshop held in Aarhus, Denmark, September 17–19, and attended via a hundred and fifty resear- ers and method builders. the once a year workshop, held together with the ecu convention on electronic Libraries, performs a big position by way of supplying the chance for all of the teams that experience participated within the evaluate crusade to celebration evaluating methods and changing rules. The time table of the workshop was once divided among plenary song overviews, and parallel, poster and breakout classes proposing this year’s experiments and discu- ing rules for the long run. there have been a number of invited talks.

Show description

Read Online or Download Evaluating Systems for Multilingual and Multimodal Information Access: 9th Workshop of the Cross-Language Evaluation Forum, CLEF 2008, Aarhus, Denmark, September 17-19, 2008, Revised Selected Papers PDF

Similar nonfiction_11 books

Primary Productivity and Biogeochemical Cycles in the Sea

Organic methods within the oceans play a vital position in regulating the fluxes of many very important parts akin to carbon, nitrogen, sulfur, oxygen, phosphorus, and silicon. As we come to the tip of the 20 th century, oceanographers have more and more focussed on how those components are cycled in the ocean, the interdependencies of those cycles, and the influence of the cycle at the composition of the earth's surroundings and weather.

Partial Differential Equations: Theory, Control and Approximation: In Honor of the Scientific Heritage of Jacques-Louis Lions

This booklet collects papers typically provided on the "International convention on Partial Differential Equations: idea, keep watch over and Approximation" (May 28 to June 1, 2012 in Shanghai) in honor of the clinical legacy of the phenomenal mathematician Jacques-Louis Lions. The individuals are best specialists from around the world, together with individuals of the Academies of Sciences in France, the us and China and so on.

IUTAM Symposium on Multiscale Modelling of Damage and Fracture Processes in Composite Materials: Proceedings of the IUTAM Symposium held in Kazimierz Dolny, Poland, 23–27 May 2005

The IUTAM Symposium on “Multiscale Modelling of wear and tear and Fracture procedures in Composite fabrics” used to be held in Kazimierz Dolny, Poland , 23 -27 could 2005. The Symposium was once attended through forty eight individuals from 15 international locations. in the course of five day assembly, four keynote lectures and 39 invited lectures have been provided. This quantity constitutes the complaints of the IUTAM Symposium.

Extra resources for Evaluating Systems for Multilingual and Multimodal Information Access: 9th Workshop of the Cross-Language Evaluation Forum, CLEF 2008, Aarhus, Denmark, September 17-19, 2008, Revised Selected Papers

Example text

Participants were supplied with archival metadata including title and description, shot boundaries, mshot-level keyframes and automatic speech recognition (ASR) transcripts in both Dutch and English. The video content was chosen to reflect the cultural heritage domain and the subject labels used in the automatic classification task were selected to be representative of cultural heritage themes. The track was coordinated by the University of Amsterdam; data was provided by The Netherlands Institute of Sound and Vision; University of Twente, provided the speech transcripts; Dublin City University, Ireland, provided the shot segmentations and the key frames.

Future cross-language system evaluation campaigns must activate new forms of experimental evaluation - laboratory and interactive – in order to foster the development of MLIA systems more adherent to the new user needs. We need a deeper understanding of the interaction between multicultural and information proactive users, multilingual content, language-dependent tasks, and the enabling technologies consisting of MLIA systems and their components. At the same time, benchmarking efforts must prove their usefulness for industrial take-up; evaluation initiatives risk being seen as irrelevant for system developers if the data they investigate are not of realistic scale and if the use cases and scenarios tested do not appear valid.

This pool is then used for subsequent relevance judgments. After calculating the effectiveness measures, the results are analyzed and run statistics produced and distributed. The stability of pools constructed in this way and their reliability for postcampaign experiments is discussed in [7] with respect to the CLEF 2003 pools. New pools were formed in CLEF 2008 for the runs submitted for the TEL and the Persian mono- and bilingual tasks. Instead, the robust tasks used the original pools and relevance assessments from previous CLEF campaigns.

Download PDF sample

Evaluating Systems for Multilingual and Multimodal by Carol Peters (auth.), Carol Peters, Thomas Deselaers, Nicola
Rated 4.61 of 5 – based on 31 votes