Hello!
You might want to take a look at the ISLE web site for MT evaluation. It's
in a VERY preliminary state, and some re-organisation is imminent, but
there's still quite a lot of information there already - and your feedback
can help us to make it better!
http://www.isi.edu/natural/language/mteval
Maghi
BOUALEM Malek FTRD/DMI/LAN wrote:
>
> > -----Original Message-----
> > From: Xavier Arderiu [mailto:[EMAIL PROTECTED]]
> > Sent: Monday, November 20, 2000 12:43 PM
> > To: [EMAIL PROTECTED]
> > Subject: [MT-List] Source text for MT evaluation
> >
> >
> > Dear listmates,
> >
> > I'm looking for available information about source documentation selection
> > parameters (types of texts, selection criteria, ...), to include in a
> general MT
> > translation quality process.
> >
> > Does anybody know any interesting source where to find relevant
> information
> > about this specific subject?
> >
> > Also, does anybody know where to find a copy of the following publication:
> >
> > Van Slype, G. 1979. - Critical Study of Methods for
> > Evaluating the Quality of
> > Machine Translation.
> > Prepared for the European Commission Directorate General
> > Scientific and
> > Technical Information
> > and Information Management. Report BR 19142.
> >
> > Thanks in advance,
> >
> > Xavier
>
> On May 2000 there have been a Workshop on the
> Evaluation of Machine Translation (see the original
> CFP below). You may find what you are looking for
> in the proceedings of that conference.
>
> Malek Boualem
> France Telecom R&D
>
> ----- Original Message -----
> From: <[EMAIL PROTECTED]>Sent: Tuesday, February 08, 2000 1:42 PM
> Subject: [MT-List] LREC workshop on evaluation - Call for papers
>
> > Call for papers
> >
> > Workshop on the Evaluation of Machine Translation
> >
> > to be held in Athens, Greece, on May 29, 2000
> > in conjunction with the LREC Conference
> >
> >
> >
> > A half-day workshop will be held in conjunction with the LREC Conference
> in
> > Athens on May 29, 2000. The theme of the workshop is Machine Translation
> > Evaluation. Machine Translation is taken in the broad sense here,
> referring
> > to all types of tools used to aid in the translation process
> (e.g.machine
> > translation, translation memory systems, terminology management
> systems,
> > etc.).
> >
> > This Workshop will be the first in a series of workshops on the topic,
> > that have as goals:
> > - to discuss the establishment of a theory of the methodology of
> evaluation
> > of MT;
> > - to develop a general framework in which existing evaluation measures
> for
> > any particular application of MT can be housed in a systematic and
> > organized way;
> > - to illustrate the theory and methodology, and to take further the
> > previous work of EAGLES, by creating a specific framework for
> evaluating
> > several machine translation systems and other tools for translation.
> This
> > work involves not only taxonomizing pertinent aspects of the nature and
> use
> > of MT, but also gathering and classifying individual evaluation
> measures
> > in the most suitable groupings, and creating criteria for the
> application of
> > each measure.
> >
> > The results of this workshop will be a first step toward outlining a
> general
> > framework to guide MT evaluators, which will ultimately include a
> taxonomy of
> > the most important aspects pertinent to MT evaluation, evaluation
> measures
> > associated with each aspect, and a set of example studies. The work
> begun in
> > this workshop will be augmented and further elaborated in future
> workshops.
> >
> > In addition, this workshop will be linked to the international MT System
> > Certification initiative, currently being developed by the International
> > Association for Machine Translation (IAMT).
> >
> >
> > We are inviting contributions to the discussion of the themes above.
> >
> >
> > Submission of papers
> >
> > Submissions should consist of an abstract of about one page, plus a title
> > page providing the following information: official title of the paper;
> > names and affiliations of the authors; full address of the first author
> > including phone, fax, email, URL; presentation facilities required. Only
> > electronic submissions in ASCII, RTF or Word format will be
> > accepted.
> > The submissions should be sent to: [EMAIL PROTECTED]
> >
> > Reception of the submission will be acknowledged within 3 days. If you
> > do not get an acknowledgement, please check the email address of
> > your submission.
> >
> > Proceedings
> >
> > The workshop organizers will produce proceedings. Therefore, print-ready
> > versions of the papers have to be submitted according to LREC
> > Guidelines for Authors which can be found at
> > www.elda.fr/lrec2000.html
> > They should not exceed 5 pages. These final versions should be submitted
> > electronically to the same email address: [EMAIL PROTECTED]
> >
> > Important Dates
> >
> > Deadline for submissions of papers: March 17
> > Notification of acceptance: April 3
> > Final versions of papers for proceedings: May 12
> > Workshop May 29
> >
> > Further information
> >
> > Information about the workshop such as call, schedule, and program can
> > be found on the LREC web-page: http://www.elda.fr/lrec2000.html
> > where you will also find information about the LREC conference itself.
> >
> > Registration
> >
> > The registration fee for the workshop is:
> > - 60 EURO for those not attending LREC
> > - 40 EURO for those attending LREC
> > Registration and payment is explained on the LREC web-page.
> >
> > Included in the registration fee are the proceedings and coffee at the
> > breaks.
> >
> > Questions
> >
> > For all questions with respect to the workshop focus, please contact the
> > workshop organisers, emails below. For all questions with respect to
> > organisational issues, accommodation, etc., please contact the LREC
> > secretariat: [EMAIL PROTECTED]
> >
> > Organising Committee
> >
> > Bente Maegaard, Center for Sprogteknologi, Copenhagen, email:
> [EMAIL PROTECTED]
> > Maghi King, TIM/ISSCO, ETI, Geneva, email: [EMAIL PROTECTED]
> > Eduard Hovy, USC/ISI, Los Angeles, email: [EMAIL PROTECTED]
> >
> >
> >
> >
> > Bente Maegaard, Director
> > Center for Sprogteknologi, Njalsgade 80, 2300 Copenhagen S
> > Phone: +45 35 32 90 74, Fax: +45 35 32 90 89
> > E-mail: [EMAIL PROTECTED]
> >
> >
>
> --
> For MT-List info, see http://www.eamt.org/mt-list.html
--
IMPORTANT: ISSCO has moved (from 28th September 1999)
AND my phone number keeps changing. Please check that you have the latest
one below.
Maghi King | E-mail: [EMAIL PROTECTED]
TIM/ISSCO, ETI
University of Geneva | WWW: http://issco-www.unige.ch/
40 blvd du Pont d'Arve | Tel: +41/22/705 87 55
CH-1211 GENEVA 4 (Switzerland) | Fax: +41/22/781 86 89
--
For MT-List info, see http://www.eamt.org/mt-list.html
