UStackUStack
MQM Annotation Tool icon

MQM Annotation Tool

MQM Annotation Tool is a web-based translation quality evaluation tool from Alconost. It lets teams upload translation output, annotate MQM errors, and export structured results for analysis and reporting.

MQM Annotation Tool

Translation quality evaluation with MQM annotations

MQM Annotation Tool is a web-based translation quality evaluation tool from Alconost. It is built around the MQM (Multidimensional Quality Metrics) framework, which records translation quality as explicit error categories and severities instead of a single holistic score.

Users can upload translation output, annotate issues in line with MQM guidelines, and export structured results for segment-level or system-level analysis. The product supports tabular and JSONL data formats, includes reporting for quality scores and error distributions, and exposes an API for automated import and export workflows.

Core features

MQM error annotation

Upload translation output and annotate errors with MQM categories and severities such as Accuracy, Fluency, Terminology, Style, Locale convention, and Other.

Structured import formats

Use TSV/CSV layouts for one-error-per-row workflows or JSONL for nested annotations and richer metadata.

Explicit no-error labeling

Mark segments explicitly as no-error so completed items are counted as checked and correct rather than skipped.

Context-aware annotation

Provide context fields for glossary terms, reference links, style guidance, or other annotator guidance that should be visible in the interface.

Reporting and export

Export annotated data and reports in JSONL, TSV, CSV, and PDF, including project scoring, error distributions, and session timing estimates.

API-driven workflow

Automate project creation and retrieval through a REST API documented with an OpenAPI spec, including import, export, and taxonomy endpoints.

Common use cases

  • Translation quality assessment

    Evaluate human or machine translation using MQM categories and severities to produce structured annotations instead of a single subjective score.

  • System comparison and benchmarking

    Compare outputs from different MT or LLM systems and export the results for system-level ranking or regression tracking.

  • Human-in-the-loop QA review

    Run blind reviews with professional linguists when you need an objective quality verdict on vendor or AI-generated translation.

  • Gold dataset creation

    Create MQM gold-standard datasets for model evaluation, benchmarking, or fine-tuning workflows that need human-verified labels.

  • Automated annotation operations

    Script batch project creation and result retrieval for larger localization workflows, including progress checks and wave-based analysis.

Pros and Cons

Pros

  • Supports granular MQM error categories and severities for fine-grained evaluation.
  • Accepts both tabular and JSONL-style data, which fits different annotation pipelines.
  • Provides structured exports and reporting for downstream analysis.
  • Includes a REST API with OpenAPI documentation for automated project creation and export.
  • Can be used in self-hosted or other non-default environments according to the API guide.

Cons

  • The pricing page captured for this product returns a page-not-found response, so public pricing details are not visible in the provided sources.
  • The source material does not describe advanced project-management features such as role management or workflow approvals.

FAQ

What is the MQM Annotation Tool used for?

The tool supports MQM-based translation quality evaluation by letting you upload translation output, annotate errors according to MQM guidelines, and export structured results for analysis. The page also describes a human-in-the-loop service where professional linguists can perform blind MQM annotation.

Which file formats does it support?

The source page and API guide describe TSV, CSV, JSONL, and JSON imports, with exports available in JSONL, TSV, and CSV. The homepage also notes tabular layouts for TSV/CSV and nested annotations in JSONL.

Can it be used offline or self-hosted?

Yes. The product page describes it as free, secure, and offline-capable, and the API guide says the Base URL changes for self-hosted or other deployment environments.

Does it have an API for automation?

The API guide says projects can be created programmatically, annotated data can be exported, and project progress can be monitored through the export endpoint. Authentication is required for creating projects, while read operations are public for anyone with a valid project UUID.

How much does it cost?

The source does not list pricing plans. The pricing URL currently returns a page-not-found response, so the public evidence only supports that pricing details are not shown on the site page captured here.

Quick Facts

Category
Translation quality evaluation
Vendor
Alconost
Platform
Web app
Deployment
Offline-capable; self-hosted support noted in API guide
Primary users
Translation evaluators, linguists, and localization teams
Domain
alconost.mt

Альтернативы MQM Annotation Tool