← All articles
Blog

What Is Data Annotation? A Practical Guide for AI Teams

Data annotation is the process of adding labels, tags or structured information to raw data so that a machine learning model can learn from it or be evaluated against it. A photo gets bounding boxes around objects. A sentence gets tagged for sentiment. An audio clip gets a transcript. A customer email gets marked with its intent and the action it needs. Without annotation, most supervised learning and most evaluation would not be possible. This guide explains what data annotation is, the main types, how quality is controlled, and how real business records can carry their own labels.

Why data annotation matters

Machine learning models learn patterns from examples. In supervised learning, every example needs a known answer, called a label, so the model can compare its prediction with the truth. Evaluation works the same way: to measure whether a model is right, you need examples where the right answer is known. Annotation supplies those answers.

As AI systems take on more complex work, annotation has moved beyond simple tags. It now includes:

  • writing preferred responses for instruction tuning
  • ranking alternative model outputs to train preference models
  • grading multi-step agent behaviour
  • explaining why an answer is right or wrong

Types of data annotation

Text annotation

  • Classification: assigning categories, such as topic, intent or sentiment.
  • Named entity recognition: marking names, organisations, dates, amounts and product codes.
  • Relation extraction: linking entities, for example "supplier X quoted price Y for part Z".
  • Summarisation and question answering: writing reference answers.

Image and video annotation

  • bounding boxes and polygons around objects
  • semantic and instance segmentation
  • keypoints for pose
  • activity and event labels in video

Audio annotation

  • transcription
  • speaker diarisation, recording who spoke when
  • labels for sound events, emotion or intent

See our guide to audio datasets.

Document annotation

Labelling fields in invoices, forms, drawings and contracts, and linking documents that belong to the same case.

Preference and judgement annotation

Experts compare model outputs, rate them against criteria, or correct them. This is central to modern post-training.

Who does data annotation

  • In-house teams: best for sensitive or specialist work.
  • Managed annotation vendors: provide trained workforces and tooling. See Scale AI alternatives.
  • Crowdsourcing platforms: suitable for simple, high-volume tasks.
  • Domain experts: engineers, clinicians, lawyers or accountants for specialist judgement.
  • Model-assisted labelling: a model proposes labels and humans review them.

Quality control

Annotation quality determines model quality. Common practices include:

  • clear guidelines with worked examples and edge cases
  • qualification tests for annotators
  • gold-standard items mixed into the work
  • multiple annotators per item, with measures of agreement
  • adjudication of disagreements by experts
  • regular audits and feedback loops

Common challenges

  • Ambiguity: many real tasks have no single right answer.
  • Cost and time: expert annotation is slow and expensive.
  • Bias: annotator background and guidelines shape labels.
  • Drift: guidelines evolve and early labels become inconsistent.
  • Privacy: annotators may see personal or confidential data.

When records carry their own labels

Some real-world data already contains its outcome. A business quotation may later be marked as won or lost. A delivery may be recorded as on time or late. A machined part may pass or fail inspection, and a support ticket may be resolved or escalated. When these outcomes are kept in linked business records, they can serve as labels without separate human annotation. This idea is often called outcome-as-label.

This is why linked, time-stamped business records interest AI teams. A sequence of request, information available, decision and recorded outcome supports both training and evaluation, provided later information can be hidden when testing an earlier decision. Read RL environment data and what is an AI dataset.

Outcome labels don't remove the need for annotation altogether. Records still need cleaning, linking, and sometimes expert explanation of why a decision was made. But they can reduce the volume of manual labelling, and they ground labels in what actually happened.

Data annotation and data rights

Annotation adds value to data, but it doesn't create rights to the underlying records. If the source data is licensed, the licence should cover annotation, derived datasets and model training. See data licensing agreements and data provenance.

How Maevar helps

Maevar introduces record owners to vetted buyers, typically AI teams looking for real business records such as emails, quotations, engineering files, delivery records and production histories. These connect a request to the decisions, exceptions and outcomes that followed. Tell us what you want a model to do. The buyer pays our introduction fee. The owner and the buyer agree terms, preparation and how personal details are handled, directly. Discuss your use case.

The annotation workflow, step by step

  1. Define the task: what the model must predict or produce, and how it will be measured.
  2. Write guidelines: definitions, examples, counter-examples and rules for ambiguous cases.
  3. Pilot: annotate a small batch, measure agreement and refine the guidelines.
  4. Scale: onboard annotators, add gold items and monitor quality continuously.
  5. Adjudicate: resolve disagreements and feed the decisions back into the guidelines.
  6. Version: record which guideline version produced each label.
  7. Audit: sample finished work regularly, and check for drift and bias.

Skipping the pilot is the most common cause of expensive relabelling later.

FAQ

What is data annotation in simple terms?

Adding labels or answers to raw data so AI models can learn from it or be tested against it.

Is data annotation the same as data labelling?

The terms are largely interchangeable. "Annotation" is sometimes used for richer structure, such as spans, relationships or explanations.

What tools are used for data annotation?

Dedicated annotation platforms for text, image, audio and video, often with model-assisted pre-labelling and quality dashboards.

Can AI do data annotation?

Models can propose labels, but human review is still needed for accuracy, especially in specialist domains.

Do real business records need annotation?

Often less than other data, because recorded outcomes can act as labels. They still need cleaning, linking and checks.

Maevar privacy notice

21 October 2026

Who we are

Maevar is operated by Marcias Limited, company number SC653353. Marcias Limited is responsible for the personal information covered by this notice.

Registered office: 51 Watt Road, Hillington, Glasgow, G52 4RY, United Kingdom.

For privacy questions or requests, email hello@maevar.com.

This notice covers this website and enquiries sent to Maevar. Any proposed introduction of a record owner to a buyer, or any sale or licence they agree, requires a separate review of the relevant rights, privacy requirements and agreed terms.

Enquiries and information you provide

The enquiry fields help you prepare an email containing your work email address, organisation, task summary and any optional format or timing details. The draft is prepared on your device. The website does not submit or store it: you choose whether to open, review and send it using your email app. There is no file-upload facility.

Please provide only a non-confidential summary. Do not include datasets, personal records, passwords or other sensitive information.

When you send an email, we receive the message, your contact details and any other information you choose to include. Richard McKay handles enquiries. Authorised service providers and connected tools, including AI-assisted tools, may support the handling of correspondence.

Why we use your information

We use enquiry information to respond, understand your requirements, assess whether we can help and discuss relevant business opportunities. We rely on our legitimate interests in managing business enquiries and developing appropriate business relationships, while considering your rights and reasonable expectations.

We also have a legitimate interest in keeping the website and email services secure and reliable. Where we must retain or disclose information to meet a legal obligation, we rely on that obligation.

Website and email services

We use OpenAI's ChatGPT Sites to host this website, Cloudflare for website delivery, security and email routing, and Google Workspace to receive and manage email enquiries. These services process information needed to deliver and protect the website and email service. This can include IP addresses, browser information, access times and technical or security logs, as well as email information when you contact us.

Optional analytics is controlled separately from necessary hosting and security services. Cloudflare uses a bot-protection cookie called __cf_bm, which normally expires after 30 minutes of inactivity. More information is available in Cloudflare's cookie documentation.

Optional analytics and your choice

Google Analytics loads only after you accept analytics. Rejecting keeps optional analytics off.

We load Google Analytics only after you accept it. Rejecting does not stop you using this website or contacting us. Necessary hosting, delivery and security services continue to operate, including their technical logs.

With your permission, analytics measures page visits and limited website interactions. We use fixed page information without search queries or URL fragments. We do not send your name, email address, organisation, enquiry text, form answers or the contents of email-draft links to Analytics. Analytics is not a record of the contents of your enquiry.

The email preparation tool may record that an email draft was prepared, without any of its contents. This is an expression of interest only: the website cannot tell whether you send the email. It is not counted as a submitted enquiry.

No Google Ads, Meta or LinkedIn advertising tags are activated by these controls. Advertising storage, advertising user data and ad personalisation remain disabled. We do not use enhanced conversions or upload contact details to Analytics.

Your privacy choice is stored on this website in your browser for up to six months. If you accept analytics, Google Analytics may set first-party cookies named _ga and _ga_ followed by the property identifier. Our code sets a maximum cookie lifetime of six months; your browser may apply a shorter limit. Google processes the analytics information and may process it outside the UK. See Google’s privacy policy. Our Google Analytics property retains user-level and event-level data for two months, without restarting that retention period when you return. This setting does not limit how long Google retains standard aggregated reports. Optional Google data sharing, Google Signals, user-provided data collection, granular location and device collection, and advertising personalisation are switched off.

Use Cookie settings in the footer to change your choice. Withdrawing analytics consent stops new measurement and reloads the page into a no-analytics state, so save any unfinished enquiry first. It also removes the relevant first-party analytics cookies where the browser permits. This does not erase information already sent to Google. We do not replay interactions that happened before you consented.

Our service providers may process information outside the UK. Their published data-processing terms describe the applicable international-transfer safeguards, including recognised adequacy arrangements and contractual safeguards:

Contact hello@maevar.com if you would like further information about these arrangements.

How long we keep information

We review unsuccessful enquiries 12 months after the last substantive contact and delete them unless there is an ongoing business or legal reason to retain them. For example, information may still be needed for an active discussion, to meet a legal obligation, or to establish, exercise or defend legal claims. Where we retain information longer, we keep it only for as long as that reason applies.

Enquiries that lead to a business relationship and related contract records are kept according to the needs of that relationship and applicable legal requirements. The 12-month enquiry review period is not a guarantee that every provider's security log or backup is erased on the same date; those records are subject to the relevant service's retention and deletion arrangements.

Your rights and complaints

Depending on the circumstances, you may ask to access, correct or delete your personal information, restrict its use, or receive a portable copy. You may also object to processing based on legitimate interests. These rights are subject to applicable conditions and exceptions.

Email hello@maevar.com to make a request or raise a concern. You can also complain to the Information Commissioner's Office through ico.org.uk/make-a-complaint.

Changes to this notice

We will update this notice when our website or information-handling arrangements change. The date above identifies the version you are reading.