View Opportunities

Work on the data behind frontier AI.

XUmmia is hiring vetted experts for LLM evaluation, computer vision, multilingual review and red teaming. Remote-first, fair pay, and projects that match your expertise.

A XUmmia expert annotator working on an AI evaluation task

Open roles

Roles we're recruiting right now.

All roles include paid onboarding, gold-set calibration and ongoing feedback from customer AI teams.

LLM Evaluator

Alignment & Evaluation

Rate, rank and red-team model outputs across reasoning, coding, safety and instruction-following rubrics. Ideal for engineers, researchers and strong generalists.

Remote (Africa-wide)Full-time / Part-timeEnglish fluencyRubric calibrationTechnical reasoning

Multilingual Linguistic Reviewer

Localization

Audit translations, generation quality and dialectal nuance in Swahili, Yoruba, Amharic, Hausa, Zulu, Wolof and 30+ languages.

RemoteFlexibleNative speakerLinguistics backgroundTranslation QA

Computer Vision Annotator

Vision Datasets

Produce bounding boxes, segmentation masks and keypoints on street scenes, agriculture, healthcare and retail imagery with 99%+ IoU targets.

Remote / Lagos / NairobiProject-basedSpatial attentionQuality consistencyTraining provided

Domain Expert Reviewer

Specialist Verticals

Apply your professional expertise in medicine, law, finance or engineering to evaluate model outputs, write guidelines and catch safety-critical errors.

RemotePart-time / ContractLicensed professionalClinical/legal/financeHigh hourly rate

Red-Team & Safety Specialist

Safety

Probe models for harmful, biased or misleading outputs and document reproducible harm taxonomies. Strong writing and structured judgment required.

RemoteFlexibleAdversarial thinkingPolicy awarenessDetail-oriented

Annotation Project Lead

Operations

Own delivery for customer projects: roster management, quality telemetry, reviewer coaching and daily client communication.

Lagos / Nairobi / RemoteFull-timeLeadershipOperationsCustomer-facing

AI Safety & Policy Evaluator

Safety

Evaluate model responses against safety policies, flag edge-case harms and write concise justifications that improve guardrails. Similar to specialist evaluator roles on top AI labs' partner platforms.

RemoteHourly / FlexiblePolicy fluencyHarm taxonomyClear writing

Software Engineering Code Evaluator

Coding & Reasoning

Review, rank and explain code generations across Python, JavaScript, C++ and Go. Ideal for early-career SWEs, bootcamp grads and CS students who can spot subtle bugs.

Remote (Africa-wide)Hourly / Project-basedCoding interview levelMultiple languagesBug detection

Content Review & Fact-Checking Expert

Trust & Knowledge

Verify factual claims, source quality and tone in generated content. Flag hallucinations, outdated references and unsupported assertions for search, chat and research products.

RemoteFlexibleResearch skillsEditorial judgmentWeb verification

AI Writing Evaluator & Trainer

Creative & Writing

Compare model-written drafts, rank clarity and style, and rewrite weak outputs to train more helpful, human-like writers. Strong C1+ English and editing experience preferred.

RemotePart-time / FlexibleC1+ EnglishCopy editingCreative judgment

Data Science & Systems Design Expert

Advanced Reasoning

Evaluate ML, statistics and systems-design responses; write rubrics and gold explanations that teach models to reason like senior data scientists.

RemoteHourly / ContractML/statisticsSystem designSenior practitioner

Generalist AI Evaluator

Alignment & Evaluation

A broad entry point for sharp generalists: compare answers, follow complex instructions, spot inconsistencies and provide readable explanations across many topics.

RemoteFlexibleStrong generalistFast learnerCommunication

Why work with XUmmia

Built for experts, not clickworkers.

Vetted, above-market pay

Rates benchmarked to global remote work, not local minimums.

Weekly payouts

No arbitrary thresholds. Work this week, get paid next week.

Work from anywhere

Remote-first with optional co-working in Lagos, Nairobi, Kigali and Cape Town.

Free upskilling

Guideline writing, calibration and AI safety training included.

The application process

Apply once. Get vetted. Work on frontier AI data.

We review every application, run a paid calibration task, and only onboard experts who meet our customer quality bars. No unpaid trials, no opaque queues.

48-hour application review

Every application is read by a real person on our talent team.

Paid calibration task

No unpaid trial work. Your first evaluation task is compensated.

Weekly payouts

Get paid in USD or local currency, every week, with no minimum threshold.

Add a link or upload a resume below — at least one is required.

By submitting you agree to be contacted by XUmmia's talent team about this role.

Not sure which role fits?

Submit a general application and our talent team will match you to the right project based on your background, language skills and availability.