AI Trainer (Contractor), Voice and Speech Evaluation - USA

Inworld AI · Mountain View, California, USA · Posted Oct 27, 2026


Transparency

Stale

Online for 3 weeks and never reposted. The first wave of applicants is in, so a reply is less likely. Apply if it's a strong fit.

First seen
Oct 28, 2026
Offered for
24 days

Overview

Category
AI & machine learning
Employment type
Contractor
Workplace type
Remote
Country
United States
Seniority
Mid level
Schedule
Part time
Salary
Not listed

Key skills

Speech Sample Evaluation
Listen to paired or grouped audio and judge naturalness, expression, and fidelity to instructions.
Rubric Scoring
Score voices on naturalness, clarity, emotion, pacing, and delivery style using defined rubrics.
Voice Attribute Labeling
Label perceived gender, age, accent, dialect, tone and flag mismatches with existing metadata.
Quality Review for Release
Assess batches of new voices for audio quality and suitability before public deployment.
Bug Reporting & Documentation
Test pre‑release speech features, record edge cases, and write clear findings for engineers.
Multilingual Pronunciation Evaluation
Evaluate pronunciation, dialect accuracy, and naturalness in native or near‑native languages.

Key phrases

  • paired or grouped speech samples
  • judge which sounds more natural
  • naturalness, clarity, emotion, pacing
  • perceived gender, age, accent or dialect
  • flag mismatches with existing metadata
  • audio quality and suitability
  • report bugs, edge cases, and usability issues
  • turn tasks around within a day

From the posting

About Inworld

Inworld is a research lab and inference provider focused on realtime AI for consumer-facing applications. We build first-party speech models, serve LLMs, and run the inference behind modular APIs designed for high-volume, realtime workloads.

Hundreds of millions of users interact with Inworld powered apps every day and we serve over 10 trillion LLM tokens per month. Our models and infrastructure support consumer applications across companions, healthcare, fitness, education, media, and more. Our work spans model research, realtime inference, large-scale serving infrastructure, and the APIs developers use to bring these capabilities into production.

We’ve raised more than $125M from Lightspeed Venture Partners, Section 32, Kleiner Perkins, Microsoft’s M12 venture fund, Founders Fund, Meta, Stanford, and others. Our technology has powered experiences from companies including NVIDIA, Microsoft Xbox, Niantic, Logitech Streamlabs, Wishroll, Little Umbrella, and Bible Chat. Inworld has also been recognized by CB Insights as one of the 100 most promising AI companies globally and named one of LinkedIn’s Top 10 Startups in the USA.

What you'll do

  • Listen to paired or grouped speech samples and judge which sounds more natural, expressive, or faithful to instructions

  • Score voices against rubrics for naturalness, clarity, emotion, pacing, and delivery style

  • Label voice attributes such as perceived gender, age, accent or dialect, and tone, and flag mismatches with existing metadata

  • Judge how closely cloned voices match their source speaker

  • Review batches of new voices for audio quality and suitability before public release

  • Test new speech features in pre-release environments and report bugs, edge cases, and usability issues

  • Write clear, structured findings that engineers can act on

  • For multilingual roles: evaluate pronunciation, dialect accuracy, and naturalness in your native language

What we're looking for

  • A trained ear. Background in audio production, broadcast, voice acting, music, linguistics, phonetics, or similar

  • Ability to hear and describe subtle differences in prosody, timing, pronunciation, and audio quality

  • Consistent, careful judgment across large batches of similar samples

  • Comfort with beta web tools, VPN access, and spreadsheets, and willingness to troubleshoot minor access issues

  • Strong written English for reporting findings

  • Ability to turn tasks around within a day when needed, including occasional weekend availability

Nice to have

  • Native or near-native fluency in Hindi, Tamil, Telugu, Bengali, Marathi, Brazilian Portuguese, or a regional Spanish dialect

  • Experience with TTS, voice AI, dubbing, or localization QA

  • Familiarity with A/B evaluation or annotation work


Location: Remote within the United States.

Compensation: $20-$55 per hour. Rate depends on region and language specialty.

Inworld Jobs Privacy

More jobs at Inworld AI

Sales Development Representative / Manager - USA

Inworld AI · 2 days ago | Mountain View, California, USA | Hybrid · Junior · Full time

Create CV

Senior Machine Learning Engineer, Inference - USA

Inworld AI · 3 weeks ago | Mountain View, California, USA | On-site · Senior · Full time

Create CV

Senior Content Marketing Manager - USA

Inworld AI · Last month | Mountain View, California, USA | $150K–$210K / year | Hybrid · Senior · Full time

Create CV

Staff / Senior Staff Machine Learning Engineer, Inference

Inworld AI · 7 months ago | Switzerland, Mountain View, California, USA, UK | Remote · Principal · Full time

Create CV

Senior / Lead Machine Learning Engineer, Inference

Inworld AI · 7 months ago | Serbia, Germany | Remote · Lead · Full time

Create CV
See all 10 jobs at Inworld AI