Job Description

Help evaluate and improve advanced AI language systems by applying expert English-language judgment to model outputs and training data. This fully remote role focuses on assessing how well large language models understand, generate, and use English across a range of real-world tasks.

Key Responsibilities

• Evaluate the quality and accuracy of AI-generated English for summarization, dialogue, grammar correction, rewriting, and reasoning tasks.
• Edit, refine, and rewrite English content to high linguistic, stylistic, and cultural standards.
• Annotate text for grammatical, syntactic, semantic, and stylistic features.
• Identify model errors, inconsistencies, and language gaps, then provide feedback that improves model performance.
• Deliver detailed linguistic analysis to inform ongoing model training.

Qualifications

• Native or near-native English fluency, with excellent command of grammar, syntax, vocabulary, and style.
• Professional experience in editing, proofreading, writing, linguistic annotation, language evaluation, or English NLP data work.
• Strong understanding of linguistic nuance, regional variation, tone, and context-appropriate English usage.
• Ability to identify subtle grammatical errors, awkward phrasing, ambiguity, and unnatural language.
• Strong attention to detail, analytical judgment, and written communication skills.
• Ability to work independently in a distributed remote environment.
• Interest in AI and large language model technologies is preferred but not required.

Work Terms

• Remote, hourly engagement with flexible, asynchronous working hours.
• Contribute to high-impact AI research and gain hands-on exposure to advanced AI development.

Compensation

• $50 per hour.

Job Tags

Similar Jobs