Role overview

Cohere is seeking a Data Annotation Specialist focused on safety to support the development of large language models. In this contract position, you will evaluate and improve model outputs by labeling, ranking, and auditing text to ensure safety and policy alignment. Your work directly contributes to making AI systems safer and more reliable for developers and enterprises building AI-powered applications.

Key responsibilities

Label, rank, audit, and refine human- and model-generated text to improve safety, quality, and alignment with safety policies.
Assess model outputs against detailed safety guidelines and rubrics, making consistent decisions in ambiguous and context-dependent cases.
Create realistic prompts, user scenarios, and adversarial test cases to evaluate how models behave across different safety categories.
Identify annotation inconsistencies and gaps in guidelines, providing feedback on recurring edge cases and opportunities to enhance data quality.
Work with precision and independence to complete annotation tasks while communicating clearly across a distributed, asynchronous team.

Requirements

At least one year of experience in content moderation, trust and safety, AI data annotation, LLM evaluation, or a related analytical role.
Demonstrated ability to apply detailed guidelines to complex and sensitive content, with strong contextual judgment and cultural awareness.
Emotional resilience to work with explicit, unsafe, or toxic content, including material of a sexual, violent, or psychologically disturbing nature.
Excellent written English skills and the ability to clearly justify content evaluations and explain safety assessments.
Strong attention to detail, commitment to accuracy, and ability to maintain consistency across high-volume tasks.
Proven ability to work independently in remote environments with good time management and comfort using new tools.

What makes this role worth considering

This position offers the flexibility of part-time, remote work within Canada or the United States, with a contract rate of 45 CAD/hour or 40 USD/hour (30/hour base plus 15 CAD or 10 USD/hour hazard pay). The 12-month contract includes potential for extension, and you will use your own device while maintaining independence as an independent contractor.