[Remote] Labeler / Annotator – AI Response Evaluation (French)

Note The job is a remote job and is open to candidates in USA. Blueprint Technologies is a technology solutions firm headquartered in Bellevue, Washington, focused on solving complex problems with technology. They are seeking a detail-oriented Labeler / Annotator to evaluate responses generated by AI systems in French, specifically through side-by-side evaluation of AI outputs across various scenarios. Responsibilities Perform side-by-side (SBS) comparisons of AI-generated responses Evaluate outputs based on Accuracy Relevance Clarity Instruction-following Identify nuances in tone, meaning, and cultural context across French Apply detailed, scenario-specific annotation guidelines Maintain consistency and high-quality evaluations Skills Native or professional fluency in French Strong English reading comprehension (required for guidelines) Prior experience with side-by-side (SBS) labeling or annotation Excellent analytical thinking and attention to detail Ability to quickly understand and apply structured evaluation frameworks Background in linguistics, translation, or localization Experience in AI evaluation Experience in data annotation Experience in search relevance or content quality analysis Benefits Statutory benefits (e.g., paid vacation and aguinaldo / Sueldo Anual Complementario (SAC)) Social security contributions and healthcare coverage (Obra Social) Additional benefits aligned with local market practices Company Overview Blueprint is redefining the data solutions ecosystem. It was founded in 2013, and is headquartered in Bellevue, Washington, USA, with a workforce of 501-1000 employees. Its website is https//bpcs.com/. Company H1B Sponsorship Blueprint has a track record of offering H1B sponsorships, with 3 in 2025, 1 in 2024, 1 in 2023, 3 in 2021, 1 in 2020. Please note that this does not guarantee sponsorship for this specific role. Apply To This Job