Apply Here: AI Benchmark & Evaluation Engineer

📋 Job Description

• Break down goals into verifiable terminal operations.
• Define objective evaluation methods and anticipate edge cases.
• Develop reproducible benchmark tasks in domains like software development, data science, system administration, and security.
• Document task requirements and evaluation standards.
• Assess AI agents using metrics and human rubrics.
• Collaborate on task refinement and realistic scenario creation.