- Company: Roblox
- Location: Gurugram, Haryana, India
- Job type: Full-time
About the role
Roblox is a platform where millions of people create and play immersive 3D experiences. As a Quality Analyst, you will help ensure these shared spaces remain safe and civil. You will use your expertise in policy and enforcement to maintain high standards for content moderation and training.
Responsibilities
- Build and maintain the answer key by creating correctly labeled image cases for training and policy work.
- Make final decisions on disputed cases and resolve disagreements between moderators, vendors, and automated systems.
- Calibrate vendor QA teams by measuring accuracy and leading sessions to close performance gaps.
- Identify root causes of errors using a standard taxonomy and analyze quality data to find trends.
- Write briefs for stakeholder reviews that size problems, describe impact, and identify the best team to fix them.
- Publish weekly quality reports with statistically valid samples, accuracy metrics, and confidence intervals.
- Incorporate outside signals like user appeals and partner feedback to assess overall quality.
- Audit affected queues after changes to confirm that quality improvements have been achieved.
Requirements
- 3+ years of experience in quality assurance, content moderation, Trust & Safety, or related operations.
- Strong understanding of content policy and sound judgment on difficult cases.
- Experience building answer keys, test sets, or calibration materials.
- Experience auditing and calibrating reviewers, including outsourced or vendor teams.
- Working knowledge of sampling and basic statistics, including accuracy rates and inter-rater agreement.
- Experience with root-cause analysis and turning findings into practical recommendations.
- Proficiency with spreadsheets for data analysis.
- Clear written and verbal communication skills, including the ability to write summaries for leadership.
- Experience working with cross-functional partners such as Policy, Operations, Engineering, and vendors.
Pay and benefits
Roblox provides equal employment opportunities to all employees and applicants. The company prohibits discrimination and harassment of any type and provides reasonable accommodations to candidates with qualifying disabilities or religious beliefs during the recruiting process. Roles based in an office are onsite Tuesday, Wednesday, and Thursday, with optional presence on Monday and Friday.
How to apply
Apply directly on Roblox’s own careers website. Omadaily never charges job seekers.
