Software Engineer - LLM evaluation (Remote)

About the Role

Join an exciting project that pushes the boundaries of AI technology. As a Software Engineer focused on evaluating AI models, you will create detailed and clear guidelines to assess how well AI-generated code works. Your work will help improve the quality and reliability of advanced AI systems used around the world. There is a 15min assessment prior to selection. We anticipate selection to occur within two days of taking the assessment. This role will tentatively begin the week of January 13th 2025.

Currently, we are only accepting applicants from the U.S., UK, and Canada.

Why You’re a Great Fit

You’re an ideal candidate if you:

• Hold a Computer Science degree from a top university in the U.S., Canada, or the UK.

• Have 2+ years of software engineering experience.

• Have exceptional attention to detail.

• Excel in written and verbal communication.

Role Highlights

• Work on a high-impact project contributing to the future of AI.

• Flexible workload: 10–20 hours per week, with potential to increase to 40 hours.

• Minimum duration: 1–2 months, with potential for extension.

Apply today and make an impact with your expertise!

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.

Contract and Payment Terms

• You will be engaged as an independent contractor.
• This is a fully remote role that can be completed on your own schedule.
• Projects can be extended, shortened, or concluded early depending on needs and performance.
• Your work at Mercor will not involve access to confidential or proprietary information from any employer, client, or institution.
• Payments are weekly on Stripe or Wise based on services rendered.
• Please note: We are unable to support H1-B or STEM OPT candidates at this time.

About Mercor

Mercor partners with leading AI labs and enterprises to train frontier models using human expertise. You will work on projects that focus on training and enhancing AI systems. You will be paid competitively, collaborate with leading researchers, and help shape the next generation of AI systems in your area of expertise.