Real Estate Practice Reviewer
$55-$60 / hr
$55-$60

Location requirements
The role
We're hiring working real estate professionals to audit AI work product in their own field, not to produce it.
You'll see an AI agent's complete attempt at a realistic task from your job: the task as written, what the agent did, the files it produced, and the scoresheet an AI grader filled in afterwards. You bring the judgment of someone who does this work for a living, and answer four questions:
-
Is this a real task? Would it come up in this job, described this way? Realistic, borderline, or contrived.
-
Is the domain content right? Are the standards, figures, regulations and constraints accurate and consistent, or is something subtly wrong in a way only a practitioner would catch?
-
Does the grading hold up? The grader answered eleven yes/no questions about the finished work: correct format, fabricated figures, requirements met, terminology, and so on. You go through them with the files open and say where you disagree, and why.
-
Is the score defensible? Band the work yourself. Could a practitioner use it? Accept it? Then check the reported score against your band.
About an hour per item. You never perform the task or redo the agent's work.
Who we're looking for
Four roles. Apply to the one that's actually yours:
-
Real Estate Sales Agents. Active US state license, 4+ years closing your own transactions.
-
Property and Community Association Managers. 4+ years managing real portfolios or HOAs, including their budgets and their reserves.
-
Real Estate Brokers. Active broker license, 5+ years supervising agents and carrying the compliance responsibility that comes with it.
-
Counter and Rental Clerks. 3+ years in equipment, vehicle or property rental, handling agreements, deposits and damage claims.
We want people who know the field cold: anyone who has caught a defective disclosure, corrected an agent's contract, reconciled a reserve study against an actual budget, or handled a commission dispute. Less of a fit are people whose license is inactive or referral-only, and investors or analysts who have never sat on the practitioner side of a transaction.
Also required: near-native business English, because you write a short reason for every judgment, and enough comfort with a spreadsheet or PDF to check whether the numbers in it reconcile.
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
Contract and Payment Terms
- You will be engaged as an independent contractor.
- This is a fully remote role that can be completed on your own schedule.
- Projects can be extended, shortened, or concluded early depending on needs and performance.
- Your work at Mercor will not involve access to confidential or proprietary information from any employer, client, or institution.
- Payments are weekly on Stripe or Wise based on services rendered.
- Please note: We are unable to support H1-B or STEM OPT candidates at this time.
About Mercor
Mercor partners with leading AI labs and enterprises to train frontier models using human expertise. You will work on projects that focus on training and enhancing AI systems. You will be paid competitively, collaborate with leading researchers, and help shape the next generation of AI systems in your area of expertise.
Earn up to $260 by referring
Posted 5 hours ago