Shopify & SQL Expert

About the role

You'll review real merchant conversations where Shopify’s Sidekick answered an analytics or segmentation question and the merchant was unhappy — pinpoint the failing query or filter, determine what it should have been, and categorize the error against a detailed rubric.

What you'll do

• Read multi-turn merchant ↔ agent conversations, including tool-call cards and the data they return

• Identify the query or segment filter the assistant generated, and determine the correct version

• Categorize why the response fell short (wrong metric/dimension/filter, unsupported report, etc.)

• Write concise, objective explanations of what went wrong

• Commitment: ~5–10 hours/week

Qualifications

Required:

• Strong general SQL — comfortably read, write, and critique queries: WHERE vs HAVING, GROUP BY, ORDER BY / LIMIT, joins, and aggregation. You should be able to look at a query and say what it returns and what's wrong with it.

Strongly preferred:

• Hands-on Shopify merchant experience — you've run or operated a Shopify store and know how merchants actually use analytics and segmentation.

• First-hand experience using Sidekick — you've used Shopify's Sidekick AI assistant yourself.

Preferred (nice to have — we'll help you ramp on the specifics):

• Familiarity with Shopify analytics / ShopifyQL and the Shopify data model — the schemas (sales, payments, sessions, fulfillments, customers), metric nuances (e.g. net_items_sold includes returns vs quantity_ordered; revenue vs unit counts for "best-selling"), and the segmentation model (products_purchased MATCHES, operators, AND/OR connectors).

• General e-commerce / analytics ops experience.

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.

Contract and Payment Terms

• You will be engaged as an independent contractor.
• This is a fully remote role that can be completed on your own schedule.
• Projects can be extended, shortened, or concluded early depending on needs and performance.
• Your work at Mercor will not involve access to confidential or proprietary information from any employer, client, or institution.
• Payments are weekly on Stripe or Wise based on services rendered.
• Please note: We are unable to support H1-B or STEM OPT candidates at this time.

About Mercor

Mercor partners with leading AI labs and enterprises to train frontier models using human expertise. You will work on projects that focus on training and enhancing AI systems. You will be paid competitively, collaborate with leading researchers, and help shape the next generation of AI systems in your area of expertise.