Accepting Applications
Full-time
Remote
LinkedIn
Posted 3 weeks, 5 days ago
3 views
0 applications
Job Description
In this hourly, remote contractor role, you will work as an Attorney / Lawyer Subject Matter Expert (SME) to review AI\-generated legal responses and/or create expert legal content, evaluating reasoning quality and step\-by\-step issue analysis while providing precise written feedback. You will assess solutions for accuracy, clarity, completeness, and adherence to the prompt; identify errors in legal reasoning, rule application, procedural steps, and risk/assumption handling; fact\-check legal concepts and (when required) citations; write high\-quality explanations and model answers that demonstrate correct legal analysis and clear communication; and rate and compare multiple responses based on correctness and reasoning quality. This role is with SME Careers, a fast\-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation\-model labs. Your legal expertise directly helps improve the world’s premier AI models by making their legal reasoning more accurate, reliable, and clearly explained.
**Important**
There is no immediate project for this role; however, if qualified, you will be among the first experts we reach out to when relevant opportunities arise. This will also provide you with access to future projects available through our expert network.
**Key Responsibilities**
* Develop AI Training Content: Create detailed prompts and gold\-standard legal outputs (issue analyses, drafting examples, checklists, policies, and memos).
* Optimize AI Performance: Evaluate and rank AI responses to improve correctness, clarity, defensibility, and risk awareness.
* Ensure Model Integrity: Test AI outputs for inaccuracies, misleading certainty, confidentiality risks, and bias; validate reliability across legal scenarios.
**Your Profile**
* JD/LLB (or equivalent law degree) and active bar membership (or eligibility) in at least one jurisdiction.
* 5\+ years of professional experience practicing law (law firm, in\-house, government, or legal aid).
* Strong ability to perform issue spotting and structured legal analysis (rules → application → conclusion), including identifying assumptions and uncertainty.
* Demonstrated experience in one or more practice areas (e.g., commercial/contracts, employment, privacy, corporate, litigation, IP, real estate, compliance).
* Strong research skills: locating and synthesizing primary authority (statutes, regulations, cases) and accurately characterizing holdings.
* Excellent drafting/editing skills: contracts/clauses, memos, letters, policies, pleadings (as applicable), with attention to precision and tone.
* Exceptional attention to detail when fact\-checking and identifying overconfident claims, missing exceptions, jurisdictional pitfalls, or procedural risks; minimum C1 English proficiency.
* Comfortable evaluating answers for internal consistency, client safety, and appropriateness to context (e.g., consumer vs business, HR vs litigation).
* Reliable, self\-directed, and able to deliver consistent quality in an hourly, remote contractor workflow across time zones.
* Prior experience with AI data training/annotation, legal QA, editorial review, or knowledge\-management work is strongly preferred.