Professional Services AI Training Specialist — Task Creation & Model Evaluation (Contract)
Rise Data Labs
AI assistant
Job Description
Rise Data Labs is seeking a Professional Services AI Training Specialist to design realistic professional services tasks and rubrics based on real client work, with a focus on accounting and audit. You will author benchmarks, grade AI outputs, and collaborate with domain experts to ensure consistent, high-quality results.
You will also review client-facing work products, prepare reference materials, and participate in calibration sessions to align scoring standards across projects.
Create realistic task scenarios based on real client work and engagements Supply reference materials (financial statements, engagement letters, project reports) Write rubrics detailing exactly what a correct deliverable requires Grade AI-generated deliverables against the rubric Join calibration sessions with other experts to ensure consistent scoring Prior hands-on experience in accounting/audit (CPA or equivalent preferred), management or strategy consulting, HR, marketing/business