Tech AI Data Delivery Manager

• Design and run AI data projects
• Build hybrid automation combining deterministic tooling with LLM agents
• Decide which workflow steps use rules versus models and design hand-offs
• Set up and run agents in Claude and the native enterprise agentic environment
• Configure task specifications, data and tool connections, schedules, monitoring, and failure handling
• Design quality assurance workflows, guidelines, rubrics, and scorecards
• Calibrate automated checks against human reviewers and develop measurable error categories
• Run data collection and annotation projects end to end, including scoping, vendors, workflows, tracking, and delivery
• Build tooling for project coordinators
• Collect, clean, and analyze production and quality data
• Create reporting on throughput, rework, error rates, and contributor performance
• Test automation before release and build continuous auditing workflows
• Document specifications, tickets, and runbooks for coordinators and engineers

• Intermediate JavaScript and Python skills sufficient to build and maintain production automation
• Hands-on agent building in Claude, including projects, skills, connectors, and scheduled tasks
• Ability to build agents in the native enterprise agentic environment and connect APIs with native infrastructure
• LLM evaluation experience, including prompt and rubric design and calibration against human judgment
• Data analytics background with experience in the data collection or annotation industry
• Experience managing projects with external vendors or contributors and multiple stakeholders
• Ability to make and own decisions with incomplete information

• Remote work
• Full-time, fixed-term employment (1 year with possibility to extend)