Secretary, Admin Assistant

• Design realistic, process-driven evaluation tasks requiring sophisticated multi-tool coordination, such as calendar reconciliation, travel and expense workflows, records management, and professional correspondence
• Create and assemble authentic data artifacts, including emails, calendar entries, receipts, meeting notes, and contact records, for evaluation scenarios
• Define correct solutions and map step-by-step expert decisions for each scenario
• Develop comprehensive rubrics with 35+ criteria assessing process adherence and nuanced judgment for AI agent outputs
• Document workflow processes and suggest improvements reflecting current administrative best practices
• Collaborate with project leads to calibrate task complexity and align with real-world challenges faced by experienced professionals

• 5+ years of experience supporting teams or departments within mid-to-large organizations in a professional administrative capacity
• Demonstrated process ownership and responsibility for ongoing, recurring workflows beyond ad-hoc assignments
• Expertise in documenting, evaluating, and improving inherited administrative procedures
• Proficient written and verbal communication skills with a strong command of professional correspondence standards
• Exceptional attention to detail, ensuring accuracy in both content creation and process documentation
• Comfort working with a variety of digital tools, platforms, and data formats (CSVs, PDFs, spreadsheets, technical documents)