Gmail & Google Calendar AI Assistant Evaluator

Test AI assistants on realistic email, scheduling, booking, and coordination tasks. Give clear instructions, check results, and record whether the assistant completed each task accurately and completely. Complete practical tasks involving Gmail, Google Calendar, email threads, invitations, bookings, and multi-person coordination. Check AI assistant work for accuracy, completeness, helpfulness, and alignment with evaluation guidance. Grade, rank, and annotate responses using evaluation guidelines. Record findings and help maintain consistent evaluation quality. Regular hands-on experience with Gmail and Google Calendar, online booking or coordination experience, strong written communication, attention to detail, organization, self-management, and comfort instructing AI tools are required; prior AI evaluation experience is helpful but not required.