Project Overview

Join a growing community of professionals advancing the next wave of AI. As an AI Trainer, you’ll play a hands-on role by analyzing and providing feedback on data to improve LLM performance, helping ensure that the next generation of AI technology is accurate and trustworthy.

We are seeking a skilled Project Manager to work as a project consultant in our AI Labor Marketplace. This is not a full-time employment position — you will be engaged as an expert project consultant on a contract basis.

Location: U.S.-based experts only

Engagement: Part-time, 1099 project-based

Work Type: Remote

Project Summary: This project evaluates how effectively AI systems provide career guidance across professional occupations. We are seeking experienced Project Managers to evaluate AI-generated career guidance related to project delivery, stakeholder management, program management, certification pathways, leadership development, Agile and traditional methodologies, and advancement within project-driven organizations. Contributors will assess whether AI-generated recommendations accurately reflect real-world project management careers and professional expectations.

Consultant Engagement Terms:

This is a project-based consultant role. Consultants will be paid on a per-project basis; hourly rates are estimates based on anticipated completion time. Consultants control their own schedule, provide their own tools, and may simultaneously provide services to other vendors/employers (subject to those vendors’ allowances).

Responsibilities:

Contributors will:

• Create benchmark answers for project management career questions
• Develop profession-specific scoring rubrics for evaluating AI-generated career guidance
• Assess recommendations involving project delivery, stakeholder management, and leadership development
• Review guidance related to PMP certification, Agile methodologies, and program management pathways
• Evaluate advice concerning career progression from coordinator and analyst roles into project and program leadership
• Identify unrealistic, inaccurate, or incomplete career recommendations
• Provide written rationale supporting evaluation decisions and scoring outcomes

Expected Outcomes:

• Accurate benchmark responses reflecting project management best practices
• Reliable scoring frameworks for evaluating AI-generated career advice
• Consistent assessment of project management career scenarios
• Identification of inaccuracies, omissions, and unrealistic guidance
• Actionable expert feedback supporting AI evaluation quality

Qualifications:

• Minimum 3 years of professional project management experience
• Experience leading projects, coordinating stakeholders, and managing project lifecycles
• PMP, CAPM, PMI-ACP, Scrum Master, or related certification preferred
• Familiarity with project management career progression and organizational structures
• Strong written communication and analytical skills
• Ability to evaluate professional guidance objectively and consistently
• U.S.-based