Project Overview

Join a growing community of professionals advancing the next wave of AI. As an AI Trainer, you’ll play a hands-on role by analyzing and providing feedback on data to improve LLM performance, helping ensure that the next generation of AI technology is accurate and trustworthy.

We are seeking a skilled Marketing & Content Specialist to work as a project consultant in our AI Labor Marketplace. This is not a full-time employment position — you will be engaged as an expert project consultant on a contract basis.

Location: U.S.-based experts only

Engagement: Part-time, project-based expert evaluation work

Work Type: Remote

Project Summary

This project supports the development of an AI benchmarking framework designed to measure how effectively artificial intelligence models perform real-world, economically valuable knowledge work. The benchmark evaluates AI systems against tasks commonly performed by marketing, content, communications, brand, growth, and digital marketing professionals across a variety of industries.

Contributors will create expert benchmark outputs, define evaluation criteria, and assess AI-generated work products across a range of professional marketing and content scenarios. Example tasks may include campaign strategy development, content creation, messaging frameworks, audience segmentation, brand positioning, SEO content planning, email marketing, social media strategy, performance marketing analysis, editorial review, and go-to-market communications. The goal is to establish rigorous, expert-driven standards for measuring AI performance on practical marketing and content workflows.

Consultant Engagement Terms

This is a project-based consultant role. Consultants will be paid on a per-project basis; hourly rates are estimates based on anticipated completion time. Consultants control their own schedule, provide their own tools, and may simultaneously provide services to other vendors/employers (subject to those vendors’ allowances).

Responsibilities

Contributors will:

• Create expert benchmark responses for marketing and content-related business scenarios
• Develop scoring rubrics that define high-quality marketing strategy, content quality, and professional decision-making standards
• Evaluate AI-generated marketing plans, written content, campaign recommendations, and strategic analyses against established benchmarks
• Assess the accuracy, effectiveness, audience relevance, clarity, creativity, and business value of AI-generated outputs
• Review AI-generated work involving brand messaging, content strategy, digital marketing, customer acquisition, audience engagement, and campaign execution
• Identify factual inaccuracies, weak positioning, ineffective messaging, unsupported recommendations, and strategic gaps
• Apply professional judgment to determine whether outputs meet real-world marketing and content standards
• Provide written rationale supporting evaluation decisions and scoring outcomes
• Participate in calibration exercises and quality review activities when required

Expected Outcomes

• High-quality benchmark responses reflecting professional marketing and content practices
• Clear, defensible evaluation rubrics aligned with real-world business objectives
• Consistent and reliable assessment of AI-generated marketing and content deliverables
• Identification of strengths, weaknesses, and performance gaps in model outputs
• Expert evaluations that support rigorous benchmarking of AI systems on economically valuable marketing work
• Documentation that enables repeatable and scalable model evaluation

Qualifications

• Minimum 5 years of professional experience in one or more of the following areas:
• Content Marketing
• Digital Marketing
• Brand Marketing
• Growth Marketing
• Product Marketing
• Content Strategy
• Corporate Communications
• Demand Generation
• Social Media Marketing
• SEO/Content Optimization
• Editorial Content
• Marketing Operations
• Strong understanding of marketing strategy, audience targeting, customer journeys, content development, and campaign performance measurement
• Experience creating, reviewing, or optimizing professional marketing assets and content deliverables
• Ability to evaluate marketing effectiveness and articulate strategic reasoning clearly in writing
• Experience working with campaign planning, messaging frameworks, content calendars, performance metrics, analytics, or go-to-market initiatives
• Strong attention to detail and ability to identify weaknesses in positioning, messaging, audience alignment, and execution quality
• Experience working in B2B, B2C, agency, in-house marketing, media, or communications environments preferred
• Relevant certifications are preferred where applicable (e.g., Google Analytics, Google Ads, HubSpot, Meta, SEMrush, Content Marketing Institute, AMA certifications, or equivalent)
• U.S.-based