Advertising Creative Data Evaluator

TEKsystems • New York, NY

5d • $38 - $38 • Remote

About The Position

The client is working to enhance creative advertising within their originals programming. We are looking to create a golden data set for AI generated ad copy for various advertisers looking for placements within Amazon originals. In this role you will be responsible for evaluating advertising copy generated by a large language model (LLM) to ensure that it meets their benchmark in quality, structure, brand voice adherence, brand guidelines, and contextual relevance between the advertise brand and content.

Requirements

• A creative advertising, media, marketing, or copywriting background.
• Experience evaluating advertising content and creative quality.
• An understanding of Brand voice and brand guidelines.
• An understanding of Marketing messaging.
• An understanding of Creative writing principles.
• An understanding of Ad copy effectiveness.
• The ability to make nuanced judgments on subjective areas such as Creativity.
• The ability to make nuanced judgments on subjective areas such as Diversity of language.
• The ability to make nuanced judgments on subjective areas such as Repetitive copy patterns.
• The ability to make nuanced judgments on subjective areas such as Structural variation.

Responsibilities

• Ad copy annotation and quality review of generated advertising copy.
• Evaluating copy against an existing Amazon-provided rubric, while also providing feedback and recommendations to improve that rubric.
• Creating and validating golden datasets and benchmark annotation sets to support quality measurement and future model development.
• Performing copy rewrites when necessary, with rewrites confirmed as in scope
• Providing recommendations to improve creative generation quality, variety, and consistency
• Assessing Copy quality and effectiveness
• Assessing Brand voice adherence
• Assessing Contextual relevance between the advertised brand/product and Prime Video content
• Assessing Creativity and diversity of generated copy
• Assessing Structural and lexical repetition patterns

Benefits

• Medical
• dental
• vision
• Critical Illness
• Accident
• Hospital
• 401(k) Retirement Plan
• Life Insurance (Voluntary Life & AD&D for the employee and dependents)
• Short and long-term disability
• Health Spending Account (HSA)
• Transportation benefits
• Employee Assistance Program
• Time Off/Leave (PTO, Vacation or Sick Leave)

What This Job Offers

• Career Level: Mid Level
• Education Level: No Education Listed