AI Prompt Developer

DoubleVerify•New York, NY

10h•Hybrid

About The Position

DoubleVerify is seeking an AI Prompt Developer with strong language skills, exceptional attention to detail, and a passion for data-driven decisions. In this role, you will convert complex content policies into concise prompts that LLMs can easily interpret, ensuring alignment with evolving business needs. You will also test, refine, and document changes based on performance metrics and stakeholder feedback, contribute to prompt development methodologies and evaluation frameworks, collect qualitative and quantitative data, performing root-cause analyses on misclassifications, and report findings through clear, structured communication (charts, written reports, demos). You will partner with Policy, Legal, and Data Science teams to ensure prompt accuracy and alignment, identify gaps in policies and offer data-driven recommendations, and document best practices and contribute to a centralized knowledge base.

Requirements

Bachelor’s degree or equivalent experience in fields such as Policy, Linguistics, Communications, Social Sciences, Business, or STEM.
Excellent written and communication skills, with the ability to simplify the complex for diverse audiences.
Highly analytical with an understanding of established research methodologies
Ability to interpret large data sets, identify trends or errors, and propose solutions.
Comfortable using spreadsheets, BI tools, or basic scripting to conduct data analyses.
Comfortable working closely with global teams across timezones
Able to adjust to shifting priorities, and propose actionable solutions in ambiguous scenarios.

Nice To Haves

1-2 years experience in roles dealing with technical writing, content moderation, policy analysis, data analytics, or research assistance.
Foundational grasp of AI/ML concepts (especially LLMs) and are open to learning new tools.
Knowledge of software for data visualization (Tableau, Looker, Power BI).
Experience with academic or industry publications or collaborative research projects.

Responsibilities

Test, refine, and document changes based on performance metrics and stakeholder feedback.
Contribute to prompt development methodologies and evaluation frameworks.
Collect qualitative and quantitative data, performing root-cause analyses on misclassifications.
Report findings through clear, structured communication (charts, written reports, demos).
Partner with Policy, Legal, and Data Science teams to ensure prompt accuracy and alignment.
Identify gaps in policies and offer data-driven recommendations.
Document best practices and contribute to a centralized knowledge base.