Generative AI Engineer Role

OpenDataJobs • Washington, DC

1d

About The Position

Generative AI Engineers build production applications around foundation models and large language models. They turn model capabilities into tools for search, drafting, summarization, information extraction, multimodal work, and guided action, with the controls and evidence needed to understand how those tools behave. The role concentrates on application and context engineering. Generative AI Engineers connect models to authoritative knowledge, tools, and workflows; design prompts and structured outputs; evaluate quality, grounding, safety, security, latency, and cost; and monitor the application after release. They treat fluent output as something to test, not proof that the system is correct.

Requirements

• A strong application-engineering foundation, including programming, APIs, testing, version control, service integration, and production debugging.
• Practical experience with foundation-model integration, prompt and context design, structured outputs, model selection, and failure analysis.
• Working knowledge of retrieval systems, embeddings, search, knowledge stores, document ingestion, and data-access controls.
• Evaluation discipline across answer quality, retrieval relevance, grounding, safety, security, latency, cost, and user outcomes.
• The judgment to constrain tools and agents, design human-review paths, document limitations, and respond when production behavior changes.

Nice To Haves

• Experience with enterprise search, document intelligence, multimodal applications, code generation, contact-center support, agent workflows, model adaptation, synthetic data, or evaluation and red-team engineering.
• Familiarity with a specific model provider, cloud platform, vector or search service, agent framework, observability stack, programming language, model-evaluation approach, content-safety service, or security and governance framework.

Responsibilities

• Build grounded assistants and knowledge applications with retrieval-augmented generation (RAG), hybrid or vector search, citations, metadata filtering, and source-level access controls.
• Develop drafting, summarization, classification, extraction, and transformation services exposed through user interfaces or APIs.
• Create agents and multistep workflows with defined tool schemas, constrained permissions, approval gates, memory boundaries, replay, and exception handling.
• Design evaluation systems with curated test cases, task-specific rubrics, retrieval measures, grounding checks, safety and security tests, and regression thresholds.
• Implement operational pipelines for versioning prompts and configurations, comparing models, tracing execution, monitoring quality and cost, collecting feedback, and responding to incidents.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed