Senior Software Engineer, AI/ML

CNA Insurance • Chicago, IL

1d • $72,000 - $141,000

About The Position

CNA is seeking a highly skilled Senior Python AI Developer to build intelligent agents using Google Vertex AI, particularly with Gemini or OpenAI models. The role calls for a strong foundation in large language models (LLMs), including understanding how they work, and experience evaluating model performance through structured testing. The engineer will develop agents using sound prompt-engineering, context-filtering, and security-aware prompting practices, as well as modern agent frameworks and observability tools to deliver robust, scalable, and reliable AI solutions.

The position combines application analysis, design, development, testing, and production support. The engineer evaluates client-area requirements and processes, develops moderate-to-complex application solutions, contributes to high-level solution design, and works with clients and IT teams to identify requirements, manage risks, and resolve problems. They research and recommend effective system and program designs, document and test solutions, and support implementation in production and testing environments.

Requirements

• Senior-level proficiency in Python and experience in AI/ML development.
• Strong understanding of large language models and their operational mechanics.
• Experience developing AI agents on Google Vertex AI using Gemini or OpenAI.
• Expertise in prompt-engineering best practices.
• Hands-on experience with Google Agent Development Kit, LangChain, and LangGraph.
• Knowledge of context filtering and prompt security best practices.
• Experience with Eval AI testing and model-evaluation workflows.
• Bachelor’s degree in Computer Science or a related discipline, or equivalent work experience.
• Typically at least four years of application program development experience.

Nice To Haves

• Applicable certificates are preferred.
• Familiarity with observability and debugging tools such as LangSmith, LangFuse, Phoenix, or Arize.

Responsibilities

• Evaluate client-area requirements, processes, enhancements, and maintenance needs; develop moderate-to-complex application program solutions.
• Review code with peers, create documentation, implement code, verify program logic, analyze the root causes of defects, and complete unit and integration testing.
• Participate in systems testing with other IT staff.
• Assist with high-level solution design; consult with client areas to analyze system requirements and capabilities, identify risks, and resolve problems.
• May act as a liaison between client areas and the applications area.
• Research and evaluate new or alternative solutions and recommend efficient, cost-effective systems and program designs.
• Develop system specifications and procedures; this may include integrating vendor applications and consulting resources into existing applications and resources.
• Support implementation of applications in production and testing environments in conjunction with operations technical staff; confer with technical personnel to identify and resolve issues.
• Develop AI agents using Google Vertex AI, Gemini or OpenAI models, and modern agent frameworks.
• Apply prompt-engineering, context-filtering, and security-aware prompting practices, and use model-evaluation workflows and observability and debugging tools.

Benefits

• Comprehensive and competitive benefits package intended to support employees’ and their family members’ physical, financial, emotional, and social wellbeing.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior