GenAI Engineer (LLM)

State Farm•Dunwoody, GA

5d•Hybrid

About The Position

State Farm is seeking a skilled software engineer with strong Python backend development and AI/LLM integration expertise. The role designs, builds, and maintains the LARRY FastAPI backend, including LLM-powered conversation flows, Retrieval-Augmented Generation (RAG) pipelines, and knowledge ingestion APIs. The platform processes interviews, documents, and mainframe artifacts into structured, queryable knowledge objects. This position offers greenfield AI work involving enterprise-scale knowledge management. The engineer collaborates with architects, product owners, business stakeholders, and subject-matter experts to develop accurate knowledge processing and retrieval. The role also leads backend architecture decisions, mentors junior engineers, and researches emerging LLM and RAG patterns. The position is hybrid, with selected candidates assigned to a facility and working both in the office and from home. Enterprise Technology hybrid work requires approximately 40% in-office time each month beginning in late 2027. Hub locations are Bloomington, Illinois; Dunwoody, Georgia; Richardson, Texas; and Tempe, Arizona. Applicants must already be eligible to work lawfully in the United States; State Farm will not sponsor work authorization for this opportunity. Compensation is based on a standard 38:45-hour work week. The potential starting salary range is $85,000–$142,000, depending on skills, background, and experience; the high end is limited to applicants with significant relevant experience. Potential yearly incentive pay is up to 15% of base salary.

Requirements

Strong Python or React experience, including FastAPI or similar asynchronous web frameworks.
Experience with LLM integration and RAG architecture patterns.
Experience designing, developing, and maintaining RESTful APIs.
Hands-on experience with CI/CD pipelines and containerized deployment.
Solid understanding of Git and version control workflows.
Experience with AWS or other cloud environments.

Nice To Haves

Ability to process and transform mainframe artifacts (JCL, DB2, COBOL) into structured, schema-compliant knowledge objects.
Experience with vector databases or embedding-based approaches.
Experience with JSON schema design and knowledge graph or structured data patterns.
Experience integrating with Entra ID (Azure AD) for authentication and managing secure API access patterns.

Responsibilities

Design, develop, and maintain the LARRY FastAPI backend, including REST API endpoints for conversation, ingestion, and knowledge retrieval.
Build and support LLM-powered RAG pipelines that query the kcd-repository knowledge base and surface relevant answers.
Lead backend architecture decisions and mentor junior engineers.
Collaborate with business stakeholders, product owners, and architects to ensure accurate knowledge processing and retrieval.
Implement and maintain GitLab CI/CD pipelines for deployment to ROSA (OpenShift).
Participate in code reviews, unit testing, and integration testing to maintain high-quality, secure code.
Integrate with Entra ID (Azure AD) for authentication and manage secure API access patterns.
Research and adopt emerging LLM and RAG patterns to improve knowledge quality and retrieval accuracy.

Benefits

Annual raise and bonus, with potential yearly incentive pay up to 15% of base salary.
Health and wellbeing programs, with State Farm paying most of the healthcare premium and offering multiple healthcare plan options.
Medical plans provide 100% coverage for in-network preventative care.
Vision, dental, telemedicine, and access to 24/7 mental health professionals.
Educational benefits, including training programs and tuition assistance.
Employee resource groups and mentoring.
Fertility, IVF, and adoption assistance.
College coaching, national discount programs, financial workshops, and free financial coaching.
Generous time-off policies, with the opportunity to initially earn up to 20 days annually.
Parental leave, paid holidays, a celebration day, life leave (40 hours per year), bereavement leave, and community service/education support days.
Matching Gift Program, Good Neighbor Grant Program, and Employee Assistance Fund.
Free financial advisors and a 401(k) plan with company contributions of up to 7% of salary.