State Farm is hiring a Software Engineer to design and build end-to-end data pipelines that pull from source systems including Entra ID, ServiceNow, Dynatrace, GitLab, Agility, and more—transforming messy, inconsistent tool data into clean canonical entities using bronze/silver/gold (medallion-style) layers. You’ll tackle problem solving at the core of our platform by delivering deterministic identity resolution (linking the same person/service/deployment across different names, IDs, and schemas), and by building and populating a knowledge graph that connects commits → deployments → incidents → service ownership. You’ll also compute trusted DORA metrics (with confidence scores), define and evolve durable entity models across a 14-domain canonical data model, and build the retrieval surface (APIs, query interfaces, and AI-agent access patterns) so both humans and AI can reliably consume what the platform knows. This is a green-field implementation of an architecture that’s already been validated end-to-end. While the core architectural approach is established, you’ll have significant ownership in building and evolving the implementation from the ground up. You’ll need strong engineering fundamentals with hands-on experience in event streaming (e.g., Kafka) and lakehouse/data platform tooling (e.g., Databricks), along with a strong data modeling, schema design, and transformation pipeline background. Java and Python are both explicitly needed for the platform’s pipelines and services, and you should be comfortable across the stack (ingestion, transformation, storage, computation, and serving). Bonus experience includes orchestrating event-driven architectures, working with graph/knowledge graph technologies, integrating with CI/CD and observability tools as data sources, and building retrieval/grounding patterns for AI; most importantly, you’ll bring the problem-solving mindset required to handle ghost records, stale data, mismatched org structures, and schema durability through source system migrations (e.g., GitLab→GitHub, Agility→Jira).
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed