Senior Data Engineer, AWS Data Platform

IDEXX•Westbrook, MA

2d•$110,000 - $130,000•Hybrid

About The Position

IT accelerates the success of IDEXX employees and customers by providing scalable and innovative solutions and leadership. We are a global organization that supports all technology needed to deliver products and solutions to customers enabling them to focus on delivering high quality patient care. We strive to provide exceptional customer service and experience in the most efficient means possible, requiring alignment and cross-functional communication. We are seeking a highly motivated and experienced Senior Data Engineer to join our IT Data Engineering team and support the accelerated advancement of IDEXX’s global LIMS (Lab Information Management System) program initiatives. This role is pivotal in developing and maintaining the data systems and infrastructure that deliver diagnostic results to our customers in near-real-time. This is not a SQL/ELT or Databricks-notebook-driven role; candidates must have experience building production data systems and services end-to-end, including CI/CD pipelines and IaC. This role centers on operational, near-real-time data pipelines, streaming ingestion, AWS-native compute, and API-driven data flows (using Kinesis, Glue/Spark, Lambda, and related services).

Requirements

4+ years of experience building, operating, and supporting production-grade data systems and services in highly reliable, fault-tolerant environments
3+ years of hands-on experience designing and developing solutions on AWS, including services such as Lambda, Glue, Kinesis, EMR, S3, SNS, SQS, DynamoDB, API Gateway, and IAM
Strong proficiency in Python and experience with shell scripting
Experience troubleshooting, debugging, and optimizing distributed data systems, including streaming pipelines, Spark workloads, APIs, messaging queues, and storage layers
Experience designing, building, and maintaining RESTful APIs
Experience implementing Infrastructure as Code using Terraform and/or CloudFormation
Experience building CI/CD pipelines and automated testing frameworks using tools such as Jenkins
Knowledge of relational, document, and key-value database technologies
Experience working with semi-structured event data (JSON, XML) and evolving data schemas
Bachelor's degree in Computer Science, Information Technology, Engineering, or equivalent combination of education and practical experience

Responsibilities

Build and maintain streaming ingestion, API-based data workflows, and distributed data transformations using AWS services (Kinesis, Lambda, Glue/Spark, EMR, S3, SNS, SQS, DynamoDB, API Gateway, and IAM)
Develop and maintain REST APIs for data ingestion and consumption
Design and implement platform automation and standardized, repeatable deployment mechanisms (e.g., versioned releases, environment promotion, and deterministic deployment workflows)
Develop and optimize data lake and operational data models for near-real-time use cases
Work across both streaming (operational) and batch (analytical) layers to ensure consistent, high-quality data delivery
Help improve reliability, automation, and observability across the RDE data platform
Participate in an on-call rotation to help provide support for the team’s data systems and services