Data Pipeline Senior Autonomy Engineer

Caterpillar Inc.•Irving, TX

3d•$112,710 - $183,140•Onsite

About The Position

The Data Pipeline Engineer is responsible for developing, maintaining, and improving the data infrastructure that enables autonomy, robotics, and machine learning development across multiple programs. This role designs and supports scalable solutions for data ingestion, storage, discovery, processing, and annotation, ensuring that high-quality robotics data is accessible and usable throughout its lifecycle. The engineer collaborates closely with software, autonomy, AI/ML, and platform teams to build reliable data workflows, manage cloud-based storage and compute environments, and develop tools that accelerate data-driven development. Key responsibilities include supporting log processing systems, improving data integrity and discoverability, enabling large-scale compute workloads, automating data management processes, and contributing to platforms that support model training, validation, simulation, and analytics. Success in this role requires strong software engineering skills, experience with cloud infrastructure and data systems, a commitment to operational excellence, and the ability to work effectively within cross-functional teams to deliver scalable and maintainable solutions. The Data Pipeline team's mission is to provide robust data infrastructure, compute resources, data management capabilities, annotation workflows, and development tools that accelerate autonomy and robotics development.

Requirements

Knowledge of approaches, tools, techniques for recognizing, anticipating, and resolving organizational, operational or process problems; ability to apply knowledge of problem solving appropriately to diverse situations.
Knowledge of relevant programming languages and tools; ability to test, write, design, debug, troubleshoot and maintain source codes and computer programs.
Knowledge of technical troubleshooting approaches, tools and techniques; ability to anticipate, recognize, and resolve technical issues on hardware, software, application or operation.

Nice To Haves

Bachelor's or master’s degree in computer engineering, Computer Science, Software Engineering, Robotics, Data Engineering, or a related field.
Experience developing software in Python, C++, or similar programming languages.
Experience with cloud platforms, data storage, and distributed computing environments.
Understanding of data pipelines, ETL processes, data lifecycle management, and automation.
Familiarity with machine learning workflows, robotics data, or autonomous systems is preferred.

Responsibilities

Design, develop, and maintain scalable data infrastructure that supports autonomy, robotics, and machine learning development across multiple programs.
Build and enhance solutions for data ingestion, storage, discovery, processing, and annotation to ensure high-quality robotics data is accessible throughout its lifecycle.
Develop and support reliable data workflows, cloud-based storage environments, and compute platforms that enable efficient data-driven development.
Improve log processing systems, data integrity, discoverability, and automation capabilities to streamline data management at scale.
Enable large-scale compute workloads and contribute to platforms that support model training, validation, simulation, analytics, and autonomous system development.
Partner closely with software, autonomy, AI/ML, and platform teams to deliver robust data infrastructure, annotation workflows, development tools, and compute resources that accelerate autonomy and robotics innovation.