Data Engineer

Caterpillar•Irving, TX

11h•Onsite

About The Position

As a Data Engineer on the Global Parts Pricing Data Engineering team, you will design and build scalable data platforms, pipelines, and cloud solutions that power pricing decisions across a global business. You will solve complex data challenges, transform diverse data sources into trusted and actionable insights, and deliver solutions that drive significant business outcomes. Working alongside data scientists, analysts, and business stakeholders, you will develop high-performance data products, automate critical processes, and help shape the future of data and AI-driven pricing determination.

Requirements

Ability to design, build, and optimize scalable batch and real-time data pipelines that deliver trusted, high-quality data for analytics, reporting, and AI applications.
Experience with cloud-based data platforms, storage, and processing technologies; ability to develop resilient, scalable, and secure data solutions.
Knowledge of data modeling, transformation, and integration techniques; ability to consolidate diverse data sources into well-governed, consumable data products.
Experience implementing data quality frameworks, monitoring, testing, and automated validation to ensure reliable and trusted data assets.
Ability to partner with cross-functional teams to understand business needs and deliver data solutions that support pricing decisions, analytics, automation, and AI-enabled outcomes.
Extensive experience in designing and developing software applications in Python.
Extensive experience working with Git version control
Extensive experience deploying software using CI/CD tools such as Github Actions, Azure Devops etc.
Experience with AWS components such as Bedrock, Lambda, Fargate, S3, Sagemaker, IAM and RDS
Experience with databases such as PostgreSQL, Snowflake, Oracle, etc.
Demonstrated strong learning ability and a proactive approach to staying current with the latest technologies and industry trends.

Nice To Haves

Experience with AI assisted software development (ex. Github Copilot, Cursor, Codex, etc)

Responsibilities

Build infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability
Perform debugging, troubleshooting, modifications and testing of integration solutions
Operationalize the developed jobs, processes and models.
Create databases and infrastructure to process data at scale
Create solutions and methods to monitor systems and solutions
Automate code testing and pipelines
Engage with business partners to participate in design and development of data integration/transformation solutions per functional requirements.
Engage and actively seek industry perspectives through, continuous learning, peer groups, etc.