Principal Digital Architect

Caterpillar Inc.•Peoria, IL

2d•Onsite

About The Position

Your Work Shapes the World at Caterpillar Inc. When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here – we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it. Caterpillar Inc. seeks Principal Digital Architect at its facility located at 501 SW Jefferson Avenue, Caterpillar Building LC, Peoria, IL 61605. Design largescale data lakes and enterprise data warehousing (EDW) projects using on-premise and cloud native data warehousing solutions such as Redshift & Snowflake. Drive development and execution of designing, implementing, and supporting end-to-end automated data processing ETL pipelines using a variety of tools and technologies such as Hadoop Technologies, AWS EMR, and AWS Glue. Lead data architecture development for enterprise scale systems in public cloud in AWS, Azure and hybrid eco-systems. Implement data lakes, big data transformations, cloud data processing, SQL, and NoSQL data modeling. Manage data modeling requirements for structured and non-structured data using various database management technologies such as AWS RDS (mySQL, PostagreSQL, Aurora), AWS DynamoDB, and NoSQL database.

Requirements

Designing, developing, deploying and maintaining software at scale
Developing software applications using relational and NoSQL databases
Application architectural patterns, such as MVC, Microservices, Event-driven, etc.
Deploying software using CI/CD tools such as Jenkins, GoCD, Azure Devops etc.
Deploying and maintaining software using public clouds such as AWS or Azure
Working within an Agile framework such as Scrum
Batch or stream processing systems such as Apache Spark, Flink, Akka, Storm
Message brokers such as Kafka, Rabbitmq, AWS SQS, AWS SNS, Apache Active MQ, Kinesis
Writing API proxies on platforms such as Apigee Edge, AWS API Gateway or Azure API Gateway
Datastores such as MongoDB, Cassandra, Redis, Elasticsearch, MySQL, Oracle
Debugging and maintaining software in Linux or Unix platforms

Responsibilities

Design largescale data lakes and enterprise data warehousing (EDW) projects using on-premise and cloud native data warehousing solutions such as Redshift & Snowflake.
Drive development and execution of designing, implementing, and supporting end-to-end automated data processing ETL pipelines using a variety of tools and technologies such as Hadoop Technologies, AWS EMR, and AWS Glue.
Lead data architecture development for enterprise scale systems in public cloud in AWS, Azure and hybrid eco-systems.
Implement data lakes, big data transformations, cloud data processing, SQL, and NoSQL data modeling.
Manage data modeling requirements for structured and non-structured data using various database management technologies such as AWS RDS (mySQL, PostagreSQL, Aurora), AWS DynamoDB, and NoSQL database.