Software Engineer III- Data Platform Engineering team

CME Group • Chicago, IL

5d

About The Position

The Data Platform Engineering team is a collection of highly skilled individuals dedicated to building and scaling the infrastructure that powers our organization's data-driven initiatives. We are building a cutting-edge platform on Google Cloud (GCP) to handle petabyte-scale data processing, real-time analytics, and machine learning workloads. We champion a DevSecOps culture, and our core principles are centered around automation, quality, and Infrastructure as Code (IaC). You will solve problems creatively, communicate effectively, and proactively engage in technical decision-making to achieve our mission: raising the bar on how we manage and deploy data infrastructure. About the Role As a Data Platform Engineer, you will be responsible for building and maintaining the self-service platforms and frameworks used by our Data Scientists and Engineers. Your work will directly accelerate the development and deployment of batch and streaming data pipelines (using Spark, Flink, and Kafka/PubSub) and enable seamless, governed access to data in BigQuery. You will be a key contributor to our automation strategy, utilizing tools like Terraform for infrastructure provisioning and Argo/Jenkins for orchestration. You will serve as a Subject Matter Expert (SME) for our core data platform components, ensuring our environment is well-architected, secure, and optimized for performance and cost.

Requirements

• Education: Bachelor’s degree or above in Computer Science, Mathematics, or related engineering field.
• Programming: Strong proficiency in a high-level programming language such as Python, Golang, or Java .
• Containerization: Proven hands-on experience with Docker and orchestration via Kubernetes (GKE).
• CI/CD & Automation: Experience building automation pipelines using tools such as Jenkins, or Argo Workflows.
• Infrastructure as Code: Proficiency with Terraform and a strong understanding of GitOps principles.
• AI Tooling: Experience with software development using AI code assistance tools.

Nice To Haves

• Operating Systems: Strong experience with Linux environments.
• Scheduling: Experience with Argo workflows or Airflow.
• Soft Skills: Excellent oral and written communication skills; ability to work independently and drive initiatives in a team environment.
• Agile Tools: Proficiency with Atlassian tools (Confluence, JIRA).
• Cloud Expertise: Experience with Google Cloud Platform (GCP) or AWS, specifically with data components(BigQuery , Dataproc etc).
• Data Frameworks: Hands-on experience with large-scale data processing (e.g., Apache Spark, Apache Flink) and streaming (e.g., Kafka, Google PubSub).

Responsibilities

• Core Platform Design: Design, build, and operate the core infrastructure for our data platform on Google Cloud, focusing on Google Kubernetes Engine (GKE) and BigQuery.
• Streaming & Processing: Architect and support large-scale data processing engines (Apache Spark, Apache Flink) and streaming technologies (Apache Kafka, Google PubSub).
• Security & Optimization: Partner with application teams to ensure data services are secure, compliant, and optimized for cloud costs and performance.
• Self-Service Enablement: Develop self-service tools and frameworks that allow Data Engineering and Data Science teams to deploy pipelines independently.
• CI/CD & DevOps: Build and support robust CI/CD automation pipelines (using Jenkins, Bitbucket , Argo Workflows) to automate build deployments and infrastructure updates.
• Infrastructure as Code: Drive the adoption of IaC (Terraform) and GitOps principles to manage infrastructure versioning and provisioning.
• Modern Development: Utilize AI code assistance tools to enhance code quality and development velocity.
• Agile Delivery: Work in a story-driven, agile environment (using JIRA/Confluence), collaborating effectively across teams to meet delivery timelines.

Benefits

• CME Group is committed to offering a competitive total rewards package for our employees that recognizes their contributions to the business and reflects our long-term investment in their future.
• Our compensation program also includes an annual target bonus opportunity for all employees, as well as the opportunity to become an owner in the company through our broad-based equity program.
• Through our benefits program, we strive to offer flexibility, value and choice. From comprehensive health coverage, to a retirement package that includes both a 401(k) and an active pension plan, to highly competitive education reimbursement provisions, paid time off and a mental health benefit, CME Group offers a holistic benefits package for our team and their dependents.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level