Senior Data Engineer (P358)

8451 • Chicago, OH

9d

About The Position

As a Senior Data Engineer on our AI Enablement team, you will cultivate strategies and solutions to ingest, store and distribute our big data. This role is on our enablement team that builds solutions for monitoring, registering, and tracking our machine learning and AI solutions across 84.51˚ and develops monitoring and observability pipelines for our internal AI tooling. Our engineers use PySpark, Python, SQL, GitHub actions, and Databricks/Azure to develop scalable data solutions.

Requirements

• Bachelor’s degree in Computer Science, Management Information Systems, Mathematics, Business Analytics or another technically strong program.
• 3+ years proven ability of professional data engineering experience
• Strong understanding of Agile Principles (Scrum)
• 3+ years proven ability of developing with Python and PySpark
• Full understanding of ETL concepts and data warehousing concepts
• Experience with CI/CD frameworks (GitHub Actions a plus)

Nice To Haves

• Experience with visualization techniques and tools like Databricks dashboards or PowerBI a plus
• Azure AKS experience a plus
• Dashboard experience a plus
• WebApp experience a plus

Responsibilities

• Take ownership of features and drive them to completion through all phases of the entire 84.51° SDLC. This includes external facing and internal applications as well as process improvement activities such as:
• Lead design of Python and PySpark based solutions
• Perform development of cloud based (Azure) ETL solutions
• Build and configure cloud infrastructure for all stages of the data development lifecycle
• Execute unit and integration testing
• Develop robust data QA processes
• Collaborate with senior resources to ensure consistent development practices
• Provide mentoring to junior resources
• Build visualizations in Databricks Apps, Databricks Dashboards and PowerBI
• Bring new perspectives to problems and be driven to improve yourself and the way things are done

Benefits

• Medical: with competitive plan designs and support for self-care, wellness and mental health.
• Dental: with in-network and out-of-network benefit.
• Vision: with in-network and out-of-network benefit.
• 401(k) with Roth option and matching contribution.
• Health Savings Account with matching contribution (requires participation in qualifying medical plan).
• AD&D and supplemental insurance options to help ensure additional protection for you.
• Paid time off with flexibility to meet your life needs, including 5 weeks of vacation time, 7 health and wellness days, 3 floating holidays, as well as 6 company-paid holidays per year.
• Paid leave for maternity, paternity and family care instances.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Number of Employees: 501-1,000 employees