Senior Data Engineer

Reply • Chicago, IL

3d • $130,000 - $160,000

About The Position

Valorem Reply is an award-winning digital transformation firm focused on delivering solutions around data-driven enterprise, IT modernization, customer experience, product transformation and digital workplace by leveraging the power of Microsoft technologies.  We provide hyper-scale and agile delivery of unique digital business services, strategic business models and design-led user experiences. Our innovative strategies and solutions securely and rapidly transform the way our clients do business. We are seeking a Senior Data Engineer to design, build, and optimize modern data platforms for our clients using Microsoft Azure, Microsoft Fabric, Power BI, and Databricks. In this role, you will combine deep technical expertise with strong consulting skills — engaging directly with clients, understanding business needs, translating requirements into scalable technical solutions, and communicating clearly with both technical and non-technical stakeholders.

Requirements

• Bachelor’s degree in computer science or related field
• 8 years of experience in data engineering, data platform development, or cloud data solutions
• 3 years of hands-on experience with Azure Databricks, Apache Spark, or similar distributed data processing technologies
• Expertise with Microsoft Azure infrastructure and data resources, including Fabric, Azure Data Factory, Synapse Data Analytics, Power BI, Azure SQL, Azure Cosmos DB
• Deep expertise with Databricks, specifically the ability to design enterprise-level strategy and architecture including Unity Catalog, data warehousing, data sharing, and Mosaic AI
• Experience setting end-to-end modern data platforms in Azure including architecture/design, ingestion, storage strategies, analytics & reporting, Apache Spark, and networking requirements
• DevOps for data, GitHub, automated testing, and working with containers (AKS, Docker, registries, etc.)
• Excellent communication skills, ability to clearly explain concepts to teammates and customers, and quickly learn new concepts and technologies

Nice To Haves

• Azure Database for PostgreSQL
• Experience working directly with clients, business stakeholders, or cross-functional teams in a consulting or professional services environment.
• Experience establishing data management strategy for customers, including data governance, data security, master data management, and familiarity with different industry security requirements
• Ability to create working environments for data engineers and scientists, and general knowledge of ML, AI, LLMs, and MLOps
• Experience with Delta Lake, Unity Catalog, and Databricks workspace administration or governance.
• Broad experience with data/reporting tools, architectures, cloud vendors, and data/AI concepts other than Microsoft

Responsibilities

• Work directly with clients to understand business goals, data challenges, and technical requirements
• Lead or support discovery sessions, requirements workshops, architecture discussions, and solution reviews
• Develop and optimize batch and streaming data ingestion pipelines from enterprise applications, databases, APIs, and file-based sources
• Implement medallion/Lakehouse architectures, dimensional models, and data transformation workflows to support analytics and reporting use cases
• Engineer solutions using technologies such as PySpark, Spark SQL, SQL, Python, Delta Lake, and orchestration tools within Azure and Databricks
• Recommend best practices for data modeling, governance, lineage, monitoring, DevOps, and security
• Help establish engineering standards, reusable frameworks, accelerators, and documentation for internal and client teams
• Contribute to estimation, project planning, and delivery management for client engagements

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Number of Employees: 5,001-10,000 employees