Senior Software Engineer
About The Position
In this role, you will design, develop, and deliver scalable cloud-native data platform solutions that support enterprise analytics and business operations. You will collaborate with cross-functional teams to build robust data ingestion and transformation pipelines using Azure Databricks, Unity Catalog, Azure Data Factory (ADF), and Pulumi Infrastructure as Code (IaC). You will contribute to data architecture, modeling, and platform design while driving engineering excellence through automation, CI/CD, and Agile delivery practices. You will also mentor engineers, participate in an on-call rotation, and help deliver secure, reliable, and governed data solutions that enable informed business decisions.
Requirements
- 5 or more years of experience in software engineering, data engineering, or related technical roles required.
- Strong experience with Azure Databricks, Apache Spark, and Delta Lake required.
- Experience implementing and managing Unity Catalog for data governance and security required.
- Hands-on experience ingesting and transforming data from on-premises systems, databases, APIs, and enterprise applications required.
- Experience developing and maintaining Azure Data Factory (ADF) pipelines required.
- Experience creating and maintaining Azure DevOps (ADO) CI/CD pipelines required.
- Strong experience using Pulumi for Infrastructure as Code (IaC); TypeScript experience is preferred.
- Excellent analytical, troubleshooting, communication, and collaboration skills.
Nice To Haves
- Relevant degree preferred. Degree in Computer Science, Engineering, Information Systems preferred.
- Strong understanding of data modeling, solution architecture, and cloud design principles preferred.
- Experience working with Git and modern software development practices preferred.
- Familiarity with Agile methodologies, including Scrum and Kanban preferred.
Responsibilities
- Design, develop, and maintain scalable data ingestion and transformation pipelines using Azure Databricks.
- Build and manage data assets within Unity Catalog, ensuring proper governance, security, and data access controls.
- Develop data integrations from various sources, including on-premises databases, enterprise systems, REST APIs, and third-party applications.
- Create, maintain, and optimize Azure Data Factory (ADF) pipelines for data movement and orchestration.
- Develop and manage cloud infrastructure using Pulumi Infrastructure as Code (IaC) to support automated and repeatable deployments.
- Design and implement efficient data models and architecture that support reporting, analytics, and business requirements.
- Create, maintain, and troubleshoot Azure DevOps (ADO) CI/CD pipelines to automate application and infrastructure deployments.
- Participate in architecture discussions, technical design reviews, and implementation planning.
- Perform code reviews and promote engineering best practices, coding standards, and software quality.
- Monitor production environments, troubleshoot issues, and participate in an on-call rotation to ensure platform reliability.
- Collaborate with cross-functional teams including architects, product owners, business analysts, and other engineering teams.
- Participate in Agile ceremonies and contribute effectively in Scrum and Kanban development environments.
- Mentor junior engineers and contribute to continuous improvement initiatives.
Benefits
- Comprehensive benefits plan
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
