Lead Data Engineer

Incedo • Austin, TX

2d

About The Position

Incedo is a US-based consulting, data science, and technology services firm with over 3,000 people across six offices in the US, Mexico, and India. The company helps clients achieve competitive advantage through end-to-end digital transformation, combining engineering, data science, and design capabilities with deep domain understanding. It serves clients in telecom, banking, wealth management, product engineering, and life sciences and healthcare. Incedo offers learning opportunities through Incedo University, a friendly work environment, and flexible career paths.

As a Technical Lead - Cloud Data Platform (Azure), you will manage and optimize Microsoft Azure environments for performance, scalability, and security. You will work with data analysts and data scientists to develop data pipelines and run data science experiments. The role includes configuring and optimizing Azure environments, ensuring pipeline efficiency and accuracy, resolving platform issues, and collaborating with security teams to maintain security and regulatory compliance. The description also calls for cloud-platform skills such as AWS or GCP and experience with data warehousing technologies such as Azure Synapse Analytics.

Requirements

• 7–9 years of work experience in a relevant field.
• Expertise in Azure services and tools such as Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
• Experience building scalable and reliable data pipelines using Azure services, Apache Spark, and related big data technologies.
• Familiarity with cloud-based infrastructure and deployment, specifically on Azure.
• Strong knowledge of Python, C#, and SQL.
• Excellent communication skills, including the ability to explain complex technical information clearly and concisely to non-technical stakeholders.
• Understand the company's long-term vision and align with it.
• Be open to new ideas and willing to learn and develop new skills.
• Work well under pressure and manage multiple tasks and priorities.
• B.Tech, B.E, M.Tech, or MCA degree from a reputed university.

Nice To Haves

• Computer science background is preferred.
• Skills in cloud computing platforms such as AWS or GCP.
• Experience with data warehousing technologies such as Azure Synapse Analytics.

Responsibilities

• Design, develop, and deploy cloud-based data platforms using Microsoft Azure.
• Integrate and process large amounts of structured and unstructured data from various sources.
• Implement and optimize ETL processes and data pipelines.
• Develop and maintain security and access controls.
• Collaborate with other teams to ensure data consistency and integrity.
• Troubleshoot and resolve data platform issues.
• Manage and optimize the Azure environment for performance, scalability, and security.
• Work with data analysts and data scientists to develop data pipelines and run data science experiments.
• Work with the security team to help ensure the Azure environment is secure and complies with relevant regulations.

Benefits

• Learning opportunities through Incedo University, including structured onboarding.
• Flexible career paths.
• Friendly work environment with a variety of activities.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior