Data Engineer II (US)
About The Position
The Data Engineer II provides a broad range of data engineering functions including data modeling, data quality, data profiling, data acquisition and ingestion, extract transform load (ETL), metadata enrichment and management, data provenance and lineage, and other specialized data management functions. This Data Engineer role will primarily focus on developing and maintaining data solutions within the Azure cloud environment. The engineer will be responsible for designing, building, and optimizing scalable data pipelines, as well as creating curated, high-quality data assets to support analytics, reporting, and business decision-making. The role requires close collaboration with data analysts, data scientists, and business stakeholders to ensure that data solutions are efficient, reliable, and aligned with organizational goals.
Requirements
- Advanced knowledge of data engineering frameworks, technologies, tools, processes, patterns, and procedures, including how they impact other technology areas such as Architecture or Infrastructure
- Performs complex technical tasks independently
- Advanced knowledge of TD applications, systems, networks, innovation, design activities, business, organization, best practices, and standards
- Designs and develops to meet business and technical requirements; analyzes, adapts, integrates, codes, tests, debugs, and executes
- Uses and evolves established patterns to solve complex problems; leads the development of new patterns where necessary
- Degree, Postgraduate Degree, or Technical Certificate in Data Management or related discipline (e.g. Computer Science, Engineering), or equivalent practical experience
- 3+ years of relevant experience
- Proficiency in Python and/or Scala for data processing tasks
- Experience with SQL for querying and transforming data
- Understanding of data modeling principles (dimensional, star/snowflake schema)
- Familiarity with Git, DevOps workflows, and deploying pipelines using CI/CD tools (e.g., Azure DevOps)
- Knowledge of data governance, security, and compliance best practices in a cloud environment
- Strong problem-solving and communication skills
- Ability to work independently and collaboratively in cross-functional teams
- Comfortable interacting with business users to understand data needs and translate them into technical solutions
Nice To Haves
- Solid hands-on experience with Microsoft Azure, to include:
- Azure Data Factory
- Azure Data Lake Storage (Gen2)
- Azure Synapse Analytics
- Azure Databricks
- Azure Functions (for orchestration or automation tasks)
- DP-203, DP-500 and AZ-305. Any Azure certifications are preferred
Responsibilities
- Designing and developing ETL/ELT pipelines
- Data ingestion, transformation, and integration from various sources
- Data modeling (dimensional, star/snowflake schema)
- Building curated, reusable datasets for downstream analytics
- Version control using Git
- DevOps workflows and deploying pipelines using CI/CD tools (e.g., Azure DevOps)
- Data governance, security, and compliance best practices in a cloud environment
Benefits
- Growth opportunities and skill development
- Health and well-being benefits
- Savings and retirement programs
- Paid time off (including Vacation PTO, Flex PTO, and Holiday PTO)
- Banking benefits and discounts
- Career development
- Reward and recognition
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Number of Employees
101-250 employees
