Data Engineer

INDEX ANALYTICS LLC•Baltimore, MD

4d•$126,000 - $142,000•Remote

About The Position

As a Data Engineer in this role, you will apply advanced data engineering principles to create reusable workflows that cover ingestion, quality assurance, transformation, and optimization of data. You will be responsible for building scalable pipelines using ETL tools, ensuring that data is efficiently extracted, transformed, and loaded into target systems. Your work will involve deploying robust data solutions into production environments and migrating information from legacy data warehouses by leveraging modern cloud architecture, particularly within Microsoft Azure SQL and Snowflake environments. Automating the flow of data for seamless consumption will be a key aspect of your daily responsibilities. You will also play a pivotal role in establishing business processes that support strong data governance practices. This includes designing and advising on comprehensive data quality rules and setting up effective data compliance policies to ensure organizational standards are met. Exposure to ETL pipeline development, cloud-based data migration, and the implementation of data governance frameworks will be highly beneficial. Experience with optimizing data workflows, deploying solutions in cloud environments, and automating data processes will help you excel in this position.

Requirements

Must be a US citizen
As a US Citizen, you will be expected to work within compliance and security guidelines, ensuring that all deliverables meet organizational and regulatory standards.
Bachelor’s Degree or equivalent OR 4 years’ relevant experience in lieu of degree
7 additional years of relevant experience
Ability to gain and hold a Public Trust clearance
Hands-on experience with: Microsoft SQL Server (Intermediate proficiency)
Hands-on experience with: Snowflake platform (Intermediate proficiency)
Hands-on experience with: ETL pipeline design and development (Intermediate proficiency)
Hands-on experience with: Microsoft Azure SQL (Intermediate proficiency)
Experience building and deploying data pipelines in production environments
Strong understanding of data engineering principles and data lifecycle management

Nice To Haves

Experience with modern cloud data architecture and platforms
Proficiency with ETL tools such as Informatica, Talend, Azure Data Factory, or dbt
Experience with cloud-based governance frameworks and implementation
Experience with automation or scripting (E.g., Python, SQL, CI/CD pipelines)

Responsibilities

Apply data engineering principles to develop reusable workflows for data ingestion, quality, transformation, and optimization
Set up and maintain effective data compliance policies
Build scalable data pipelines using ETL tools and processes
Deploy data solutions to production environments
Migrate data from legacy data warehouses leveraging cloud architecture principles
Automate the flow of data for efficient consumption
Build and implement business processes that enable data governance
Design and advise on data quality rules