Senior Data Engineer

ONEGLOBE LLCWashington, DC

About The Position

This Senior Data Engineer role involves serving as a technical point of contact for client stakeholders, leading meetings with both internal teams and federal agency counterparts. The position requires maintaining version-controlled codebases in GitLab, enforcing code review and CI/CD best practices, and containerizing development and deployment workflows using Docker for environment consistency. Responsibilities also include developing and maintaining comprehensive business rules documentation in platforms like Confluence and mentoring junior data engineers on SQL optimization, migration patterns, and documentation standards. A core aspect of the role is taking responsibility for the delivery of data migration for multiple systems, encompassing analysis, design, implementation, testing, validation, and acceptance. This includes assembling large, complex data sets, communicating with stakeholders to understand data migration needs, troubleshooting inconsistencies, and building optimal infrastructure for data extraction, transformation, and loading using AWS and SQL technologies. The engineer will work with various stakeholders to assist with data-related technical issues, develop data migration strategies and plans, create ETL scripts, perform data analysis and cleansing, troubleshoot migration issues, participate in data migration testing, and document all processes, procedures, and outcomes.

Requirements

  • Must be a US Citizen for DHS Suitability clearance.
  • 5+ years of work experience with a combination of data modeling, ETL, database operations, data services, data analytics, ETL and data migration tools.
  • 5+ years of work experience with coding in one of mainstream programming languages: Python, Java, Node.js etc.
  • Experience with Git/GitLab workflows, including branching strategies, merge requests, and CI/CD pipeline configuration.
  • Experience with Docker or containerized development environments.
  • Experience in design and development of ETL process using AWS ETL tools like AWS DMS, Glue, Athena, AWS Aurora PostgreSQL, etc.
  • Experience in designing data migration solutions, archival processes, and reconciliation.
  • Experience with data quality checks, data de-duplication and data validation processes.
  • Perform data migration audit, reconciliation, and exception reporting.
  • Experience with a public cloud (AWS, Microsoft Azure, Google Cloud).
  • Solid understanding of data elements and their relationships between the source and target systems.

Nice To Haves

  • Familiarity with federal data systems and agency stakeholder dynamics (DHS/FEMA preferred).
  • Experience operating production workloads on Oracle/PostgreSQL (preferred).

Responsibilities

  • Serve as a technical point of contact for client stakeholders, leading meetings with both internal teams and federal agency counterparts.
  • Maintain version-controlled codebases in GitLab and enforce code review and CI/CD best practices across the data engineering team.
  • Containerize development and deployment workflows using Docker to ensure environment consistency.
  • Develop and maintain comprehensive business rules documentation in Confluence or equivalent knowledge management platforms.
  • Mentor junior data engineers on SQL optimization, migration patterns, and documentation standards.
  • Take responsibility for the delivery of Data Migration for multiple systems: analysis, design, implementation, testing, validation, and acceptance.
  • Assembling large, complex sets of data that meet non-functional and functional business requirements.
  • Communicate with key stakeholders to understand the data migration needs and requirements and troubleshoot data inconsistencies that might arise.
  • Building required infrastructure for optimal extraction, transformation and loading of data from various data sources using AWS and SQL technologies.
  • Working with stakeholders including data, design, product, and executive teams and assisting them with data-related technical issues.
  • Develop data migration strategies and plans.
  • Develop scripts to extract, transform and load data.
  • Perform data analysis and cleansing activities to ensure data quality, as needed.
  • Troubleshoot and resolve issues related to data migration.
  • Participate in data migration testing including data-level validation and application-level validation.
  • Document data migration processes, procedures, and outcome.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service