Data Engineer

Accenture Federal ServicesSt. Louis, MO
18dOnsite

About The Position

At Accenture Federal Services, nothing matters more than helping the US federal government make the nation stronger and safer and life better for people. Our 13,000+ people are united in a shared purpose to pursue the limitless potential of technology and ingenuity for clients across defense, national security, public safety, civilian, and military health organizations. Join Accenture Federal Services, a technology company and part of global Accenture, to do work that matters in a collaborative and caring community, where you feel like you belong and are empowered to grow, learn and thrive through hands-on experience, certifications, industry training and more. Join us to drive positive, lasting change that moves missions and the government forward! The work: Data Engineer is responsible for creating efficient data pipelines, ensuring data quality, and implementing ETL (Extract, Transform, Load) processes to facilitate the seamless migration and deployment of data across systems. The Data Engineer works within the Agile frameworks to support the team's data-driven approach to application migration, collaborating closely with other team members to ensure data integrity and accessibility throughout the transition to cloud environments.

Requirements

  • Bachelors degree and a minimum of 5 years experience.
  • Active Secret Security clearance required
  • Experience with cloud-based ETL services (e.g. AWS Glue, Google Cloud Dataflow, Azure Data Factory)
  • Experience with Python, SQL, Spark, and PySpark
  • Familiarity with data orchestration and data quality processes

Nice To Haves

  • Experience with data platforms like Databricks, Palantir, and Snowflake

Responsibilities

  • Design and develop scalable, efficient data architectures to support the migration process
  • Create data models and schemas that align with both source and target systems
  • Develop and maintain robust data pipelines for data generation, collection, and processing
  • Implement real-time and batch processing pipelines as required by the migration strategy
  • Design and implement ETL processes to migrate data between source and target systems
  • Develop scripts and workflows for data extraction, transformation, and loading
  • Develop and maintain data cleansing routines to address data inconsistencies
  • Create monitoring systems to track data quality metrics throughout the migration
  • Collaborate with the migration team to plan and execute data migration strategies
  • Provide expertise on data-related aspects of the migration process
  • Troubleshoot and resolve data-related issues during migration
  • Optimize data processing and storage for improved performance in cloud environments
  • Monitor and tune data pipelines for efficiency
  • Implement data security measures to protect sensitive information during migration
  • Ensure compliance with data protection regulations and organizational policies
  • Develop and maintain data access controls and audit trails
  • Create and maintain comprehensive documentation for data architectures and processes
  • Work closely with data analysts, cloud engineers, and application developers
  • Integrate data solutions with other components of the migrated applications
  • Participate in Agile ceremonies (Sprint Planning, Daily Stand-ups, Sprint Reviews, and Retrospectives)
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service