Data Engineer

AnalyticaWashington, DC
56d

About The Position

Analytica is seeking a Data Engineer to support one or more dynamic, long-term federal government enterprise data programs. As a data engineer, you will translate business requirements to data engineering solutions to support an enterprise scale AWS and/or Databricks based data environments. You will support designing, maintaining, automating and optimizing ETL operations ensuring data quality and efficient data management.

Requirements

  • 5+ years of hands-on Data Integration experience creating and maintaining efficient scripts/data pipelines to clean, transform and ingest data from a variety of formats into database tables, data warehouses or data lake repositories.
  • 3+ years of experience using SQL and Python to manipulate, profile and build data products
  • Strong Experience building data pipelines using Databricks and/or AWS serverless components; using AWS Glue to build, maintain and monitor ETL jobs; using Python to implement ETL scripts and AWS Secrets Manager to manage credentials.
  • Proficient written, verbal, and client communication and presentation skills
  • Must be US Citizen and be able to obtain and maintain a Public Trust security clearance

Nice To Haves

  • Databricks and/or AWS Data Engineer Certification is strongly preferred.

Responsibilities

  • Design, build, and optimize scalable data solutions using a Medallion Architecture.
  • Manage ingestion routines for processing multi-terabyte datasets efficiently for multiple projects simultaneously, where each project may have multiple workspaces.
  • Integrate data from various structured and unstructured sources to enable high-quality business insights. Proficiency in data analysis techniques for deriving insights from large datasets.
  • Implement effective data management strategies to ensure data integrity, availability, and accessibility.
  • Identify opportunities for cost optimization in data storage, processing, and analytics operations.
  • Montor and support user requests, addressing platform or performance issues, cluster stability, Spark optimization, and configuration management.
  • Collaborate with the team to enable advanced AI-driven analytics and data science workflows.

Stand Out From the Crowd

Upload your resume and get instant feedback on how well it matches this job.

Upload and Match Resume

What This Job Offers

Job Type

Full-time

Career Level

Mid Level

Education Level

No Education Listed

Number of Employees

51-100 employees

© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service