Data Engineer (Azure Synapse ETL/SQL)

PeratonHerndon, VA
6d$86,000 - $138,000Hybrid

About The Position

Peraton is seeking a Data Engineer (Azure Synapse ETL/SQL) to join our team of qualified, diverse individuals. This position will be located in Herndon, VA with some remote work possible. The qualified applicant will become part of Peraton’s Department of State (DOS) Consular Systems Modernization (CSM) Program, for the Bureau of Consular Affairs (CA). This initiative will modernize and consolidate the operational environment under a common technology framework in order to better support the services provided to CA’s customers. The Data Engineer is responsible for working with large datasets, verifying data is collected, stored, and processed in a reliable and optimized manner. The Data Engineer will develop ETL processes, manage data warehouses, and confirm data integrity. This role collaborates closely with data scientists and analysts to provide clean, structured data that supports business insights and decision-making. Strong problem-solving skills and expertise in big data technologies are key to success in this role.

Requirements

  • Bachelor’s degree and eight (8) years’ experience.
  • At least 5 years of experience with developing relational database management systems (RDBMS) using Oracle, PostgreSQL, MySQL, or Microsoft SQL Server in a production environment.
  • Hands-on experience developing, testing and optimizing complex SQL scripts
  • Hands-on experience with Azure Synapse Analytics for pipeline orchestration and/or SQL/Spark processing.
  • Experience supporting database engineering activities for software projects specializing in development of enterprise web applications within an Agile environment.
  • Experience designing database solutions using conceptual, logical, and physical diagrams.
  • Experience with developing database solutions involving storage of structured and unstructured data, data ingestion via batch and streaming, and ETL processes.
  • Excellent communication skills, both verbally and in writing.
  • Must be able to obtain or have an Active Secret (or higher) clearance. Interim clearances acceptable.
  • Must be a US Citizen.

Nice To Haves

  • Experience with enterprise software system modernization efforts.
  • Experience developing database solutions in an incremental manner using the Agile methodology.
  • Experience in cloud-based environments including the development of database solutions that are based on a hybrid-cloud architecture.
  • Experience developing database solutions for high volume, highly available, and secure software system.
  • Experience developing database solutions in a secure environment that are required to meet DISA STIG and NIST specifications (security controls).
  • Ability to work independently and in a team environment.

Responsibilities

  • Key Responsibility includes building and maintaining ETL pipelines using Azure Synapse.
  • Work with the system engineering team to understand customer business needs and priorities.
  • Implement Azure cloud analytics and databases, leveraging tools such as Azure Synapse, Azure SQL, Synapse pipelines, Databricks, and related frameworks
  • Utilize data science tools such as Anaconda, R, Weka, and Synapse Analytics for advanced data processing modeling.
  • Define system and technical requirements, including both functional and non-functional, to support database management system development within an Agile environment.
  • Develop conceptual, logical, and physical designs for database solutions.
  • Develop and maintain database solutions for managing structured and unstructured data.
  • Develop and maintain database solutions for data ingestion (batch and streaming).
  • Develop and maintain database scripts supporting ETL processes and functions.
  • Monitor and tune database solutions for optimal performance.
  • Develop and maintain secure database solutions that are compliant with DISA STIG and NIST specifications (security controls).
  • Develop data analytic models, incorporating machine learning (ML), deep neural networks (DNN), and large language models (LLM) to support business objectives.
  • Support CI/CD initiatives and utilize static code analyzers to ensure high quality source code.
  • Author clear documentation for database solutions, including data dictionaries, data catalogs, and design artifacts.
  • Integrate database solutions with the software applications and/or platforms.
  • Support software testing activities, including IV&V, and provide timely software defect resolutions.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service