Senior Data Engineer - (Software Engineer Principal I)

PRISM+ • Sterling, VA

18d • Hybrid

About The Position

PRISM is seeking a highly skilled and experienced Principal Data Engineer to join our team. This role will support PRISM's clients on critical, mission-focused initiatives involving enterprise digital transformation and the introduction of next-generation cyber capabilities. The engineer will primarily lead the design, development, and migration of large-scale data applications, services, and platforms to modern data architectures. THIS IS A HYBRID ROLE

Requirements

• Citizenship & Clearance: Must be a U.S. Citizen. Active Secret (S) clearance is required; must be able to obtain a Top Secret/SCI (TS/SCI) clearance.
• Suitability: Must be able to obtain client/agency suitability (e.g., DHS Suitability).
• 8+ years of professional software engineering experience.
• Minimum of 4 years of experience performing data engineering work in a cloud environment.
• Experience with relational, noSQL, and/or file-based storage systems (e.g., Databricks, Elasticsearch, Postgres, etc.).
• Experience with DevOps tools such as Jenkins, Docker, Ansible, Puppet, Chef, Splunk, etc.
• Working knowledge of Databricks, Cloud Relational Database Services, and Elasticsearch.

Nice To Haves

• Experience with Databricks workflows, Databricks Unity Catalog, Databricks Autoloader, and Databricks Delta Live Tables and Apache Spark.
• Basic working knowledge with Apache NiFi (Niagara Files).
• Experience with collaboration tools including MS Teams, MS Outlook, MS SharePoint, and Confluence.
• Amazon Web Services (AWS) Professional certification or equivalent.
• DoD 8570.1-M Compliance at IAT Level I (e.g., Certified Information Systems Security Professional (CISSP) certification highly desired).

Responsibilities

• Data Pipeline Developer: Design, develop, and implement end-to-end data ingestion and processing pipelines using various Cloud and Platform Technologies.
• Medallion Model Implementation: Transform incoming bronze data (RAW) into silver (clean/validated) and finally create projected datasets in the gold tier to implement a modern Medallion Data Architecture.
• Orchestration and Monitoring: Schedule, orchestrate, and continuously monitor automated and semi-automated data pipelines for performance and reliability.
• Data Asset Integration: Perform mapping and integration of diverse data assets in support of the execution of PRISM's client missions.
• Process Improvement: Develop and maintain the data engineering team's process improvement plan and ensure Standard Operating Procedures (SOPs) are captured and communicated across the team.
• Automation: Develop code using various programming and scripting languages to automate data ingestion, pipeline orchestration, and improve overall data management processes.
• Observability: Implement transparency, leveraging monitoring technologies (e.g., AWS CloudWatch, Splunk) to measure and gather performance information on automated data pipelines.
• Quality Assurance: Ensure the technical correctness, timeliness, and quality of delivery for the team's output.
• Communication: Demonstrate excellent oral and written communication skills when engaging with all levels of management and PRISM's clients.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Number of Employees: 101-250 employees