Senior Manager, Data Engineering

Clarity Innovations•Herndon, VA
•$145,900 - $248,000

About The Position

Clarity Innovations is seeking a senior technical leader for a Department of Defense mission involving a large-scale enterprise data lake and data brokerage platform. The role is described as providing technical leadership and architectural oversight, defining the platform’s overarching architecture, ensuring integration across engineering disciplines, and guiding development of a secure, scalable, highly available data ecosystem. The position requires systems-level thinking and the ability to translate complex mission requirements into cohesive technical solutions. The successful candidate will bring broad understanding of platform engineering, cloud infrastructure, data engineering, and data science, with hands-on experience in at least two disciplines. They will guide specialized engineering teams, establish architecture and engineering standards, assess technical risks and tradeoffs, and communicate architectural decisions to engineering teams, program leadership, and government stakeholders. The ideal candidate combines broad cross-domain awareness with deep practical expertise in at least one discipline and can oversee the technical ecosystem without necessarily performing daily troubleshooting.

Requirements

  • At least 10 years of experience in software engineering, systems engineering, cloud architecture, data engineering, or related technical disciplines, including significant experience leading complex technical initiatives.
  • Understanding of the DoD Zero Trust Reference Architecture and its application in the context of Iceberg and Trino.
  • Understanding of technical considerations for operating petabyte-scale Iceberg warehouses, including data pipelines and data cataloging.
  • Demonstrated experience architecting or overseeing large-scale, distributed enterprise data systems, including end-to-end ownership of vendor data onboarding, ETL, storage, governance, and access layers.
  • Hands-on depth with open-source ETL and data lakehouse technologies, including Apache NiFi, Apache Spark, Apache Iceberg, and Trino.
  • Experience with OpenMetadata or comparable cataloging, lineage, governance, and data-quality tools such as DataHub or Alation.
  • Experience building usage analytics and Grafana dashboards to help customers measure the value and return on investment of vendor data feeds.
  • Experience designing automated data-quality evaluation processes for onboarding new feeds and continuously monitoring completeness, accuracy, timeliness, and schema stability.
  • Strong understanding of fine-grained access control, including attribute-based and field-level security enforced through user entitlements, classification levels, and regulatory requirements.
  • Experience deploying and operating containerized data platforms on Kubernetes across Azure and AWS, including infrastructure as code, CI/CD, high availability, and security hardening.
  • Proven technical leadership across engineering teams, including setting architectural standards and serving as the primary technical liaison to customer stakeholders.
  • Broad technical understanding across Platform Engineering, Cloud Infrastructure, Data Engineering, and Data Science, with hands-on experience in at least two of those disciplines.
  • Ability to develop and evaluate end-to-end technical architectures spanning multiple engineering domains.
  • Strong understanding of system scalability, high availability, fault tolerance, security, and performance optimization.
  • Demonstrated ability to lead technical design discussions, evaluate engineering tradeoffs, and guide multidisciplinary engineering teams.
  • Excellent communication skills and ability to engage technical and nontechnical stakeholders.

Nice To Haves

  • Hands-on engineering experience in Platform Engineering, Cloud Engineering, Data Engineering, Software Engineering, or Data Science.
  • Knowledge of DoD or Federal data governance policies, security requirements, and regulatory frameworks, including NIST, RMF, FedRAMP, and applicable DoD data management policies.
  • Familiarity with cross-domain data transfer, data classification, access control, and sensitive data handling requirements.
  • Experience supporting DoD, Intelligence Community, or other Federal enterprise technology programs.
  • Experience evaluating emerging technologies and incorporating AI/ML capabilities into enterprise data architectures.
  • Experience with AWS, Azure, Kubernetes, Terraform, Apache NiFi, Apache Spark, Trino, or comparable technologies.
  • Experience designing large-scale data lakes, data fabrics, data mesh architectures, or enterprise data brokerage systems.
  • Experience supporting petabyte-scale data environments or high-throughput data processing systems.

Responsibilities

  • Lead the design and evolution of an enterprise-scale data platform supporting data ingestion, storage, processing, discovery, analytics, and distribution.
  • Provide architectural direction and technical oversight across Platform Engineering, Cloud Infrastructure, Data Engineering, Data Science, and Software Development teams.
  • Ensure interoperability across distributed systems, cloud environments, data pipelines, APIs, and mission applications.
  • Establish technical standards, design principles, and engineering best practices to support scalability, reliability, security, and maintainability.
  • Evaluate architectural alternatives, identify technical risks and dependencies, and develop solutions aligned with mission objectives.
  • Work with cybersecurity and compliance stakeholders to incorporate security controls, data governance, and regulatory requirements into system architecture.
  • Support technical planning, capability prioritization, technology selection, and long-term platform modernization.
  • Communicate technical concepts, architectural decisions, tradeoffs, and risks to engineering teams, program leadership, and government stakeholders.
  • Guide end-to-end architecture across multiple engineering domains and multidisciplinary teams.
  • Support data-platform design and operation, including vendor data onboarding, ETL, storage, governance, access layers, data quality evaluation, and usage analytics.

Benefits

  • Performance-based bonuses.
  • Medical coverage.
  • Dental coverage.
  • Vision coverage.
  • 401(k) plan with company match.
  • Substantial paid time off and holidays.
  • Flexible work arrangements where possible.
  • Income protection benefits.
  • Resources supporting professional growth.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service