Lead Data Engineer

Hypergiant Industries

About The Position

We are looking for a Lead Data Engineer to work alongside our balanced agile delivery teams on highly complex DoD projects, specifically the development of a data service for command and control (C2) software. Hypergiant with its partners is building an innovative cloud-based command and control system that seamlessly integrates existing capabilities and provides automation that improves efficiency and effectiveness of mission planning and execution. A perfect candidate is able to write high-quality code, integrate with partner capability providers, and ensure code and product quality. This position will work alongside our development team and other capability providers on highly complex DoD projects.

Requirements

10+ years of professional software development or data engineering experience (6+ with a STEM B.S. or 4+ with a relevant Master's degree)
Strong proficiency in Python and Typescript, familiarity with Java and Bash scripting
Hands-on experience implementing database technologies, messaging systems, and stream computing software (e.g., PostgreSQL, PostGIS, RabbitMQ)
Experience with data fabric development using publish-subscribe models (e.g., Apache NiFi, Apache Pulsar, Apache Kafka and Kafka-based data service architecture)
Proficiency with containerization technologies (e.g., Docker, Docker-Compose, RKE2, Kubernetes, and Microk8s)
Experience with version control systems (e.g., Git), CI/CD tools (e.g., Jenkins), and collaborative development workflows
Strong knowledge of data modeling and database optimization techniques
Familiarity with data serialization languages (e.g., JSON, GeoJSON, YAML, XML)
Excellent problem-solving and analytical skills
Strong communication skills and ability to work in a collaborative environment
Must be a US Citizen and eligible to obtain and maintain a US Security Clearance

Nice To Haves

Experience with Cloud platforms (e.g., AWS, Azure, GCP) and deployment strategies (Ansible, Terraform, WebGL)
Geospatial information system (GIS) experience (e.g., Geoserver)
Data science and experience integrating AI/ML to web-based applications
Experience managing and mentoring development teams in an Agile environment
Experience managing robust build & test tools and implementing workflow automations / scripts
Experience balancing hot and cold data path strategies to meet performance and cost goals
Penchant for learning new technologies, balanced with strong pragmatic thinking
Design-minded attention to detail in data service implementation
Portfolio of past projects with code samples
Ability to travel as needed
Active Security Clearance

Responsibilities

Develop and continuously improve a data service that underpins cloud-based applications
Support data and database modeling efforts
Contribute to the development and maintenance of reusable component libraries and shared codebase
Participate in the entire software development lifecycle, including requirement gathering, design, development, testing, and deployment, using an agile, iterative process
Collaborate with developers, designers, testers, project managers, product owners, and project sponsors to integrate the data service to end user applications
Communicate tasking estimation and progress regularly to a development lead and product owner through appropriate tools
Ensure seamless integration between database and messaging systems and the frontend / UI they support
Ensure data quality, reliability, and performance through code reviews and effective testing strategies
Write high-quality code, applying best practices, coding standards, and design patterns
Team with other developers, fostering a culture of continuous learning and professional growth