Forward Deployed Data Engineer (Groton, CT / Senior) [Secret]
About The Position
We’re seeking a skilled Forward Deployed Data Engineer to build the next-generation data management and artificial intelligence platform for maritime domain awareness. As a forward-deployed engineer, you’ll work on-site with customers — writing code, integrating systems, and solving hard problems in the field. You’re part engineer, part technical advisor, and wholly accountable for making the mission succeed. The position requires a current or active U.S. Secret clearance. Spear AI is a growing defense contracting company dedicated to delivering cutting-edge solutions that support our nation’s security. As we expand, we’re building a culture where innovation meets mission-critical work. We operate with a flat organizational structure that empowers every team member to make an impact, collaborate directly with leadership, and contribute to projects that matter. Whether you’re joining our Hardware, Software, or Services division, you’ll work alongside talented professionals who are committed to excellence and advancing the capabilities that keep our nation safe and secure. Spear AI builds sonobuoy sensors that are deployed into the water and collect edge data. We also work with the U.S. Navy to collect and process their SONAR data. You’ll have an opportunity to work on real-world projects that directly impact warfighter capabilities and mission success.
Requirements
- Strong Software Engineering skills
- Fanatical about polish: code is linted, formatted, fully typed, and has 100% test coverage.
- Care about correctness: take pride in building trustworthy libraries and services.
- Obsess over performance: focus on Lighthouse scores and query speed.
- Dive deep: understand how things work, build prototypes, and set up experiments.
- Live on the bleeding edge: excited about upcoming platform features.
- Great teacher: able to break down concepts for specific audiences.
- Expertise in time-series data processing and analysis (windowing, resampling, interpolation, etc.)
- Proficiency in Python and Rust for data engineering workflows.
- Experience with binary message parsing.
- Experience with row-based & columnar-based data formats.
- Experience with OLTP & OLAP databases.
- Knowledge of distributed systems, streaming architectures, and batch processing patterns.
- Hands-on experience with a batch orchestrator such as Dagster/Airflow.
- Hands-on experience with a streaming platform such as Redpanda/Kafka.
- Hands-on experience with binary message formats such as Protobuf.
Nice To Haves
- Experience with IoT devices and sensors.
- Digital signal processing experience.
- Geospatial analysis and GIS experience.
- Familiar with working in monorepos.
Responsibilities
- Implement real-time data pipelines with MQTT and Redpanda for stream processing.
- Implement offline data pipelines using Dagster for batch processing.
- Parse and process binary message formats from various data sources.
- Build data warehouses using Postgres, Apache Iceberg, Parquet, and S3.
- Design data models that allow for high-performance queries.
- Validate and normalize data sources.
- Improve local development and CI/CD using modern tooling and GitHub Actions.
Benefits
- Unlimited PTO
- Dedicated sick time
- Comprehensive health and benefits – Medical, dental, and vision coverage
- 11 Paid Holidays
- Professional development
- Collaborative environment
- Mission-driven work
- Growth opportunities
- 401(k) with company match.
- Onsite / Remote / Flexible work arrangements or hybrid options (position dependent).
- Relocation assistance (position dependent).
- Referral bonuses.
- Performance bonuses.
- Life insurance and disability coverage.
- Technology home office setup stipend.
- Professional certification reimbursement (position dependent).
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
