Software Engineer – AI Infrastructure

Bitwise • Laurel, MD

3d • Onsite

About The Position

We're looking for an experienced full-stack Software Engineer to help build the next generation of AI infrastructure that powers innovation across a high-impact national security mission. You'll join an AI infrastructure team and play a central role in designing, building, and operating the platform that serves as the foundation for a broad ecosystem of AI-enabled capabilities — with a primary focus on inference services. This is a role for engineers who can operate independently, navigate ambiguity with confidence, and bring structure to underspecified problems. You won't just be executing tickets — you'll be shaping how AI systems are built and run at scale.

Requirements

• 8 years of relevant experience, with a B.S. in a technical discipline — or 12 years of experience in lieu of a degree
• Proven experience building and maintaining production systems at scale
• Experience with high-volume web application architecture and performance optimization
• Strong background in systems integration across diverse technologies and platforms
• Hands-on experience with cloud engineering in AWS
• Proficiency with Kubernetes administration and deployment patterns
• Strong Python programming skills
• Experience implementing observability solutions (APM, OpenTelemetry, Grafana, Prometheus)
• Familiarity with CI/CD pipelines and DevOps practices
• Strong change management and organizational influence skills
• Ability to thrive in ambiguous environments and create structure where needed
• Excellent communication and collaboration skills
• An active TS//SCI clearance with polygraph

Nice To Haves

• Experience with AI inference serving technologies (vLLM, LiteLLM, etc.)
• Previous experience with agentic frameworks such as LangChain
• Knowledge of vector databases and embedding systems
• Experience with high-performance computing or distributed systems

Responsibilities

• Design, implement, and optimize infrastructure for AI model inference at scale
• Support the development and maintenance of production AI services and applications, including retrieval augmented generation (RAG), autonomous agents, and emerging technologies
• Navigate ambiguity and define solutions where requirements are incomplete or evolving
• Drive adoption of new technologies and engineering practices across teams
• Implement monitoring, logging, and observability solutions for AI services
• Automate infrastructure provisioning and configuration using Infrastructure as Code (IaC) principles
• Ensure high availability, reliability, and performance of AI platform components
• Contribute to security best practices for AI systems and data
• Provide technical guidance and informal mentorship to junior engineers

Benefits

• Pick your PTO — Everyone values time and money differently, so we give you the flexibility to choose between 3 and 5 weeks of PTO with a corresponding adjustment to your pay.
• All 11 federal holidays, paid!
• Up to 2 snow days, paid!
• We'll quadruple (4x!) the first 6% you contribute to your 401(k), giving you up to a 24% company match. Contributing less than 6%? Unclaimed matches come right back to you as extra income, giving you a guaranteed 24% that goes to your retirement, to your paycheck, or both.
• 100% employer-paid medical, dental, vision, life, and disability insurances.
• $5,250 annual education assistance for training, certifications, tuition, and even student loan repayments.
• Spot bonuses for obtained certifications, customer recognition, and just about anything else that makes us go "Hot damn!".
• Flex income

What This Job Offers

• Job Type: Full-time
• Career Level: Senior