Senior Software Engineer – AI Infrastructure

Bitwise • Laurel, MD

15h • Onsite

About The Position

Bitwise is seeking a Senior Software Engineer to contribute to the development of next-generation AI infrastructure. This is a full-stack, hands-on role with significant technical leadership responsibilities within a small, integrated team. The position involves designing and operating critical AI platform components, focusing on scalable inference services and the AI application ecosystem. Responsibilities include writing code, architecting systems, making technical decisions, mentoring teammates, coordinating cross-team initiatives, and shaping the technical direction of the platform.

Requirements

• 12 years of relevant experience; a B.S. in a technical discipline is required, or 4 additional years of experience in lieu of a degree
• Extensive experience designing, building, and operating large-scale production systems
• Deep expertise in systems integration across diverse technologies and platforms
• Hands-on cloud engineering experience in AWS
• Advanced proficiency with Kubernetes administration and deployment patterns
• Strong Python programming skills
• Experience implementing and scaling observability solutions (APM, OpenTelemetry, Grafana, Prometheus)
• Proven ability to lead technical initiatives and influence organizational change
• Experience developing technical policies and governance frameworks
• Excellent communication, stakeholder management, and leadership skills
• Ability to balance hands-on engineering with leadership and coordination responsibilities
• Active TS/SCI clearance with polygraph

Nice To Haves

• Experience with AI inference serving technologies such as vLLM or LiteLLM
• Previous experience with agentic frameworks, particularly LangChain
• Knowledge of vector databases and embedding systems
• Experience with high-performance computing or distributed systems
• A track record of successfully driving technical and cultural change within engineering organizations

Responsibilities

• Design, implement, and optimize infrastructure for AI model inference at scale
• Lead the development and maintenance of production AI services and applications, including retrieval augmented generation (RAG), autonomous agents, and other emerging technologies
• Serve as the technical lead for AI infrastructure initiatives, coordinating work across integrated teams
• Conduct regular one-on-ones and provide coaching, feedback, and support for assigned team members
• Act as the team point of contact for contract administration functions
• Navigate ambiguity and define solutions for complex, underspecified systems and requirements
• Establish technical policies, standards, and governance frameworks where gaps exist
• Drive adoption of new technologies and engineering practices across the organization
• Implement and oversee monitoring, logging, and observability solutions for AI services
• Ensure the high availability, reliability, performance, and security of AI platform components
• Communicate clearly and confidently with stakeholders at multiple organizational levels

Benefits

• Top salaries
• Flexible PTO (3-5 weeks with corresponding pay adjustment)
• Paid federal holidays (11)
• Paid snow days (up to 2)
• 4x match on the first 6% of 401(k) contributions (up to 24% company match)
• 100% employer-paid medical, dental, vision, life, and disability insurances
• Option to trade health insurance benefit for salary increase
• $5,250 annual education assistance for training, certifications, tuition, and student loan repayments
• Spot bonuses for obtained certifications, customer recognition, etc.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior