Junior Software Engineer

Belay Technologies•Fort Meade, MD

3d•$70,000 - $190,000

About The Position

Belay Technologies is seeking a Software Engineer to join their intel team. The role involves building and maintaining the foundation for customer AI capabilities and supporting a broader ecosystem of AI-enabled applications. The focus will be on ensuring access to high-quality LLMs throughout the inference software stack. This position requires continuous learning and adaptation to evolving mission needs and emerging technologies, turning loosely defined problems into working solutions.

Requirements

TS/SCI Clearance with polygraph
3 yrs., B.S. in a technical discipline or 4 additional yrs. in place of B.S.
Experience with Python and/or other modern programming languages.
Familiarity with Argo CD and/or other CI/CD frameworks.
Experience with Kubernetes/Helm.
Familiarity with AWS or other cloud service providers.
Ability to learn new technologies quickly.
Strong communication skills and willingness to ask questions.

Nice To Haves

Experience with vLLM, LiteLLM, or similar inference-serving frameworks.
Experience with other LLM hosting frameworks and practices.
Experience supporting production software using Site Reliability Engineering (SRE) best practices.
Experience with Elastic, Grafana/Prometheus, or other observability frameworks and practices.
Experience with Docker and containerization.
Experience in traffic shaping and quality-of-service engineering.
Knowledge of and interest in hosting AI capabilities.

Responsibilities

Procure, configure, and test new inference models, preparing them for release to our user base.
Develop in-house services and techniques to guarantee continual high-quality inference service for our customer.
Work with model vendor teams and representatives to create reliable pipelines for closed-source model usage.
Collaborate with teammates on surge efforts to support short-term, high-priority inference needs from our customer.
Engage with other teams in our organization to establish solid infrastructure for our services and integrate LLM-powered tools for user needs.

Benefits

8 weeks paid leave - 4 weeks of personal leave, 3 Yay! days, take off on your birthday,11 paid holidays and optional leave up to 6 days through Belay's volunteer program
10% matching in 401(k) contributions vested on day one
$5,000 annual training/tuition
Student Loan Repayment Program
100% company-funded HSA
Rich medical coverage (100% coinsurance)
Dental coverage including orthodontia
Up to $420,000 in life insurance, premiums 100% company funded
Amazon Prime, gym reimbursement, monthly lunches, games and prizes
Pet adoption program, generous referral bonus program, fun events, and more!