Senior AI Software Engineer
KMM Technologies•Reston, VA
•Hybrid
About The Position
You will work at the intersection of AI engineering, cloud architecture, and product development, building intelligent systems that leverage multiple foundation models for reasoning, automation, and data-driven insights. This is a hands-on role for engineers passionate about transforming cutting-edge AI capabilities into robust, scalable commercial applications.
Requirements
- 6+ years software engineering experience
- 3+ years building AI/ML-powered applications
- Experience deploying AI systems into production
- Hands-on experience with LLM APIs or foundation models
- Experience building RAG systems, AI copilots, conversational agents, automated workflows, AI-driven analytics, document AI solutions
- Python
- Java / TypeScript / Go (any backend language)
- FastAPI
- Terraform
- Vector databases (pg-vector, S3-vector, OpenSearch, FAISS)
- Embeddings and semantic search
- Prompt engineering
- Tracing, hallucination detection, cost monitoring, prompt performance, drift detection
- Model evaluation frameworks
- Experience with LangChain, LangGraph, LlamaIndex, or AI orchestration frameworks
- Experience with multi-model routing systems
- Experience building AI agents or tool-using LLMs
- Knowledge of AI safety, guardrails, and prompt management
- Experience deploying models with Docker and Kubernetes
- MCP, FastMCP
- Reinforcement Learning
- AWS SageMaker with MLOPs
- Experience with Bedrock API [Like from Lambda or Other services]
Nice To Haves
- Thinks like a systems architect and builder
- Has shipped real AI products to production
- Understands tradeoffs between models
- Can design robust AI pipelines
- Is comfortable working with rapidly evolving AI technologies
Responsibilities
- Design and develop production AI applications using models available via AWS Bedrock and external providers
- Create pipelines for embeddings, document ingestion, knowledge indexing, and model evaluation
- Design high-performance AI APIs and microservices
- Optimize latency, reliability, and cost of model inference
- Implement evaluation pipelines and monitoring for AI systems
- Build an enterprise knowledge assistant using Bedrock
- Create AI agents that automate complex workflows
- Develop document intelligence pipelines for financial or operational data
- Design multi-model orchestration frameworks
- Optimize LLM cost, latency, and reliability
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Upload and Match Resume
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
