AI/LLM Engineer

Ostro Health

3h•Remote

About The Position

At Ostro, we are transforming how life sciences connect with the people who need their innovations most. We help millions live healthier lives by bridging the gap between those who make medicines, treatments, and diagnostics — and those who take them. Our patent-pending AI technology powers personalized healthcare journeys that make access to trusted information as seamless and intuitive as the best consumer experiences. As the leader in AI-powered omnichannel engagement for life sciences, Ostro is trusted by a majority of the world’s top 20 pharmaceutical companies. We are not your typical life sciences company. Our team brings together experts from leading healthcare and life sciences organizations alongside product and engineering talent from some of the world’s most innovative technology companies. This mix of scientific, regulatory, and consumer expertise allows us to reimagine how information flows between patients, providers, and the brands that serve them. We are a remote-first team united by curiosity, honesty, and a shared passion for improving healthcare. We call ourselves Ostronauts — explorers building the future of life sciences together. If you thrive in a collaborative, fast-moving environment and want your work to make a measurable impact on global health, come join us as we shape the next era of intelligent life sciences commercialization. We are seeking an AI/LLM Engineer to help us continue to scale and expand our established AI/LLM products, with a focus on the development of next generation features. This role involves designing and delivering scalable services for Ostro’s SaaS platform, with a strong emphasis on integrating and leveraging large language models. You will help to identify, create, and implement features and improvements, balancing speed of delivery with long-term maintainability. You will also play a key role in supporting our engineering best practices by ensuring reliable testing, clean architecture, and low technical debt — all while helping us move at startup speed.

Requirements

Experience shipping LLM pipelines including preprocessing, prompt optimization, output validation, and fallback mechanisms
Experience with production use of LLM APIs (e.g., OpenAI, Gemini)
Experience building systems to measure model performance, detect drift, and ensure output quality in production environments.
Proficiency in prompt engineering and/or have developed systematic approaches to prompt design
Proficiency with Python and Django (or similar frameworks)
Strong collaboration and communication skills in cross-functional environments
Bachelor’s degree in computer science or related field, or equivalent work experience
3+ years of experience as a Software Engineer

Nice To Haves

Docker/Kubernetes
CI/CD pipelines (GitLab CI, Github actions, Jenkins, etc.)
Working in highly regulated industries (e.g., healthcare, pharma, fintech)
Experience with async tasks and workflows (such as Celery)
Shipping production code for B2B software products
Relational databases (PostgreSQL preferred)

Responsibilities

Develop performant, scalable, and high quality APIs and backend processes for Ostro's SaaS platform, with a strong emphasis on LLM integration.
Collaborate with cross-functional teams to implement new features and refine existing ones, particularly those involving AI/LLM capabilities.
Provide feedback on roadmap and features for your team, contributing to the strategic direction of Ostro’s AI/LLM initiatives.
Ensure code quality and compliance through thorough reviews, unit testing, and adherence to best practices for LLM-powered applications and Ostro engineering.
Optimize application performance and scalability to meet user demands, especially for LLM inference and data processing.
Stay informed about emerging AI/LLM technologies, prompt engineering techniques, and industry trends.
Troubleshoot and resolve production issues, ensuring performance, reliability, and scalability of LLM-driven features.

Benefits

Impacting the future of healthcare - your innovations could very likely become the new norm for millions of people.
Working alongside the founders of the company. If you have any entrepreneurial desire to start your own company in the future, you will see first-hand what it takes.
100% fully remote but with frequent opportunities to collaborate in-person.
Technology & office setup reimbursement.
Freedom and responsibility to structure your work as you desire. We measure output and results and believe freedom allows for maximum ability.
Unlimited PTO, plus two extended company-wide closures per year!
Family leave: up to 10 weeks of 100% paid salary.
Open communication - we believe in being transparent and radically honest with no retaliation.
Competitive salary and equity.
Medical/dental/vision benefits and more.