Conversational AI | Prompt Engineer

Medfar

1d • Hybrid

About The Position

As a Senior Prompt Designer, you will play a defining role in shaping the quality, reliability, and evolution of MEDFAR's generative AI features — most notably CoeurWay , our AI-powered clinical scribe, and emerging AI capabilities within MYLE EMR. Reporting to the Director of UX, you will sit at the intersection of product, clinical quality, and AI craft, working closely with product designers, developers, QA, and client-facing teams to ensure that every AI-generated output meets the high standards required in a healthcare setting. This is a senior individual contributor role with a clear growth path toward mentoring and leading a prompt engineering practice as MEDFAR's AI product surface expands.

Requirements

• 5+ years of professional experience in AI/ML, product development, computational linguistics, or a closely related field.
• 2+ years of hands-on prompt engineering experience in production LLM systems, ideally in a B2B SaaS or regulated industry context.
• Demonstrable experience decomposing complex prompts into modular, chained architectures (e.g., using patterns such as prompt chaining, routing, reflection, or tool use).
• Experience designing or significantly improving LLM evaluation frameworks — rubric design, inter-rater alignment, and failure mode analysis.
• Strong familiarity with frontier commercial LLM APIs (OpenAI, Anthropic, Google, etc.) and the practical tradeoffs between them.
• Advanced proficiency in English, both written and spoken; French is also required due to frequent client interactions.

Nice To Haves

• Experience working within or alongside healthcare, clinical, or life sciences domains is a strong asset.
• Proficiency in Python or another scripting language for building eval pipelines or prompt tooling is an asset.
• Experience with self-hosted or open-weight models is an asset.

Responsibilities

• Audit and re-architect CoeurWay's existing monolithic prompts into a modular chain of focused, maintainable prompts — improving robustness, debuggability, and adaptability.
• Lead the selection, evaluation, and pairing of language models to specific prompt tasks, fostering a model-agnostic approach that reduces vendor dependency and optimizes for quality and cost.
• Own the quality of AI-generated clinical outputs: define what "good" looks like, identify failure modes, and drive continuous improvement through structured validation processes.
• Evolve and re-align our existing evaluation framework, currently covering 7 clinical note quality rubrics, improving its coverage, automation potential, and alignment with clinical ground truth.
• Establish and maintain a systematic approach to output validation, including edge case identification, regression testing for prompt changes, and documentation of known limitations.
• Design and implement new prompts and evaluation suites to support new features in CoeurWay and MYLE EMR.
• Collaborate with the GenAIOps to ensure prompts are production-ready — observable, versioned, and deployable through established CI/CD processes.
• Develop a deep understanding of clinical workflows and the needs of healthcare providers, maintaining close relationships with client-facing teams and end users.
• Stay current on the rapidly evolving LLM landscape — new models, prompting techniques, evaluation methodologies — and bring relevant findings back to the team.
• Contribute to internal documentation, standards, and best practices for prompt engineering at MEDFAR.
• Mentor future prompt designers as the team grows, and participate in hiring decisions as the practice scales.

Benefits

• RRSP contribution
• Healthcare insurance from day one
• Paid time off: 3 weeks + 1 additional week between Christmas and New Year
• Annual training allowance ($1,500) to support your professional development
• An onboarding program to help you get familiar with our environment and the digital healthcare field
• All IT equipment is provided, with additional gear if needed
• Internal growth opportunities (promotions, internal mobility)
• Support from a wellness and social committee, with initiatives to foster team cohesion, mental health, and employee well-being
• A company culture focused on transparency, collaboration, and innovation

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed