Principal Quality Development Engineer

InterSystems•Boston, MA

20h

About The Position

Join InterSystems and help us build the next generation of the EMR. The sheer scale of our capabilities and client engagements and the way we collaborate, operate and deliver value provides an unparalleled opportunity to grow and advance. Choose InterSystems and make delivering innovative work part of your extraordinary career. InterSystems is the place for someone looking for a challenging IT career and access to the kind of training, expertise and development tools that only a large company can offer. Our international reach also means you have the opportunity to be part of a truly global organization of smart, technically minded people. InterSystems employs IT professionals as technical specialists to enhance the quality, performance and usability of innovative products that transform healthcare organizations. Apply your technical skills with cutting-edge tools and technologies to improve patient outcomes. Work as a technical specialist embedded in a cross-functional agile development team focusing on product quality. About the Product: Healthcare organizations in 25 countries are making breakthroughs in patient care with TrakCare and IntelliCare, a unified healthcare information system that enables coordinated care within a hospital or across care settings throughout a region — facilitating a seamless patient journey. Clinicians and administrators use TrakCare and IntelliCare to improve safety and outcomes, control costs by eliminating duplicate tests, reduce medication errors, expedite billing, maximize resource utilization, and achieve other strategic initiatives. Built on InterSystems’ health informatics platform, HealthShare, TrakCare and IntelliCare create a consolidated view of each patient’s history, provide secure access to records at every point of care and on any Internet-connected device, enables interoperability with legacy and future applications, and perform analytics that provide real-time insights to drive fully informed actions.

Requirements

Tertiary qualification in Computer Science or related discipline.
3+ years professional experience.
Comprehensive understanding of AI tools’ capabilities and limitations.
A flexible and adaptable approach to learning and developing new methodology, technologies and software products.
Possesses intellectual curiosity and have a collaborative and personable demeanor.
Experience working with interdisciplinary teams.
Good understanding of the SDLC and software testing principles.

Nice To Haves

Qualifications and/or certifications in AI.
Technical proficiency in multiple programming languages.
System administration or DevOps experience is advantageous.

Responsibilities

Develop, maintain, and implement AI validation methodologies and tools to validate non-deterministic AI-enabled applications in alignment with industry best practices.
Define and standardize non-functional and structural testing strategies to validate application performance, security, and interoperability across various LLM.
Collaborate with Agile teams in TrakCare and HealthShare to incorporate end-user needs and prioritize testing efforts to deliver work of high caliber.
Research and maintain up-to-date industry knowledge and developments in the AI space.
Evaluate and optimize LLM performance, including accuracy, safety, and hallucination detection.
Identify, evaluate, document, and provide clear reporting of results for configuration testing and optimization.
Lead the development of AI test strategies and detailed test plans for releases.
Support QD teams with test design, execution, triage, and reporting practices.
Perform system management tasks to support testing activities.
Design and build custom tools for UI, API, and AI/ML validation.
Provide governance across AI validation activities, operating with managerial and stakeholder oversight.
Perform other duties as directed by the company from time to time.