Software Engineer – AI/ML QA Engineer

Lumen Solutions Group Inc • Columbia, MD

6d • Hybrid

About The Position

We are seeking a Software Engineer / AI/ML QA Engineer with strong experience in QA automation, Salesforce, AI/ML, and Generative AI testing. The ideal candidate will have hands-on experience testing LLMs, RAG applications, prompts, ML models, APIs, chatbots, and AI-powered workflows, along with strong Selenium/BDD automation, SQL, and Oracle skills.

Requirements

• 3+ years of Software Engineering experience.
• 1–2 years of hands-on AI/ML/Generative AI project experience.
• 3+ years of Cloud experience with AWS, GCP, or another major cloud platform.
• Strong QA/Software Testing experience, including AI/ML outputs and chatbot responses.
• Strong hands-on experience with Selenium, BDD, and test automation.
• Experience with API, UI, manual, and automation testing.
• Strong SQL skills and experience with Oracle.
• Understanding of relational and non-relational databases.
• Understanding of data pipelines and ability to validate intermediate pipeline outputs.
• Experience working with Jira and Confluence.
• Bachelor's degree required; technical degree preferred.

Nice To Haves

• Experience with AWS Bedrock and/or SageMaker.
• Experience with AI/ML testing frameworks.

Responsibilities

• Test and validate AI/ML and Generative AI applications, including LLM responses, prompts, model predictions, and end-to-end workflows.
• Develop test strategies for AI-powered applications and non-deterministic GenAI outputs.
• Perform manual, exploratory, API, UI, and automated testing for Salesforce and AI/ML applications.
• Develop and maintain automated test suites using Selenium, BDD, and related automation frameworks.
• Test Salesforce Einstein and integrations with external LLM/AI platforms.
• Validate RAG pipelines, embeddings, vector databases, ML pipelines, and intermediate data outputs.
• Evaluate AI applications for accuracy, hallucinations, bias, model drift, and safety.
• Write and execute complex SQL queries across multiple databases, with strong Oracle experience.
• Collaborate with Product Owners, Developers, Data Scientists, and Business stakeholders to define requirements and testing strategies.
• Participate in Agile ceremonies and maintain project documentation using Jira and Confluence.

What This Job Offers

• Job Type: Full-time
• Career Level: Entry Level