Software Developer In Test

TEKsystems•Seattle, WA

1d•$55 - $55•Onsite

About The Position

As a Software Development Engineer 2 on this team, you will be working on Test automation frameworks and ML evaluation solutions development. This position requires someone comfortable will all aspects of the software development lifecycle, that thrives in a dynamic cross-functional organization, is not afraid to debate ideas openly, and is flexible enough to pivot on constantly evolving requirements. Job Summary Play a part in the next revolution in human-computer interaction and redefine mobile computing through voice interaction! Looking for a passionate and skilled engineer to join our mission of delivering the highest quality AI experiences to millions of users worldwide. In this role, you will be instrumental in ensuring the highest quality by developing and deploying innovative solutions for automated testing, anomaly detection, and performance analysis. You will work on a diverse set of problems, from predicting potential regressions to creating intelligent systems that can identify subtle quality issues before they impact users. Description We are seeking a Software Engineer to join our AI Client Platforms Quality Engineering team. In this role, you will be dealing with high volumes of test data and evaluation pipelines requiring both technical depth and creative thinking to build solutions that can keep pace with the rapid evolution of AI technologies. You will be responsible for designing, driving, triaging, evaluating automation results that support the qualification of AI features, not just validating what features are supposed to do, but creatively measuring qualitative experiences the way a real user would. This means going beyond pass/fail metrics and thinking deeply about how our responses feel, how natural the interactions are, and how well the product truly serves our customers in the real world. You will work closely with Product, Platform engineers, and program managers to understand how it behaves, how they evolve, and how changes in the underlying AI stack ripple through to the customer experience. Your insights and findings will directly influence product decisions, model improvements, and feature launches. We are a fast-paced, and deeply collaborative team that values the tight relationship between Quality engineering, Product engineering, and program management. We move quickly, we hold ourselves to the highest standards, and we genuinely care about the products we build. If you are someone who thrives in an environment where your work matters, where innovation is encouraged, and where you can see the direct impact of your contributions on a global scale, this is the team for you.

Requirements

5+ years of industry experience in the relevant space.
3+ years of experience in machine learning, including hands-on work with LLMs.
Strong programming skills in Python and experience with ML/NLP libraries
Understanding of prompt engineering, agentic workflow and retrieval-augmented generation (RAG)
Experience developing LLM based automated evaluation frameworks
Proficiency with software revision control (e.g. Git) and CI/CD systems (e.g. Jenkins)
Strong communication and collaboration skills, with the ability to work effectively with cross-functional teams
BS/MS in Computer Science, Engineering, or a related field.

Nice To Haves

Experience in Swift/XCTest/XCUITest is preferred
Excellent problem-solving, analytical, and debugging skills
Experience working with large-scale datasets, infrastructure, and/or data formats (e.g., JSONL, protobuf)
Experience with large-scale data processing (e.g., Spark, Hadoop) is a plus
Comfortable working in a fast-paced, collaborative environment with shifting priorities

Responsibilities

designing, driving, triaging, evaluating automation results that support the qualification of AI features
creatively measuring qualitative experiences the way a real user would
thinking deeply about how our responses feel, how natural the interactions are, and how well the product truly serves our customers in the real world
work closely with Product, Platform engineers, and program managers to understand how it behaves, how they evolve, and how changes in the underlying AI stack ripple through to the customer experience
Your insights and findings will directly influence product decisions, model improvements, and feature launches.