Software ML Test Engineer, Senior Staff

d-Matrix • Santa Clara, CA

5h • Hybrid

About The Position

At d-Matrix, we are focused on unleashing the potential of generative AI to power the transformation of technology. We are at the forefront of software and hardware innovation, pushing the boundaries of what is possible. Our culture is one of respect and collaboration. We value humility and believe in direct communication. Our team is inclusive, and our differing perspectives allow for better solutions. We are seeking individuals passionate about tackling challenges and are driven by execution. Ready to come find your playground? Together, we can help shape the endless possibilities of AI.
The role requires you to be part of the team and to lead junior team members with test planning, test automation, and test execution to help productize the d-Matrix AI compute engine. As part of the Software Qualification team, you will be responsible for the development of the test suites, the test cases, and the test infrastructures. You will work side by side with the software development teams to design, automate, and execute both software and system use cases that are applicable to the features and the functionalities as well as the deployment scenarios for the next-gen AI chip software stack. You will implement Python programs to test workloads and ML models within the Pytest framework. You will implement and improve the d-Matrix end-to-end test suite along with the regression test suite in CI/CD infrastructure using the pytest framework along with Jenkins and GitLab. You will collaborate with the product team, the software development team, and the systems team on the test coverage and the test results. You will be fully engaged with the test case implementation and the software bug triaging and debugging. You are fluent in advanced Python programming with the ability to write data structures and algorithms and apply them to testing.

Requirements

• MS or PhD preferred in Computer Science, Electrical Engineering, or related degree with 5+ Years of Industry Experience
• Strong grasp of large language models and machine learning fundamentals
• Experience with Deep Learning, Tensorflow, Transformers, and PyTorch testing
• Proficient in Python development, Python Data Structures, and Linux environments
• Self-motivated team player with a strong sense of ownership and leadership

Nice To Haves

• Prior startup, small team experience
• Experience with Machine Learning models and their layers
• Experience testing and automating at-scale ML kernels, MLIR, LLVM, Matmuls, and Numpy workloads
• Fluency with Gitlab CI/CD infrastructure

Responsibilities

• Lead junior team members with test planning, test automation, and test execution
• Responsible for the development of the test suites, the test cases, and the test infrastructures
• Work side by side with the software development teams to design, automate, and execute both software and system use cases
• Implement Python programs to test workloads and ML models within the Pytest framework
• Implement and improve the d-Matrix end-to-end test suite along with the regression test suite in CI/CD infrastructure using the pytest framework along with Jenkins and GitLab
• Collaborate with the product team, the software development team, and the systems team on the test coverage and the test results
• Engage with the test case implementation and the software bug triaging and debugging

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Number of Employees: 251-500 employees