Senior Infrastructure Engineer
About The Position
The Senior Infrastructure Engineer will operate and improve the software infrastructure used by d-Matrix engineers to build and test, as well as the systems supporting externally accessible product demos. The environment includes cloud resources, conventional servers, AI accelerators, and networking hardware. This role owns first response and end-to-end resolution of infrastructure issues, diagnosing and addressing problems or coordinating with IT or the product software group when the root cause lies with them. IT owns physical hardware; this team manages systems from the operating system up. The role is not an IT support or ticket-queue position, and on-call participation is expected. The engineer will handle recurring operational work, improve monitoring and alerting, and convert repeat incidents into automation and runbooks. The role also contributes to design and build work across the team’s systems as its scope grows.
Requirements
- At least 2 years operating production Linux systems, including hands-on Kubernetes troubleshooting.
- Methodical debugging skills, including forming hypotheses, narrowing them quickly, and working across layers when the obvious answer is wrong.
- Scripting experience in Python and/or Bash.
- Familiarity with CI/CD systems; GitLab is preferred.
- Working knowledge of networking fundamentals, including DNS, routing, load balancing, and TLS.
- Experience with monitoring and observability tools.
- Clear communication under pressure, including concise incident status updates.
- Drive and curiosity to learn unfamiliar systems and how state-of-the-art inference systems are built.
Nice To Haves
- Experience with GPU or accelerator nodes in Kubernetes.
- Experience with infrastructure-as-code tools such as Ansible or Terraform.
- Experience with monitoring platforms such as DataDog, Prometheus, or Grafana.
- Bare metal or on-premises infrastructure experience.
- CKA or CKAD certification.
Responsibilities
- Own first response and resolution for issues across Kubernetes clusters, GitLab and CI runners, virtual machines, standalone systems, and demo environments.
- Triage issues across teams with IT and the product software group when the root cause is on their side.
- Convert recurring issues into automation, alerts, and runbooks to reduce repeat incidents.
- Improve monitoring and alerting to reduce false alarms and speed detection of real problems.
- Perform routine operational work, including upgrades, patching, certificate renewals, and capacity checks.
- Deliver automation and improvements the team relies on, beyond individual fixes.
- Participate in on-call coverage for the environment.
- Contribute to design and build work across the team’s systems as scope grows.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
