Senior/Principal Infrastructure Engineer, Data Centers
About The Position
Utilidata is a fast-growing NVIDIA-backed edge AI company enabling greater visibility and control of power utilization in energy-intensive infrastructure, like the electric grid and data centers. Karman, the company’s distributed AI platform powered by a custom NVIDIA module, is transforming the way utility companies operate the grid edge and will enable data centers to unlock more compute for the same provisioned power. The Infrastructure Engineer is responsible for deploying, configuring, and supporting Karman systems within high-density data center environments, ensuring optimal performance, reliability, and scalability of infrastructure operations. This role provides Tier 3 infrastructure support across Utilidata’s self-hosted data center and partner colocation environments. The engineer will operate across networking, power, Linux systems, and rack infrastructure to ensure high availability and rapid issue resolution in environments where monitoring and visibility are evolving. In addition to operational ownership, this role will contribute to building the policies, tooling, and processes required to deliver robust Tier 3 support. This includes defining incident response practices, escalation paths, root cause analysis standards, and reliability targets (SLAs/SLOs), while improving logging, monitoring, and observability. The engineer will not only resolve complex cross-layer issues, but also drive the systematic improvements needed to reduce recurrence and strengthen long-term reliability across both environments. This position is based onsite at our company headquarters in Ann Arbor, Michigan, with flexibility for occasional remote work. Candidates will be expected to collaborate cross-functionally with remote teams based across the country.
Requirements
- 8+ years of experience with Linux system administration (RHEL, Ubuntu, CentOS, or similar distributions)
- Proven experience deploying and managing applications in high-density data center environments
- Strong understanding of data center infrastructure including rack systems (B300 or equivalent), PDUs, PSUs, cooling systems, and power management
- Hands-on experience with enterprise networking concepts including TCP/IP, DNS, DHCP, VLANs, firewall concepts, routing protocols, switching, and network troubleshooting
- Demonstrated ability to operate effectively in environments with evolving processes and incomplete tooling, using first-principles debugging and cross-domain reasoning.
- Strong ownership mindset with a bias toward proactive improvement rather than reactive ticket resolution.
- Willingness to travel up to 20% of the time, including international travel
Nice To Haves
- Proficiency with configuration management and automation tools (Ansible, Puppet, Chef, or similar)
- Familiarity with tail-scale/wireguard experience
- Experience with monitoring and observability tools (Prometheus, Grafana, ELK stack, or similar)
- Knowledge of containerization and orchestration technologies (Docker, Kubernetes)
Responsibilities
- Deploy and configure Karman systems in high-density data center environments, ensuring adherence to best practices and organizational standards
- Monitor, troubleshoot, and resolve technical issues related to Karman applications, networking, and infrastructure components
- Manage and maintain B300 or equivalent rack systems, including PDU (Power Distribution Units) and PSU (Power Supply Units) configuration and optimization
- Perform Linux system administration tasks including installation, configuration, patch management, and performance tuningDesign and implement network configurations to support Karman deployments, including routing, switching, and connectivity optimization
- Develop a deep understanding of how compute, power, and networking resources are being consumed by internal teams, and proactively identify constraints, risks, and scaling bottlenecks
- Collaborate with cross-functional teams to plan capacity requirements and scale infrastructure to meet growing demands
- Document deployment procedures, configuration standards, and troubleshooting guides for knowledge sharing and operational continuity
- Provide technical support and training to internal teams on Karman system operations and best practices
- Conduct regular system health checks, performance monitoring, and proactive maintenance to prevent downtime
- Participate in on-call rotation to ensure 24/7 system availability and rapid incident response
Benefits
- A flexible work environment with flexible paid time off
- Competitive compensation and benefits, including health, dental, vision, and employer-match 401k
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
