Cloud Systems Engineer - Site Reliability
About The Position
TherapyNotes is seeking a Site Reliability Engineer to improve the reliability and operability of production services and shared platforms supporting its growing 24×7 SaaS environment. The role applies software and systems engineering practices to improve availability, performance, scalability, resilience, observability, incident response, and operational automation. The engineer partners with software development, infrastructure, database, security, and other technology teams to establish measurable reliability goals, reduce operational toil, and ensure services are supportable throughout their lifecycle. The position owns and improves observability practices, especially Datadog, and designs, implements, and maintains critical high-availability, high-throughput systems. It includes production on-call support and incident management, collaboration on service reliability and operational readiness, and ensuring systems and operational activities comply with organizational security, HIPAA, and operating policies.
Requirements
- Bachelor of Science degree in Information Systems or Engineering, or equivalent experience.
- At least 5 years of engineering experience in Systems Engineering, Cloud or Platform Engineering, DevOps, Software Engineering, and/or SRE.
- Experience designing and operating production systems using cloud-based compute, storage, networking, and containerization technologies.
- Strong Linux systems and networking fundamentals, with experience troubleshooting complex distributed systems in production.
- Expertise with an observability platform.
- Experience with scripting and operational automation using tools such as Bash, PowerShell, or Python, along with infrastructure-as-code and configuration-management practices.
- Experience participating in production on-call rotations, incident response, root cause analysis, and post-incident improvement.
- Experience working in Agile/DevOps environments and operating production services using ITSM practices where applicable.
Nice To Haves
- Azure and Kubernetes experience preferred.
- Datadog experience strongly preferred; experience with Prometheus, Grafana, New Relic, or equivalent platforms is valuable.
- Prior software development experience, or experience investigating application behavior through code, logs, and distributed traces.
Responsibilities
- Own and continuously improve the use of Datadog to make reliability visible and actionable across metrics, logs, traces, dashboards, monitors, alerts, and service-level views.
- Design, implement, and maintain high-availability, high-throughput, data- and compute-intensive critical systems supporting a growing 24×7 SaaS platform.
- Partner with service owners to define and improve reliability using meaningful SLIs, SLOs, error budgets, actionable alerting, and operational-readiness practices.
- Participate in and help drive production incident management, serving as an incident commander or technical responder as needed; coordinate triage, service restoration, escalation, communication, documentation, root cause analysis, and corrective actions.
- Partner with development teams to investigate infrastructure- and application-layer issues using metrics, logs, distributed traces, and code-level context.
- Improve deployment safety and service resilience through automated validation, recovery and rollback capabilities, reliability testing, and analysis of system failure modes.
- Partner with technical leaders to ensure new systems are supportable and maintainable by development and operations teams.
- Provide escalated technical guidance and support to technology teams throughout the organization.
- Provide on-call coverage for production support and perform other duties as required.
- Ensure supported systems and operational activities comply with organizational security, HIPAA, and operating policies.
- Identify and eliminate repetitive operational toil using Bash, PowerShell, Python, or Ansible.
- Manage infrastructure as code using Terraform/OpenTofu and configuration automation using Ansible.
Benefits
- Competitive salary of $110,000–$130,000.
- Employer-sponsored health, dental, vision, life, and disability insurance.
- Retirement plan with company contribution.
- Annual company profit sharing.
- Personal development/training budget.
- Open, collaborative work environment.
- Extensive two-week onboarding plan.
- Comprehensive mentorship program.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
