Senior Monitoring Engineer

Sanford Health•Sioux Falls, SD

10h•Onsite

About The Position

Sanford Health, the largest rural health system in the United States, is dedicated to transforming the health care experience and providing access to world-class health care in America’s heartland. The Sanford monitoring team is a new team and currently reviewing and deploying new tools and processes to improve the enterprise monitoring and observability of the environment. This is an opportunity to join the team on the ground floor and help to build out this critical team. The Senior Monitoring Engineer is responsible for delivering and supporting large-scale network, system, application, service, and business activity monitoring and alerting solutions.

Requirements

Bachelor’s degree in Computer Information Systems, Computer Science, Systems Administration or related field required.
Must have a minimum of two years in a hands-on technical operations role with an emphasis on monitoring functions, as well as at least five years industry experience supporting an enterprise environment.
Must have experience implementing enterprise monitoring platforms, maintaining and supporting solutions such as: Dynatect, PagerDuty, VictorOps, Solarwinds, Cacti, Nagios, Zabbix, Data Dog, AppDynamics or New Relic.
In addition, must have experience with log aggregation or SEIM solutions such as LogRythm, Splunk, Graylog, Scalyr or ELK.

Nice To Haves

Experience in a healthcare setting and ServiceNow Event Management experience preferred.
Strong technical background including experience in JSON, Rest API and PowerShell a plus, as well as scripting experience in language such as Python, Perl, PowerShell, bash, VBScript, etc.

Responsibilities

In close partnership with other IT groups, design and deploy monitoring solutions covering databases, networks, infrastructure services, applications and mission critical health care systems.
Create and drive strategy and standardization of monitoring across the enterprise.
Ensure accurate collection of metrics at the right frequency, verifying the data is readily available for alerting, reporting, and analysis.
Work with teams to put monitoring solutions of critical systems and network infrastructure into place to ensure high availability and reduce impact of issues.
Create and maintain dashboards pulling together monitoring across multiple teams within the same tool as well as across multiple tools.
Maintain platform health by keeping current on upgrades and patches by troubleshooting and resolving issues independently and/or with vendor support.
Participate in planning for deployments/provisioning to ensure that monitoring requirements are accounted for.
Assist with writing or working with additional teams to define scripts and queries that can help with environment self-healing capabilities.
Report on status of operational services, log and performance and other trend analyses.
Work closely with backend engineering teams and support engineers to ensure monitoring/alerting work seamlessly with Incident Management response protocols.
Create and maintain reports showing volume/type/performance of teams relating to monitoring.
Identify and track problem patterns and develop proactive solutions.
Collaborates with peers in coordinating, responding and implementing responses to IT infrastructure issues.
Make recommendations on how to grow, optimize and mature Sanford Health's Enterprise Monitoring program.
Conscientiously consider patient safety, ethics, industry standards, and known regulations in decisions and practices regarding the design, operation, maintenance and use of the computer systems.
Leverage advanced skills to assist and mentor other team members and in support of departmental goals.
Provide guidance and mentorship to all engineers.
Must have strong communication skills, both written and verbal and be comfortable interfacing with all levels of leadership.
Performs other functions that by be assigned.