Senior Monitoring Engineer

Sanford Health•Sioux Falls, SD

3d•$33 - $52•Onsite

About The Position

The Senior Monitoring Engineer is responsible for delivering and supporting large-scale network, system, application, service, and business activity monitoring and alerting solutions. In close partnership with other IT groups, design and deploy monitoring solutions covering databases, networks, infrastructure services, applications and mission critical health care systems. Create and drive strategy and standardization of monitoring across the enterprise. Ensure accurate collection of metrics at the right frequency, verifying the data is readily available for alerting, reporting, and analysis. Work with teams to put monitoring solutions of critical systems and network infrastructure into place to ensure high availability and reduce impact of issues. Create and maintain dashboards pulling together monitoring across multiple teams within the same tool as well as across multiple tools. Maintain platform health by keeping current on upgrades and patches by troubleshooting and resolving issues independently and/or with vendor support. Participate in planning for deployments/provisioning to ensure that monitoring requirements are accounted for. Assist with writing or working with additional teams to define scripts and queries that can help with environment self-healing capabilities. Report on status of operational services, log and performance and other trend analyses. Work closely with backend engineering teams and support engineers to ensure monitoring/alerting work seamlessly with Incident Management response protocols. Create and maintain reports showing volume/type/performance of teams relating to monitoring. Identify and track problem patterns and develop proactive solutions. Collaborates with peers in coordinating, responding and implementing responses to IT infrastructure issues. Make recommendations on how to grow, optimize and mature Sanford Health's Enterprise Monitoring program. Conscientiously consider patient safety, ethics, industry standards, and known regulations in decisions and practices regarding the design, operation, maintenance and use of the computer systems. Leverage advanced skills to assist and mentor other team members and in support of departmental goals. Provide guidance and mentorship to all engineers. Must have strong communication skills, both written and verbal and be comfortable interfacing with all levels of leadership. Performs other functions that by be assigned.

Requirements

Bachelor’s degree in Computer Information Systems, Computer Science, Systems Administration or related field required.
Minimum of two years in a hands-on technical operations role with an emphasis on monitoring functions.
At least five years industry experience supporting an enterprise environment.
Strong communication skills, both written and verbal.
Comfortable interfacing with all levels of leadership.

Nice To Haves

Experience in a healthcare setting.
ServiceNow Event Management experience.
Strong technical background including experience in JSON, Rest API and PowerShell.
Scripting experience in language such as Python, Perl, PowerShell, bash, VBScript, etc.
Experience implementing enterprise monitoring platforms, maintaining and supporting solutions such as: Dynatrace, PagerDuty, VictorOps, Solarwinds, Cacti, Nagios, Zabbix, Data Dog, AppDynamics or New Relic.
Experience with log aggregation or SEIM solutions such as LogRythm, Splunk, Graylog, Scalyr or ELK.

Responsibilities

Deliver and support large-scale network, system, application, service, and business activity monitoring and alerting solutions.
Design and deploy monitoring solutions covering databases, networks, infrastructure services, applications and mission critical health care systems.
Create and drive strategy and standardization of monitoring across the enterprise.
Ensure accurate collection of metrics at the right frequency, verifying the data is readily available for alerting, reporting, and analysis.
Implement monitoring solutions for critical systems and network infrastructure to ensure high availability and reduce impact of issues.
Create and maintain dashboards pulling together monitoring across multiple teams and tools.
Maintain platform health by keeping current on upgrades and patches, troubleshooting and resolving issues independently or with vendor support.
Participate in planning for deployments/provisioning to ensure monitoring requirements are accounted for.
Assist with writing or working with additional teams to define scripts and queries for environment self-healing capabilities.
Report on status of operational services, log and performance, and other trend analyses.
Ensure monitoring/alerting work seamlessly with Incident Management response protocols.
Create and maintain reports showing volume/type/performance of teams relating to monitoring.
Identify and track problem patterns and develop proactive solutions.
Collaborate with peers in coordinating, responding, and implementing responses to IT infrastructure issues.
Make recommendations on how to grow, optimize, and mature Sanford Health's Enterprise Monitoring program.
Consider patient safety, ethics, industry standards, and known regulations in decisions and practices regarding the design, operation, maintenance, and use of computer systems.
Leverage advanced skills to assist and mentor other team members and support departmental goals.
Provide guidance and mentorship to all engineers.