Senior Systems Engineer, Qolo

CSI•Remote - Florida, FL

About The Position

The Senior Systems Engineer is the technical and day-to-day team lead for Qolo’s Production Support / Site Reliability Engineering (SRE) team. The role is responsible for the stability, integrity, and availability of the Qolo payments platform, covering issuer authorization, settlement and funds movement, scheduled jobs, reports and file transfers, and client and internal portals. It is a senior individual-contributor position that serves as Incident Commander for major incidents, provides L2 escalation, sets technical direction for monitoring, automation and runbooks, and mentors team members. The role collaborates with Engineering, DevOps, Security, Product, Client Success, Onboarding, banks and vendors, and acts as liaison with Infrastructure & Support leadership. Production Support / SRE owns detection, monitoring, incident triage and incident command; Payments Operations owns day-to-day settlement and ACH subject-matter operations, while Sustaining and Feature Engineering handle code-level remediation. The Senior Systems Engineer works across these boundaries and drives requirements to reduce manual work. The position leads major incident response and root-cause analysis, maintains on-call practices, and improves monitoring, alerting, observability and service-level objectives. It oversees recovery of scheduled jobs and file flows, investigates payment incidents, supports settlement and funds-movement operations, and maintains the job and file inventory. The engineer builds and maintains SQL, PowerShell and Azure-based automation; defines operational requirements for Engineering and DevOps; and supports production releases, deployments, rollbacks and hotfixes. The role also handles escalated client and internal technical support, production configuration requests, access reviews and security investigations. It maintains production certificate inventories and renewal processes, supports security and compliance audits, and develops operational documentation such as runbooks, playbooks, SOPs and diagnostic query libraries. As team lead, the engineer sets priorities, coordinates coverage and handoffs, mentors team members, reports team health and risks, recommends technical direction, and may lead large or complex projects. Participation in a 24x7 on-call rotation is required.

Requirements

  • At least seven years of successful, extensive experience in systems engineering, production support, site reliability, infrastructure operations or a related technical field.
  • Demonstrated experience as an incident commander or technical escalation lead for production systems.
  • Expert-level Azure operations and monitoring skills, including Azure Monitor, Log Analytics, Application Insights and KQL.
  • Advanced SQL Server skills, including writing and reading diagnostic queries and working with stored procedures.
  • PowerShell scripting and automation skills.
  • Windows and Linux server administration experience, and Azure networking and security fundamentals.
  • Experience with job scheduling and file-transfer tools, such as VisualCron and SFTP, and incident and alerting platforms such as PagerDuty.
  • Strong working knowledge of Qolo solutions and services, including card issuing and authorization flows and money movement (ACH and settlement), or ability to develop that knowledge quickly.
  • Familiarity with SRE practices, including SLIs, SLOs, error budgets, blameless postmortems and progressive delivery.
  • Strong time-management, organizational and communication skills, with the ability to multitask in a fast-paced environment.
  • Ability to provide 24x7 monitoring and support through participation in an on-call rotation.
  • Bachelor’s degree or training from an accredited university, college or trade school in a related technology field, or equivalent professional and technical experience.
  • Must be authorized to work in the United States without visa sponsorship now or in the future.

Nice To Haves

  • Experience in payments, financial services or other regulated, high-availability environments.
  • Experience with Azure Automation and GitHub workflows.
  • Advanced certifications such as Microsoft Azure Administrator, Azure Security Engineer, ITIL or equivalent.
  • Advanced degree.

Responsibilities

  • Serve as Incident Commander for Sev 1 and major Sev 2 incidents, managing bridges, severity and priority, SLA clocks, stakeholders and incident communications.
  • Provide L2 and high-level escalation support for technical issues, including SQL and transaction diagnostics, approved manual interventions, and coordination with Engineering and external parties.
  • Lead blameless root-cause analyses, complete RCAs within the 48-hour target, and drive corrective actions into runbooks, alerts, automation or engineering work items.
  • Participate in and help design the 24x7 on-call rotation, PagerDuty routing, escalation policies and Engineering Areas of Responsibility escalation model.
  • Maintain on-call handoffs, escalation criteria and incident documentation.
  • Design, tune and maintain alerts for issuer flows, jobs, reports, file transfers and portals using Azure Monitor, Log Analytics, Application Insights and KQL.
  • Improve alert quality, reduce noise, measure actionable alerts, and retire or refine alerts that do not drive action.
  • Define and track SLIs, SLOs and error budgets for critical services and payment paths.
  • Conduct recurring monitoring audits, including quarterly Azure alert action group reviews, and monitor and report system performance and capacity needs.
  • Oversee scheduled jobs and file-flow operation and recovery, including diagnosing failures, identifying partial loads, backing out and reprocessing, and safely rerunning jobs.
  • Verify file creation, transmission, receipt and posting; investigate exceptions; and rerun, deduplicate, correct and re-deliver failed reports and malformed client files.
  • Maintain the Qolo File Management Tracker as the source of truth for job and file names, schedules, owners, dependencies and SLAs.
  • Support daily settlement and funds-movement operations for sponsor banks during the transition of ownership to Payments Operations, while retaining detection, triage and escalation of settlement failures.
  • Investigate payment incidents using targeted SQL queries and research in card network and payment portals.
  • Build and maintain SQL, PowerShell and Azure-based automation for jobs, audits, reruns, diagnostics and repeatable tasks.
  • Convert recurring manual work into documented, restartable and monitored automation, and specify operational requirements for Engineering and DevOps work.
  • Track team work by category, escalate when reactive work exceeds the target cap, and prioritize recurring pain points into an automation or tooling backlog with measurable effort reduction.
  • Install, configure, upgrade and enhance monitoring, operating system, database and utility software supporting production operations.
  • Prepare, test, evaluate and implement infrastructure and operations changes in accordance with Qolo change controls.
  • Support production releases by sending client and vendor notices, monitoring Application Insights and Azure Front Door, validating post-deployment health, and participating in rollback and hotfix steps.
  • Define minimum observability, post-deployment validation and rollback requirements, and ensure tested rollback or hotfix paths are linked from release records and service runbooks.
  • Move production traffic and adjust scaling during releases as directed by the release plan.
  • Resolve escalations from Client Services, Client Success and Onboarding by reproducing issues, retrieving logs, running SQL and data checks, documenting findings, and escalating to Product or Engineering as needed.
  • Execute program, BIN and other non-financial configuration requests under Qolo change controls and help define self-service requirements.
  • Administer and review production platform and tool access, and support security investigations with Security.
  • Maintain production certificate inventories, renewal calendars, alerts and runbooks in partnership with Security and Engineering.
  • Apply Azure security best practices to administered resources and support audits with evidence of controls, access reviews and incident records.
  • Follow access-control and least-privilege policies for on-call and production changes.
  • Develop and maintain runbooks, incident playbooks, SOPs, knowledge base articles, deployment procedures, client notification templates and diagnostic query libraries.
  • Ensure frequent alert types have linked runbooks covering initial checks, mitigation and escalation, and feed RCA findings back into runbooks and SOPs.
  • Document completed projects for subsequent engineers and stakeholders.
  • Set day-to-day team priorities, review work, coordinate coverage and handoffs, and maintain disciplined intake.
  • Mentor and train team members and L1 resources in alert triage, SQL and KQL diagnostics, runbook use and incident communications; promote cross-training.
  • Act as liaison between Production Support / SRE, stakeholder teams and Infrastructure & Support leadership; advise on work and report team health, workload and risks.
  • Research and introduce technology and best practices, and recommend technical direction for operations and reliability projects.
  • Lead large or complex assigned projects by defining plans, coordinating participants and ensuring accurate, timely delivery.
  • Expand personal education, technical skills and relevant certifications, and perform other duties as assigned.

Benefits

  • Competitive salary
  • Eligibility for incentive awards based on individual and business performance
  • Comprehensive range of benefits
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service