Lead Technology Resiliency Engineer

City National Bank of Florida•Coral Gables, FL

About The Position

The Lead Technology Resiliency Engineer is an IT-based technical individual contributor who engineers and validates the availability, recoverability, and resilience of technology supporting critical banking services. The role translates approved business recovery time objectives (RTOs), recovery point objectives (RPOs), and service requirements into technical recovery designs, dependency sequencing, data protection, automated procedures, and measurable test outcomes. It leads assigned engineering improvements with IT owners while partnering with Operational Resilience and Business Continuity on business priorities and validation. The role maps critical services and technology dependencies, translates recovery objectives into component-level technical requirements, analyzes failure modes and recovery gaps, and designs assigned resilience improvements. It also defines monitoring and observability requirements, assesses new or materially changed technology, and leads technical planning and coordination for disaster recovery, backup restoration, failover/failback, and integrated recovery testing. The engineer documents outcomes and variances, coordinates corrective actions with accountable owners, maintains technical standards and metrics, and contributes technical analysis to operational resilience exercises, audit requests, and regulatory requests. The role does not independently approve or revise business recovery objectives or disruption tolerances.

Requirements

At least 7 years of progressive hands-on infrastructure, cloud, application-platform, database, SRE, or disaster recovery engineering experience, including recovery design, implementation, and testing.
Experience with critical-service mapping, application and infrastructure dependency analysis, failure-mode analysis, recovery architecture, and disaster recovery testing.
Working knowledge of application architecture, networks, databases, storage, identity, cloud platforms, enterprise integrations, and third-party technology services.
Hands-on experience with backup and restoration, replication, high availability, failover/failback, and scripting or automation for recovery procedures.
Experience measuring recovery performance, diagnosing impediments to RTO/RPO targets, and defining observability and service-health indicators.
Knowledge of banking technology risk, disaster recovery, cybersecurity, third-party risk, business continuity, and operational resilience expectations.
Strong analysis, documentation, facilitation, and communication skills, including the ability to explain recovery constraints to business and executive audiences.
Availability for major disruptions and time-sensitive projects, including extended hours when needed and deployment to authorized Bank recovery sites or other designated locations.
Bachelor’s degree in information technology, engineering, computer science, or a related technical field, or equivalent relevant technical experience. An equivalent combination of education and/or relevant professional experience may be considered in lieu of a degree.

Nice To Haves

Familiarity with ServiceNow CMDB/CSDM, architecture repositories, observability platforms, and dependency-discovery or service-mapping tools.

Responsibilities

Identify and maintain technology dependencies for critical services, including applications, infrastructure, data stores, integrations, identity services, networks, cloud platforms, hosting facilities, communications, support personnel, and third-party technology dependencies.
Develop and validate business-to-technology dependency maps, upstream and downstream relationships, data flows, authentication and connectivity paths, recovery prerequisites, and sequencing.
Define resiliency data and relationship requirements for the ServiceNow CMDB/CSDM and work with platform and data owners to validate accuracy and lifecycle maintenance.
Translate approved RTOs and RPOs into component-level requirements, recovery time budgets, data protection requirements, and end-to-end sequencing.
Validate backup restoration, replication, database consistency, connectivity, and authentication; measure achieved recovery times and recoverable data points during tests.
Document vendor commitments, integration constraints, escalation paths, and cloud or managed-service shared responsibilities, and provide relevant findings to Operational Resilience and Third-Party Risk.
Escalate recovery feasibility and capability gaps for prioritization and authorized risk disposition; do not independently approve or revise business recovery objectives or disruption tolerances.
Assess service architecture for single points of failure, hidden dependencies, capacity constraints, and recovery gaps, including through failure-mode and impact analysis.
Design and implement assigned redundancy, fault-tolerance, recovery automation, failover/failback, and graceful-degradation improvements with platform and application owners.
Develop and technically validate runbooks, scripts, restoration prerequisites, orchestration procedures, recovery-environment capacity, and configuration consistency.
Validate recovery approaches for outages, data corruption, and cyber-related disruption with Cybersecurity and IT teams, and recommend technical recovery triggers and actions under established incident procedures.
Define telemetry, health and synthetic checks, capacity measures, service thresholds, alerts, and escalation triggers for critical technology dependencies.
Identify observability coverage gaps and work with engineering and operations teams to implement and validate observability; accountable operations teams retain day-to-day monitoring.
Assess new or materially changed applications, cloud services, platforms, and integrations for availability, recoverability, supportability, and approved recovery objectives.
Lead technical planning, execution coordination, and evidence gathering for disaster recovery, backup restoration, failover/failback, and integrated recovery tests; validate sequencing, achieved RTO/RPO, data integrity, and service functionality.
Coordinate business validation with Operational Resilience/Business Continuity and business owners; document technical defects, coordinate corrective-action assignment through established IT processes, and validate remediation through retesting.
Maintain technical resiliency standards, recovery patterns, procedures, and metrics; report posture, dependency risk, gaps, remediation, and investment priorities; and support audit or regulatory requests.
Connect critical business services and priorities to technology dependencies, shared infrastructure, and third-party arrangements, and contribute technical scenarios, constraints, and results to exercises.
Identify where component recovery fails to restore the complete business service and coordinate corrective action with technology and business owners.
Be available for major disruptions and time-sensitive projects, including extended hours when needed, and deploy to authorized Bank recovery sites or other designated locations.