Production Operations / Sustainment Engineer

BDR Solutions•Herdon, VA

36d•Onsite

About The Position

BDR Solutions is seeking Production Operations / O&M Engineers to sustain 24x7 EAG production operations at ~1 billion API transactions/month and deliver ongoing API onboarding lifecycle under EAGMO. Strict SLAs apply: 99.5% availability, P1 response within 15 minutes of detection, service restoration within 4 hours. This role also executes centralized API onboarding (~35 APIs/month) during non-incident periods until automated self-service is approved for production.

Requirements

5+ years in 24x7 production support for high-volume enterprise API gateway or middleware platforms (1B+ transaction/month scale strongly preferred)
IBM webMethods API Gateway or comparable enterprise API management platform in a production operations context
Demonstrated ability to meet aggressive SLAs: sub-15-minute P1 response and 99.5%+ availability targets
ServiceNow incident, change, and request management; structured escalation and root cause analysis processes
AppDynamics and ELK stack monitoring: dashboard management, anomaly analysis, API performance metrics
API lifecycle operations: onboarding, configuration updates, policy management, versioning, retirement
Active IRS Minimum Background Investigation (MBI) required

Nice To Haves

Direct IRS D&PE, DISM, or EAG-adjacent production operations experience — highest priority
Active MBI from IRS D&PE program
ITIL Foundation or service management certification
IBM webMethods administration and monitoring certification
API gateway backup/restore and DR exercise experience

Responsibilities

Provide 24x7x365 monitoring of the EAG IBM webMethods platform; respond to P1 incidents within 15 minutes of detection or notification, initiate remediation within 30 minutes, restore service within 4 hours
Maintain EAG system availability at 99.5% or higher (excluding approved maintenance windows)
Log 100% of incidents and service requests in IRS-approved ServiceNow; produce P1 root cause analyses within 5 business days
Monitor API performance metrics via AppDynamics dashboards (latency, throughput, error rates, availability); maintain dashboards accessible to IRS stakeholders
Execute API onboarding and lifecycle delivery (TA1): onboard new APIs, update configurations/policies/routes/documentation, execute deployments through IRS CI/CD pipelines — ~35 APIs/month
Perform API connectivity, regression, security, observability, and performance testing to validate functionality prior to each deployment
Support migration-lane API readiness activities for movement from IBM webMethods to the new gateway platform
Maintain backup/restore procedures; conduct quarterly backup restoration testing; support IRS DR exercises
Produce Monthly O&M Performance Reports, Quarterly Trend Analysis Reports, and Incident Root Cause Analyses per the Deliverables schedule