Senior Network Engineer

Black Mountain Dynamics•Mountain View, CA

6d•$125,000 - $140,000•Remote

About The Position

Black Mountain Dynamics is seeking a Senior Network Engineer to serve as the senior escalation point for its Service Delivery team and own complex technical issues across network, security, identity, endpoint, SaaS, monitoring, and client infrastructure environments. The role combines hands-on engineering with service leadership, including advanced troubleshooting, major incident response, project support, mentoring Tier 1 and Tier 2 engineers, improving documentation and standards, and providing technical guidance to clients and internal stakeholders. The engineer will lead complex network and security work, support infrastructure deployments and modernization, investigate security events, and improve operational visibility and reliability. They are expected to create repeatable processes, reduce recurring incidents, maintain strong technical documentation, and model calm, blameless, security-first problem solving. The position is remote for someone residing in the Pacific Time Zone, with client-site travel primarily in the San Francisco Bay Area and occasional travel elsewhere in the United States. Travel is approximately 10–20%, depending on projects and client requirements. Occasional evening or weekend work and participation in an on-call, NOC escalation, or PagerDuty rotation may be required. The role reports to the Service Delivery Manager. Black Mountain Dynamics describes opportunities to grow into broader technical leadership roles, including Senior Infrastructure Architect, Principal Engineer, Security Engineering Lead, or engineering or program leadership positions.

Requirements

At least 5 years of experience configuring, supporting, and troubleshooting enterprise or MSP/MSSP technical environments.
Bachelor's or Master's degree in Networking, Cybersecurity, Computer Science, or a related field.
Strong experience with network architecture, deployment, and troubleshooting across LAN, WAN, WLAN, VPN, firewalls, switching, routing, VLANs, NAT/PAT, and wireless.
Experience with networking and security platforms such as Palo Alto Networks, Juniper, Ruckus, Cisco, Aruba, Meraki, or similar.
Strong working knowledge of monitoring and alerting tools such as PRTG, Unimus, SIEM platforms, or related systems.
Experience with security tools and processes, including EDR, firewall logs, vulnerability management, incident response, and threat analysis.
Experience supporting cloud identity and SaaS platforms such as JumpCloud, Microsoft 365, Google Workspace, SSO/SAML, SCIM, and MDM.
Strong documentation habits using tools such as Hudu, ticketing platforms such as HaloPSA, and internal communication tools such as Slack.
Ability to lead complex troubleshooting efforts and communicate clearly with clients, vendors, peers, and leadership.
Experience mentoring junior engineers or acting as a senior escalation point.
Ability to participate in on-call, NOC escalation, after-hours maintenance, or incident response as needed.
Remote role requires residing in the Pacific Time Zone.
Ability to travel to client sites within the San Francisco Bay Area and occasionally to other U.S. locations; travel is approximately 10–20%, depending on project and client requirements.
Availability for occasional evening or weekend work for deployments, maintenance windows, incident response, or urgent escalations.

Nice To Haves

Certifications such as CCNP, CCIE, CISSP, Security+, Network+, Palo Alto Certifications, or equivalent practical experience.
Experience working in an MSP, MSSP, startup, or fast-moving client-service environment.
Experience with scripting or automation using Python, PowerShell, or related tools.
Familiarity with compliance or security frameworks such as NIST, ISO 27001, or similar.
Experience designing long-term network, infrastructure, or cybersecurity strategies.
Experience leading technical projects, client buildouts, wireless deployments, firewall migrations, identity integrations, or security improvement initiatives.
Experience creating technical diagrams, RCA reports, SOPs, escalation playbooks, and operational standards.

Responsibilities

Own the highest-complexity escalations across network, security, identity, endpoint, SaaS, monitoring, and infrastructure issues.
Lead troubleshooting for complex, recurring, architectural, or security-sensitive issues; establish root cause, client impact, resolution paths, and prevention opportunities.
Support Tier 2 engineers with deeper analysis, senior validation, architectural review, and risk assessment.
Provide escalation guidance and technical decisions under pressure, and ensure complex tickets include impact analysis, troubleshooting history, documentation, and clear next actions.
Design, implement, troubleshoot, and support LAN, WAN, WLAN, firewall, VPN, VLAN, NAT/PAT, and segmentation environments.
Configure, install, and maintain routers, switches, firewalls, wireless access points, and related network infrastructure.
Lead network deployments, client buildouts, site changes, and infrastructure modernization efforts.
Use monitoring platforms to identify patterns, bottlenecks, outages, false positives, and recurring issues.
Review firewall policies and logs, routing, wireless health, ISP issues, and client-impacting network events; provide senior review and sign-off for firewall changes, network changes, and higher-risk technical work.
Coordinate critical security incident response, including stabilization, communication, containment, remediation, documentation, and prevention follow-up.
Investigate security events using tools such as SentinelOne, firewall logs, SIEM and monitoring platforms, and ticket history; conduct threat analysis, vulnerability review, and root cause analysis.
Identify systemic risks and recommend preventive controls, process improvements, or architecture changes; ensure secure execution through least privilege, documented change plans, rollback paths, and stakeholder communication.
Provide senior support for JumpCloud, Microsoft 365, Google Workspace, MDM, SSO/SAML, SCIM, JIT provisioning, and related identity workflows.
Troubleshoot SAML assertion errors, certificate issues, attribute mapping, provisioning failures, and authentication problems.
Support Apple Business Manager/DEP, device enrollment, encryption enforcement, and endpoint management issues; validate and guide Tier 2 work involving identity integrations, policy changes, access control, and endpoint security.
Document repeatable identity and endpoint standards.
Serve as a senior escalation point for NOC issues, after-hours escalations, monitoring alerts, and PagerDuty events; distinguish routine alert or maintenance response from emergencies or urgent client work.
Correlate alerts across monitoring systems, firewalls, switches, endpoints, ISPs, and client impact; identify noisy alerts, monitoring gaps, false positives, and recurring operational problems.
Improve alert-handling procedures, escalation paths, and NOC documentation.
Create and maintain technical documentation in Hudu, including network diagrams, troubleshooting guides, escalation procedures, client environment details, and post-incident notes.
Produce RCA summaries, incident reports, technical recommendations, and standards documentation; build SOPs and playbooks that make complex issues easier for Tier 1 and Tier 2 engineers to resolve.
Drive continuous improvement across engineering processes, security practices, monitoring standards, documentation maturity, escalation quality, and infrastructure reliability.
Partner with the Service Delivery Manager and Technical Project Manager to ensure project handoffs into operations are clean and supportable.
Mentor Tier 1 and Tier 2 engineers on escalation review, troubleshooting, documentation, client communication, and repeatable technical standards; review escalation packets and coach on effective technical handoffs.
Confirm readiness or proficiency for Tier 2 engineers as they ramp up on tools and workflows, including HaloPSA, JumpCloud, PRTG, SentinelOne, Hudu, SSO, firewall troubleshooting, and NOC processes.
Model BMX core values and white-glove service in internal and client-facing work; communicate clearly during complex incidents and client-impacting changes.
Stabilize incidents first, then drive root cause, prevention, documentation, and standards improvement; make safe, security-first decisions and coach others on the reasoning behind solutions.
Take accountability for complex issue resolution, major incident follow-through, secure architecture and implementation quality, reduction of repeat incidents, clear documentation, mentorship, client communication, and operational maturity.
Identify service, security, and infrastructure improvement opportunities that create long-term client value.