Software Development Engineer - US Federal

Workday•Reston, VA

2d•Hybrid

About The Position

This role will support one or more direct or indirect contracts with the U.S. Federal Government which, due to federal government security requirements, mandates that all Workday personnel working on the contracts be United States citizens (naturalized or native). Are you eager to use Workday's vast computing resources and extensive datasets? Do you want to collaborate with world-class engineers to build and evolve our Observability data platform? If so, we'd love to hear from you! The Data Platform and Observability team empowers real-time insights across Workday's platforms, infrastructure, and applications. Our mission is to develop and operate a large-scale distributed data platform that fuels critically important Workday applications. We provide software solutions for the collection, ingestion, storage, and visualization of critical data assets. We manage hundreds of terabytes of data, encompassing billions of messages generated daily by Workday applications and underlying services. If you're passionate about crafting efficient software or optimizing and scaling large distributed systems, you'll find a fulfilling home with us.

Requirements

Employees may be required to be on site at client locations in the DC, MD, and VA (DMV) area.
BS/MS in Computer Science or a related technical field.
Strong software engineering background with a proven track record of delivering high-quality products at scale.
Exceptional coding skills (Java, Python; Go is a plus) and the ability to design systems that meet business needs.
Solid understanding of high-performance data capture and collection systems, API design, and reliable data delivery.
Good understanding of Time-Series Databases and Log collection and management.
Good knowledge and understanding of Kubernetes.
4 + years of experience building high-performance data ingestion software, addressing concurrency, latency, and efficiency challenges.
Excellent interpersonal, technical, and communication skills.
Ability to prioritize multiple tasks in a fast-paced environment.
Fluency in Linux.
Experience with Infrastructure Automation (Ansible, Chef, Terraform).

Nice To Haves

Hands-on experience with the Prometheus Ecosystem, Elastic Search, Grafana and InfluxData stack.
Hands-on experience with PromQL and InfluxQL.
Hands-on experience with Kubernetes and Helm.
Preferred DoD 8570/8140 compliant with at least IAT Level Il certification, including a current Computing Environment (CE) credential and one approved specialty certification (e.g., CompTIA CySA+, GICSP, CASP+).

Responsibilities

Design, build, and enhance critical Observability services, including Monitoring, Logging, Alerting, and Tracing.
Develop data capture and collection services using pioneering technologies across diverse infrastructure environments (Kubernetes, OpenStack, Bare Metal, etc.).
Design and develop core software modules for real-time and batch data processing.
Construct Metrics ingestion pipelines, Alert definitions, and automation for Dashboard lifecycle management.
Build and deploy infrastructure components in production environments.
Champion all aspects of observability with a focus on data quality, integrity, and availability.
Evaluate and implement new open-source and cloud-native tools and technologies as needed.
Participate in the on-call rotation to support the observability platform.
Manage and optimize Workday within the air-gapped U.S. AWS cloud regions, forming the core of the team responsible for this mission.
Collaborate closely with our commercial software engineering teams responsible for the overall Workday platform.
Partner with the Workday Federal Cyber Defense team to ensure security operations, cybersecurity posture, governance, risk, compliance, and platform security health.