Software Development Engineer (US Federal)

Workday • Atlanta, GA

1d • $123,900 - $222,000 • Hybrid

About The Position

The Software Development Engineer will support one or more direct or indirect contracts with the U.S. Federal Government. Federal security requirements mandate that personnel working on these contracts be United States citizens, naturalized or native. The role is part of the team operating and improving Workday Government’s observability platform, which supports highly scalable distributed systems and services for metrics, logging, tracing, and alerting.

The position involves deploying services to production on AWS EKS, operating observability services that handle very large data volumes, supporting cybersecurity and platform security practices, and helping internal customers resolve service issues. The engineer will participate in an on-call rotation, write technical documentation, build test environments and automation for CI/CD, and create or improve observability signals and dashboards. The role may include responsibility for services in an air-gapped region and may require regular work from a SCIF.

The team develops and operates a large-scale distributed data platform supporting Workday applications. It provides software for collecting, ingesting, storing, and visualizing critical data, and manages hundreds of terabytes and billions of messages generated daily.

Requirements

• United States citizenship, naturalized or native, due to federal government security requirements.
• Bachelor of Science in Computer Science or a related technical field.
• At least 5 years of experience building and deploying highly scalable software.
• Experience deploying software to public cloud platforms such as AWS, Azure, or GCP.
• Scripting skills in any programming language.
• Understanding of system design, particularly distributed systems.
• Good knowledge and understanding of Kubernetes.
• Experience with Linux-based system administration.

Nice To Haves

• Demonstrable experience with Prometheus and Grafana Mimir.
• Demonstrable experience with Fluent Bit, Kafka, and Elasticsearch.
• Strong DevOps knowledge and hands-on experience with infrastructure-as-code and CI/CD tools.

Responsibilities

• Use Terraform and Argo CD to deploy services to AWS EKS in production environments.
• Ensure the reliable operation of metrics, logging, tracing, and alerting services handling large volumes of data.
• Collaborate with the cyber defense team on security operations, cybersecurity posture, governance, risk, compliance, and platform security health.
• Participate in the on-call rotation supporting the observability platform.
• Resolve internal customers’ issues with the services.
• Write technical documentation, including ADRs, RCAs, and runbooks.
• Collaborate with managers and engineers at the parent company to promote healthy engineering practices across government and non-government environments.
• Build test environments, tooling, and automation to implement CI/CD best practices.
• Create metrics, logs, alerts, and dashboards to address gaps in observability of the system and the services using it.
• Potentially support observability services deployed to an air-gapped region and regularly work from a SCIF.

Benefits

• May be eligible for the Workday Bonus Plan or a role-specific commission or bonus.
• May be eligible for annual refresh stock grants.
• Flexible work arrangements, with at least half of each quarter spent in the office or in the field for applicable roles.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior