Platform Engineer (DataOps)

Black Canyon Consulting • Bethesda, MD

1d • $115,000 - $150,000

About The Position

Black Canyon Consulting (BCC) is hiring a Platform Engineer (DataOps) to support work for the National Center for Biotechnology Information (NCBI) at the National Library of Medicine (NLM), an institute of the National Institutes of Health. The role is full time and may be performed onsite at NCBI in Bethesda, Maryland and/or remotely.

The engineer will join NCBI’s new DataOps Platform team, which is developing an enterprise-wide DataOps platform. The initiative applies modern technologies, including Kubernetes, GitOps, and containerization, to data-intensive applications. The team develops and continuously improves the platform and shared tools and libraries, evaluates technologies and practices, supports NCBI developers adopting the platform, and provides automated solutions and compliance pipelines for federal application security requirements. The team embraces agile development and continuous improvement and encourages a growth mindset and leadership at any level.

BCC describes its benefits package as including medical, dental, and vision coverage, a 401(k) plan with employer contribution, paid holidays, vacation, flexible work schedule, and tuition reimbursement. Salary is commensurate with experience and location; the targeted range is $115,000–$150,000.

Requirements

• Strong coding skills in at least one programming language, such as Python or C++.
• Experience with Kubernetes and containerization.
• Experience with Google Cloud Platform (GCP), Amazon Web Services (AWS), Microsoft Azure, or equivalent cloud services.
• Experience with Apache Kafka, Google Cloud Pub/Sub, or an equivalent.
• Experience with Apache Airflow or an equivalent.
• Experience with data-processing applications and modern cloud-based data-processing infrastructure.
• Linux command-line skills.
• B.S. in a STEM field (Engineering, Computer Science, Mathematics, or Physics), or equivalent industry experience in Systems Engineering.

Nice To Haves

• Google Anthos.
• Docker.
• GitOps tools such as ArgoCD or equivalent.
• Infrastructure-as-code tools such as Terraform or equivalent.
• Products for Git source control, CI/CD pipelines, and artifact lifecycle management, such as GitLab, GitHub, Bitbucket, TeamCity, or Artifactory.
• Modern observability and logging tools such as Prometheus, EFK, TIGK, DataDog, Sensu, Jaeger, Sentry, OpsGenie, PagerDuty, Splunk, or equivalent.
• Secret-management tools such as HashiCorp Vault, CyberArk, Azure Key Vault, Google Cloud Secret Manager, or equivalent.
• Data-transfer tools such as AWS DataSync, Aspera, MinIO, CloudSoda, or equivalent.
• Apache Pulsar, RabbitMQ, Amazon Kinesis, Apache Flume, Apache Storm, Apache Spark Streaming, or Google Cloud Pub/Sub.
• Experience with best-practice design patterns in coding and architecture.
• Experience working in an agile environment.

Responsibilities

• Develop and continuously improve the DataOps platform.
• Develop and maintain common tools and libraries.
• Evaluate new technologies and practices.
• Help NCBI developers adopt the platform.
• Provide automated solutions and compliance pipelines to ensure compliance with federal application security regulations and standards.
• Embrace agile development and continuous improvement.
• Encourage a growth mindset and offer leadership opportunities at any level.

Benefits

• Medical coverage
• Dental coverage
• Vision coverage
• 401(k) plan with employer contribution
• Paid holidays
• Vacation
• Flexible work schedule
• Tuition reimbursement
• Competitive salary commensurate with experience and location; targeted range of $115,000–$150,000

What This Job Offers

• Job Type: Full-time