Data Engineer

Black Canyon Consulting•Bethesda, MD

9d•Onsite

About The Position

Black Canyon Consulting (BCC) is hiring Data Engineer(s) to support work for the National Center for Biotechnology Information (NCBI) at the National Library of Medicine (NLM), part of the National Institutes of Health. The position is full time at NCBI in Bethesda, Maryland. The role works with scientists and software developers to design, develop, test, and maintain programs for NCBI biomedical data resources, including PubMed, GenBank, the Sequence Read Archive (SRA), and ClinicalTrials.gov. Tasks may include implementing efficient bioinformatic algorithms and helping develop cloud-ready tools and pipelines to improve the performance and scalability of searching and submitting genetic sequence data.

Requirements

Proficiency in Python.
Experience with MS SQL Server and relational database design and optimization.
Programming experience in a Linux environment and with shell scripts such as BASH.
Experience handling large amounts of data.
Ability to work with common structured documents, including at least one of XML or JSON.
Experience with CI/CD pipelines, unit tests, integration testing, and regression testing.

Nice To Haves

Experience with cloud technologies, including AWS EC2, S3, and Lambda, or GCP GKE, Google Store, and Cloud Functions.
Five or more years of working with genetic and biological data.
Familiarity with NGS computational tools and formats such as BWA, GATK, and Galaxy.
Demonstrated active involvement in open source communities such as GitHub.
Experience managing production workflow of an online public database.
Experience with RESTful API design.

Responsibilities

Design, develop, test, and maintain programs for NCBI biomedical data resources.
Implement efficient bioinformatic algorithms.
Facilitate development of cloud-ready tools and pipelines to improve the performance and scalability of searching and submitting genetic sequence data.