Data Engineer

Altamira Technologies Corp.•Washington, DC

3d•$150,000•Hybrid

About The Position

As a Data Engineer in this role, you will collaborate closely with various combatant commands, offering technical guidance for navigating the WDP environment. Your responsibilities will include troubleshooting access control issues and resolving challenges related to missing Python libraries, ensuring seamless operations for all stakeholders. You will develop and maintain Databricks notebooks and workflows, supporting the auditing of engineering practices across the Embedded Support Division (ESD). Leveraging your expertise, you will utilize APIs from platforms such as Databricks, GitLab, and Confluence to collect and analyze project activity data throughout the entire lifecycle, from initial development through deployment and ongoing usage. You will play a key role in assisting ESD leadership with the research evaluation, and implementation of new features and tools designed to enhance the technical environment. Current initiatives involve integrating JIRA and GitLab to improve visibility into project activities and exploring the deployment of GitLab on SIPR WDP to bolster engineering capabilities at higher classification levels. Managing the Central team’s GitLab repository will be a core responsibility, where you will establish standards for merge requests and code reviews. Additionally, you will be instrumental in setting up and maintaining integrations between GitLab and Databricks, enabling a foundational CI pipeline that streamlines development processes within the team.

Requirements

Experience with GitLab for repository management, merge requests, and code reviews
Proficiency in Databricks, developing and maintaining notebooks and workflows
Strong understanding of DevSecOps practices
Familiarity with Jira and Confluence for project management and documentation
API development and integration skills (Databricks, GitLab, Confluence, etc.)
Advanced Python programming skills
Ability to troubleshoot access controls and resolve issues with Python libraries
Experience collaborating with cross-functional technical teams
SECRET security clearance with ability to acquire TS/SCI

Responsibilities

Collaborate with various combatant commands, offering technical guidance for navigating the WDP environment.
Troubleshoot access control issues and resolve challenges related to missing Python libraries.
Develop and maintain Databricks notebooks and workflows.
Support the auditing of engineering practices across the Embedded Support Division (ESD).
Utilize APIs from platforms such as Databricks, GitLab, and Confluence to collect and analyze project activity data.
Assist ESD leadership with the research, evaluation, and implementation of new features and tools.
Integrate JIRA and GitLab to improve visibility into project activities.
Explore the deployment of GitLab on SIPR WDP.
Manage the Central team’s GitLab repository, establishing standards for merge requests and code reviews.
Set up and maintain integrations between GitLab and Databricks, enabling a foundational CI pipeline.